2023-07-05T23:20:17.842 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-05T23:20:17.843 DEBUG:teuthology.run:Teuthology command: teuthology --name rishabh-2023-07-05_18:32:52-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi --owner scheduled_rishabh@teuthology --verbose --archive /home/teuthworker/archive/rishabh-2023-07-05_18:32:52-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7327586 --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/workunit/quota} -- /home/teuthworker/archive/rishabh-2023-07-05_18:32:52-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7327586/orig.config.yaml 2023-07-05T23:20:17.892 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-05T23:20:17.994 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-07-05_18:32:52-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7327586 branch: wip-rishabh-CephManager-in-CephFSTestCase description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/workunit/quota} email: null first_in_suite: false job_id: '7327586' kernel: client: sha1: distro flavor: default kdb: true sha1: 84139c18d56f518615369e8310ae4ecf07a36dcd ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-07-05_18:32:52-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-rishabh-CephManager-in-CephFSTestCase ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 0a781ef0807ae9473fb1306ef07036226ca4f1a6 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 0a781ef0807ae9473fb1306ef07036226ca4f1a6 kclient: syntax: v2 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-CephManager-in-CephFSTestCase sha1: 0a781ef0807ae9473fb1306ef07036226ca4f1a6 owner: scheduled_rishabh@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 sha1: 0a781ef0807ae9473fb1306ef07036226ca4f1a6 sleep_before_teardown: 0 suite: fs suite_branch: wip-rishabh-CephManager-in-CephFSTestCase suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_0a781ef0807ae9473fb1306ef07036226ca4f1a6/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 0a781ef0807ae9473fb1306ef07036226ca4f1a6 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi027.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= smithi162.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - kclient: null - workunit: clients: all: - fs/quota teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: b53f236c1077f1d295baafb9e0ca9a4b447019d7 timestamp: 2023-07-05_18:32:52 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23459 2023-07-05T23:20:17.994 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_0a781ef0807ae9473fb1306ef07036226ca4f1a6/qa; will attempt to use it 2023-07-05T23:20:17.995 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_0a781ef0807ae9473fb1306ef07036226ca4f1a6/qa/tasks 2023-07-05T23:20:17.995 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-07-05T23:20:17.997 INFO:teuthology.task.internal:Checking packages... 2023-07-05T23:20:18.027 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '0a781ef0807ae9473fb1306ef07036226ca4f1a6' 2023-07-05T23:20:18.027 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-07-05T23:20:18.028 INFO:teuthology.packaging:ref: None 2023-07-05T23:20:18.028 INFO:teuthology.packaging:tag: None 2023-07-05T23:20:18.028 INFO:teuthology.packaging:branch: wip-rishabh-CephManager-in-CephFSTestCase 2023-07-05T23:20:18.028 INFO:teuthology.packaging:sha1: 0a781ef0807ae9473fb1306ef07036226ca4f1a6 2023-07-05T23:20:18.029 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-rishabh-CephManager-in-CephFSTestCase 2023-07-05T23:20:18.180 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-4488.g0a781ef0 2023-07-05T23:20:18.181 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-07-05T23:20:18.188 INFO:teuthology.task.internal:no buildpackages task found 2023-07-05T23:20:18.188 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-07-05T23:20:18.231 INFO:teuthology.task.internal:Saving configuration 2023-07-05T23:20:18.250 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-07-05T23:20:18.266 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-05T23:20:18.297 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi027.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-05_18:32:52-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7327586', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-05 23:14:23.800244', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-07-05T23:20:18.324 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi162.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-05_18:32:52-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7327586', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-05 23:14:23.801747', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-07-05T23:20:18.324 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-07-05T23:20:18.332 INFO:teuthology.task.internal:roles: ubuntu@smithi027.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-07-05T23:20:18.332 INFO:teuthology.task.internal:roles: ubuntu@smithi162.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-07-05T23:20:18.332 INFO:teuthology.run_tasks:Running task console_log... 2023-07-05T23:20:18.447 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2e492d8280>, signals=[15]) 2023-07-05T23:20:18.448 INFO:teuthology.run_tasks:Running task internal.connect... 2023-07-05T23:20:18.455 INFO:teuthology.task.internal:Opening connections... 2023-07-05T23:20:18.456 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi027.front.sepia.ceph.com 2023-07-05T23:20:18.458 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:20:18.529 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi162.front.sepia.ceph.com 2023-07-05T23:20:18.530 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:20:18.597 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-07-05T23:20:18.606 DEBUG:teuthology.orchestra.run.smithi027:> uname -m 2023-07-05T23:20:18.628 INFO:teuthology.orchestra.run.smithi027.stdout:x86_64 2023-07-05T23:20:18.629 DEBUG:teuthology.orchestra.run.smithi027:> cat /etc/os-release 2023-07-05T23:20:18.689 INFO:teuthology.orchestra.run.smithi027.stdout:NAME="Red Hat Enterprise Linux" 2023-07-05T23:20:18.690 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION="8.6 (Ootpa)" 2023-07-05T23:20:18.690 INFO:teuthology.orchestra.run.smithi027.stdout:ID="rhel" 2023-07-05T23:20:18.690 INFO:teuthology.orchestra.run.smithi027.stdout:ID_LIKE="fedora" 2023-07-05T23:20:18.690 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_ID="8.6" 2023-07-05T23:20:18.690 INFO:teuthology.orchestra.run.smithi027.stdout:PLATFORM_ID="platform:el8" 2023-07-05T23:20:18.690 INFO:teuthology.orchestra.run.smithi027.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-05T23:20:18.691 INFO:teuthology.orchestra.run.smithi027.stdout:ANSI_COLOR="0;31" 2023-07-05T23:20:18.691 INFO:teuthology.orchestra.run.smithi027.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-05T23:20:18.691 INFO:teuthology.orchestra.run.smithi027.stdout:HOME_URL="https://www.redhat.com/" 2023-07-05T23:20:18.691 INFO:teuthology.orchestra.run.smithi027.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-05T23:20:18.691 INFO:teuthology.orchestra.run.smithi027.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-05T23:20:18.691 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:20:18.691 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-05T23:20:18.692 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-05T23:20:18.692 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-05T23:20:18.692 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-05T23:20:18.692 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server 2023-07-05T23:20:18.716 DEBUG:teuthology.orchestra.run.smithi162:> uname -m 2023-07-05T23:20:18.737 INFO:teuthology.orchestra.run.smithi162.stdout:x86_64 2023-07-05T23:20:18.737 DEBUG:teuthology.orchestra.run.smithi162:> cat /etc/os-release 2023-07-05T23:20:18.797 INFO:teuthology.orchestra.run.smithi162.stdout:NAME="Red Hat Enterprise Linux" 2023-07-05T23:20:18.798 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION="8.6 (Ootpa)" 2023-07-05T23:20:18.798 INFO:teuthology.orchestra.run.smithi162.stdout:ID="rhel" 2023-07-05T23:20:18.798 INFO:teuthology.orchestra.run.smithi162.stdout:ID_LIKE="fedora" 2023-07-05T23:20:18.798 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_ID="8.6" 2023-07-05T23:20:18.799 INFO:teuthology.orchestra.run.smithi162.stdout:PLATFORM_ID="platform:el8" 2023-07-05T23:20:18.799 INFO:teuthology.orchestra.run.smithi162.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-05T23:20:18.799 INFO:teuthology.orchestra.run.smithi162.stdout:ANSI_COLOR="0;31" 2023-07-05T23:20:18.799 INFO:teuthology.orchestra.run.smithi162.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-05T23:20:18.799 INFO:teuthology.orchestra.run.smithi162.stdout:HOME_URL="https://www.redhat.com/" 2023-07-05T23:20:18.799 INFO:teuthology.orchestra.run.smithi162.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-05T23:20:18.800 INFO:teuthology.orchestra.run.smithi162.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-05T23:20:18.800 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-07-05T23:20:18.800 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-05T23:20:18.800 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-05T23:20:18.800 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-05T23:20:18.800 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-05T23:20:18.801 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server 2023-07-05T23:20:18.825 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-07-05T23:20:18.841 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-07-05T23:20:18.873 INFO:teuthology.task.internal:Checking for old test directory... 2023-07-05T23:20:18.873 DEBUG:teuthology.orchestra.run.smithi027:> test '!' -e /home/ubuntu/cephtest 2023-07-05T23:20:18.876 DEBUG:teuthology.orchestra.run.smithi162:> test '!' -e /home/ubuntu/cephtest 2023-07-05T23:20:18.895 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-07-05T23:20:18.907 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-07-05T23:20:18.908 DEBUG:teuthology.orchestra.run.smithi027:> test -z $(ls -A /var/lib/ceph) 2023-07-05T23:20:18.937 DEBUG:teuthology.orchestra.run.smithi162:> test -z $(ls -A /var/lib/ceph) 2023-07-05T23:20:18.968 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-07-05T23:20:19.032 INFO:teuthology.run_tasks:Running task kernel... 2023-07-05T23:20:19.048 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '84139c18d56f518615369e8310ae4ecf07a36dcd'} 2023-07-05T23:20:19.049 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2023-07-05T23:20:19.049 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2023-07-05T23:20:19.050 DEBUG:teuthology.orchestra.run.smithi027:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-05T23:20:19.050 DEBUG:teuthology.orchestra.run.smithi162:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-05T23:20:19.068 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-05T23:20:19.068 DEBUG:teuthology.orchestra.run.smithi162:> uname -r 2023-07-05T23:20:19.069 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-05T23:20:19.070 DEBUG:teuthology.orchestra.run.smithi027:> uname -r 2023-07-05T23:20:19.126 INFO:teuthology.orchestra.run.smithi162.stdout:4.18.0-372.9.1.el8.x86_64 2023-07-05T23:20:19.127 INFO:teuthology.task.kernel:Running kernel on smithi162: 4.18.0-372.9.1.el8.x86_64 2023-07-05T23:20:19.127 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum install -y kernel 2023-07-05T23:20:19.130 INFO:teuthology.orchestra.run.smithi027.stdout:4.18.0-372.9.1.el8.x86_64 2023-07-05T23:20:19.130 INFO:teuthology.task.kernel:Running kernel on smithi027: 4.18.0-372.9.1.el8.x86_64 2023-07-05T23:20:19.130 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum install -y kernel 2023-07-05T23:20:20.277 INFO:teuthology.orchestra.run.smithi027.stdout:Updating Subscription Management repositories. 2023-07-05T23:20:20.277 INFO:teuthology.orchestra.run.smithi027.stdout:Unable to read consumer identity 2023-07-05T23:20:20.338 INFO:teuthology.orchestra.run.smithi162.stdout:Updating Subscription Management repositories. 2023-07-05T23:20:20.338 INFO:teuthology.orchestra.run.smithi162.stdout:Unable to read consumer identity 2023-07-05T23:20:23.916 INFO:teuthology.orchestra.run.smithi027.stdout:Copr repo for python3-asyncssh owned by ceph 1.5 kB/s | 3.5 kB 00:02 2023-07-05T23:20:24.250 INFO:teuthology.orchestra.run.smithi162.stdout:Copr repo for python3-asyncssh owned by ceph 1.3 kB/s | 3.5 kB 00:02 2023-07-05T23:20:26.283 INFO:teuthology.orchestra.run.smithi027.stdout:Extra Packages for Enterprise Linux 6.7 MB/s | 16 MB 00:02 2023-07-05T23:20:26.559 INFO:teuthology.orchestra.run.smithi162.stdout:Extra Packages for Enterprise Linux 6.8 MB/s | 16 MB 00:02 2023-07-05T23:20:29.950 INFO:teuthology.orchestra.run.smithi027.stdout:lab-extras 461 kB/s | 24 kB 00:00 2023-07-05T23:20:29.976 INFO:teuthology.orchestra.run.smithi162.stdout:lab-extras 408 kB/s | 24 kB 00:00 2023-07-05T23:20:30.694 INFO:teuthology.orchestra.run.smithi027.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-07-05T23:20:30.695 INFO:teuthology.orchestra.run.smithi162.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-07-05T23:20:30.747 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. 2023-07-05T23:20:30.748 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2023-07-05T23:20:30.748 INFO:teuthology.orchestra.run.smithi027.stdout:Nothing to do. 2023-07-05T23:20:30.749 INFO:teuthology.orchestra.run.smithi027.stdout:Complete! 2023-07-05T23:20:30.749 INFO:teuthology.orchestra.run.smithi162.stdout:Nothing to do. 2023-07-05T23:20:30.749 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2023-07-05T23:20:30.874 DEBUG:teuthology.orchestra.run.smithi162:> echo no | sudo yum reinstall kernel || true 2023-07-05T23:20:30.879 DEBUG:teuthology.orchestra.run.smithi027:> echo no | sudo yum reinstall kernel || true 2023-07-05T23:20:31.205 INFO:teuthology.orchestra.run.smithi162.stdout:Updating Subscription Management repositories. 2023-07-05T23:20:31.205 INFO:teuthology.orchestra.run.smithi162.stdout:Unable to read consumer identity 2023-07-05T23:20:31.229 INFO:teuthology.orchestra.run.smithi027.stdout:Updating Subscription Management repositories. 2023-07-05T23:20:31.230 INFO:teuthology.orchestra.run.smithi027.stdout:Unable to read consumer identity 2023-07-05T23:20:31.461 INFO:teuthology.orchestra.run.smithi162.stdout:Last metadata expiration check: 0:00:02 ago on Wed 05 Jul 2023 11:20:29 PM UTC. 2023-07-05T23:20:31.498 INFO:teuthology.orchestra.run.smithi027.stdout:Last metadata expiration check: 0:00:02 ago on Wed 05 Jul 2023 11:20:29 PM UTC. 2023-07-05T23:20:31.513 INFO:teuthology.orchestra.run.smithi162.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-07-05T23:20:31.543 INFO:teuthology.orchestra.run.smithi027.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-07-05T23:20:31.546 INFO:teuthology.orchestra.run.smithi162.stderr:Error: No packages marked for reinstall. 2023-07-05T23:20:31.571 INFO:teuthology.orchestra.run.smithi027.stderr:Error: No packages marked for reinstall. 2023-07-05T23:20:31.593 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum reinstall -y kernel || true 2023-07-05T23:20:31.619 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum reinstall -y kernel || true 2023-07-05T23:20:31.922 INFO:teuthology.orchestra.run.smithi162.stdout:Updating Subscription Management repositories. 2023-07-05T23:20:31.923 INFO:teuthology.orchestra.run.smithi162.stdout:Unable to read consumer identity 2023-07-05T23:20:31.969 INFO:teuthology.orchestra.run.smithi027.stdout:Updating Subscription Management repositories. 2023-07-05T23:20:31.970 INFO:teuthology.orchestra.run.smithi027.stdout:Unable to read consumer identity 2023-07-05T23:20:32.174 INFO:teuthology.orchestra.run.smithi162.stdout:Last metadata expiration check: 0:00:03 ago on Wed 05 Jul 2023 11:20:29 PM UTC. 2023-07-05T23:20:32.215 INFO:teuthology.orchestra.run.smithi162.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-07-05T23:20:32.233 INFO:teuthology.orchestra.run.smithi027.stdout:Last metadata expiration check: 0:00:03 ago on Wed 05 Jul 2023 11:20:29 PM UTC. 2023-07-05T23:20:32.245 INFO:teuthology.orchestra.run.smithi162.stderr:Error: No packages marked for reinstall. 2023-07-05T23:20:32.277 INFO:teuthology.orchestra.run.smithi027.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-07-05T23:20:32.297 INFO:teuthology.orchestra.run.smithi027.stderr:Error: No packages marked for reinstall. 2023-07-05T23:20:32.298 DEBUG:teuthology.orchestra.run.smithi162:> rpm -q kernel | sort -rV | head -n 1 2023-07-05T23:20:32.342 DEBUG:teuthology.orchestra.run.smithi027:> rpm -q kernel | sort -rV | head -n 1 2023-07-05T23:20:32.379 INFO:teuthology.orchestra.run.smithi162.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-07-05T23:20:32.380 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-07-05T23:20:32.380 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-07-05T23:20:32.380 DEBUG:teuthology.parallel:result is None 2023-07-05T23:20:32.425 INFO:teuthology.orchestra.run.smithi027.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-07-05T23:20:32.425 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-07-05T23:20:32.425 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-07-05T23:20:32.425 DEBUG:teuthology.parallel:result is None 2023-07-05T23:20:32.426 INFO:teuthology.run_tasks:Running task internal.base... 2023-07-05T23:20:32.437 INFO:teuthology.task.internal:Creating test directory... 2023-07-05T23:20:32.437 DEBUG:teuthology.orchestra.run.smithi027:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-05T23:20:32.440 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-05T23:20:32.457 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-07-05T23:20:32.488 INFO:teuthology.run_tasks:Running task internal.archive... 2023-07-05T23:20:32.522 INFO:teuthology.task.internal:Creating archive directory... 2023-07-05T23:20:32.522 DEBUG:teuthology.orchestra.run.smithi027:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-05T23:20:32.526 DEBUG:teuthology.orchestra.run.smithi162:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-05T23:20:32.550 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-07-05T23:20:32.561 INFO:teuthology.task.internal:Enabling coredump saving... 2023-07-05T23:20:32.562 DEBUG:teuthology.orchestra.run.smithi027:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-05T23:20:32.583 DEBUG:teuthology.orchestra.run.smithi162:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-05T23:20:32.622 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-05T23:20:32.626 INFO:teuthology.orchestra.run.smithi027.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-05T23:20:32.643 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-05T23:20:32.644 INFO:teuthology.orchestra.run.smithi027.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-05T23:20:32.646 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-07-05T23:20:32.654 INFO:teuthology.task.internal:Configuring sudo... 2023-07-05T23:20:32.654 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-05T23:20:32.656 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-05T23:20:32.712 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-07-05T23:20:32.721 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-07-05T23:20:32.721 DEBUG:teuthology.orchestra.run.smithi027:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-05T23:20:32.724 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-05T23:20:32.769 DEBUG:teuthology.orchestra.run.smithi027:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-05T23:20:32.822 DEBUG:teuthology.orchestra.run.smithi027:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-05T23:20:32.879 DEBUG:teuthology.orchestra.run.smithi027:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-05T23:20:32.967 DEBUG:teuthology.orchestra.run.smithi027:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-05T23:20:33.006 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-07-05T23:20:33.007 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-05T23:20:33.074 DEBUG:teuthology.orchestra.run.smithi162:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-05T23:20:33.119 DEBUG:teuthology.orchestra.run.smithi162:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-05T23:20:33.168 DEBUG:teuthology.orchestra.run.smithi162:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-05T23:20:33.257 DEBUG:teuthology.orchestra.run.smithi162:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-05T23:20:33.293 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-07-05T23:20:33.293 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-05T23:20:33.359 DEBUG:teuthology.orchestra.run.smithi027:> sudo service rsyslog restart 2023-07-05T23:20:33.362 DEBUG:teuthology.orchestra.run.smithi162:> sudo service rsyslog restart 2023-07-05T23:20:33.419 INFO:teuthology.orchestra.run.smithi027.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-05T23:20:33.454 INFO:teuthology.orchestra.run.smithi162.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-05T23:20:33.769 INFO:teuthology.run_tasks:Running task internal.timer... 2023-07-05T23:20:33.779 INFO:teuthology.task.internal:Starting timer... 2023-07-05T23:20:33.779 INFO:teuthology.run_tasks:Running task pcp... 2023-07-05T23:20:33.834 INFO:teuthology.run_tasks:Running task selinux... 2023-07-05T23:20:33.883 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']} 2023-07-05T23:20:33.883 DEBUG:teuthology.orchestra.run.smithi027:> sudo service auditd rotate 2023-07-05T23:20:33.961 INFO:teuthology.orchestra.run.smithi027.stdout:Rotating logs: 2023-07-05T23:20:33.962 DEBUG:teuthology.orchestra.run.smithi162:> sudo service auditd rotate 2023-07-05T23:20:34.025 INFO:teuthology.orchestra.run.smithi162.stdout:Rotating logs: 2023-07-05T23:20:34.027 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-07-05T23:20:34.027 DEBUG:teuthology.orchestra.run.smithi027:> /usr/sbin/getenforce 2023-07-05T23:20:34.048 INFO:teuthology.orchestra.run.smithi027.stdout:Permissive 2023-07-05T23:20:34.048 DEBUG:teuthology.orchestra.run.smithi162:> /usr/sbin/getenforce 2023-07-05T23:20:34.072 INFO:teuthology.orchestra.run.smithi162.stdout:Permissive 2023-07-05T23:20:34.073 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi027.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi162.front.sepia.ceph.com': 'permissive'} 2023-07-05T23:20:34.073 DEBUG:teuthology.orchestra.run.smithi027:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-05T23:20:34.117 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-05T23:20:34.118 DEBUG:teuthology.orchestra.run.smithi162:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-05T23:20:34.147 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-05T23:20:34.148 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-07-05T23:20:34.149 DEBUG:teuthology.orchestra.run.smithi027:> sudo /usr/sbin/setenforce permissive 2023-07-05T23:20:34.186 DEBUG:teuthology.orchestra.run.smithi162:> sudo /usr/sbin/setenforce permissive 2023-07-05T23:20:34.216 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-07-05T23:20:34.227 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-07-05T23:20:34.228 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-07-05T23:20:34.251 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-07-05T23:20:34.252 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi027.front.sepia.ceph.com,smithi162.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-07-05T23:29:23.509 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi027.front.sepia.ceph.com'), Remote(name='ubuntu@smithi162.front.sepia.ceph.com')] 2023-07-05T23:29:23.510 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2023-07-05T23:29:23.511 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:29:23.580 DEBUG:teuthology.orchestra.run.smithi027:> true 2023-07-05T23:29:23.649 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi027.front.sepia.ceph.com' 2023-07-05T23:29:23.650 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2023-07-05T23:29:23.651 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:29:23.719 DEBUG:teuthology.orchestra.run.smithi162:> true 2023-07-05T23:29:23.789 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi162.front.sepia.ceph.com' 2023-07-05T23:29:23.790 INFO:teuthology.run_tasks:Running task clock... 2023-07-05T23:29:23.806 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-07-05T23:29:23.806 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-05T23:29:23.807 DEBUG:teuthology.orchestra.run.smithi027:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-05T23:29:23.810 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-05T23:29:23.810 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-05T23:29:23.840 INFO:teuthology.orchestra.run.smithi027.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-07-05T23:29:23.855 INFO:teuthology.orchestra.run.smithi027.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-07-05T23:29:23.862 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-07-05T23:29:23.877 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-07-05T23:29:23.923 INFO:teuthology.orchestra.run.smithi027.stderr:sudo: ntpd: command not found 2023-07-05T23:29:23.935 INFO:teuthology.orchestra.run.smithi027.stdout:506 Cannot talk to daemon 2023-07-05T23:29:23.943 INFO:teuthology.orchestra.run.smithi162.stderr:sudo: ntpd: command not found 2023-07-05T23:29:23.949 INFO:teuthology.orchestra.run.smithi027.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-07-05T23:29:23.954 INFO:teuthology.orchestra.run.smithi162.stdout:506 Cannot talk to daemon 2023-07-05T23:29:23.964 INFO:teuthology.orchestra.run.smithi027.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-07-05T23:29:23.968 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-07-05T23:29:23.982 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-07-05T23:29:24.041 INFO:teuthology.orchestra.run.smithi027.stderr:bash: ntpq: command not found 2023-07-05T23:29:24.044 INFO:teuthology.orchestra.run.smithi027.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-05T23:29:24.044 INFO:teuthology.orchestra.run.smithi027.stdout:=============================================================================== 2023-07-05T23:29:24.045 INFO:teuthology.orchestra.run.smithi027.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-05T23:29:24.045 INFO:teuthology.orchestra.run.smithi027.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-05T23:29:24.045 INFO:teuthology.orchestra.run.smithi027.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-05T23:29:24.045 INFO:teuthology.orchestra.run.smithi027.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-05T23:29:24.056 INFO:teuthology.orchestra.run.smithi162.stderr:bash: ntpq: command not found 2023-07-05T23:29:24.059 INFO:teuthology.orchestra.run.smithi162.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-05T23:29:24.060 INFO:teuthology.orchestra.run.smithi162.stdout:=============================================================================== 2023-07-05T23:29:24.060 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-05T23:29:24.060 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-05T23:29:24.060 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-05T23:29:24.060 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-05T23:29:24.061 INFO:teuthology.run_tasks:Running task install... 2023-07-05T23:29:24.069 DEBUG:teuthology.task.install:project ceph 2023-07-05T23:29:24.070 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '0a781ef0807ae9473fb1306ef07036226ca4f1a6'}} 2023-07-05T23:29:24.070 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '0a781ef0807ae9473fb1306ef07036226ca4f1a6'} 2023-07-05T23:29:24.070 INFO:teuthology.task.install:Using flavor: default 2023-07-05T23:29:24.076 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-07-05T23:29:24.076 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-07-05T23:29:24.077 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '0a781ef0807ae9473fb1306ef07036226ca4f1a6', 'tag': None, 'wait_for_package': False} 2023-07-05T23:29:24.078 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=0a781ef0807ae9473fb1306ef07036226ca4f1a6 2023-07-05T23:29:24.080 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '0a781ef0807ae9473fb1306ef07036226ca4f1a6', 'tag': None, 'wait_for_package': False} 2023-07-05T23:29:24.080 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=0a781ef0807ae9473fb1306ef07036226ca4f1a6 2023-07-05T23:29:24.222 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/centos/8/flavors/default/ 2023-07-05T23:29:24.223 INFO:teuthology.task.install.rpm:Package version is 18.0.0-4488.g0a781ef0 2023-07-05T23:29:24.296 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/centos/8/flavors/default/ 2023-07-05T23:29:24.296 INFO:teuthology.task.install.rpm:Package version is 18.0.0-4488.g0a781ef0 2023-07-05T23:29:24.505 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-07-05T23:29:24.505 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-07-05T23:29:24.506 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-07-05T23:29:24.535 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-07-05T23:29:24.536 DEBUG:teuthology.orchestra.run.smithi162:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/0a781ef0807ae9473fb1306ef07036226ca4f1a6/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-07-05T23:29:24.604 DEBUG:teuthology.orchestra.run.smithi162:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-07-05T23:29:24.668 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-07-05T23:29:24.669 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-07-05T23:29:24.669 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-07-05T23:29:24.682 DEBUG:teuthology.orchestra.run.smithi162:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-07-05T23:29:24.699 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-07-05T23:29:24.699 DEBUG:teuthology.orchestra.run.smithi027:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/0a781ef0807ae9473fb1306ef07036226ca4f1a6/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-07-05T23:29:24.749 INFO:teuthology.orchestra.run.smithi162.stdout:check_obsoletes = 1 2023-07-05T23:29:24.750 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum clean all 2023-07-05T23:29:24.770 DEBUG:teuthology.orchestra.run.smithi027:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-07-05T23:29:24.849 DEBUG:teuthology.orchestra.run.smithi027:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-07-05T23:29:24.921 INFO:teuthology.orchestra.run.smithi027.stdout:check_obsoletes = 1 2023-07-05T23:29:24.921 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum clean all 2023-07-05T23:29:25.121 INFO:teuthology.orchestra.run.smithi162.stdout:Updating Subscription Management repositories. 2023-07-05T23:29:25.315 INFO:teuthology.orchestra.run.smithi027.stdout:Updating Subscription Management repositories. 2023-07-05T23:29:25.882 INFO:teuthology.orchestra.run.smithi162.stdout:44 files removed 2023-07-05T23:29:25.931 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-07-05T23:29:26.263 INFO:teuthology.orchestra.run.smithi162.stdout:Updating Subscription Management repositories. 2023-07-05T23:29:26.272 INFO:teuthology.orchestra.run.smithi027.stdout:44 files removed 2023-07-05T23:29:26.325 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-07-05T23:29:26.678 INFO:teuthology.orchestra.run.smithi027.stdout:Updating Subscription Management repositories. 2023-07-05T23:29:28.260 INFO:teuthology.orchestra.run.smithi162.stdout:ceph packages for x86_64 91 kB/s | 81 kB 00:00 2023-07-05T23:29:28.476 INFO:teuthology.orchestra.run.smithi027.stdout:ceph packages for x86_64 110 kB/s | 81 kB 00:00 2023-07-05T23:29:29.126 INFO:teuthology.orchestra.run.smithi027.stdout:ceph noarch packages 15 kB/s | 9.4 kB 00:00 2023-07-05T23:29:29.202 INFO:teuthology.orchestra.run.smithi162.stdout:ceph noarch packages 10 kB/s | 9.4 kB 00:00 2023-07-05T23:29:29.661 INFO:teuthology.orchestra.run.smithi162.stdout:ceph source packages 3.4 kB/s | 1.5 kB 00:00 2023-07-05T23:29:31.060 INFO:teuthology.orchestra.run.smithi027.stdout:ceph source packages 793 B/s | 1.5 kB 00:01 2023-07-05T23:29:32.070 INFO:teuthology.orchestra.run.smithi162.stdout:Copr repo for python3-asyncssh owned by ceph 1.5 kB/s | 3.5 kB 00:02 2023-07-05T23:29:32.881 INFO:teuthology.orchestra.run.smithi162.stdout:Extra Packages for Enterprise Linux 20 MB/s | 16 MB 00:00 2023-07-05T23:29:33.220 INFO:teuthology.orchestra.run.smithi027.stdout:Copr repo for python3-asyncssh owned by ceph 1.6 kB/s | 3.5 kB 00:02 2023-07-05T23:29:35.289 INFO:teuthology.orchestra.run.smithi027.stdout:Extra Packages for Enterprise Linux 7.6 MB/s | 16 MB 00:02 2023-07-05T23:29:36.312 INFO:teuthology.orchestra.run.smithi162.stdout:lab-extras 458 kB/s | 24 kB 00:00 2023-07-05T23:29:37.255 INFO:teuthology.orchestra.run.smithi162.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 61 MB/s | 53 MB 00:00 2023-07-05T23:29:38.912 INFO:teuthology.orchestra.run.smithi027.stdout:lab-extras 431 kB/s | 24 kB 00:00 2023-07-05T23:29:39.889 INFO:teuthology.orchestra.run.smithi027.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 53 MB/s | 47 MB 00:00 2023-07-05T23:29:45.397 INFO:teuthology.orchestra.run.smithi162.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 60 MB/s | 47 MB 00:00 2023-07-05T23:29:48.323 INFO:teuthology.orchestra.run.smithi027.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 59 MB/s | 53 MB 00:00 2023-07-05T23:29:56.319 INFO:teuthology.orchestra.run.smithi162.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-05T23:29:56.320 INFO:teuthology.orchestra.run.smithi162.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-05T23:29:56.334 INFO:teuthology.orchestra.run.smithi162.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-07-05T23:29:56.335 INFO:teuthology.orchestra.run.smithi162.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-07-05T23:29:56.336 INFO:teuthology.orchestra.run.smithi162.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-07-05T23:29:56.337 INFO:teuthology.orchestra.run.smithi162.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-07-05T23:29:56.339 INFO:teuthology.orchestra.run.smithi162.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-07-05T23:29:56.342 INFO:teuthology.orchestra.run.smithi162.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-07-05T23:29:56.345 INFO:teuthology.orchestra.run.smithi162.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-07-05T23:29:56.475 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2023-07-05T23:29:56.488 INFO:teuthology.orchestra.run.smithi162.stdout:=========================================================================================================================== 2023-07-05T23:29:56.488 INFO:teuthology.orchestra.run.smithi162.stdout: Package Arch Version Repository Size 2023-07-05T23:29:56.488 INFO:teuthology.orchestra.run.smithi162.stdout:=========================================================================================================================== 2023-07-05T23:29:56.488 INFO:teuthology.orchestra.run.smithi162.stdout:Installing: 2023-07-05T23:29:56.489 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-07-05T23:29:56.489 INFO:teuthology.orchestra.run.smithi162.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-07-05T23:29:56.489 INFO:teuthology.orchestra.run.smithi162.stdout: ceph x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 6.4 k 2023-07-05T23:29:56.489 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-base x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 5.4 M 2023-07-05T23:29:56.489 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-fuse x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 848 k 2023-07-05T23:29:56.489 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 165 k 2023-07-05T23:29:56.489 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 1.5 M 2023-07-05T23:29:56.490 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-cephadm noarch 2:18.0.0-4488.g0a781ef0.el8 ceph-noarch 128 k 2023-07-05T23:29:56.490 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-dashboard noarch 2:18.0.0-4488.g0a781ef0.el8 ceph-noarch 1.7 M 2023-07-05T23:29:56.490 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-4488.g0a781ef0.el8 ceph-noarch 7.4 M 2023-07-05T23:29:56.490 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-rook noarch 2:18.0.0-4488.g0a781ef0.el8 ceph-noarch 47 k 2023-07-05T23:29:56.490 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-radosgw x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 13 M 2023-07-05T23:29:56.490 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-test x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 48 M 2023-07-05T23:29:56.490 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-volume noarch 2:18.0.0-4488.g0a781ef0.el8 ceph-noarch 258 k 2023-07-05T23:29:56.490 INFO:teuthology.orchestra.run.smithi162.stdout: cephadm noarch 2:18.0.0-4488.g0a781ef0.el8 ceph-noarch 161 k 2023-07-05T23:29:56.491 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-mirror x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 258 k 2023-07-05T23:29:56.491 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-top noarch 2:18.0.0-4488.g0a781ef0.el8 ceph-noarch 18 k 2023-07-05T23:29:56.491 INFO:teuthology.orchestra.run.smithi162.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-07-05T23:29:56.491 INFO:teuthology.orchestra.run.smithi162.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-07-05T23:29:56.491 INFO:teuthology.orchestra.run.smithi162.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-07-05T23:29:56.491 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs-devel x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 31 k 2023-07-05T23:29:56.491 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs2 x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 771 k 2023-07-05T23:29:56.492 INFO:teuthology.orchestra.run.smithi162.stdout: librados-devel x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 139 k 2023-07-05T23:29:56.492 INFO:teuthology.orchestra.run.smithi162.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-07-05T23:29:56.492 INFO:teuthology.orchestra.run.smithi162.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-07-05T23:29:56.492 INFO:teuthology.orchestra.run.smithi162.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-07-05T23:29:56.492 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-07-05T23:29:56.492 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-07-05T23:29:56.492 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-07-05T23:29:56.493 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cephfs x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 197 k 2023-07-05T23:29:56.493 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rados x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 371 k 2023-07-05T23:29:56.493 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rbd x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 364 k 2023-07-05T23:29:56.493 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rgw x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 107 k 2023-07-05T23:29:56.493 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-fuse x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 94 k 2023-07-05T23:29:56.493 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-mirror x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 3.4 M 2023-07-05T23:29:56.493 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-nbd x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 180 k 2023-07-05T23:29:56.493 INFO:teuthology.orchestra.run.smithi162.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-07-05T23:29:56.494 INFO:teuthology.orchestra.run.smithi162.stdout:Upgrading: 2023-07-05T23:29:56.494 INFO:teuthology.orchestra.run.smithi162.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-07-05T23:29:56.494 INFO:teuthology.orchestra.run.smithi162.stdout: librados2 x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 3.7 M 2023-07-05T23:29:56.494 INFO:teuthology.orchestra.run.smithi162.stdout: librbd1 x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 3.6 M 2023-07-05T23:29:56.494 INFO:teuthology.orchestra.run.smithi162.stdout:Installing dependencies: 2023-07-05T23:29:56.494 INFO:teuthology.orchestra.run.smithi162.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-07-05T23:29:56.494 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-common x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 22 M 2023-07-05T23:29:56.494 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-grafana-dashboards noarch 2:18.0.0-4488.g0a781ef0.el8 ceph-noarch 23 k 2023-07-05T23:29:56.495 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mds x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 2.3 M 2023-07-05T23:29:56.495 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-modules-core noarch 2:18.0.0-4488.g0a781ef0.el8 ceph-noarch 240 k 2023-07-05T23:29:56.495 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mon x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 4.6 M 2023-07-05T23:29:56.495 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-osd x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 18 M 2023-07-05T23:29:56.495 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-prometheus-alerts noarch 2:18.0.0-4488.g0a781ef0.el8 ceph-noarch 15 k 2023-07-05T23:29:56.495 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-selinux x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 24 k 2023-07-05T23:29:56.495 INFO:teuthology.orchestra.run.smithi162.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-07-05T23:29:56.496 INFO:teuthology.orchestra.run.smithi162.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-07-05T23:29:56.496 INFO:teuthology.orchestra.run.smithi162.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-07-05T23:29:56.496 INFO:teuthology.orchestra.run.smithi162.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-07-05T23:29:56.496 INFO:teuthology.orchestra.run.smithi162.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-07-05T23:29:56.496 INFO:teuthology.orchestra.run.smithi162.stdout: libcephsqlite x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 137 k 2023-07-05T23:29:56.496 INFO:teuthology.orchestra.run.smithi162.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-07-05T23:29:56.496 INFO:teuthology.orchestra.run.smithi162.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-07-05T23:29:56.496 INFO:teuthology.orchestra.run.smithi162.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-07-05T23:29:56.497 INFO:teuthology.orchestra.run.smithi162.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-07-05T23:29:56.497 INFO:teuthology.orchestra.run.smithi162.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-07-05T23:29:56.497 INFO:teuthology.orchestra.run.smithi162.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-07-05T23:29:56.497 INFO:teuthology.orchestra.run.smithi162.stdout: libradosstriper1 x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 473 k 2023-07-05T23:29:56.497 INFO:teuthology.orchestra.run.smithi162.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-07-05T23:29:56.497 INFO:teuthology.orchestra.run.smithi162.stdout: librgw2 x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 6.7 M 2023-07-05T23:29:56.497 INFO:teuthology.orchestra.run.smithi162.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-07-05T23:29:56.498 INFO:teuthology.orchestra.run.smithi162.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-07-05T23:29:56.498 INFO:teuthology.orchestra.run.smithi162.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-07-05T23:29:56.498 INFO:teuthology.orchestra.run.smithi162.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-07-05T23:29:56.498 INFO:teuthology.orchestra.run.smithi162.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-07-05T23:29:56.498 INFO:teuthology.orchestra.run.smithi162.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-07-05T23:29:56.499 INFO:teuthology.orchestra.run.smithi162.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-07-05T23:29:56.499 INFO:teuthology.orchestra.run.smithi162.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-07-05T23:29:56.499 INFO:teuthology.orchestra.run.smithi162.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-07-05T23:29:56.499 INFO:teuthology.orchestra.run.smithi162.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-07-05T23:29:56.499 INFO:teuthology.orchestra.run.smithi162.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-07-05T23:29:56.499 INFO:teuthology.orchestra.run.smithi162.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-07-05T23:29:56.499 INFO:teuthology.orchestra.run.smithi162.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-07-05T23:29:56.500 INFO:teuthology.orchestra.run.smithi162.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-07-05T23:29:56.500 INFO:teuthology.orchestra.run.smithi162.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-07-05T23:29:56.500 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-07-05T23:29:56.500 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-argparse x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 45 k 2023-07-05T23:29:56.500 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-common x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 119 k 2023-07-05T23:29:56.500 INFO:teuthology.orchestra.run.smithi162.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-07-05T23:29:56.500 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-07-05T23:29:56.501 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-07-05T23:29:56.501 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-07-05T23:29:56.501 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-07-05T23:29:56.501 INFO:teuthology.orchestra.run.smithi162.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-07-05T23:29:56.501 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-07-05T23:29:56.501 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-07-05T23:29:56.501 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-07-05T23:29:56.501 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-07-05T23:29:56.502 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-07-05T23:29:56.502 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-07-05T23:29:56.502 INFO:teuthology.orchestra.run.smithi162.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-07-05T23:29:56.502 INFO:teuthology.orchestra.run.smithi162.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-07-05T23:29:56.502 INFO:teuthology.orchestra.run.smithi162.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-07-05T23:29:56.502 INFO:teuthology.orchestra.run.smithi162.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-07-05T23:29:56.502 INFO:teuthology.orchestra.run.smithi162.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-07-05T23:29:56.503 INFO:teuthology.orchestra.run.smithi162.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-07-05T23:29:56.503 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-07-05T23:29:56.503 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-07-05T23:29:56.503 INFO:teuthology.orchestra.run.smithi162.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-07-05T23:29:56.503 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-07-05T23:29:56.503 INFO:teuthology.orchestra.run.smithi162.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-07-05T23:29:56.503 INFO:teuthology.orchestra.run.smithi162.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-07-05T23:29:56.503 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-07-05T23:29:56.504 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-07-05T23:29:56.504 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-07-05T23:29:56.504 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-07-05T23:29:56.504 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-07-05T23:29:56.504 INFO:teuthology.orchestra.run.smithi162.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-07-05T23:29:56.504 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-07-05T23:29:56.504 INFO:teuthology.orchestra.run.smithi162.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-07-05T23:29:56.505 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-07-05T23:29:56.505 INFO:teuthology.orchestra.run.smithi162.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-07-05T23:29:56.505 INFO:teuthology.orchestra.run.smithi162.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-07-05T23:29:56.505 INFO:teuthology.orchestra.run.smithi162.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-07-05T23:29:56.505 INFO:teuthology.orchestra.run.smithi162.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-07-05T23:29:56.505 INFO:teuthology.orchestra.run.smithi162.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-07-05T23:29:56.505 INFO:teuthology.orchestra.run.smithi162.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-07-05T23:29:56.505 INFO:teuthology.orchestra.run.smithi162.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-07-05T23:29:56.506 INFO:teuthology.orchestra.run.smithi162.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-07-05T23:29:56.506 INFO:teuthology.orchestra.run.smithi162.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-07-05T23:29:56.506 INFO:teuthology.orchestra.run.smithi162.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-07-05T23:29:56.506 INFO:teuthology.orchestra.run.smithi162.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-07-05T23:29:56.506 INFO:teuthology.orchestra.run.smithi162.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-07-05T23:29:56.506 INFO:teuthology.orchestra.run.smithi162.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-07-05T23:29:56.506 INFO:teuthology.orchestra.run.smithi162.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-07-05T23:29:56.507 INFO:teuthology.orchestra.run.smithi162.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-07-05T23:29:56.507 INFO:teuthology.orchestra.run.smithi162.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-07-05T23:29:56.507 INFO:teuthology.orchestra.run.smithi162.stdout:Enabling module streams: 2023-07-05T23:29:56.507 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql 10 2023-07-05T23:29:56.507 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-07-05T23:29:56.507 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction Summary 2023-07-05T23:29:56.507 INFO:teuthology.orchestra.run.smithi162.stdout:=========================================================================================================================== 2023-07-05T23:29:56.507 INFO:teuthology.orchestra.run.smithi162.stdout:Install 128 Packages 2023-07-05T23:29:56.508 INFO:teuthology.orchestra.run.smithi162.stdout:Upgrade 3 Packages 2023-07-05T23:29:56.508 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-07-05T23:29:56.508 INFO:teuthology.orchestra.run.smithi162.stdout:Total download size: 205 M 2023-07-05T23:29:56.508 INFO:teuthology.orchestra.run.smithi162.stdout:Downloading Packages: 2023-07-05T23:29:56.646 INFO:teuthology.orchestra.run.smithi162.stdout:(1/131): ceph-18.0.0-4488.g0a781ef0.el8.x86_64. 57 kB/s | 6.4 kB 00:00 2023-07-05T23:29:56.921 INFO:teuthology.orchestra.run.smithi162.stdout:(2/131): ceph-fuse-18.0.0-4488.g0a781ef0.el8.x8 3.0 MB/s | 848 kB 00:00 2023-07-05T23:29:57.013 INFO:teuthology.orchestra.run.smithi162.stdout:(3/131): ceph-immutable-object-cache-18.0.0-448 1.8 MB/s | 165 kB 00:00 2023-07-05T23:29:57.378 INFO:teuthology.orchestra.run.smithi162.stdout:(4/131): ceph-mds-18.0.0-4488.g0a781ef0.el8.x86 6.3 MB/s | 2.3 MB 00:00 2023-07-05T23:29:57.648 INFO:teuthology.orchestra.run.smithi162.stdout:(5/131): ceph-base-18.0.0-4488.g0a781ef0.el8.x8 4.8 MB/s | 5.4 MB 00:01 2023-07-05T23:29:57.715 INFO:teuthology.orchestra.run.smithi162.stdout:(6/131): ceph-mgr-18.0.0-4488.g0a781ef0.el8.x86 4.6 MB/s | 1.5 MB 00:00 2023-07-05T23:29:58.573 INFO:teuthology.orchestra.run.smithi162.stdout:(7/131): ceph-mon-18.0.0-4488.g0a781ef0.el8.x86 5.0 MB/s | 4.6 MB 00:00 2023-07-05T23:30:00.097 INFO:teuthology.orchestra.run.smithi027.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-05T23:30:00.098 INFO:teuthology.orchestra.run.smithi027.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-05T23:30:00.113 INFO:teuthology.orchestra.run.smithi027.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-07-05T23:30:00.114 INFO:teuthology.orchestra.run.smithi027.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-07-05T23:30:00.115 INFO:teuthology.orchestra.run.smithi027.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-07-05T23:30:00.116 INFO:teuthology.orchestra.run.smithi027.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-07-05T23:30:00.118 INFO:teuthology.orchestra.run.smithi027.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-07-05T23:30:00.122 INFO:teuthology.orchestra.run.smithi027.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-07-05T23:30:00.123 INFO:teuthology.orchestra.run.smithi027.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-07-05T23:30:00.223 INFO:teuthology.orchestra.run.smithi162.stdout:(8/131): ceph-osd-18.0.0-4488.g0a781ef0.el8.x86 7.1 MB/s | 18 MB 00:02 2023-07-05T23:30:00.264 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. 2023-07-05T23:30:00.277 INFO:teuthology.orchestra.run.smithi027.stdout:=========================================================================================================================== 2023-07-05T23:30:00.277 INFO:teuthology.orchestra.run.smithi027.stdout: Package Arch Version Repository Size 2023-07-05T23:30:00.278 INFO:teuthology.orchestra.run.smithi027.stdout:=========================================================================================================================== 2023-07-05T23:30:00.278 INFO:teuthology.orchestra.run.smithi027.stdout:Installing: 2023-07-05T23:30:00.278 INFO:teuthology.orchestra.run.smithi027.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-07-05T23:30:00.278 INFO:teuthology.orchestra.run.smithi027.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-07-05T23:30:00.278 INFO:teuthology.orchestra.run.smithi027.stdout: ceph x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 6.4 k 2023-07-05T23:30:00.279 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-base x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 5.4 M 2023-07-05T23:30:00.279 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-fuse x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 848 k 2023-07-05T23:30:00.279 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 165 k 2023-07-05T23:30:00.279 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 1.5 M 2023-07-05T23:30:00.279 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-cephadm noarch 2:18.0.0-4488.g0a781ef0.el8 ceph-noarch 128 k 2023-07-05T23:30:00.280 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-dashboard noarch 2:18.0.0-4488.g0a781ef0.el8 ceph-noarch 1.7 M 2023-07-05T23:30:00.280 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-4488.g0a781ef0.el8 ceph-noarch 7.4 M 2023-07-05T23:30:00.280 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-rook noarch 2:18.0.0-4488.g0a781ef0.el8 ceph-noarch 47 k 2023-07-05T23:30:00.280 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-radosgw x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 13 M 2023-07-05T23:30:00.280 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-test x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 48 M 2023-07-05T23:30:00.280 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-volume noarch 2:18.0.0-4488.g0a781ef0.el8 ceph-noarch 258 k 2023-07-05T23:30:00.281 INFO:teuthology.orchestra.run.smithi027.stdout: cephadm noarch 2:18.0.0-4488.g0a781ef0.el8 ceph-noarch 161 k 2023-07-05T23:30:00.281 INFO:teuthology.orchestra.run.smithi027.stdout: cephfs-mirror x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 258 k 2023-07-05T23:30:00.281 INFO:teuthology.orchestra.run.smithi027.stdout: cephfs-top noarch 2:18.0.0-4488.g0a781ef0.el8 ceph-noarch 18 k 2023-07-05T23:30:00.281 INFO:teuthology.orchestra.run.smithi027.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-07-05T23:30:00.281 INFO:teuthology.orchestra.run.smithi027.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-07-05T23:30:00.281 INFO:teuthology.orchestra.run.smithi027.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-07-05T23:30:00.281 INFO:teuthology.orchestra.run.smithi027.stdout: libcephfs-devel x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 31 k 2023-07-05T23:30:00.282 INFO:teuthology.orchestra.run.smithi027.stdout: libcephfs2 x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 771 k 2023-07-05T23:30:00.282 INFO:teuthology.orchestra.run.smithi027.stdout: librados-devel x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 139 k 2023-07-05T23:30:00.282 INFO:teuthology.orchestra.run.smithi027.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-07-05T23:30:00.282 INFO:teuthology.orchestra.run.smithi027.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-07-05T23:30:00.282 INFO:teuthology.orchestra.run.smithi027.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-07-05T23:30:00.282 INFO:teuthology.orchestra.run.smithi027.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-07-05T23:30:00.283 INFO:teuthology.orchestra.run.smithi027.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-07-05T23:30:00.283 INFO:teuthology.orchestra.run.smithi027.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-07-05T23:30:00.283 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cephfs x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 197 k 2023-07-05T23:30:00.283 INFO:teuthology.orchestra.run.smithi027.stdout: python3-rados x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 371 k 2023-07-05T23:30:00.283 INFO:teuthology.orchestra.run.smithi027.stdout: python3-rbd x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 364 k 2023-07-05T23:30:00.284 INFO:teuthology.orchestra.run.smithi027.stdout: python3-rgw x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 107 k 2023-07-05T23:30:00.284 INFO:teuthology.orchestra.run.smithi027.stdout: rbd-fuse x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 94 k 2023-07-05T23:30:00.284 INFO:teuthology.orchestra.run.smithi027.stdout: rbd-mirror x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 3.4 M 2023-07-05T23:30:00.284 INFO:teuthology.orchestra.run.smithi027.stdout: rbd-nbd x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 180 k 2023-07-05T23:30:00.284 INFO:teuthology.orchestra.run.smithi027.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-07-05T23:30:00.284 INFO:teuthology.orchestra.run.smithi027.stdout:Upgrading: 2023-07-05T23:30:00.285 INFO:teuthology.orchestra.run.smithi027.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-07-05T23:30:00.285 INFO:teuthology.orchestra.run.smithi027.stdout: librados2 x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 3.7 M 2023-07-05T23:30:00.285 INFO:teuthology.orchestra.run.smithi027.stdout: librbd1 x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 3.6 M 2023-07-05T23:30:00.285 INFO:teuthology.orchestra.run.smithi027.stdout:Installing dependencies: 2023-07-05T23:30:00.285 INFO:teuthology.orchestra.run.smithi027.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-07-05T23:30:00.285 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-common x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 22 M 2023-07-05T23:30:00.285 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-grafana-dashboards noarch 2:18.0.0-4488.g0a781ef0.el8 ceph-noarch 23 k 2023-07-05T23:30:00.286 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mds x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 2.3 M 2023-07-05T23:30:00.286 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-modules-core noarch 2:18.0.0-4488.g0a781ef0.el8 ceph-noarch 240 k 2023-07-05T23:30:00.286 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mon x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 4.6 M 2023-07-05T23:30:00.286 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-osd x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 18 M 2023-07-05T23:30:00.286 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-prometheus-alerts noarch 2:18.0.0-4488.g0a781ef0.el8 ceph-noarch 15 k 2023-07-05T23:30:00.286 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-selinux x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 24 k 2023-07-05T23:30:00.286 INFO:teuthology.orchestra.run.smithi027.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-07-05T23:30:00.286 INFO:teuthology.orchestra.run.smithi027.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-07-05T23:30:00.287 INFO:teuthology.orchestra.run.smithi027.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-07-05T23:30:00.287 INFO:teuthology.orchestra.run.smithi027.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-07-05T23:30:00.287 INFO:teuthology.orchestra.run.smithi027.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-07-05T23:30:00.287 INFO:teuthology.orchestra.run.smithi027.stdout: libcephsqlite x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 137 k 2023-07-05T23:30:00.287 INFO:teuthology.orchestra.run.smithi027.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-07-05T23:30:00.287 INFO:teuthology.orchestra.run.smithi027.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-07-05T23:30:00.287 INFO:teuthology.orchestra.run.smithi027.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-07-05T23:30:00.288 INFO:teuthology.orchestra.run.smithi027.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-07-05T23:30:00.288 INFO:teuthology.orchestra.run.smithi027.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-07-05T23:30:00.288 INFO:teuthology.orchestra.run.smithi027.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-07-05T23:30:00.288 INFO:teuthology.orchestra.run.smithi027.stdout: libradosstriper1 x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 473 k 2023-07-05T23:30:00.288 INFO:teuthology.orchestra.run.smithi027.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-07-05T23:30:00.288 INFO:teuthology.orchestra.run.smithi027.stdout: librgw2 x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 6.7 M 2023-07-05T23:30:00.288 INFO:teuthology.orchestra.run.smithi027.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-07-05T23:30:00.289 INFO:teuthology.orchestra.run.smithi027.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-07-05T23:30:00.289 INFO:teuthology.orchestra.run.smithi027.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-07-05T23:30:00.289 INFO:teuthology.orchestra.run.smithi027.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-07-05T23:30:00.289 INFO:teuthology.orchestra.run.smithi027.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-07-05T23:30:00.289 INFO:teuthology.orchestra.run.smithi027.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-07-05T23:30:00.289 INFO:teuthology.orchestra.run.smithi027.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-07-05T23:30:00.289 INFO:teuthology.orchestra.run.smithi027.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-07-05T23:30:00.289 INFO:teuthology.orchestra.run.smithi027.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-07-05T23:30:00.290 INFO:teuthology.orchestra.run.smithi027.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-07-05T23:30:00.290 INFO:teuthology.orchestra.run.smithi027.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-07-05T23:30:00.290 INFO:teuthology.orchestra.run.smithi027.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-07-05T23:30:00.290 INFO:teuthology.orchestra.run.smithi027.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-07-05T23:30:00.290 INFO:teuthology.orchestra.run.smithi027.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-07-05T23:30:00.290 INFO:teuthology.orchestra.run.smithi027.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-07-05T23:30:00.290 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-07-05T23:30:00.291 INFO:teuthology.orchestra.run.smithi027.stdout: python3-ceph-argparse x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 45 k 2023-07-05T23:30:00.291 INFO:teuthology.orchestra.run.smithi027.stdout: python3-ceph-common x86_64 2:18.0.0-4488.g0a781ef0.el8 ceph 119 k 2023-07-05T23:30:00.291 INFO:teuthology.orchestra.run.smithi027.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-07-05T23:30:00.291 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-07-05T23:30:00.291 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-07-05T23:30:00.291 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-07-05T23:30:00.291 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-07-05T23:30:00.291 INFO:teuthology.orchestra.run.smithi027.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-07-05T23:30:00.292 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-07-05T23:30:00.292 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-07-05T23:30:00.292 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-07-05T23:30:00.292 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-07-05T23:30:00.292 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-07-05T23:30:00.292 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-07-05T23:30:00.292 INFO:teuthology.orchestra.run.smithi027.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-07-05T23:30:00.293 INFO:teuthology.orchestra.run.smithi027.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-07-05T23:30:00.293 INFO:teuthology.orchestra.run.smithi027.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-07-05T23:30:00.293 INFO:teuthology.orchestra.run.smithi027.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-07-05T23:30:00.293 INFO:teuthology.orchestra.run.smithi027.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-07-05T23:30:00.293 INFO:teuthology.orchestra.run.smithi027.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-07-05T23:30:00.293 INFO:teuthology.orchestra.run.smithi027.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-07-05T23:30:00.293 INFO:teuthology.orchestra.run.smithi027.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-07-05T23:30:00.293 INFO:teuthology.orchestra.run.smithi027.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-07-05T23:30:00.294 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-07-05T23:30:00.294 INFO:teuthology.orchestra.run.smithi027.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-07-05T23:30:00.294 INFO:teuthology.orchestra.run.smithi027.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-07-05T23:30:00.294 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-07-05T23:30:00.294 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-07-05T23:30:00.294 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-07-05T23:30:00.294 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-07-05T23:30:00.294 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-07-05T23:30:00.295 INFO:teuthology.orchestra.run.smithi027.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-07-05T23:30:00.295 INFO:teuthology.orchestra.run.smithi027.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-07-05T23:30:00.295 INFO:teuthology.orchestra.run.smithi027.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-07-05T23:30:00.295 INFO:teuthology.orchestra.run.smithi027.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-07-05T23:30:00.295 INFO:teuthology.orchestra.run.smithi027.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-07-05T23:30:00.295 INFO:teuthology.orchestra.run.smithi027.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-07-05T23:30:00.295 INFO:teuthology.orchestra.run.smithi027.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-07-05T23:30:00.296 INFO:teuthology.orchestra.run.smithi027.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-07-05T23:30:00.296 INFO:teuthology.orchestra.run.smithi027.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-07-05T23:30:00.296 INFO:teuthology.orchestra.run.smithi027.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-07-05T23:30:00.296 INFO:teuthology.orchestra.run.smithi027.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-07-05T23:30:00.296 INFO:teuthology.orchestra.run.smithi027.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-07-05T23:30:00.296 INFO:teuthology.orchestra.run.smithi027.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-07-05T23:30:00.296 INFO:teuthology.orchestra.run.smithi027.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-07-05T23:30:00.296 INFO:teuthology.orchestra.run.smithi027.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-07-05T23:30:00.297 INFO:teuthology.orchestra.run.smithi027.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-07-05T23:30:00.297 INFO:teuthology.orchestra.run.smithi027.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-07-05T23:30:00.297 INFO:teuthology.orchestra.run.smithi027.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-07-05T23:30:00.297 INFO:teuthology.orchestra.run.smithi027.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-07-05T23:30:00.297 INFO:teuthology.orchestra.run.smithi027.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-07-05T23:30:00.297 INFO:teuthology.orchestra.run.smithi027.stdout:Enabling module streams: 2023-07-05T23:30:00.297 INFO:teuthology.orchestra.run.smithi027.stdout: postgresql 10 2023-07-05T23:30:00.298 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:30:00.298 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction Summary 2023-07-05T23:30:00.298 INFO:teuthology.orchestra.run.smithi027.stdout:=========================================================================================================================== 2023-07-05T23:30:00.298 INFO:teuthology.orchestra.run.smithi027.stdout:Install 128 Packages 2023-07-05T23:30:00.298 INFO:teuthology.orchestra.run.smithi027.stdout:Upgrade 3 Packages 2023-07-05T23:30:00.298 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:30:00.299 INFO:teuthology.orchestra.run.smithi162.stdout:(9/131): ceph-selinux-18.0.0-4488.g0a781ef0.el8 325 kB/s | 24 kB 00:00 2023-07-05T23:30:00.299 INFO:teuthology.orchestra.run.smithi027.stdout:Total download size: 205 M 2023-07-05T23:30:00.299 INFO:teuthology.orchestra.run.smithi027.stdout:Downloading Packages: 2023-07-05T23:30:00.940 INFO:teuthology.orchestra.run.smithi162.stdout:(10/131): ceph-radosgw-18.0.0-4488.g0a781ef0.el 5.7 MB/s | 13 MB 00:02 2023-07-05T23:30:00.966 INFO:teuthology.orchestra.run.smithi027.stdout:(1/131): ceph-18.0.0-4488.g0a781ef0.el8.x86_64. 19 kB/s | 6.4 kB 00:00 2023-07-05T23:30:01.032 INFO:teuthology.orchestra.run.smithi162.stdout:(11/131): cephfs-mirror-18.0.0-4488.g0a781ef0.e 2.8 MB/s | 258 kB 00:00 2023-07-05T23:30:01.116 INFO:teuthology.orchestra.run.smithi162.stdout:(12/131): libcephfs-devel-18.0.0-4488.g0a781ef0 373 kB/s | 31 kB 00:00 2023-07-05T23:30:01.308 INFO:teuthology.orchestra.run.smithi162.stdout:(13/131): libcephfs2-18.0.0-4488.g0a781ef0.el8. 3.9 MB/s | 771 kB 00:00 2023-07-05T23:30:01.400 INFO:teuthology.orchestra.run.smithi162.stdout:(14/131): libcephsqlite-18.0.0-4488.g0a781ef0.e 1.5 MB/s | 137 kB 00:00 2023-07-05T23:30:01.492 INFO:teuthology.orchestra.run.smithi162.stdout:(15/131): librados-devel-18.0.0-4488.g0a781ef0. 1.5 MB/s | 139 kB 00:00 2023-07-05T23:30:01.667 INFO:teuthology.orchestra.run.smithi162.stdout:(16/131): libradosstriper1-18.0.0-4488.g0a781ef 2.6 MB/s | 473 kB 00:00 2023-07-05T23:30:01.876 INFO:teuthology.orchestra.run.smithi162.stdout:(17/131): ceph-common-18.0.0-4488.g0a781ef0.el8 4.1 MB/s | 22 MB 00:05 2023-07-05T23:30:02.001 INFO:teuthology.orchestra.run.smithi162.stdout:(18/131): python3-ceph-argparse-18.0.0-4488.g0a 358 kB/s | 45 kB 00:00 2023-07-05T23:30:02.093 INFO:teuthology.orchestra.run.smithi162.stdout:(19/131): python3-ceph-common-18.0.0-4488.g0a78 1.3 MB/s | 119 kB 00:00 2023-07-05T23:30:02.107 INFO:teuthology.orchestra.run.smithi027.stdout:(2/131): ceph-fuse-18.0.0-4488.g0a781ef0.el8.x8 743 kB/s | 848 kB 00:01 2023-07-05T23:30:02.260 INFO:teuthology.orchestra.run.smithi162.stdout:(20/131): python3-cephfs-18.0.0-4488.g0a781ef0. 1.2 MB/s | 197 kB 00:00 2023-07-05T23:30:02.325 INFO:teuthology.orchestra.run.smithi027.stdout:(3/131): ceph-immutable-object-cache-18.0.0-448 764 kB/s | 165 kB 00:00 2023-07-05T23:30:02.827 INFO:teuthology.orchestra.run.smithi162.stdout:(21/131): python3-rados-18.0.0-4488.g0a781ef0.e 654 kB/s | 371 kB 00:00 2023-07-05T23:30:03.060 INFO:teuthology.orchestra.run.smithi162.stdout:(22/131): python3-rbd-18.0.0-4488.g0a781ef0.el8 1.5 MB/s | 364 kB 00:00 2023-07-05T23:30:03.152 INFO:teuthology.orchestra.run.smithi162.stdout:(23/131): librgw2-18.0.0-4488.g0a781ef0.el8.x86 4.5 MB/s | 6.7 MB 00:01 2023-07-05T23:30:03.178 INFO:teuthology.orchestra.run.smithi162.stdout:(24/131): python3-rgw-18.0.0-4488.g0a781ef0.el8 911 kB/s | 107 kB 00:00 2023-07-05T23:30:03.236 INFO:teuthology.orchestra.run.smithi162.stdout:(25/131): rbd-fuse-18.0.0-4488.g0a781ef0.el8.x8 1.1 MB/s | 94 kB 00:00 2023-07-05T23:30:03.337 INFO:teuthology.orchestra.run.smithi162.stdout:(26/131): rbd-nbd-18.0.0-4488.g0a781ef0.el8.x86 1.8 MB/s | 180 kB 00:00 2023-07-05T23:30:03.420 INFO:teuthology.orchestra.run.smithi162.stdout:(27/131): ceph-grafana-dashboards-18.0.0-4488.g 277 kB/s | 23 kB 00:00 2023-07-05T23:30:03.512 INFO:teuthology.orchestra.run.smithi162.stdout:(28/131): ceph-mgr-cephadm-18.0.0-4488.g0a781ef 1.4 MB/s | 128 kB 00:00 2023-07-05T23:30:03.524 INFO:teuthology.orchestra.run.smithi027.stdout:(4/131): ceph-mds-18.0.0-4488.g0a781ef0.el8.x86 1.9 MB/s | 2.3 MB 00:01 2023-07-05T23:30:03.608 INFO:teuthology.orchestra.run.smithi027.stdout:(5/131): ceph-base-18.0.0-4488.g0a781ef0.el8.x8 1.8 MB/s | 5.4 MB 00:02 2023-07-05T23:30:04.012 INFO:teuthology.orchestra.run.smithi162.stdout:(29/131): ceph-mgr-dashboard-18.0.0-4488.g0a781 3.4 MB/s | 1.7 MB 00:00 2023-07-05T23:30:04.341 INFO:teuthology.orchestra.run.smithi027.stdout:(6/131): ceph-mgr-18.0.0-4488.g0a781ef0.el8.x86 1.9 MB/s | 1.5 MB 00:00 2023-07-05T23:30:04.413 INFO:teuthology.orchestra.run.smithi162.stdout:(30/131): rbd-mirror-18.0.0-4488.g0a781ef0.el8. 2.8 MB/s | 3.4 MB 00:01 2023-07-05T23:30:04.571 INFO:teuthology.orchestra.run.smithi162.stdout:(31/131): ceph-mgr-modules-core-18.0.0-4488.g0a 1.5 MB/s | 240 kB 00:00 2023-07-05T23:30:04.688 INFO:teuthology.orchestra.run.smithi162.stdout:(32/131): ceph-mgr-rook-18.0.0-4488.g0a781ef0.e 406 kB/s | 47 kB 00:00 2023-07-05T23:30:04.772 INFO:teuthology.orchestra.run.smithi162.stdout:(33/131): ceph-prometheus-alerts-18.0.0-4488.g0 174 kB/s | 15 kB 00:00 2023-07-05T23:30:04.914 INFO:teuthology.orchestra.run.smithi162.stdout:(34/131): ceph-volume-18.0.0-4488.g0a781ef0.el8 1.8 MB/s | 258 kB 00:00 2023-07-05T23:30:05.033 INFO:teuthology.orchestra.run.smithi162.stdout:(35/131): cephadm-18.0.0-4488.g0a781ef0.el8.noa 1.3 MB/s | 161 kB 00:00 2023-07-05T23:30:05.123 INFO:teuthology.orchestra.run.smithi162.stdout:(36/131): cephfs-top-18.0.0-4488.g0a781ef0.el8. 200 kB/s | 18 kB 00:00 2023-07-05T23:30:05.309 INFO:teuthology.orchestra.run.smithi027.stdout:(7/131): ceph-mon-18.0.0-4488.g0a781ef0.el8.x86 2.7 MB/s | 4.6 MB 00:01 2023-07-05T23:30:05.598 INFO:teuthology.orchestra.run.smithi162.stdout:(37/131): gperftools-libs-2.7-9.el8.x86_64.rpm 645 kB/s | 306 kB 00:00 2023-07-05T23:30:05.698 INFO:teuthology.orchestra.run.smithi162.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 588 kB/s | 59 kB 00:00 2023-07-05T23:30:05.849 INFO:teuthology.orchestra.run.smithi162.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 500 kB/s | 75 kB 00:00 2023-07-05T23:30:06.032 INFO:teuthology.orchestra.run.smithi162.stdout:(40/131): python3-asyncssh-2.7.0-2.el8.noarch.r 2.5 MB/s | 476 kB 00:00 2023-07-05T23:30:06.116 INFO:teuthology.orchestra.run.smithi162.stdout:(41/131): ceph-mgr-diskprediction-local-18.0.0- 3.5 MB/s | 7.4 MB 00:02 2023-07-05T23:30:06.141 INFO:teuthology.orchestra.run.smithi162.stdout:(42/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 402 kB/s | 44 kB 00:00 2023-07-05T23:30:06.242 INFO:teuthology.orchestra.run.smithi162.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 330 kB/s | 33 kB 00:00 2023-07-05T23:30:06.342 INFO:teuthology.orchestra.run.smithi162.stdout:(44/131): python3-certifi-2018.10.15-7.el8.noar 163 kB/s | 16 kB 00:00 2023-07-05T23:30:06.442 INFO:teuthology.orchestra.run.smithi162.stdout:(45/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.7 MB/s | 173 kB 00:00 2023-07-05T23:30:06.501 INFO:teuthology.orchestra.run.smithi162.stdout:(46/131): python3-beautifulsoup4-4.6.3-2.el8.1. 482 kB/s | 185 kB 00:00 2023-07-05T23:30:06.542 INFO:teuthology.orchestra.run.smithi162.stdout:(47/131): python3-cherrypy-18.4.0-1.el8.noarch. 3.8 MB/s | 384 kB 00:00 2023-07-05T23:30:06.559 INFO:teuthology.orchestra.run.smithi027.stdout:(8/131): ceph-common-18.0.0-4488.g0a781ef0.el8. 3.7 MB/s | 22 MB 00:05 2023-07-05T23:30:06.601 INFO:teuthology.orchestra.run.smithi162.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 811 kB/s | 81 kB 00:00 2023-07-05T23:30:06.643 INFO:teuthology.orchestra.run.smithi162.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 111 kB/s | 11 kB 00:00 2023-07-05T23:30:06.659 INFO:teuthology.orchestra.run.smithi027.stdout:(9/131): ceph-selinux-18.0.0-4488.g0a781ef0.el8 244 kB/s | 24 kB 00:00 2023-07-05T23:30:06.702 INFO:teuthology.orchestra.run.smithi162.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 175 kB/s | 18 kB 00:00 2023-07-05T23:30:06.802 INFO:teuthology.orchestra.run.smithi162.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 487 kB/s | 49 kB 00:00 2023-07-05T23:30:06.844 INFO:teuthology.orchestra.run.smithi162.stdout:(52/131): python3-kubernetes-11.0.0-6.el8.noarc 5.8 MB/s | 1.2 MB 00:00 2023-07-05T23:30:06.903 INFO:teuthology.orchestra.run.smithi162.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 586 kB/s | 59 kB 00:00 2023-07-05T23:30:06.945 INFO:teuthology.orchestra.run.smithi162.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 601 kB/s | 60 kB 00:00 2023-07-05T23:30:07.045 INFO:teuthology.orchestra.run.smithi162.stdout:(55/131): python3-portend-2.6-1.el8.noarch.rpm 156 kB/s | 16 kB 00:00 2023-07-05T23:30:07.070 INFO:teuthology.orchestra.run.smithi162.stdout:(56/131): python3-pecan-1.3.2-9.el8.noarch.rpm 1.7 MB/s | 283 kB 00:00 2023-07-05T23:30:07.145 INFO:teuthology.orchestra.run.smithi162.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 336 kB/s | 34 kB 00:00 2023-07-05T23:30:07.179 INFO:teuthology.orchestra.run.smithi162.stdout:(58/131): python3-routes-2.4.1-12.el8.noarch.rp 1.8 MB/s | 196 kB 00:00 2023-07-05T23:30:07.246 INFO:teuthology.orchestra.run.smithi162.stdout:(59/131): python3-rsa-4.8-1.el8.noarch.rpm 611 kB/s | 61 kB 00:00 2023-07-05T23:30:07.280 INFO:teuthology.orchestra.run.smithi162.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 187 kB/s | 19 kB 00:00 2023-07-05T23:30:07.364 INFO:teuthology.orchestra.run.smithi162.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 204 kB/s | 24 kB 00:00 2023-07-05T23:30:07.389 INFO:teuthology.orchestra.run.smithi162.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 270 kB/s | 29 kB 00:00 2023-07-05T23:30:07.464 INFO:teuthology.orchestra.run.smithi162.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 275 kB/s | 27 kB 00:00 2023-07-05T23:30:07.489 INFO:teuthology.orchestra.run.smithi162.stdout:(64/131): python3-waitress-1.4.3-1.el8.noarch.r 2.5 MB/s | 255 kB 00:00 2023-07-05T23:30:07.565 INFO:teuthology.orchestra.run.smithi162.stdout:(65/131): python3-webob-1.8.5-1.el8.1.noarch.rp 2.4 MB/s | 251 kB 00:00 2023-07-05T23:30:07.590 INFO:teuthology.orchestra.run.smithi162.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 610 kB/s | 61 kB 00:00 2023-07-05T23:30:07.665 INFO:teuthology.orchestra.run.smithi162.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 854 kB/s | 85 kB 00:00 2023-07-05T23:30:07.690 INFO:teuthology.orchestra.run.smithi162.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 229 kB/s | 23 kB 00:00 2023-07-05T23:30:07.716 INFO:teuthology.orchestra.run.smithi162.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-07-05T23:30:07.800 INFO:teuthology.orchestra.run.smithi162.stdout:(70/131): thrift-0.13.0-2.el8.x86_64.rpm 13 MB/s | 1.7 MB 00:00 2023-07-05T23:30:07.825 INFO:teuthology.orchestra.run.smithi162.stdout:(71/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 431 kB/s | 47 kB 00:00 2023-07-05T23:30:08.292 INFO:teuthology.orchestra.run.smithi162.stdout:(72/131): ceph-test-18.0.0-4488.g0a781ef0.el8.x 6.0 MB/s | 48 MB 00:07 2023-07-05T23:30:08.317 INFO:teuthology.orchestra.run.smithi162.stdout:(73/131): python3-jwt-1.6.1-2.el8.noarch.rpm 88 kB/s | 43 kB 00:00 2023-07-05T23:30:08.350 INFO:teuthology.orchestra.run.smithi162.stdout:(74/131): libselinux-devel-2.9-5.el8.x86_64.rpm 363 kB/s | 200 kB 00:00 2023-07-05T23:30:08.401 INFO:teuthology.orchestra.run.smithi162.stdout:(75/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 2.0 MB/s | 220 kB 00:00 2023-07-05T23:30:08.426 INFO:teuthology.orchestra.run.smithi162.stdout:(76/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 466 kB/s | 48 kB 00:00 2023-07-05T23:30:08.451 INFO:teuthology.orchestra.run.smithi162.stdout:(77/131): libsepol-devel-2.9-3.el8.x86_64.rpm 865 kB/s | 87 kB 00:00 2023-07-05T23:30:08.469 INFO:teuthology.orchestra.run.smithi162.stdout:(78/131): python3-requests-oauthlib-1.0.0-1.el8 637 kB/s | 43 kB 00:00 2023-07-05T23:30:08.494 INFO:teuthology.orchestra.run.smithi162.stdout:(79/131): python3-pycparser-2.14-14.el8.noarch. 1.6 MB/s | 109 kB 00:00 2023-07-05T23:30:08.527 INFO:teuthology.orchestra.run.smithi162.stdout:(80/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 3.0 MB/s | 229 kB 00:00 2023-07-05T23:30:08.561 INFO:teuthology.orchestra.run.smithi162.stdout:(81/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 279 kB/s | 19 kB 00:00 2023-07-05T23:30:08.586 INFO:teuthology.orchestra.run.smithi162.stdout:(82/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 4.7 MB/s | 560 kB 00:00 2023-07-05T23:30:08.611 INFO:teuthology.orchestra.run.smithi162.stdout:(83/131): python3-oauthlib-2.1.0-1.el8.noarch.r 1.8 MB/s | 155 kB 00:00 2023-07-05T23:30:08.653 INFO:teuthology.orchestra.run.smithi162.stdout:(84/131): python3-cryptography-3.2.1-5.el8.x86_ 5.9 MB/s | 559 kB 00:00 2023-07-05T23:30:08.687 INFO:teuthology.orchestra.run.smithi162.stdout:(85/131): pcre2-devel-10.32-2.el8.x86_64.rpm 7.9 MB/s | 605 kB 00:00 2023-07-05T23:30:08.712 INFO:teuthology.orchestra.run.smithi162.stdout:(86/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 142 kB/s | 18 kB 00:00 2023-07-05T23:30:08.788 INFO:teuthology.orchestra.run.smithi162.stdout:(87/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 23 MB/s | 2.3 MB 00:00 2023-07-05T23:30:08.813 INFO:teuthology.orchestra.run.smithi162.stdout:(88/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 721 kB/s | 72 kB 00:00 2023-07-05T23:30:08.838 INFO:teuthology.orchestra.run.smithi162.stdout:(89/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 1.3 MB/s | 238 kB 00:00 2023-07-05T23:30:08.864 INFO:teuthology.orchestra.run.smithi162.stdout:(90/131): fuse-2.9.7-15.el8.x86_64.rpm 1.1 MB/s | 83 kB 00:00 2023-07-05T23:30:08.897 INFO:teuthology.orchestra.run.smithi162.stdout:(91/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 1.6 MB/s | 98 kB 00:00 2023-07-05T23:30:08.922 INFO:teuthology.orchestra.run.smithi162.stdout:(92/131): elfutils-libelf-devel-0.186-1.el8.x86 548 kB/s | 60 kB 00:00 2023-07-05T23:30:08.947 INFO:teuthology.orchestra.run.smithi162.stdout:(93/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 688 kB/s | 58 kB 00:00 2023-07-05T23:30:08.973 INFO:teuthology.orchestra.run.smithi162.stdout:(94/131): libcom_err-devel-1.45.6-4.el8.x86_64. 513 kB/s | 39 kB 00:00 2023-07-05T23:30:09.048 INFO:teuthology.orchestra.run.smithi162.stdout:(95/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 6.3 MB/s | 644 kB 00:00 2023-07-05T23:30:09.073 INFO:teuthology.orchestra.run.smithi162.stdout:(96/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 1.3 MB/s | 171 kB 00:00 2023-07-05T23:30:09.099 INFO:teuthology.orchestra.run.smithi162.stdout:(97/131): NetworkManager-initscripts-updown-1.3 1.1 MB/s | 138 kB 00:00 2023-07-05T23:30:09.124 INFO:teuthology.orchestra.run.smithi162.stdout:(98/131): python3-pyasn1-modules-0.3.7-6.el8.no 2.1 MB/s | 110 kB 00:00 2023-07-05T23:30:09.141 INFO:teuthology.orchestra.run.smithi162.stdout:(99/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.3 MB/s | 54 kB 00:00 2023-07-05T23:30:09.200 INFO:teuthology.orchestra.run.smithi162.stdout:(100/131): socat-1.7.4.1-1.el8.x86_64.rpm 5.4 MB/s | 323 kB 00:00 2023-07-05T23:30:09.225 INFO:teuthology.orchestra.run.smithi162.stdout:(101/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.5 MB/s | 259 kB 00:00 2023-07-05T23:30:09.234 INFO:teuthology.orchestra.run.smithi027.stdout:(10/131): ceph-radosgw-18.0.0-4488.g0a781ef0.el 3.4 MB/s | 13 MB 00:03 2023-07-05T23:30:09.292 INFO:teuthology.orchestra.run.smithi162.stdout:(102/131): bison-3.0.4-10.el8.x86_64.rpm 10 MB/s | 688 kB 00:00 2023-07-05T23:30:09.317 INFO:teuthology.orchestra.run.smithi162.stdout:(103/131): python3-markupsafe-0.23-19.el8.x86_6 331 kB/s | 39 kB 00:00 2023-07-05T23:30:09.359 INFO:teuthology.orchestra.run.smithi162.stdout:(104/131): python3-jinja2-2.10.1-3.el8.noarch.r 7.9 MB/s | 538 kB 00:00 2023-07-05T23:30:09.384 INFO:teuthology.orchestra.run.smithi162.stdout:(105/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.3 MB/s | 157 kB 00:00 2023-07-05T23:30:09.426 INFO:teuthology.orchestra.run.smithi162.stdout:(106/131): oniguruma-6.8.2-2.el8.x86_64.rpm 2.7 MB/s | 187 kB 00:00 2023-07-05T23:30:09.460 INFO:teuthology.orchestra.run.smithi162.stdout:(107/131): automake-1.16.1-7.el8.noarch.rpm 9.3 MB/s | 713 kB 00:00 2023-07-05T23:30:09.516 INFO:teuthology.orchestra.run.smithi027.stdout:(11/131): cephfs-mirror-18.0.0-4488.g0a781ef0.e 916 kB/s | 258 kB 00:00 2023-07-05T23:30:09.518 INFO:teuthology.orchestra.run.smithi162.stdout:(108/131): python3-jsonpatch-1.21-2.el8.noarch. 455 kB/s | 27 kB 00:00 2023-07-05T23:30:09.577 INFO:teuthology.orchestra.run.smithi027.stdout:(12/131): libcephfs-devel-18.0.0-4488.g0a781ef0 518 kB/s | 31 kB 00:00 2023-07-05T23:30:09.660 INFO:teuthology.orchestra.run.smithi162.stdout:(109/131): python3-scipy-1.0.0-21.module+el8.5. 22 MB/s | 14 MB 00:00 2023-07-05T23:30:09.694 INFO:teuthology.orchestra.run.smithi162.stdout:(110/131): flex-2.6.1-9.el8.x86_64.rpm 1.8 MB/s | 320 kB 00:00 2023-07-05T23:30:09.828 INFO:teuthology.orchestra.run.smithi027.stdout:(13/131): ceph-osd-18.0.0-4488.g0a781ef0.el8.x8 3.2 MB/s | 18 MB 00:05 2023-07-05T23:30:09.861 INFO:teuthology.orchestra.run.smithi027.stdout:(14/131): libcephfs2-18.0.0-4488.g0a781ef0.el8. 2.7 MB/s | 771 kB 00:00 2023-07-05T23:30:09.911 INFO:teuthology.orchestra.run.smithi027.stdout:(15/131): librados-devel-18.0.0-4488.g0a781ef0. 2.7 MB/s | 139 kB 00:00 2023-07-05T23:30:09.936 INFO:teuthology.orchestra.run.smithi162.stdout:(111/131): python3-babel-2.5.1-7.el8.noarch.rpm 9.4 MB/s | 4.8 MB 00:00 2023-07-05T23:30:10.003 INFO:teuthology.orchestra.run.smithi027.stdout:(16/131): libradosstriper1-18.0.0-4488.g0a781ef 5.0 MB/s | 473 kB 00:00 2023-07-05T23:30:10.036 INFO:teuthology.orchestra.run.smithi162.stdout:(112/131): python3-prettytable-0.7.2-14.el8.noa 117 kB/s | 44 kB 00:00 2023-07-05T23:30:10.070 INFO:teuthology.orchestra.run.smithi162.stdout:(113/131): python3-werkzeug-0.12.2-4.el8.noarch 3.3 MB/s | 457 kB 00:00 2023-07-05T23:30:10.154 INFO:teuthology.orchestra.run.smithi162.stdout:(114/131): python3-numpy-1.14.3-10.el8.x86_64.r 8.1 MB/s | 3.7 MB 00:00 2023-07-05T23:30:10.187 INFO:teuthology.orchestra.run.smithi162.stdout:(115/131): python3-numpy-f2py-1.14.3-10.el8.x86 1.5 MB/s | 225 kB 00:00 2023-07-05T23:30:10.204 INFO:teuthology.orchestra.run.smithi162.stdout:(116/131): uuid-1.6.2-43.el8.x86_64.rpm 478 kB/s | 64 kB 00:00 2023-07-05T23:30:10.296 INFO:teuthology.orchestra.run.smithi162.stdout:(117/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 889 kB/s | 126 kB 00:00 2023-07-05T23:30:10.313 INFO:teuthology.orchestra.run.smithi162.stdout:(118/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 953 kB/s | 103 kB 00:00 2023-07-05T23:30:10.338 INFO:teuthology.orchestra.run.smithi162.stdout:(119/131): python3-jsonpointer-1.10-11.el8.noar 133 kB/s | 20 kB 00:00 2023-07-05T23:30:10.447 INFO:teuthology.orchestra.run.smithi162.stdout:(120/131): libtool-2.4.6-25.el8.x86_64.rpm 4.6 MB/s | 709 kB 00:00 2023-07-05T23:30:10.472 INFO:teuthology.orchestra.run.smithi162.stdout:(121/131): libpq-13.5-1.el8.x86_64.rpm 1.4 MB/s | 198 kB 00:00 2023-07-05T23:30:10.581 INFO:teuthology.orchestra.run.smithi162.stdout:(122/131): openblas-threads-0.3.15-3.el8.x86_64 18 MB/s | 4.9 MB 00:00 2023-07-05T23:30:10.606 INFO:teuthology.orchestra.run.smithi162.stdout:(123/131): jq-1.6-3.el8.x86_64.rpm 1.5 MB/s | 202 kB 00:00 2023-07-05T23:30:10.628 INFO:teuthology.orchestra.run.smithi027.stdout:(17/131): libcephsqlite-18.0.0-4488.g0a781ef0.e 171 kB/s | 137 kB 00:00 2023-07-05T23:30:10.704 INFO:teuthology.orchestra.run.smithi027.stdout:(18/131): python3-ceph-argparse-18.0.0-4488.g0a 597 kB/s | 45 kB 00:00 2023-07-05T23:30:10.706 INFO:teuthology.orchestra.run.smithi162.stdout:(124/131): openblas-0.3.15-3.el8.x86_64.rpm 18 MB/s | 4.7 MB 00:00 2023-07-05T23:30:10.732 INFO:teuthology.orchestra.run.smithi162.stdout:(125/131): librdkafka-0.11.4-3.el8.x86_64.rpm 2.3 MB/s | 354 kB 00:00 2023-07-05T23:30:10.782 INFO:teuthology.orchestra.run.smithi162.stdout:(126/131): postgresql-contrib-10.21-2.module+el 11 MB/s | 808 kB 00:00 2023-07-05T23:30:10.829 INFO:teuthology.orchestra.run.smithi027.stdout:(19/131): librgw2-18.0.0-4488.g0a781ef0.el8.x86 8.2 MB/s | 6.7 MB 00:00 2023-07-05T23:30:10.832 INFO:teuthology.orchestra.run.smithi162.stdout:(127/131): postgresql-10.21-2.module+el8.6.0+15 15 MB/s | 1.5 MB 00:00 2023-07-05T23:30:10.854 INFO:teuthology.orchestra.run.smithi027.stdout:(20/131): python3-ceph-common-18.0.0-4488.g0a78 791 kB/s | 119 kB 00:00 2023-07-05T23:30:10.896 INFO:teuthology.orchestra.run.smithi027.stdout:(21/131): python3-cephfs-18.0.0-4488.g0a781ef0. 2.9 MB/s | 197 kB 00:00 2023-07-05T23:30:10.907 INFO:teuthology.orchestra.run.smithi162.stdout:(128/131): postgresql-server-10.21-2.module+el8 17 MB/s | 5.1 MB 00:00 2023-07-05T23:30:11.005 INFO:teuthology.orchestra.run.smithi027.stdout:(22/131): python3-rados-18.0.0-4488.g0a781ef0.e 2.4 MB/s | 371 kB 00:00 2023-07-05T23:30:11.030 INFO:teuthology.orchestra.run.smithi027.stdout:(23/131): python3-rbd-18.0.0-4488.g0a781ef0.el8 2.7 MB/s | 364 kB 00:00 2023-07-05T23:30:11.058 INFO:teuthology.orchestra.run.smithi162.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 5.2 MB/s | 798 kB 00:00 2023-07-05T23:30:11.089 INFO:teuthology.orchestra.run.smithi027.stdout:(24/131): python3-rgw-18.0.0-4488.g0a781ef0.el8 1.2 MB/s | 107 kB 00:00 2023-07-05T23:30:11.114 INFO:teuthology.orchestra.run.smithi027.stdout:(25/131): rbd-fuse-18.0.0-4488.g0a781ef0.el8.x8 1.1 MB/s | 94 kB 00:00 2023-07-05T23:30:11.206 INFO:teuthology.orchestra.run.smithi027.stdout:(26/131): rbd-nbd-18.0.0-4488.g0a781ef0.el8.x86 1.9 MB/s | 180 kB 00:00 2023-07-05T23:30:11.298 INFO:teuthology.orchestra.run.smithi027.stdout:(27/131): ceph-grafana-dashboards-18.0.0-4488.g 251 kB/s | 23 kB 00:00 2023-07-05T23:30:11.390 INFO:teuthology.orchestra.run.smithi027.stdout:(28/131): ceph-mgr-cephadm-18.0.0-4488.g0a781ef 1.4 MB/s | 128 kB 00:00 2023-07-05T23:30:11.616 INFO:teuthology.orchestra.run.smithi162.stdout:(130/131): librados2-18.0.0-4488.g0a781ef0.el8. 4.4 MB/s | 3.7 MB 00:00 2023-07-05T23:30:11.898 INFO:teuthology.orchestra.run.smithi027.stdout:(29/131): ceph-mgr-dashboard-18.0.0-4488.g0a781 3.4 MB/s | 1.7 MB 00:00 2023-07-05T23:30:11.975 INFO:teuthology.orchestra.run.smithi162.stdout:(131/131): librbd1-18.0.0-4488.g0a781ef0.el8.x8 3.1 MB/s | 3.6 MB 00:01 2023-07-05T23:30:11.977 INFO:teuthology.orchestra.run.smithi162.stdout:-------------------------------------------------------------------------------- 2023-07-05T23:30:11.978 INFO:teuthology.orchestra.run.smithi162.stdout:Total 13 MB/s | 205 MB 00:15 2023-07-05T23:30:12.232 INFO:teuthology.orchestra.run.smithi027.stdout:(30/131): rbd-mirror-18.0.0-4488.g0a781ef0.el8. 3.0 MB/s | 3.4 MB 00:01 2023-07-05T23:30:12.324 INFO:teuthology.orchestra.run.smithi027.stdout:(31/131): ceph-mgr-modules-core-18.0.0-4488.g0a 2.6 MB/s | 240 kB 00:00 2023-07-05T23:30:12.408 INFO:teuthology.orchestra.run.smithi027.stdout:(32/131): ceph-mgr-rook-18.0.0-4488.g0a781ef0.e 569 kB/s | 47 kB 00:00 2023-07-05T23:30:12.491 INFO:teuthology.orchestra.run.smithi027.stdout:(33/131): ceph-prometheus-alerts-18.0.0-4488.g0 174 kB/s | 15 kB 00:00 2023-07-05T23:30:12.683 INFO:teuthology.orchestra.run.smithi027.stdout:(34/131): ceph-volume-18.0.0-4488.g0a781ef0.el8 1.3 MB/s | 258 kB 00:00 2023-07-05T23:30:12.775 INFO:teuthology.orchestra.run.smithi027.stdout:(35/131): cephadm-18.0.0-4488.g0a781ef0.el8.noa 1.7 MB/s | 161 kB 00:00 2023-07-05T23:30:12.825 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction check 2023-07-05T23:30:12.859 INFO:teuthology.orchestra.run.smithi027.stdout:(36/131): cephfs-top-18.0.0-4488.g0a781ef0.el8. 216 kB/s | 18 kB 00:00 2023-07-05T23:30:12.946 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction check succeeded. 2023-07-05T23:30:12.947 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction test 2023-07-05T23:30:13.159 INFO:teuthology.orchestra.run.smithi027.stdout:(37/131): gperftools-libs-2.7-9.el8.x86_64.rpm 1.0 MB/s | 306 kB 00:00 2023-07-05T23:30:13.226 INFO:teuthology.orchestra.run.smithi027.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 883 kB/s | 59 kB 00:00 2023-07-05T23:30:13.318 INFO:teuthology.orchestra.run.smithi027.stdout:(39/131): ceph-mgr-diskprediction-local-18.0.0- 5.2 MB/s | 7.4 MB 00:01 2023-07-05T23:30:13.343 INFO:teuthology.orchestra.run.smithi027.stdout:(40/131): libunwind-1.3.1-3.el8.x86_64.rpm 642 kB/s | 75 kB 00:00 2023-07-05T23:30:13.427 INFO:teuthology.orchestra.run.smithi027.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 524 kB/s | 44 kB 00:00 2023-07-05T23:30:13.502 INFO:teuthology.orchestra.run.smithi027.stdout:(42/131): python3-beautifulsoup4-4.6.3-2.el8.1. 2.4 MB/s | 185 kB 00:00 2023-07-05T23:30:13.594 INFO:teuthology.orchestra.run.smithi027.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 360 kB/s | 33 kB 00:00 2023-07-05T23:30:13.670 INFO:teuthology.orchestra.run.smithi027.stdout:(44/131): python3-certifi-2018.10.15-7.el8.noar 217 kB/s | 16 kB 00:00 2023-07-05T23:30:13.695 INFO:teuthology.orchestra.run.smithi027.stdout:(45/131): python3-asyncssh-2.7.0-2.el8.noarch.r 1.2 MB/s | 476 kB 00:00 2023-07-05T23:30:13.737 INFO:teuthology.orchestra.run.smithi027.stdout:(46/131): python3-cheroot-8.5.2-1.el8.noarch.rp 2.5 MB/s | 173 kB 00:00 2023-07-05T23:30:13.770 INFO:teuthology.orchestra.run.smithi027.stdout:(47/131): python3-cherrypy-18.4.0-1.el8.noarch. 5.0 MB/s | 384 kB 00:00 2023-07-05T23:30:13.804 INFO:teuthology.orchestra.run.smithi027.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 1.2 MB/s | 81 kB 00:00 2023-07-05T23:30:13.829 INFO:teuthology.orchestra.run.smithi027.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 189 kB/s | 11 kB 00:00 2023-07-05T23:30:13.863 INFO:teuthology.orchestra.run.smithi027.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 300 kB/s | 18 kB 00:00 2023-07-05T23:30:14.064 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction test succeeded. 2023-07-05T23:30:14.068 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction 2023-07-05T23:30:14.313 INFO:teuthology.orchestra.run.smithi027.stdout:(51/131): ceph-test-18.0.0-4488.g0a781ef0.el8.x 6.2 MB/s | 48 MB 00:07 2023-07-05T23:30:14.339 INFO:teuthology.orchestra.run.smithi027.stdout:(52/131): python3-logutils-0.3.5-11.el8.noarch. 102 kB/s | 49 kB 00:00 2023-07-05T23:30:14.372 INFO:teuthology.orchestra.run.smithi027.stdout:(53/131): python3-kubernetes-11.0.0-6.el8.noarc 2.1 MB/s | 1.2 MB 00:00 2023-07-05T23:30:14.406 INFO:teuthology.orchestra.run.smithi027.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 899 kB/s | 60 kB 00:00 2023-07-05T23:30:14.448 INFO:teuthology.orchestra.run.smithi027.stdout:(55/131): python3-pecan-1.3.2-9.el8.noarch.rpm 3.7 MB/s | 283 kB 00:00 2023-07-05T23:30:14.473 INFO:teuthology.orchestra.run.smithi027.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 233 kB/s | 16 kB 00:00 2023-07-05T23:30:14.515 INFO:teuthology.orchestra.run.smithi027.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 503 kB/s | 34 kB 00:00 2023-07-05T23:30:14.540 INFO:teuthology.orchestra.run.smithi027.stdout:(58/131): python3-more-itertools-7.2.0-3.el8.no 259 kB/s | 59 kB 00:00 2023-07-05T23:30:14.582 INFO:teuthology.orchestra.run.smithi027.stdout:(59/131): python3-rsa-4.8-1.el8.noarch.rpm 918 kB/s | 61 kB 00:00 2023-07-05T23:30:14.608 INFO:teuthology.orchestra.run.smithi027.stdout:(60/131): python3-routes-2.4.1-12.el8.noarch.rp 1.4 MB/s | 196 kB 00:00 2023-07-05T23:30:14.633 INFO:teuthology.orchestra.run.smithi027.stdout:(61/131): python3-simplegeneric-0.8.1-17.el8.no 203 kB/s | 19 kB 00:00 2023-07-05T23:30:14.687 INFO:teuthology.orchestra.run.smithi027.stdout:(62/131): python3-singledispatch-3.4.0.3-18.el8 228 kB/s | 24 kB 00:00 2023-07-05T23:30:14.717 INFO:teuthology.orchestra.run.smithi027.stdout:(63/131): python3-tempora-1.14.1-5.el8.noarch.r 268 kB/s | 29 kB 00:00 2023-07-05T23:30:14.742 INFO:teuthology.orchestra.run.smithi027.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 253 kB/s | 27 kB 00:00 2023-07-05T23:30:14.767 INFO:teuthology.orchestra.run.smithi027.stdout:(65/131): python3-waitress-1.4.3-1.el8.noarch.r 3.1 MB/s | 255 kB 00:00 2023-07-05T23:30:14.817 INFO:teuthology.orchestra.run.smithi027.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 818 kB/s | 61 kB 00:00 2023-07-05T23:30:14.843 INFO:teuthology.orchestra.run.smithi027.stdout:(67/131): python3-webob-1.8.5-1.el8.1.noarch.rp 2.4 MB/s | 251 kB 00:00 2023-07-05T23:30:14.868 INFO:teuthology.orchestra.run.smithi027.stdout:(68/131): python3-webtest-2.0.33-1.el8.noarch.r 851 kB/s | 85 kB 00:00 2023-07-05T23:30:14.893 INFO:teuthology.orchestra.run.smithi027.stdout:(69/131): python3-zc-lockfile-2.0-2.el8.noarch. 304 kB/s | 23 kB 00:00 2023-07-05T23:30:14.977 INFO:teuthology.orchestra.run.smithi027.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 641 kB/s | 70 kB 00:00 2023-07-05T23:30:15.078 INFO:teuthology.orchestra.run.smithi027.stdout:(71/131): thrift-0.13.0-2.el8.x86_64.rpm 7.4 MB/s | 1.7 MB 00:00 2023-07-05T23:30:15.094 INFO:teuthology.orchestra.run.smithi027.stdout:(72/131): python3-pyasn1-modules-0.3.7-6.el8.no 1.0 MB/s | 110 kB 00:00 2023-07-05T23:30:15.161 INFO:teuthology.orchestra.run.smithi027.stdout:(73/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 4.3 MB/s | 259 kB 00:00 2023-07-05T23:30:15.187 INFO:teuthology.orchestra.run.smithi027.stdout:(74/131): python3-pytz-2017.2-9.el8.noarch.rpm 499 kB/s | 54 kB 00:00 2023-07-05T23:30:15.228 INFO:teuthology.orchestra.run.smithi027.stdout:(75/131): socat-1.7.4.1-1.el8.x86_64.rpm 4.7 MB/s | 323 kB 00:00 2023-07-05T23:30:15.254 INFO:teuthology.orchestra.run.smithi027.stdout:(76/131): python3-markupsafe-0.23-19.el8.x86_64 580 kB/s | 39 kB 00:00 2023-07-05T23:30:15.312 INFO:teuthology.orchestra.run.smithi027.stdout:(77/131): bison-3.0.4-10.el8.x86_64.rpm 8.0 MB/s | 688 kB 00:00 2023-07-05T23:30:15.346 INFO:teuthology.orchestra.run.smithi027.stdout:(78/131): python3-jinja2-2.10.1-3.el8.noarch.rp 5.7 MB/s | 538 kB 00:00 2023-07-05T23:30:15.371 INFO:teuthology.orchestra.run.smithi027.stdout:(79/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2023-07-05T23:30:15.405 INFO:teuthology.orchestra.run.smithi027.stdout:(80/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.1 MB/s | 187 kB 00:00 2023-07-05T23:30:15.489 INFO:teuthology.orchestra.run.smithi027.stdout:(81/131): automake-1.16.1-7.el8.noarch.rpm 6.0 MB/s | 713 kB 00:00 2023-07-05T23:30:15.547 INFO:teuthology.orchestra.run.smithi027.stdout:(82/131): python3-jsonpatch-1.21-2.el8.noarch.r 456 kB/s | 27 kB 00:00 2023-07-05T23:30:15.722 INFO:teuthology.orchestra.run.smithi027.stdout:(83/131): python3-scipy-1.0.0-21.module+el8.5.0 17 MB/s | 14 MB 00:00 2023-07-05T23:30:15.756 INFO:teuthology.orchestra.run.smithi027.stdout:(84/131): flex-2.6.1-9.el8.x86_64.rpm 1.5 MB/s | 320 kB 00:00 2023-07-05T23:30:15.840 INFO:teuthology.orchestra.run.smithi027.stdout:(85/131): python3-babel-2.5.1-7.el8.noarch.rpm 11 MB/s | 4.8 MB 00:00 2023-07-05T23:30:15.865 INFO:teuthology.orchestra.run.smithi027.stdout:(86/131): python3-prettytable-0.7.2-14.el8.noar 309 kB/s | 44 kB 00:00 2023-07-05T23:30:15.899 INFO:teuthology.orchestra.run.smithi027.stdout:(87/131): python3-werkzeug-0.12.2-4.el8.noarch. 7.6 MB/s | 457 kB 00:00 2023-07-05T23:30:15.924 INFO:teuthology.orchestra.run.smithi027.stdout:(88/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 3.8 MB/s | 225 kB 00:00 2023-07-05T23:30:15.949 INFO:teuthology.orchestra.run.smithi027.stdout:(89/131): uuid-1.6.2-43.el8.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2023-07-05T23:30:15.974 INFO:teuthology.orchestra.run.smithi027.stdout:(90/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.4 MB/s | 126 kB 00:00 2023-07-05T23:30:15.999 INFO:teuthology.orchestra.run.smithi027.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 399 kB/s | 20 kB 00:00 2023-07-05T23:30:16.025 INFO:teuthology.orchestra.run.smithi027.stdout:(92/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.0 MB/s | 103 kB 00:00 2023-07-05T23:30:16.058 INFO:teuthology.orchestra.run.smithi027.stdout:(93/131): libtool-2.4.6-25.el8.x86_64.rpm 12 MB/s | 709 kB 00:00 2023-07-05T23:30:16.142 INFO:teuthology.orchestra.run.smithi027.stdout:(94/131): python3-numpy-1.14.3-10.el8.x86_64.rp 9.7 MB/s | 3.7 MB 00:00 2023-07-05T23:30:16.167 INFO:teuthology.orchestra.run.smithi027.stdout:(95/131): libpq-13.5-1.el8.x86_64.rpm 1.8 MB/s | 198 kB 00:00 2023-07-05T23:30:16.226 INFO:teuthology.orchestra.run.smithi027.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 3.4 MB/s | 202 kB 00:00 2023-07-05T23:30:16.326 INFO:teuthology.orchestra.run.smithi027.stdout:(97/131): openblas-threads-0.3.15-3.el8.x86_64. 16 MB/s | 4.9 MB 00:00 2023-07-05T23:30:16.360 INFO:teuthology.orchestra.run.smithi027.stdout:(98/131): librdkafka-0.11.4-3.el8.x86_64.rpm 2.6 MB/s | 354 kB 00:00 2023-07-05T23:30:16.435 INFO:teuthology.orchestra.run.smithi027.stdout:(99/131): openblas-0.3.15-3.el8.x86_64.rpm 16 MB/s | 4.7 MB 00:00 2023-07-05T23:30:16.477 INFO:teuthology.orchestra.run.smithi027.stdout:(100/131): postgresql-contrib-10.21-2.module+el 6.7 MB/s | 808 kB 00:00 2023-07-05T23:30:16.536 INFO:teuthology.orchestra.run.smithi027.stdout:(101/131): postgresql-10.21-2.module+el8.6.0+15 15 MB/s | 1.5 MB 00:00 2023-07-05T23:30:16.561 INFO:teuthology.orchestra.run.smithi027.stdout:(102/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 559 kB/s | 47 kB 00:00 2023-07-05T23:30:16.586 INFO:teuthology.orchestra.run.smithi027.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 3.9 MB/s | 200 kB 00:00 2023-07-05T23:30:16.662 INFO:teuthology.orchestra.run.smithi027.stdout:(104/131): postgresql-server-10.21-2.module+el8 15 MB/s | 5.1 MB 00:00 2023-07-05T23:30:16.687 INFO:teuthology.orchestra.run.smithi027.stdout:(105/131): python3-jwt-1.6.1-2.el8.noarch.rpm 339 kB/s | 43 kB 00:00 2023-07-05T23:30:16.734 INFO:teuthology.orchestra.run.smithi027.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 673 kB/s | 48 kB 00:00 2023-07-05T23:30:16.763 INFO:teuthology.orchestra.run.smithi027.stdout:(107/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.1 MB/s | 87 kB 00:00 2023-07-05T23:30:16.788 INFO:teuthology.orchestra.run.smithi027.stdout:(108/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.1 MB/s | 220 kB 00:00 2023-07-05T23:30:16.813 INFO:teuthology.orchestra.run.smithi027.stdout:(109/131): python3-requests-oauthlib-1.0.0-1.el 538 kB/s | 43 kB 00:00 2023-07-05T23:30:16.839 INFO:teuthology.orchestra.run.smithi027.stdout:(110/131): python3-pycparser-2.14-14.el8.noarch 1.4 MB/s | 109 kB 00:00 2023-07-05T23:30:16.864 INFO:teuthology.orchestra.run.smithi027.stdout:(111/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 3.0 MB/s | 229 kB 00:00 2023-07-05T23:30:16.906 INFO:teuthology.orchestra.run.smithi027.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 279 kB/s | 19 kB 00:00 2023-07-05T23:30:16.931 INFO:teuthology.orchestra.run.smithi027.stdout:(113/131): python3-oauthlib-2.1.0-1.el8.noarch. 2.3 MB/s | 155 kB 00:00 2023-07-05T23:30:16.973 INFO:teuthology.orchestra.run.smithi027.stdout:(114/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 3.4 MB/s | 560 kB 00:00 2023-07-05T23:30:16.990 INFO:teuthology.orchestra.run.smithi027.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 305 kB/s | 18 kB 00:00 2023-07-05T23:30:17.023 INFO:teuthology.orchestra.run.smithi027.stdout:(116/131): python3-cryptography-3.2.1-5.el8.x86 4.6 MB/s | 559 kB 00:00 2023-07-05T23:30:17.049 INFO:teuthology.orchestra.run.smithi027.stdout:(117/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 4.0 MB/s | 238 kB 00:00 2023-07-05T23:30:17.082 INFO:teuthology.orchestra.run.smithi027.stdout:(118/131): pcre2-devel-10.32-2.el8.x86_64.rpm 5.4 MB/s | 605 kB 00:00 2023-07-05T23:30:17.108 INFO:teuthology.orchestra.run.smithi027.stdout:(119/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 1.2 MB/s | 72 kB 00:00 2023-07-05T23:30:17.133 INFO:teuthology.orchestra.run.smithi027.stdout:(120/131): fuse-2.9.7-15.el8.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2023-07-05T23:30:17.200 INFO:teuthology.orchestra.run.smithi027.stdout:(121/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 13 MB/s | 2.3 MB 00:00 2023-07-05T23:30:17.225 INFO:teuthology.orchestra.run.smithi027.stdout:(122/131): elfutils-libelf-devel-0.186-1.el8.x8 511 kB/s | 60 kB 00:00 2023-07-05T23:30:17.250 INFO:teuthology.orchestra.run.smithi027.stdout:(123/131): libuuid-devel-2.32.1-35.el8.x86_64.r 838 kB/s | 98 kB 00:00 2023-07-05T23:30:17.276 INFO:teuthology.orchestra.run.smithi027.stdout:(124/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 762 kB/s | 58 kB 00:00 2023-07-05T23:30:17.301 INFO:teuthology.orchestra.run.smithi027.stdout:(125/131): libcom_err-devel-1.45.6-4.el8.x86_64 510 kB/s | 39 kB 00:00 2023-07-05T23:30:17.326 INFO:teuthology.orchestra.run.smithi027.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 3.3 MB/s | 171 kB 00:00 2023-07-05T23:30:17.368 INFO:teuthology.orchestra.run.smithi027.stdout:(127/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 5.3 MB/s | 644 kB 00:00 2023-07-05T23:30:17.393 INFO:teuthology.orchestra.run.smithi027.stdout:(128/131): NetworkManager-initscripts-updown-1. 1.5 MB/s | 138 kB 00:00 2023-07-05T23:30:17.460 INFO:teuthology.orchestra.run.smithi027.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 12 MB/s | 798 kB 00:00 2023-07-05T23:30:17.786 INFO:teuthology.orchestra.run.smithi027.stdout:(130/131): librbd1-18.0.0-4488.g0a781ef0.el8.x8 8.5 MB/s | 3.6 MB 00:00 2023-07-05T23:30:19.170 INFO:teuthology.orchestra.run.smithi162.stdout: Preparing : 1/1 2023-07-05T23:30:19.236 INFO:teuthology.orchestra.run.smithi027.stdout:(131/131): librados2-18.0.0-4488.g0a781ef0.el8. 1.9 MB/s | 3.7 MB 00:01 2023-07-05T23:30:19.239 INFO:teuthology.orchestra.run.smithi027.stdout:-------------------------------------------------------------------------------- 2023-07-05T23:30:19.239 INFO:teuthology.orchestra.run.smithi027.stdout:Total 11 MB/s | 205 MB 00:18 2023-07-05T23:30:19.330 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-07-05T23:30:19.497 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-07-05T23:30:19.658 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-07-05T23:30:19.795 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-07-05T23:30:19.991 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-07-05T23:30:20.104 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction check 2023-07-05T23:30:20.235 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction check succeeded. 2023-07-05T23:30:20.236 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction test 2023-07-05T23:30:20.396 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-07-05T23:30:20.640 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : librados2-2:18.0.0-4488.g0a781ef0.el8.x86_64 5/134 2023-07-05T23:30:21.044 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librados2-2:18.0.0-4488.g0a781ef0.el8.x86_64 5/134 2023-07-05T23:30:21.415 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction test succeeded. 2023-07-05T23:30:21.420 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction 2023-07-05T23:30:21.515 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : librbd1-2:18.0.0-4488.g0a781ef0.el8.x86_64 6/134 2023-07-05T23:30:21.642 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librbd1-2:18.0.0-4488.g0a781ef0.el8.x86_64 6/134 2023-07-05T23:30:21.824 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libcephfs2-2:18.0.0-4488.g0a781ef0.el8.x86_64 7/134 2023-07-05T23:30:21.921 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libcephfs2-2:18.0.0-4488.g0a781ef0.el8.x86_64 7/134 2023-07-05T23:30:22.112 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rados-2:18.0.0-4488.g0a781ef0.el8.x86_64 8/134 2023-07-05T23:30:22.292 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-07-05T23:30:22.527 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-07-05T23:30:22.753 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-07-05T23:30:23.184 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-07-05T23:30:23.402 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-07-05T23:30:23.615 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libcephsqlite-2:18.0.0-4488.g0a781ef0.el8.x86_64 14/134 2023-07-05T23:30:23.719 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libcephsqlite-2:18.0.0-4488.g0a781ef0.el8.x86_64 14/134 2023-07-05T23:30:23.881 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libradosstriper1-2:18.0.0-4488.g0a781ef0.el8.x86 15/134 2023-07-05T23:30:24.030 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libradosstriper1-2:18.0.0-4488.g0a781ef0.el8.x86 15/134 2023-07-05T23:30:24.202 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-07-05T23:30:24.395 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-07-05T23:30:24.584 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-07-05T23:30:24.723 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-07-05T23:30:24.867 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-07-05T23:30:24.989 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-07-05T23:30:25.603 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-07-05T23:30:25.773 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-07-05T23:30:26.291 INFO:teuthology.orchestra.run.smithi027.stdout: Preparing : 1/1 2023-07-05T23:30:26.370 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-07-05T23:30:26.455 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-07-05T23:30:26.547 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-07-05T23:30:26.621 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-07-05T23:30:26.816 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-07-05T23:30:27.020 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-07-05T23:30:27.145 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-07-05T23:30:27.259 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-07-05T23:30:27.345 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-07-05T23:30:27.554 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-07-05T23:30:27.729 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-07-05T23:30:27.773 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-07-05T23:30:27.932 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-07-05T23:30:28.003 INFO:teuthology.orchestra.run.smithi027.stdout: Upgrading : librados2-2:18.0.0-4488.g0a781ef0.el8.x86_64 6/134 2023-07-05T23:30:28.062 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-ceph-common-2:18.0.0-4488.g0a781ef0.el8. 26/134 2023-07-05T23:30:28.183 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-ceph-argparse-2:18.0.0-4488.g0a781ef0.el 27/134 2023-07-05T23:30:28.407 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: librados2-2:18.0.0-4488.g0a781ef0.el8.x86_64 6/134 2023-07-05T23:30:28.418 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cephfs-2:18.0.0-4488.g0a781ef0.el8.x86_6 28/134 2023-07-05T23:30:28.589 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-07-05T23:30:28.595 INFO:teuthology.orchestra.run.smithi027.stdout: Upgrading : librbd1-2:18.0.0-4488.g0a781ef0.el8.x86_64 7/134 2023-07-05T23:30:28.725 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: librbd1-2:18.0.0-4488.g0a781ef0.el8.x86_64 7/134 2023-07-05T23:30:28.894 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libcephfs2-2:18.0.0-4488.g0a781ef0.el8.x86_64 8/134 2023-07-05T23:30:28.995 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: libcephfs2-2:18.0.0-4488.g0a781ef0.el8.x86_64 8/134 2023-07-05T23:30:29.187 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-rados-2:18.0.0-4488.g0a781ef0.el8.x86_64 9/134 2023-07-05T23:30:29.445 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-07-05T23:30:29.648 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-07-05T23:30:30.156 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-07-05T23:30:30.355 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-07-05T23:30:30.374 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-07-05T23:30:30.544 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libcephsqlite-2:18.0.0-4488.g0a781ef0.el8.x86_64 14/134 2023-07-05T23:30:30.635 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: libcephsqlite-2:18.0.0-4488.g0a781ef0.el8.x86_64 14/134 2023-07-05T23:30:30.794 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libradosstriper1-2:18.0.0-4488.g0a781ef0.el8.x86 15/134 2023-07-05T23:30:30.881 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: libradosstriper1-2:18.0.0-4488.g0a781ef0.el8.x86 15/134 2023-07-05T23:30:31.019 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-07-05T23:30:31.173 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-07-05T23:30:31.352 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-07-05T23:30:31.399 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-07-05T23:30:31.711 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-07-05T23:30:32.011 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-07-05T23:30:32.203 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-07-05T23:30:32.309 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-07-05T23:30:32.519 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-07-05T23:30:32.724 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rsa-4.8-1.el8.noarch 34/134 2023-07-05T23:30:32.842 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-07-05T23:30:32.940 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-07-05T23:30:33.019 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-07-05T23:30:33.110 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rbd-2:18.0.0-4488.g0a781ef0.el8.x86_64 36/134 2023-07-05T23:30:33.278 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librados-devel-2:18.0.0-4488.g0a781ef0.el8.x86_6 37/134 2023-07-05T23:30:33.411 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-07-05T23:30:33.547 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-07-05T23:30:33.737 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-07-05T23:30:33.766 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-07-05T23:30:33.804 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-07-05T23:30:34.008 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-07-05T23:30:34.031 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-07-05T23:30:34.216 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-07-05T23:30:34.295 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-07-05T23:30:34.337 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-07-05T23:30:34.435 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-07-05T23:30:34.524 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-07-05T23:30:34.642 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-07-05T23:30:34.709 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-07-05T23:30:34.799 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-07-05T23:30:34.932 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-07-05T23:30:34.982 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-07-05T23:30:35.159 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-07-05T23:30:35.197 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-07-05T23:30:35.326 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-ceph-common-2:18.0.0-4488.g0a781ef0.el8. 26/134 2023-07-05T23:30:35.356 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-07-05T23:30:35.464 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-ceph-argparse-2:18.0.0-4488.g0a781ef0.el 27/134 2023-07-05T23:30:35.524 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-07-05T23:30:35.709 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-07-05T23:30:35.899 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-07-05T23:30:36.265 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-07-05T23:30:36.415 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-cephfs-2:18.0.0-4488.g0a781ef0.el8.x86_6 28/134 2023-07-05T23:30:36.514 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-07-05T23:30:36.751 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-07-05T23:30:36.954 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-07-05T23:30:36.974 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-07-05T23:30:37.200 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-07-05T23:30:37.267 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-07-05T23:30:37.496 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-07-05T23:30:37.525 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-07-05T23:30:37.695 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-07-05T23:30:37.727 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-07-05T23:30:37.866 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-07-05T23:30:38.059 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-07-05T23:30:38.218 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-07-05T23:30:38.398 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-07-05T23:30:38.704 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-07-05T23:30:38.950 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-07-05T23:30:39.208 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-07-05T23:30:39.421 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-07-05T23:30:39.561 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-07-05T23:30:39.609 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-07-05T23:30:39.731 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-07-05T23:30:39.914 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-07-05T23:30:40.005 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-07-05T23:30:40.132 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-rsa-4.8-1.el8.noarch 34/134 2023-07-05T23:30:40.201 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-07-05T23:30:40.340 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-07-05T23:30:40.356 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-07-05T23:30:40.488 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-07-05T23:30:40.533 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-rbd-2:18.0.0-4488.g0a781ef0.el8.x86_64 36/134 2023-07-05T23:30:40.680 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : librados-devel-2:18.0.0-4488.g0a781ef0.el8.x86_6 37/134 2023-07-05T23:30:40.703 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-07-05T23:30:40.850 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-07-05T23:30:40.881 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-07-05T23:30:41.011 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-07-05T23:30:41.055 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-07-05T23:30:41.187 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-07-05T23:30:41.197 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-07-05T23:30:41.367 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-07-05T23:30:41.380 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-07-05T23:30:41.575 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-07-05T23:30:41.576 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-07-05T23:30:41.773 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-07-05T23:30:41.826 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-07-05T23:30:41.950 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-07-05T23:30:42.176 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-07-05T23:30:42.234 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-07-05T23:30:42.435 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-07-05T23:30:42.464 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-07-05T23:30:42.652 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-07-05T23:30:42.671 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-07-05T23:30:42.857 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-07-05T23:30:42.893 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-07-05T23:30:43.107 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-07-05T23:30:43.428 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-07-05T23:30:43.676 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-07-05T23:30:43.855 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-07-05T23:30:43.930 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-07-05T23:30:44.074 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-07-05T23:30:44.172 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-07-05T23:30:44.241 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-07-05T23:30:44.426 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-07-05T23:30:44.431 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-07-05T23:30:44.703 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-07-05T23:30:44.760 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-07-05T23:30:44.956 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-07-05T23:30:45.031 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-07-05T23:30:45.132 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-07-05T23:30:45.285 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-07-05T23:30:45.516 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-07-05T23:30:45.692 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-07-05T23:30:45.836 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-07-05T23:30:45.970 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-07-05T23:30:46.009 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-07-05T23:30:46.081 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-07-05T23:30:46.151 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librgw2-2:18.0.0-4488.g0a781ef0.el8.x86_64 92/134 2023-07-05T23:30:46.211 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librgw2-2:18.0.0-4488.g0a781ef0.el8.x86_64 92/134 2023-07-05T23:30:46.320 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-07-05T23:30:46.377 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rgw-2:18.0.0-4488.g0a781ef0.el8.x86_64 93/134 2023-07-05T23:30:46.572 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-07-05T23:30:46.734 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-07-05T23:30:46.818 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-07-05T23:30:47.033 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-07-05T23:30:47.219 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-07-05T23:30:47.394 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-07-05T23:30:47.617 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-07-05T23:30:47.890 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-07-05T23:30:48.100 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-07-05T23:30:48.247 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-07-05T23:30:48.405 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-07-05T23:30:48.631 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-07-05T23:30:48.849 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-07-05T23:30:49.031 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-07-05T23:30:49.195 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-07-05T23:30:49.349 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-07-05T23:30:49.553 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-07-05T23:30:49.756 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-07-05T23:30:49.948 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-07-05T23:30:50.033 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-common-2:18.0.0-4488.g0a781ef0.el8.x86_64 94/134 2023-07-05T23:30:50.206 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-07-05T23:30:50.243 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-common-2:18.0.0-4488.g0a781ef0.el8.x86_64 94/134 2023-07-05T23:30:50.442 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-07-05T23:30:50.643 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-07-05T23:30:50.822 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-common-2:18.0.0-4488.g0a781ef0.el8.x86_64 94/134 2023-07-05T23:30:50.865 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-07-05T23:30:51.072 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-base-2:18.0.0-4488.g0a781ef0.el8.x86_64 95/134 2023-07-05T23:30:51.153 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-base-2:18.0.0-4488.g0a781ef0.el8.x86_64 95/134 2023-07-05T23:30:51.275 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-selinux-2:18.0.0-4488.g0a781ef0.el8.x86_64 96/134 2023-07-05T23:30:52.019 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-07-05T23:30:52.257 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-07-05T23:30:52.543 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-07-05T23:30:52.845 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-07-05T23:30:53.108 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-07-05T23:30:53.276 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-07-05T23:30:54.102 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-07-05T23:30:54.283 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : librgw2-2:18.0.0-4488.g0a781ef0.el8.x86_64 92/134 2023-07-05T23:30:54.361 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: librgw2-2:18.0.0-4488.g0a781ef0.el8.x86_64 92/134 2023-07-05T23:30:54.517 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-rgw-2:18.0.0-4488.g0a781ef0.el8.x86_64 93/134 2023-07-05T23:30:58.346 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-common-2:18.0.0-4488.g0a781ef0.el8.x86_64 94/134 2023-07-05T23:30:58.541 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-common-2:18.0.0-4488.g0a781ef0.el8.x86_64 94/134 2023-07-05T23:30:59.169 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-common-2:18.0.0-4488.g0a781ef0.el8.x86_64 94/134 2023-07-05T23:30:59.429 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-base-2:18.0.0-4488.g0a781ef0.el8.x86_64 95/134 2023-07-05T23:30:59.513 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-base-2:18.0.0-4488.g0a781ef0.el8.x86_64 95/134 2023-07-05T23:30:59.641 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-selinux-2:18.0.0-4488.g0a781ef0.el8.x86_64 96/134 2023-07-05T23:31:09.789 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-selinux-2:18.0.0-4488.g0a781ef0.el8.x86_64 96/134 2023-07-05T23:31:09.790 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /sys 2023-07-05T23:31:09.790 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /proc 2023-07-05T23:31:09.791 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /dev 2023-07-05T23:31:09.791 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /run 2023-07-05T23:31:09.792 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /mnt 2023-07-05T23:31:09.792 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /var/tmp 2023-07-05T23:31:09.792 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /home 2023-07-05T23:31:09.792 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /tmp 2023-07-05T23:31:09.793 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /dev 2023-07-05T23:31:09.793 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-07-05T23:31:10.096 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-volume-2:18.0.0-4488.g0a781ef0.el8.noarch 97/134 2023-07-05T23:31:11.672 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-volume-2:18.0.0-4488.g0a781ef0.el8.noarch 97/134 2023-07-05T23:31:11.817 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-osd-2:18.0.0-4488.g0a781ef0.el8.x86_64 98/134 2023-07-05T23:31:12.038 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-osd-2:18.0.0-4488.g0a781ef0.el8.x86_64 98/134 2023-07-05T23:31:12.154 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mds-2:18.0.0-4488.g0a781ef0.el8.x86_64 99/134 2023-07-05T23:31:12.632 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mds-2:18.0.0-4488.g0a781ef0.el8.x86_64 99/134 2023-07-05T23:31:12.812 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mon-2:18.0.0-4488.g0a781ef0.el8.x86_64 100/134 2023-07-05T23:31:12.829 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mon-2:18.0.0-4488.g0a781ef0.el8.x86_64 100/134 2023-07-05T23:31:14.495 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: cephadm-2:18.0.0-4488.g0a781ef0.el8.noarch 101/134 2023-07-05T23:31:14.669 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : cephadm-2:18.0.0-4488.g0a781ef0.el8.noarch 101/134 2023-07-05T23:31:14.793 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-4488.g0a781ef0.e 102/134 2023-07-05T23:31:15.009 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-4488.g0a781ef0. 103/134 2023-07-05T23:31:15.178 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-4488.g0a781ef0.el8.noa 104/134 2023-07-05T23:31:15.396 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-4488.g0a781ef0.el8.noa 104/134 2023-07-05T23:31:15.708 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-4488.g0a781ef0.el8.n 105/134 2023-07-05T23:31:16.670 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-4488.g0a781ef0.el8.n 105/134 2023-07-05T23:31:16.819 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-4488.g0a7 106/134 2023-07-05T23:31:16.911 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-4488.g0a7 106/134 2023-07-05T23:31:17.253 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-4488.g0a781ef0.el 107/134 2023-07-05T23:31:17.408 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-2:18.0.0-4488.g0a781ef0.el8.x86_64 108/134 2023-07-05T23:31:17.442 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-2:18.0.0-4488.g0a781ef0.el8.x86_64 108/134 2023-07-05T23:31:17.611 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-rook-2:18.0.0-4488.g0a781ef0.el8.noarch 109/134 2023-07-05T23:31:17.622 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-4488.g0a781ef0.el8.noarch 109/134 2023-07-05T23:31:18.894 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-2:18.0.0-4488.g0a781ef0.el8.x86_64 110/134 2023-07-05T23:31:18.972 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-selinux-2:18.0.0-4488.g0a781ef0.el8.x86_64 96/134 2023-07-05T23:31:18.972 INFO:teuthology.orchestra.run.smithi027.stdout:skipping the directory /sys 2023-07-05T23:31:18.972 INFO:teuthology.orchestra.run.smithi027.stdout:skipping the directory /proc 2023-07-05T23:31:18.973 INFO:teuthology.orchestra.run.smithi027.stdout:skipping the directory /dev 2023-07-05T23:31:18.973 INFO:teuthology.orchestra.run.smithi027.stdout:skipping the directory /run 2023-07-05T23:31:18.973 INFO:teuthology.orchestra.run.smithi027.stdout:skipping the directory /mnt 2023-07-05T23:31:18.973 INFO:teuthology.orchestra.run.smithi027.stdout:skipping the directory /var/tmp 2023-07-05T23:31:18.973 INFO:teuthology.orchestra.run.smithi027.stdout:skipping the directory /home 2023-07-05T23:31:18.973 INFO:teuthology.orchestra.run.smithi027.stdout:skipping the directory /tmp 2023-07-05T23:31:18.973 INFO:teuthology.orchestra.run.smithi027.stdout:skipping the directory /dev 2023-07-05T23:31:18.973 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:31:19.095 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-radosgw-2:18.0.0-4488.g0a781ef0.el8.x86_64 111/134 2023-07-05T23:31:19.129 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-4488.g0a781ef0.el8.x86_64 111/134 2023-07-05T23:31:19.261 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-4488.g0a781 112/134 2023-07-05T23:31:19.297 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-volume-2:18.0.0-4488.g0a781ef0.el8.noarch 97/134 2023-07-05T23:31:19.303 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-4488.g0a781 112/134 2023-07-05T23:31:19.436 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : cephfs-mirror-2:18.0.0-4488.g0a781ef0.el8.x86_64 113/134 2023-07-05T23:31:19.781 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-4488.g0a781ef0.el8.x86_64 113/134 2023-07-05T23:31:19.936 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : rbd-mirror-2:18.0.0-4488.g0a781ef0.el8.x86_64 114/134 2023-07-05T23:31:20.979 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-volume-2:18.0.0-4488.g0a781ef0.el8.noarch 97/134 2023-07-05T23:31:21.143 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-osd-2:18.0.0-4488.g0a781ef0.el8.x86_64 98/134 2023-07-05T23:31:21.375 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-osd-2:18.0.0-4488.g0a781ef0.el8.x86_64 98/134 2023-07-05T23:31:21.530 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-mds-2:18.0.0-4488.g0a781ef0.el8.x86_64 99/134 2023-07-05T23:31:22.028 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-mds-2:18.0.0-4488.g0a781ef0.el8.x86_64 99/134 2023-07-05T23:31:22.188 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-mon-2:18.0.0-4488.g0a781ef0.el8.x86_64 100/134 2023-07-05T23:31:22.206 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-mon-2:18.0.0-4488.g0a781ef0.el8.x86_64 100/134 2023-07-05T23:31:23.994 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: cephadm-2:18.0.0-4488.g0a781ef0.el8.noarch 101/134 2023-07-05T23:31:24.187 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : cephadm-2:18.0.0-4488.g0a781ef0.el8.noarch 101/134 2023-07-05T23:31:24.311 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-4488.g0a781ef0.e 102/134 2023-07-05T23:31:24.464 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: rbd-mirror-2:18.0.0-4488.g0a781ef0.el8.x86_64 114/134 2023-07-05T23:31:24.496 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-4488.g0a781ef0. 103/134 2023-07-05T23:31:24.662 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-4488.g0a781ef0.el8.noa 104/134 2023-07-05T23:31:24.887 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-4488.g0a781ef0.el8.noa 104/134 2023-07-05T23:31:25.192 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-4488.g0a781ef0.el8.n 105/134 2023-07-05T23:31:25.324 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-test-2:18.0.0-4488.g0a781ef0.el8.x86_64 115/134 2023-07-05T23:31:25.616 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-07-05T23:31:25.825 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-fuse-2:18.0.0-4488.g0a781ef0.el8.x86_64 117/134 2023-07-05T23:31:26.059 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-07-05T23:31:26.184 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-07-05T23:31:26.214 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-4488.g0a781ef0.el8.n 105/134 2023-07-05T23:31:26.354 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-4488.g0a7 106/134 2023-07-05T23:31:26.375 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-07-05T23:31:26.451 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-4488.g0a7 106/134 2023-07-05T23:31:26.622 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-07-05T23:31:26.788 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libcephfs-devel-2:18.0.0-4488.g0a781ef0.el8.x86_ 121/134 2023-07-05T23:31:26.830 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-4488.g0a781ef0.el 107/134 2023-07-05T23:31:26.935 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-07-05T23:31:27.034 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-mgr-2:18.0.0-4488.g0a781ef0.el8.x86_64 108/134 2023-07-05T23:31:27.072 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-mgr-2:18.0.0-4488.g0a781ef0.el8.x86_64 108/134 2023-07-05T23:31:27.253 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-mgr-rook-2:18.0.0-4488.g0a781ef0.el8.noarch 109/134 2023-07-05T23:31:27.265 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-4488.g0a781ef0.el8.noarch 109/134 2023-07-05T23:31:28.651 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-2:18.0.0-4488.g0a781ef0.el8.x86_64 110/134 2023-07-05T23:31:28.861 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-radosgw-2:18.0.0-4488.g0a781ef0.el8.x86_64 111/134 2023-07-05T23:31:28.897 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-4488.g0a781ef0.el8.x86_64 111/134 2023-07-05T23:31:29.079 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-4488.g0a781 112/134 2023-07-05T23:31:29.124 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-4488.g0a781 112/134 2023-07-05T23:31:29.176 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-05T23:31:29.254 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : cephfs-mirror-2:18.0.0-4488.g0a781ef0.el8.x86_64 113/134 2023-07-05T23:31:29.417 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-05T23:31:29.437 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-05T23:31:29.620 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-4488.g0a781ef0.el8.x86_64 113/134 2023-07-05T23:31:29.626 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : cephfs-top-2:18.0.0-4488.g0a781ef0.el8.noarch 124/134 2023-07-05T23:31:29.754 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : rbd-mirror-2:18.0.0-4488.g0a781ef0.el8.x86_64 114/134 2023-07-05T23:31:29.891 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : rbd-fuse-2:18.0.0-4488.g0a781ef0.el8.x86_64 125/134 2023-07-05T23:31:30.172 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : rbd-nbd-2:18.0.0-4488.g0a781ef0.el8.x86_64 126/134 2023-07-05T23:31:30.517 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-07-05T23:31:30.675 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-07-05T23:31:30.754 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-07-05T23:31:30.958 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-07-05T23:31:30.970 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-07-05T23:31:31.141 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-07-05T23:31:31.150 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-07-05T23:31:31.285 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-07-05T23:31:31.286 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-05T23:31:31.477 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-05T23:31:31.478 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-07-05T23:31:31.713 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-07-05T23:31:31.932 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-07-05T23:31:32.437 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-07-05T23:31:32.437 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-2:18.0.0-4488.g0a781ef0.el8.x86_64 1/134 2023-07-05T23:31:32.437 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-base-2:18.0.0-4488.g0a781ef0.el8.x86_64 2/134 2023-07-05T23:31:32.437 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-common-2:18.0.0-4488.g0a781ef0.el8.x86_64 3/134 2023-07-05T23:31:32.437 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-fuse-2:18.0.0-4488.g0a781ef0.el8.x86_64 4/134 2023-07-05T23:31:32.438 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-4488.g0a781 5/134 2023-07-05T23:31:32.438 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mds-2:18.0.0-4488.g0a781ef0.el8.x86_64 6/134 2023-07-05T23:31:32.438 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-2:18.0.0-4488.g0a781ef0.el8.x86_64 7/134 2023-07-05T23:31:32.438 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mon-2:18.0.0-4488.g0a781ef0.el8.x86_64 8/134 2023-07-05T23:31:32.438 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-osd-2:18.0.0-4488.g0a781ef0.el8.x86_64 9/134 2023-07-05T23:31:32.438 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-radosgw-2:18.0.0-4488.g0a781ef0.el8.x86_64 10/134 2023-07-05T23:31:32.439 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-selinux-2:18.0.0-4488.g0a781ef0.el8.x86_64 11/134 2023-07-05T23:31:32.439 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-test-2:18.0.0-4488.g0a781ef0.el8.x86_64 12/134 2023-07-05T23:31:32.439 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : cephfs-mirror-2:18.0.0-4488.g0a781ef0.el8.x86_64 13/134 2023-07-05T23:31:32.439 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libcephfs-devel-2:18.0.0-4488.g0a781ef0.el8.x86_ 14/134 2023-07-05T23:31:32.439 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libcephfs2-2:18.0.0-4488.g0a781ef0.el8.x86_64 15/134 2023-07-05T23:31:32.439 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libcephsqlite-2:18.0.0-4488.g0a781ef0.el8.x86_64 16/134 2023-07-05T23:31:32.440 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librados-devel-2:18.0.0-4488.g0a781ef0.el8.x86_6 17/134 2023-07-05T23:31:32.440 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libradosstriper1-2:18.0.0-4488.g0a781ef0.el8.x86 18/134 2023-07-05T23:31:32.440 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librgw2-2:18.0.0-4488.g0a781ef0.el8.x86_64 19/134 2023-07-05T23:31:32.440 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-ceph-argparse-2:18.0.0-4488.g0a781ef0.el 20/134 2023-07-05T23:31:32.440 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-ceph-common-2:18.0.0-4488.g0a781ef0.el8. 21/134 2023-07-05T23:31:32.440 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cephfs-2:18.0.0-4488.g0a781ef0.el8.x86_6 22/134 2023-07-05T23:31:32.441 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rados-2:18.0.0-4488.g0a781ef0.el8.x86_64 23/134 2023-07-05T23:31:32.441 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rbd-2:18.0.0-4488.g0a781ef0.el8.x86_64 24/134 2023-07-05T23:31:32.441 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rgw-2:18.0.0-4488.g0a781ef0.el8.x86_64 25/134 2023-07-05T23:31:32.441 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : rbd-fuse-2:18.0.0-4488.g0a781ef0.el8.x86_64 26/134 2023-07-05T23:31:32.441 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : rbd-mirror-2:18.0.0-4488.g0a781ef0.el8.x86_64 27/134 2023-07-05T23:31:32.441 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : rbd-nbd-2:18.0.0-4488.g0a781ef0.el8.x86_64 28/134 2023-07-05T23:31:32.441 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-4488.g0a781ef0. 29/134 2023-07-05T23:31:32.448 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-4488.g0a781ef0.el8.noa 30/134 2023-07-05T23:31:32.448 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-4488.g0a781ef0.el8.n 31/134 2023-07-05T23:31:32.449 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-4488.g0a7 32/134 2023-07-05T23:31:32.449 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-4488.g0a781ef0.el 33/134 2023-07-05T23:31:32.449 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-rook-2:18.0.0-4488.g0a781ef0.el8.noarch 34/134 2023-07-05T23:31:32.449 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-4488.g0a781ef0.e 35/134 2023-07-05T23:31:32.449 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-volume-2:18.0.0-4488.g0a781ef0.el8.noarch 36/134 2023-07-05T23:31:32.449 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : cephadm-2:18.0.0-4488.g0a781ef0.el8.noarch 37/134 2023-07-05T23:31:32.450 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : cephfs-top-2:18.0.0-4488.g0a781ef0.el8.noarch 38/134 2023-07-05T23:31:32.450 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-07-05T23:31:32.450 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-07-05T23:31:32.450 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-07-05T23:31:32.450 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-07-05T23:31:32.450 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-07-05T23:31:32.451 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-07-05T23:31:32.451 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-07-05T23:31:32.451 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-07-05T23:31:32.451 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-07-05T23:31:32.451 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-07-05T23:31:32.451 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-07-05T23:31:32.451 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-07-05T23:31:32.452 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-07-05T23:31:32.452 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-07-05T23:31:32.452 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-07-05T23:31:32.452 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-07-05T23:31:32.452 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-07-05T23:31:32.452 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-07-05T23:31:32.452 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-07-05T23:31:32.453 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-07-05T23:31:32.454 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-07-05T23:31:32.454 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 60/134 2023-07-05T23:31:32.454 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-07-05T23:31:32.455 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-07-05T23:31:32.455 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-07-05T23:31:32.455 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-07-05T23:31:32.455 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-07-05T23:31:32.456 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-07-05T23:31:32.456 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-07-05T23:31:32.456 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-07-05T23:31:32.457 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-07-05T23:31:32.457 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-07-05T23:31:32.457 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-07-05T23:31:32.457 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-07-05T23:31:32.458 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-07-05T23:31:32.458 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-07-05T23:31:32.458 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-07-05T23:31:32.459 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-07-05T23:31:32.459 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-07-05T23:31:32.459 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-07-05T23:31:32.460 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-07-05T23:31:32.460 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-07-05T23:31:32.460 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-07-05T23:31:32.460 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-07-05T23:31:32.461 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-07-05T23:31:32.461 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-07-05T23:31:32.461 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-07-05T23:31:32.461 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-07-05T23:31:32.462 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-07-05T23:31:32.462 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-07-05T23:31:32.462 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-07-05T23:31:32.462 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-07-05T23:31:32.462 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-07-05T23:31:32.463 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-07-05T23:31:32.463 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-07-05T23:31:32.463 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-07-05T23:31:32.463 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-07-05T23:31:32.464 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-07-05T23:31:32.464 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-07-05T23:31:32.464 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-07-05T23:31:32.465 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-07-05T23:31:32.465 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-07-05T23:31:32.465 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-07-05T23:31:32.465 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-07-05T23:31:32.465 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-07-05T23:31:32.465 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-07-05T23:31:32.465 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-07-05T23:31:32.466 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-07-05T23:31:32.466 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-07-05T23:31:32.466 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-07-05T23:31:32.466 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-07-05T23:31:32.466 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-07-05T23:31:32.466 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-07-05T23:31:32.466 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-07-05T23:31:32.466 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-07-05T23:31:32.467 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-07-05T23:31:32.467 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-07-05T23:31:32.467 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-07-05T23:31:32.467 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-07-05T23:31:32.467 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-07-05T23:31:32.467 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-07-05T23:31:32.467 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-07-05T23:31:32.468 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-07-05T23:31:32.468 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-07-05T23:31:32.468 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-07-05T23:31:32.468 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-07-05T23:31:32.468 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-07-05T23:31:32.468 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-07-05T23:31:32.468 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-07-05T23:31:32.469 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-07-05T23:31:32.469 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librados2-2:18.0.0-4488.g0a781ef0.el8.x86_64 129/134 2023-07-05T23:31:32.469 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-07-05T23:31:32.469 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librbd1-2:18.0.0-4488.g0a781ef0.el8.x86_64 131/134 2023-07-05T23:31:32.469 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-05T23:31:32.469 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-07-05T23:31:34.561 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: rbd-mirror-2:18.0.0-4488.g0a781ef0.el8.x86_64 114/134 2023-07-05T23:31:34.832 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-test-2:18.0.0-4488.g0a781ef0.el8.x86_64 115/134 2023-07-05T23:31:35.002 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-07-05T23:31:35.167 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-07-05T23:31:35.168 INFO:teuthology.orchestra.run.smithi162.stdout:Last metadata expiration check: 0:01:51 ago on Wed 05 Jul 2023 11:29:44 PM UTC. 2023-07-05T23:31:35.206 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-07-05T23:31:36.160 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-07-05T23:31:36.472 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-07-05T23:31:36.624 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-fuse-2:18.0.0-4488.g0a781ef0.el8.x86_64 119/134 2023-07-05T23:31:36.924 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-07-05T23:31:37.098 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libcephfs-devel-2:18.0.0-4488.g0a781ef0.el8.x86_ 121/134 2023-07-05T23:31:37.279 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-07-05T23:31:38.175 INFO:teuthology.orchestra.run.smithi162.stdout:Installed products updated. 2023-07-05T23:31:38.400 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-07-05T23:31:38.400 INFO:teuthology.orchestra.run.smithi162.stdout:Upgraded: 2023-07-05T23:31:38.400 INFO:teuthology.orchestra.run.smithi162.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-07-05T23:31:38.401 INFO:teuthology.orchestra.run.smithi162.stdout: librados2-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T23:31:38.401 INFO:teuthology.orchestra.run.smithi162.stdout: librbd1-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T23:31:38.401 INFO:teuthology.orchestra.run.smithi162.stdout:Installed: 2023-07-05T23:31:38.401 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-07-05T23:31:38.401 INFO:teuthology.orchestra.run.smithi162.stdout: automake-1.16.1-7.el8.noarch 2023-07-05T23:31:38.401 INFO:teuthology.orchestra.run.smithi162.stdout: bison-3.0.4-10.el8.x86_64 2023-07-05T23:31:38.401 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T23:31:38.402 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-base-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T23:31:38.402 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-common-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T23:31:38.402 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-fuse-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T23:31:38.402 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-grafana-dashboards-2:18.0.0-4488.g0a781ef0.el8.noarch 2023-07-05T23:31:38.402 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-immutable-object-cache-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T23:31:38.402 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mds-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T23:31:38.403 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T23:31:38.403 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-cephadm-2:18.0.0-4488.g0a781ef0.el8.noarch 2023-07-05T23:31:38.403 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-dashboard-2:18.0.0-4488.g0a781ef0.el8.noarch 2023-07-05T23:31:38.403 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-diskprediction-local-2:18.0.0-4488.g0a781ef0.el8.noarch 2023-07-05T23:31:38.403 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-modules-core-2:18.0.0-4488.g0a781ef0.el8.noarch 2023-07-05T23:31:38.403 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-rook-2:18.0.0-4488.g0a781ef0.el8.noarch 2023-07-05T23:31:38.403 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mon-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T23:31:38.403 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-osd-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T23:31:38.404 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-prometheus-alerts-2:18.0.0-4488.g0a781ef0.el8.noarch 2023-07-05T23:31:38.404 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-radosgw-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T23:31:38.404 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-selinux-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T23:31:38.404 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-test-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T23:31:38.404 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-volume-2:18.0.0-4488.g0a781ef0.el8.noarch 2023-07-05T23:31:38.404 INFO:teuthology.orchestra.run.smithi162.stdout: cephadm-2:18.0.0-4488.g0a781ef0.el8.noarch 2023-07-05T23:31:38.405 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-mirror-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T23:31:38.405 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-top-2:18.0.0-4488.g0a781ef0.el8.noarch 2023-07-05T23:31:38.405 INFO:teuthology.orchestra.run.smithi162.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-07-05T23:31:38.405 INFO:teuthology.orchestra.run.smithi162.stdout: flex-2.6.1-9.el8.x86_64 2023-07-05T23:31:38.405 INFO:teuthology.orchestra.run.smithi162.stdout: fuse-2.9.7-15.el8.x86_64 2023-07-05T23:31:38.405 INFO:teuthology.orchestra.run.smithi162.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-07-05T23:31:38.405 INFO:teuthology.orchestra.run.smithi162.stdout: jq-1.6-3.el8.x86_64 2023-07-05T23:31:38.406 INFO:teuthology.orchestra.run.smithi162.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-07-05T23:31:38.406 INFO:teuthology.orchestra.run.smithi162.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-07-05T23:31:38.406 INFO:teuthology.orchestra.run.smithi162.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-07-05T23:31:38.406 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs-devel-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T23:31:38.406 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs2-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T23:31:38.406 INFO:teuthology.orchestra.run.smithi162.stdout: libcephsqlite-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T23:31:38.407 INFO:teuthology.orchestra.run.smithi162.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-07-05T23:31:38.407 INFO:teuthology.orchestra.run.smithi162.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-07-05T23:31:38.407 INFO:teuthology.orchestra.run.smithi162.stdout: liboath-2.6.2-3.el8.x86_64 2023-07-05T23:31:38.407 INFO:teuthology.orchestra.run.smithi162.stdout: libpq-13.5-1.el8.x86_64 2023-07-05T23:31:38.407 INFO:teuthology.orchestra.run.smithi162.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-07-05T23:31:38.407 INFO:teuthology.orchestra.run.smithi162.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-07-05T23:31:38.407 INFO:teuthology.orchestra.run.smithi162.stdout: librados-devel-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T23:31:38.408 INFO:teuthology.orchestra.run.smithi162.stdout: libradosstriper1-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T23:31:38.408 INFO:teuthology.orchestra.run.smithi162.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-07-05T23:31:38.408 INFO:teuthology.orchestra.run.smithi162.stdout: librgw2-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T23:31:38.408 INFO:teuthology.orchestra.run.smithi162.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-07-05T23:31:38.408 INFO:teuthology.orchestra.run.smithi162.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-07-05T23:31:38.408 INFO:teuthology.orchestra.run.smithi162.stdout: libtool-2.4.6-25.el8.x86_64 2023-07-05T23:31:38.409 INFO:teuthology.orchestra.run.smithi162.stdout: libunwind-1.3.1-3.el8.x86_64 2023-07-05T23:31:38.409 INFO:teuthology.orchestra.run.smithi162.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-07-05T23:31:38.409 INFO:teuthology.orchestra.run.smithi162.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-07-05T23:31:38.409 INFO:teuthology.orchestra.run.smithi162.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-07-05T23:31:38.409 INFO:teuthology.orchestra.run.smithi162.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-07-05T23:31:38.409 INFO:teuthology.orchestra.run.smithi162.stdout: openblas-0.3.15-3.el8.x86_64 2023-07-05T23:31:38.409 INFO:teuthology.orchestra.run.smithi162.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-07-05T23:31:38.410 INFO:teuthology.orchestra.run.smithi162.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-07-05T23:31:38.410 INFO:teuthology.orchestra.run.smithi162.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-07-05T23:31:38.410 INFO:teuthology.orchestra.run.smithi162.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-07-05T23:31:38.410 INFO:teuthology.orchestra.run.smithi162.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-07-05T23:31:38.410 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-05T23:31:38.410 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-05T23:31:38.410 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-05T23:31:38.410 INFO:teuthology.orchestra.run.smithi162.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-07-05T23:31:38.411 INFO:teuthology.orchestra.run.smithi162.stdout: python3-babel-2.5.1-7.el8.noarch 2023-07-05T23:31:38.411 INFO:teuthology.orchestra.run.smithi162.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-07-05T23:31:38.411 INFO:teuthology.orchestra.run.smithi162.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-07-05T23:31:38.411 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-07-05T23:31:38.411 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-argparse-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T23:31:38.411 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-common-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T23:31:38.411 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cephfs-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T23:31:38.412 INFO:teuthology.orchestra.run.smithi162.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-07-05T23:31:38.412 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-07-05T23:31:38.412 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-07-05T23:31:38.412 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-07-05T23:31:38.412 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-07-05T23:31:38.412 INFO:teuthology.orchestra.run.smithi162.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-07-05T23:31:38.412 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-6.2-6.el8.noarch 2023-07-05T23:31:38.413 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-07-05T23:31:38.413 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-07-05T23:31:38.413 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-07-05T23:31:38.413 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-07-05T23:31:38.413 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-07-05T23:31:38.413 INFO:teuthology.orchestra.run.smithi162.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-07-05T23:31:38.413 INFO:teuthology.orchestra.run.smithi162.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-07-05T23:31:38.413 INFO:teuthology.orchestra.run.smithi162.stdout: python3-mako-1.0.6-13.el8.noarch 2023-07-05T23:31:38.414 INFO:teuthology.orchestra.run.smithi162.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-07-05T23:31:38.414 INFO:teuthology.orchestra.run.smithi162.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-07-05T23:31:38.414 INFO:teuthology.orchestra.run.smithi162.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-07-05T23:31:38.414 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-07-05T23:31:38.414 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-07-05T23:31:38.414 INFO:teuthology.orchestra.run.smithi162.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-07-05T23:31:38.414 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-07-05T23:31:38.414 INFO:teuthology.orchestra.run.smithi162.stdout: python3-portend-2.6-1.el8.noarch 2023-07-05T23:31:38.415 INFO:teuthology.orchestra.run.smithi162.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-07-05T23:31:38.415 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-07-05T23:31:38.415 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-07-05T23:31:38.415 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-07-05T23:31:38.415 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pycparser-2.14-14.el8.noarch 2023-07-05T23:31:38.415 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pytz-2017.2-9.el8.noarch 2023-07-05T23:31:38.415 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rados-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T23:31:38.416 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rbd-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T23:31:38.416 INFO:teuthology.orchestra.run.smithi162.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-07-05T23:31:38.416 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-07-05T23:31:38.416 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rgw-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T23:31:38.416 INFO:teuthology.orchestra.run.smithi162.stdout: python3-routes-2.4.1-12.el8.noarch 2023-07-05T23:31:38.416 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rsa-4.8-1.el8.noarch 2023-07-05T23:31:38.416 INFO:teuthology.orchestra.run.smithi162.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-07-05T23:31:38.417 INFO:teuthology.orchestra.run.smithi162.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-07-05T23:31:38.417 INFO:teuthology.orchestra.run.smithi162.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-07-05T23:31:38.417 INFO:teuthology.orchestra.run.smithi162.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-07-05T23:31:38.417 INFO:teuthology.orchestra.run.smithi162.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-07-05T23:31:38.417 INFO:teuthology.orchestra.run.smithi162.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-07-05T23:31:38.417 INFO:teuthology.orchestra.run.smithi162.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-07-05T23:31:38.417 INFO:teuthology.orchestra.run.smithi162.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-07-05T23:31:38.417 INFO:teuthology.orchestra.run.smithi162.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-07-05T23:31:38.418 INFO:teuthology.orchestra.run.smithi162.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-07-05T23:31:38.418 INFO:teuthology.orchestra.run.smithi162.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-07-05T23:31:38.418 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-fuse-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T23:31:38.418 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-mirror-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T23:31:38.418 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-nbd-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T23:31:38.418 INFO:teuthology.orchestra.run.smithi162.stdout: socat-1.7.4.1-1.el8.x86_64 2023-07-05T23:31:38.418 INFO:teuthology.orchestra.run.smithi162.stdout: thrift-0.13.0-2.el8.x86_64 2023-07-05T23:31:38.418 INFO:teuthology.orchestra.run.smithi162.stdout: uuid-1.6.2-43.el8.x86_64 2023-07-05T23:31:38.419 INFO:teuthology.orchestra.run.smithi162.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-07-05T23:31:38.419 INFO:teuthology.orchestra.run.smithi162.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-07-05T23:31:38.419 INFO:teuthology.orchestra.run.smithi162.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-07-05T23:31:38.419 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-07-05T23:31:38.420 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2023-07-05T23:31:38.601 DEBUG:teuthology.parallel:result is None 2023-07-05T23:31:39.627 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-05T23:31:39.877 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-05T23:31:39.897 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-05T23:31:40.045 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : cephfs-top-2:18.0.0-4488.g0a781ef0.el8.noarch 124/134 2023-07-05T23:31:40.344 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : rbd-fuse-2:18.0.0-4488.g0a781ef0.el8.x86_64 125/134 2023-07-05T23:31:40.625 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : rbd-nbd-2:18.0.0-4488.g0a781ef0.el8.x86_64 126/134 2023-07-05T23:31:40.888 INFO:teuthology.orchestra.run.smithi027.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-07-05T23:31:41.019 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-07-05T23:31:41.028 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-07-05T23:31:41.191 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-07-05T23:31:41.377 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-07-05T23:31:41.467 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-07-05T23:31:41.660 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-07-05T23:31:41.674 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-07-05T23:31:41.674 INFO:teuthology.orchestra.run.smithi027.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-05T23:31:41.905 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-05T23:31:41.906 INFO:teuthology.orchestra.run.smithi027.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-07-05T23:31:42.133 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-07-05T23:31:42.424 INFO:teuthology.orchestra.run.smithi027.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-07-05T23:31:42.976 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-07-05T23:31:42.976 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-2:18.0.0-4488.g0a781ef0.el8.x86_64 1/134 2023-07-05T23:31:42.977 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-base-2:18.0.0-4488.g0a781ef0.el8.x86_64 2/134 2023-07-05T23:31:42.977 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-common-2:18.0.0-4488.g0a781ef0.el8.x86_64 3/134 2023-07-05T23:31:42.977 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-fuse-2:18.0.0-4488.g0a781ef0.el8.x86_64 4/134 2023-07-05T23:31:42.978 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-4488.g0a781 5/134 2023-07-05T23:31:42.978 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-mds-2:18.0.0-4488.g0a781ef0.el8.x86_64 6/134 2023-07-05T23:31:42.978 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-mgr-2:18.0.0-4488.g0a781ef0.el8.x86_64 7/134 2023-07-05T23:31:42.979 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-mon-2:18.0.0-4488.g0a781ef0.el8.x86_64 8/134 2023-07-05T23:31:42.979 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-osd-2:18.0.0-4488.g0a781ef0.el8.x86_64 9/134 2023-07-05T23:31:42.979 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-radosgw-2:18.0.0-4488.g0a781ef0.el8.x86_64 10/134 2023-07-05T23:31:42.979 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-selinux-2:18.0.0-4488.g0a781ef0.el8.x86_64 11/134 2023-07-05T23:31:42.980 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-test-2:18.0.0-4488.g0a781ef0.el8.x86_64 12/134 2023-07-05T23:31:42.981 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : cephfs-mirror-2:18.0.0-4488.g0a781ef0.el8.x86_64 13/134 2023-07-05T23:31:42.981 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libcephfs-devel-2:18.0.0-4488.g0a781ef0.el8.x86_ 14/134 2023-07-05T23:31:42.982 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libcephfs2-2:18.0.0-4488.g0a781ef0.el8.x86_64 15/134 2023-07-05T23:31:42.982 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libcephsqlite-2:18.0.0-4488.g0a781ef0.el8.x86_64 16/134 2023-07-05T23:31:42.982 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : librados-devel-2:18.0.0-4488.g0a781ef0.el8.x86_6 17/134 2023-07-05T23:31:42.982 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libradosstriper1-2:18.0.0-4488.g0a781ef0.el8.x86 18/134 2023-07-05T23:31:42.982 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : librgw2-2:18.0.0-4488.g0a781ef0.el8.x86_64 19/134 2023-07-05T23:31:42.982 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-ceph-argparse-2:18.0.0-4488.g0a781ef0.el 20/134 2023-07-05T23:31:42.982 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-ceph-common-2:18.0.0-4488.g0a781ef0.el8. 21/134 2023-07-05T23:31:42.983 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-cephfs-2:18.0.0-4488.g0a781ef0.el8.x86_6 22/134 2023-07-05T23:31:42.983 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-rados-2:18.0.0-4488.g0a781ef0.el8.x86_64 23/134 2023-07-05T23:31:42.983 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-rbd-2:18.0.0-4488.g0a781ef0.el8.x86_64 24/134 2023-07-05T23:31:42.983 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-rgw-2:18.0.0-4488.g0a781ef0.el8.x86_64 25/134 2023-07-05T23:31:42.983 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : rbd-fuse-2:18.0.0-4488.g0a781ef0.el8.x86_64 26/134 2023-07-05T23:31:42.983 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : rbd-mirror-2:18.0.0-4488.g0a781ef0.el8.x86_64 27/134 2023-07-05T23:31:42.983 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : rbd-nbd-2:18.0.0-4488.g0a781ef0.el8.x86_64 28/134 2023-07-05T23:31:42.983 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-4488.g0a781ef0. 29/134 2023-07-05T23:31:42.984 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-4488.g0a781ef0.el8.noa 30/134 2023-07-05T23:31:42.984 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-4488.g0a781ef0.el8.n 31/134 2023-07-05T23:31:42.984 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-4488.g0a7 32/134 2023-07-05T23:31:42.984 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-4488.g0a781ef0.el 33/134 2023-07-05T23:31:42.984 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-mgr-rook-2:18.0.0-4488.g0a781ef0.el8.noarch 34/134 2023-07-05T23:31:42.984 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-4488.g0a781ef0.e 35/134 2023-07-05T23:31:42.984 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-volume-2:18.0.0-4488.g0a781ef0.el8.noarch 36/134 2023-07-05T23:31:42.985 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : cephadm-2:18.0.0-4488.g0a781ef0.el8.noarch 37/134 2023-07-05T23:31:42.985 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : cephfs-top-2:18.0.0-4488.g0a781ef0.el8.noarch 38/134 2023-07-05T23:31:42.985 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-07-05T23:31:42.985 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-07-05T23:31:42.985 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-07-05T23:31:42.985 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-07-05T23:31:42.985 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-07-05T23:31:42.985 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-07-05T23:31:42.986 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-07-05T23:31:42.986 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-07-05T23:31:42.986 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-07-05T23:31:42.986 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-07-05T23:31:42.986 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-07-05T23:31:42.986 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-07-05T23:31:42.986 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-07-05T23:31:42.987 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-07-05T23:31:42.987 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-07-05T23:31:42.987 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-07-05T23:31:42.987 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-07-05T23:31:42.987 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-07-05T23:31:42.987 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-07-05T23:31:42.987 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-07-05T23:31:42.987 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-07-05T23:31:42.988 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 60/134 2023-07-05T23:31:42.988 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-07-05T23:31:42.988 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-07-05T23:31:42.988 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-07-05T23:31:42.988 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-07-05T23:31:42.988 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-07-05T23:31:42.988 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-07-05T23:31:42.988 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-07-05T23:31:42.989 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-07-05T23:31:42.989 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-07-05T23:31:42.989 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-07-05T23:31:42.989 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-07-05T23:31:42.989 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-07-05T23:31:42.989 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-07-05T23:31:42.989 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-07-05T23:31:42.990 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-07-05T23:31:42.990 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-07-05T23:31:42.990 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-07-05T23:31:42.990 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-07-05T23:31:42.990 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-07-05T23:31:42.990 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-07-05T23:31:42.990 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-07-05T23:31:42.990 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-07-05T23:31:42.991 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-07-05T23:31:42.991 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-07-05T23:31:42.991 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-07-05T23:31:42.991 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-07-05T23:31:42.991 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-07-05T23:31:42.991 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-07-05T23:31:42.991 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-07-05T23:31:42.992 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-07-05T23:31:42.992 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-07-05T23:31:42.992 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-07-05T23:31:42.992 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-07-05T23:31:42.992 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-07-05T23:31:42.992 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-07-05T23:31:42.992 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-07-05T23:31:42.992 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-07-05T23:31:42.993 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-07-05T23:31:42.993 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-07-05T23:31:42.993 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-07-05T23:31:42.993 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-07-05T23:31:42.993 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-07-05T23:31:42.993 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-07-05T23:31:42.993 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-07-05T23:31:42.993 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-07-05T23:31:42.994 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-07-05T23:31:42.994 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-07-05T23:31:42.994 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-07-05T23:31:42.994 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-07-05T23:31:42.994 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-07-05T23:31:42.994 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-07-05T23:31:42.994 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-07-05T23:31:42.994 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-07-05T23:31:42.995 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-07-05T23:31:42.995 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-07-05T23:31:42.995 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-07-05T23:31:42.995 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-07-05T23:31:42.995 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-07-05T23:31:42.995 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-07-05T23:31:42.995 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-07-05T23:31:42.996 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-07-05T23:31:42.996 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-07-05T23:31:42.996 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-07-05T23:31:42.996 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-07-05T23:31:42.996 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-07-05T23:31:42.996 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-07-05T23:31:42.996 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-07-05T23:31:42.996 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-07-05T23:31:42.997 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : librados2-2:18.0.0-4488.g0a781ef0.el8.x86_64 129/134 2023-07-05T23:31:42.997 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-07-05T23:31:42.997 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : librbd1-2:18.0.0-4488.g0a781ef0.el8.x86_64 131/134 2023-07-05T23:31:42.997 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-05T23:31:42.997 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-07-05T23:31:45.714 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-07-05T23:31:45.714 INFO:teuthology.orchestra.run.smithi027.stdout:Last metadata expiration check: 0:01:57 ago on Wed 05 Jul 2023 11:29:48 PM UTC. 2023-07-05T23:31:49.340 INFO:teuthology.orchestra.run.smithi027.stdout:Installed products updated. 2023-07-05T23:31:49.589 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:31:49.589 INFO:teuthology.orchestra.run.smithi027.stdout:Upgraded: 2023-07-05T23:31:49.589 INFO:teuthology.orchestra.run.smithi027.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-07-05T23:31:49.590 INFO:teuthology.orchestra.run.smithi027.stdout: librados2-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T23:31:49.590 INFO:teuthology.orchestra.run.smithi027.stdout: librbd1-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T23:31:49.590 INFO:teuthology.orchestra.run.smithi027.stdout:Installed: 2023-07-05T23:31:49.590 INFO:teuthology.orchestra.run.smithi027.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-07-05T23:31:49.590 INFO:teuthology.orchestra.run.smithi027.stdout: automake-1.16.1-7.el8.noarch 2023-07-05T23:31:49.590 INFO:teuthology.orchestra.run.smithi027.stdout: bison-3.0.4-10.el8.x86_64 2023-07-05T23:31:49.590 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T23:31:49.590 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-base-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T23:31:49.591 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-common-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T23:31:49.591 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-fuse-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T23:31:49.591 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-grafana-dashboards-2:18.0.0-4488.g0a781ef0.el8.noarch 2023-07-05T23:31:49.591 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-immutable-object-cache-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T23:31:49.591 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mds-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T23:31:49.591 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T23:31:49.591 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-cephadm-2:18.0.0-4488.g0a781ef0.el8.noarch 2023-07-05T23:31:49.592 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-dashboard-2:18.0.0-4488.g0a781ef0.el8.noarch 2023-07-05T23:31:49.592 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-diskprediction-local-2:18.0.0-4488.g0a781ef0.el8.noarch 2023-07-05T23:31:49.592 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-modules-core-2:18.0.0-4488.g0a781ef0.el8.noarch 2023-07-05T23:31:49.592 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-rook-2:18.0.0-4488.g0a781ef0.el8.noarch 2023-07-05T23:31:49.592 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mon-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T23:31:49.592 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-osd-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T23:31:49.592 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-prometheus-alerts-2:18.0.0-4488.g0a781ef0.el8.noarch 2023-07-05T23:31:49.592 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-radosgw-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T23:31:49.593 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-selinux-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T23:31:49.593 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-test-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T23:31:49.593 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-volume-2:18.0.0-4488.g0a781ef0.el8.noarch 2023-07-05T23:31:49.593 INFO:teuthology.orchestra.run.smithi027.stdout: cephadm-2:18.0.0-4488.g0a781ef0.el8.noarch 2023-07-05T23:31:49.593 INFO:teuthology.orchestra.run.smithi027.stdout: cephfs-mirror-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T23:31:49.593 INFO:teuthology.orchestra.run.smithi027.stdout: cephfs-top-2:18.0.0-4488.g0a781ef0.el8.noarch 2023-07-05T23:31:49.593 INFO:teuthology.orchestra.run.smithi027.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-07-05T23:31:49.593 INFO:teuthology.orchestra.run.smithi027.stdout: flex-2.6.1-9.el8.x86_64 2023-07-05T23:31:49.594 INFO:teuthology.orchestra.run.smithi027.stdout: fuse-2.9.7-15.el8.x86_64 2023-07-05T23:31:49.594 INFO:teuthology.orchestra.run.smithi027.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-07-05T23:31:49.594 INFO:teuthology.orchestra.run.smithi027.stdout: jq-1.6-3.el8.x86_64 2023-07-05T23:31:49.594 INFO:teuthology.orchestra.run.smithi027.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-07-05T23:31:49.594 INFO:teuthology.orchestra.run.smithi027.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-07-05T23:31:49.594 INFO:teuthology.orchestra.run.smithi027.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-07-05T23:31:49.594 INFO:teuthology.orchestra.run.smithi027.stdout: libcephfs-devel-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T23:31:49.595 INFO:teuthology.orchestra.run.smithi027.stdout: libcephfs2-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T23:31:49.595 INFO:teuthology.orchestra.run.smithi027.stdout: libcephsqlite-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T23:31:49.595 INFO:teuthology.orchestra.run.smithi027.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-07-05T23:31:49.595 INFO:teuthology.orchestra.run.smithi027.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-07-05T23:31:49.595 INFO:teuthology.orchestra.run.smithi027.stdout: liboath-2.6.2-3.el8.x86_64 2023-07-05T23:31:49.595 INFO:teuthology.orchestra.run.smithi027.stdout: libpq-13.5-1.el8.x86_64 2023-07-05T23:31:49.596 INFO:teuthology.orchestra.run.smithi027.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-07-05T23:31:49.596 INFO:teuthology.orchestra.run.smithi027.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-07-05T23:31:49.596 INFO:teuthology.orchestra.run.smithi027.stdout: librados-devel-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T23:31:49.596 INFO:teuthology.orchestra.run.smithi027.stdout: libradosstriper1-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T23:31:49.596 INFO:teuthology.orchestra.run.smithi027.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-07-05T23:31:49.596 INFO:teuthology.orchestra.run.smithi027.stdout: librgw2-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T23:31:49.596 INFO:teuthology.orchestra.run.smithi027.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-07-05T23:31:49.597 INFO:teuthology.orchestra.run.smithi027.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-07-05T23:31:49.597 INFO:teuthology.orchestra.run.smithi027.stdout: libtool-2.4.6-25.el8.x86_64 2023-07-05T23:31:49.597 INFO:teuthology.orchestra.run.smithi027.stdout: libunwind-1.3.1-3.el8.x86_64 2023-07-05T23:31:49.597 INFO:teuthology.orchestra.run.smithi027.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-07-05T23:31:49.597 INFO:teuthology.orchestra.run.smithi027.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-07-05T23:31:49.597 INFO:teuthology.orchestra.run.smithi027.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-07-05T23:31:49.597 INFO:teuthology.orchestra.run.smithi027.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-07-05T23:31:49.597 INFO:teuthology.orchestra.run.smithi027.stdout: openblas-0.3.15-3.el8.x86_64 2023-07-05T23:31:49.598 INFO:teuthology.orchestra.run.smithi027.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-07-05T23:31:49.598 INFO:teuthology.orchestra.run.smithi027.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-07-05T23:31:49.598 INFO:teuthology.orchestra.run.smithi027.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-07-05T23:31:49.598 INFO:teuthology.orchestra.run.smithi027.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-07-05T23:31:49.598 INFO:teuthology.orchestra.run.smithi027.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-07-05T23:31:49.598 INFO:teuthology.orchestra.run.smithi027.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-05T23:31:49.598 INFO:teuthology.orchestra.run.smithi027.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-05T23:31:49.598 INFO:teuthology.orchestra.run.smithi027.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-05T23:31:49.599 INFO:teuthology.orchestra.run.smithi027.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-07-05T23:31:49.599 INFO:teuthology.orchestra.run.smithi027.stdout: python3-babel-2.5.1-7.el8.noarch 2023-07-05T23:31:49.599 INFO:teuthology.orchestra.run.smithi027.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-07-05T23:31:49.599 INFO:teuthology.orchestra.run.smithi027.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-07-05T23:31:49.599 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-07-05T23:31:49.599 INFO:teuthology.orchestra.run.smithi027.stdout: python3-ceph-argparse-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T23:31:49.599 INFO:teuthology.orchestra.run.smithi027.stdout: python3-ceph-common-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T23:31:49.600 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cephfs-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T23:31:49.600 INFO:teuthology.orchestra.run.smithi027.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-07-05T23:31:49.600 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-07-05T23:31:49.600 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-07-05T23:31:49.600 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-07-05T23:31:49.600 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-07-05T23:31:49.600 INFO:teuthology.orchestra.run.smithi027.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-07-05T23:31:49.600 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco-6.2-6.el8.noarch 2023-07-05T23:31:49.601 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-07-05T23:31:49.601 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-07-05T23:31:49.601 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-07-05T23:31:49.601 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-07-05T23:31:49.601 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-07-05T23:31:49.601 INFO:teuthology.orchestra.run.smithi027.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-07-05T23:31:49.601 INFO:teuthology.orchestra.run.smithi027.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-07-05T23:31:49.601 INFO:teuthology.orchestra.run.smithi027.stdout: python3-mako-1.0.6-13.el8.noarch 2023-07-05T23:31:49.602 INFO:teuthology.orchestra.run.smithi027.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-07-05T23:31:49.602 INFO:teuthology.orchestra.run.smithi027.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-07-05T23:31:49.602 INFO:teuthology.orchestra.run.smithi027.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-07-05T23:31:49.602 INFO:teuthology.orchestra.run.smithi027.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-07-05T23:31:49.602 INFO:teuthology.orchestra.run.smithi027.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-07-05T23:31:49.602 INFO:teuthology.orchestra.run.smithi027.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-07-05T23:31:49.602 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-07-05T23:31:49.602 INFO:teuthology.orchestra.run.smithi027.stdout: python3-portend-2.6-1.el8.noarch 2023-07-05T23:31:49.603 INFO:teuthology.orchestra.run.smithi027.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-07-05T23:31:49.603 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-07-05T23:31:49.603 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-07-05T23:31:49.603 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-07-05T23:31:49.603 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pycparser-2.14-14.el8.noarch 2023-07-05T23:31:49.603 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pytz-2017.2-9.el8.noarch 2023-07-05T23:31:49.603 INFO:teuthology.orchestra.run.smithi027.stdout: python3-rados-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T23:31:49.604 INFO:teuthology.orchestra.run.smithi027.stdout: python3-rbd-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T23:31:49.604 INFO:teuthology.orchestra.run.smithi027.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-07-05T23:31:49.604 INFO:teuthology.orchestra.run.smithi027.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-07-05T23:31:49.604 INFO:teuthology.orchestra.run.smithi027.stdout: python3-rgw-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T23:31:49.604 INFO:teuthology.orchestra.run.smithi027.stdout: python3-routes-2.4.1-12.el8.noarch 2023-07-05T23:31:49.604 INFO:teuthology.orchestra.run.smithi027.stdout: python3-rsa-4.8-1.el8.noarch 2023-07-05T23:31:49.604 INFO:teuthology.orchestra.run.smithi027.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-07-05T23:31:49.604 INFO:teuthology.orchestra.run.smithi027.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-07-05T23:31:49.605 INFO:teuthology.orchestra.run.smithi027.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-07-05T23:31:49.605 INFO:teuthology.orchestra.run.smithi027.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-07-05T23:31:49.605 INFO:teuthology.orchestra.run.smithi027.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-07-05T23:31:49.605 INFO:teuthology.orchestra.run.smithi027.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-07-05T23:31:49.605 INFO:teuthology.orchestra.run.smithi027.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-07-05T23:31:49.605 INFO:teuthology.orchestra.run.smithi027.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-07-05T23:31:49.605 INFO:teuthology.orchestra.run.smithi027.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-07-05T23:31:49.605 INFO:teuthology.orchestra.run.smithi027.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-07-05T23:31:49.606 INFO:teuthology.orchestra.run.smithi027.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-07-05T23:31:49.606 INFO:teuthology.orchestra.run.smithi027.stdout: rbd-fuse-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T23:31:49.606 INFO:teuthology.orchestra.run.smithi027.stdout: rbd-mirror-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T23:31:49.606 INFO:teuthology.orchestra.run.smithi027.stdout: rbd-nbd-2:18.0.0-4488.g0a781ef0.el8.x86_64 2023-07-05T23:31:49.606 INFO:teuthology.orchestra.run.smithi027.stdout: socat-1.7.4.1-1.el8.x86_64 2023-07-05T23:31:49.606 INFO:teuthology.orchestra.run.smithi027.stdout: thrift-0.13.0-2.el8.x86_64 2023-07-05T23:31:49.606 INFO:teuthology.orchestra.run.smithi027.stdout: uuid-1.6.2-43.el8.x86_64 2023-07-05T23:31:49.606 INFO:teuthology.orchestra.run.smithi027.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-07-05T23:31:49.607 INFO:teuthology.orchestra.run.smithi027.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-07-05T23:31:49.607 INFO:teuthology.orchestra.run.smithi027.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-07-05T23:31:49.607 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:31:49.608 INFO:teuthology.orchestra.run.smithi027.stdout:Complete! 2023-07-05T23:31:49.767 DEBUG:teuthology.parallel:result is None 2023-07-05T23:31:49.768 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=0a781ef0807ae9473fb1306ef07036226ca4f1a6 2023-07-05T23:31:49.909 DEBUG:teuthology.orchestra.run.smithi027:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-07-05T23:31:49.933 INFO:teuthology.orchestra.run.smithi027.stdout:18.0.0-4488.g0a781ef0.el8 2023-07-05T23:31:49.934 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4488.g0a781ef0.el8 2023-07-05T23:31:49.934 INFO:teuthology.task.install:The correct ceph version 18.0.0-4488.g0a781ef0 is installed. 2023-07-05T23:31:49.935 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=0a781ef0807ae9473fb1306ef07036226ca4f1a6 2023-07-05T23:31:50.075 DEBUG:teuthology.orchestra.run.smithi162:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-07-05T23:31:50.104 INFO:teuthology.orchestra.run.smithi162.stdout:18.0.0-4488.g0a781ef0.el8 2023-07-05T23:31:50.104 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4488.g0a781ef0.el8 2023-07-05T23:31:50.104 INFO:teuthology.task.install:The correct ceph version 18.0.0-4488.g0a781ef0 is installed. 2023-07-05T23:31:50.105 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-07-05T23:31:50.105 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-07-05T23:31:50.106 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-05T23:31:50.148 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-07-05T23:31:50.148 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-05T23:31:50.193 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-07-05T23:31:50.194 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-07-05T23:31:50.194 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/usr/bin/daemon-helper 2023-07-05T23:31:50.221 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-05T23:31:50.288 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-07-05T23:31:50.289 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/daemon-helper 2023-07-05T23:31:50.317 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-05T23:31:50.386 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-07-05T23:31:50.387 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-07-05T23:31:50.387 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-05T23:31:50.414 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-05T23:31:50.482 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-07-05T23:31:50.482 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-05T23:31:50.510 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-05T23:31:50.577 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-07-05T23:31:50.577 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-07-05T23:31:50.578 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/usr/bin/stdin-killer 2023-07-05T23:31:50.605 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-05T23:31:50.672 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-07-05T23:31:50.673 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/stdin-killer 2023-07-05T23:31:50.699 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-05T23:31:50.767 INFO:teuthology.run_tasks:Running task ceph... 2023-07-05T23:31:50.847 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-07-05T23:31:50.848 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 777 /var/log/ceph 2023-07-05T23:31:50.850 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 777 /var/log/ceph 2023-07-05T23:31:50.877 INFO:tasks.ceph:Disabling ceph logrotate... 2023-07-05T23:31:50.877 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm -f -- /etc/logrotate.d/ceph 2023-07-05T23:31:50.917 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /etc/logrotate.d/ceph 2023-07-05T23:31:50.943 INFO:tasks.ceph:Creating extra log directories... 2023-07-05T23:31:50.943 DEBUG:teuthology.orchestra.run.smithi027:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-07-05T23:31:50.984 DEBUG:teuthology.orchestra.run.smithi162:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-07-05T23:31:51.018 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-07-05T23:31:51.018 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-07-05T23:31:51.019 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-07-05T23:31:51.019 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-07-05T23:31:51.019 DEBUG:teuthology.orchestra.run.smithi027:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-07-05T23:31:51.066 DEBUG:teuthology.orchestra.run.smithi027:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-07-05T23:31:51.202 DEBUG:teuthology.orchestra.run.smithi027:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-07-05T23:31:51.229 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-07-05T23:31:51.229 DEBUG:teuthology.orchestra.run.smithi162:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-07-05T23:31:51.245 DEBUG:teuthology.orchestra.run.smithi162:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-07-05T23:31:51.380 DEBUG:teuthology.orchestra.run.smithi162:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-07-05T23:31:51.412 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-07-05T23:31:51.413 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-07-05T23:31:51.413 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2023-07-05_18:32:52-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7327586', 'branch': 'wip-rishabh-CephManager-in-CephFSTestCase', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/workunit/quota}', 'email': None, 'first_in_suite': False, 'job_id': '7327586', 'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '84139c18d56f518615369e8310ae4ecf07a36dcd'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2023-07-05_18:32:52-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.6', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-CephManager-in-CephFSTestCase'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '0a781ef0807ae9473fb1306ef07036226ca4f1a6'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '0a781ef0807ae9473fb1306ef07036226ca4f1a6'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-CephManager-in-CephFSTestCase', 'sha1': '0a781ef0807ae9473fb1306ef07036226ca4f1a6'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 80, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'sha1': '0a781ef0807ae9473fb1306ef07036226ca4f1a6', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-rishabh-CephManager-in-CephFSTestCase', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_0a781ef0807ae9473fb1306ef07036226ca4f1a6/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '0a781ef0807ae9473fb1306ef07036226ca4f1a6', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi027.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac=', 'smithi162.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '84139c18d56f518615369e8310ae4ecf07a36dcd'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '0a781ef0807ae9473fb1306ef07036226ca4f1a6'}}, {'ceph': None}, {'kclient': None}, {'workunit': {'clients': {'all': ['fs/quota']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'b53f236c1077f1d295baafb9e0ca9a4b447019d7', 'timestamp': '2023-07-05_18:32:52', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.23459'} 2023-07-05T23:31:51.414 DEBUG:teuthology.orchestra.run.smithi027:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-07-05T23:31:51.416 DEBUG:teuthology.orchestra.run.smithi162:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-07-05T23:31:51.464 DEBUG:teuthology.orchestra.run.smithi027:> sudo install -d -m0777 -- /var/run/ceph 2023-07-05T23:31:51.477 DEBUG:teuthology.orchestra.run.smithi162:> sudo install -d -m0777 -- /var/run/ceph 2023-07-05T23:31:51.530 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-07-05T23:31:51.530 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/scratch_devs of=/dev/stdout 2023-07-05T23:31:51.560 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-05T23:31:51.561 DEBUG:teuthology.orchestra.run.smithi027:> stat /dev/vg_nvme/lv_1 2023-07-05T23:31:51.616 INFO:teuthology.orchestra.run.smithi027.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-05T23:31:51.617 INFO:teuthology.orchestra.run.smithi027.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-05T23:31:51.617 INFO:teuthology.orchestra.run.smithi027.stdout:Device: 6h/6d Inode: 381001 Links: 1 2023-07-05T23:31:51.617 INFO:teuthology.orchestra.run.smithi027.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-05T23:31:51.617 INFO:teuthology.orchestra.run.smithi027.stdout:Context: system_u:object_r:device_t:s0 2023-07-05T23:31:51.618 INFO:teuthology.orchestra.run.smithi027.stdout:Access: 2023-07-05 23:31:42.649776128 +0000 2023-07-05T23:31:51.618 INFO:teuthology.orchestra.run.smithi027.stdout:Modify: 2023-07-05 23:28:53.803617736 +0000 2023-07-05T23:31:51.618 INFO:teuthology.orchestra.run.smithi027.stdout:Change: 2023-07-05 23:28:53.803617736 +0000 2023-07-05T23:31:51.618 INFO:teuthology.orchestra.run.smithi027.stdout: Birth: - 2023-07-05T23:31:51.618 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-05T23:31:51.682 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records in 2023-07-05T23:31:51.683 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records out 2023-07-05T23:31:51.683 INFO:teuthology.orchestra.run.smithi027.stderr:512 bytes copied, 0.00024059 s, 2.1 MB/s 2023-07-05T23:31:51.684 DEBUG:teuthology.orchestra.run.smithi027:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-05T23:31:51.742 DEBUG:teuthology.orchestra.run.smithi027:> stat /dev/vg_nvme/lv_2 2023-07-05T23:31:51.800 INFO:teuthology.orchestra.run.smithi027.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-05T23:31:51.800 INFO:teuthology.orchestra.run.smithi027.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-05T23:31:51.800 INFO:teuthology.orchestra.run.smithi027.stdout:Device: 6h/6d Inode: 380446 Links: 1 2023-07-05T23:31:51.800 INFO:teuthology.orchestra.run.smithi027.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-05T23:31:51.800 INFO:teuthology.orchestra.run.smithi027.stdout:Context: system_u:object_r:device_t:s0 2023-07-05T23:31:51.801 INFO:teuthology.orchestra.run.smithi027.stdout:Access: 2023-07-05 23:31:42.649776128 +0000 2023-07-05T23:31:51.801 INFO:teuthology.orchestra.run.smithi027.stdout:Modify: 2023-07-05 23:28:54.331604270 +0000 2023-07-05T23:31:51.801 INFO:teuthology.orchestra.run.smithi027.stdout:Change: 2023-07-05 23:28:54.331604270 +0000 2023-07-05T23:31:51.801 INFO:teuthology.orchestra.run.smithi027.stdout: Birth: - 2023-07-05T23:31:51.801 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-05T23:31:51.866 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records in 2023-07-05T23:31:51.867 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records out 2023-07-05T23:31:51.867 INFO:teuthology.orchestra.run.smithi027.stderr:512 bytes copied, 0.000205031 s, 2.5 MB/s 2023-07-05T23:31:51.867 DEBUG:teuthology.orchestra.run.smithi027:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-05T23:31:51.924 DEBUG:teuthology.orchestra.run.smithi027:> stat /dev/vg_nvme/lv_3 2023-07-05T23:31:51.981 INFO:teuthology.orchestra.run.smithi027.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-05T23:31:51.982 INFO:teuthology.orchestra.run.smithi027.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-05T23:31:51.982 INFO:teuthology.orchestra.run.smithi027.stdout:Device: 6h/6d Inode: 383202 Links: 1 2023-07-05T23:31:51.982 INFO:teuthology.orchestra.run.smithi027.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-05T23:31:51.982 INFO:teuthology.orchestra.run.smithi027.stdout:Context: system_u:object_r:device_t:s0 2023-07-05T23:31:51.982 INFO:teuthology.orchestra.run.smithi027.stdout:Access: 2023-07-05 23:31:42.649776128 +0000 2023-07-05T23:31:51.982 INFO:teuthology.orchestra.run.smithi027.stdout:Modify: 2023-07-05 23:28:54.879590295 +0000 2023-07-05T23:31:51.982 INFO:teuthology.orchestra.run.smithi027.stdout:Change: 2023-07-05 23:28:54.879590295 +0000 2023-07-05T23:31:51.983 INFO:teuthology.orchestra.run.smithi027.stdout: Birth: - 2023-07-05T23:31:51.983 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-05T23:31:52.047 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records in 2023-07-05T23:31:52.047 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records out 2023-07-05T23:31:52.048 INFO:teuthology.orchestra.run.smithi027.stderr:512 bytes copied, 0.00020209 s, 2.5 MB/s 2023-07-05T23:31:52.049 DEBUG:teuthology.orchestra.run.smithi027:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-05T23:31:52.107 DEBUG:teuthology.orchestra.run.smithi027:> stat /dev/vg_nvme/lv_4 2023-07-05T23:31:52.164 INFO:teuthology.orchestra.run.smithi027.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-05T23:31:52.164 INFO:teuthology.orchestra.run.smithi027.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-05T23:31:52.164 INFO:teuthology.orchestra.run.smithi027.stdout:Device: 6h/6d Inode: 383236 Links: 1 2023-07-05T23:31:52.165 INFO:teuthology.orchestra.run.smithi027.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-05T23:31:52.165 INFO:teuthology.orchestra.run.smithi027.stdout:Context: system_u:object_r:device_t:s0 2023-07-05T23:31:52.165 INFO:teuthology.orchestra.run.smithi027.stdout:Access: 2023-07-05 23:31:42.649776128 +0000 2023-07-05T23:31:52.165 INFO:teuthology.orchestra.run.smithi027.stdout:Modify: 2023-07-05 23:28:55.422576447 +0000 2023-07-05T23:31:52.165 INFO:teuthology.orchestra.run.smithi027.stdout:Change: 2023-07-05 23:28:55.422576447 +0000 2023-07-05T23:31:52.165 INFO:teuthology.orchestra.run.smithi027.stdout: Birth: - 2023-07-05T23:31:52.166 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-05T23:31:52.230 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records in 2023-07-05T23:31:52.231 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records out 2023-07-05T23:31:52.231 INFO:teuthology.orchestra.run.smithi027.stderr:512 bytes copied, 0.000216407 s, 2.4 MB/s 2023-07-05T23:31:52.232 DEBUG:teuthology.orchestra.run.smithi027:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-05T23:31:52.290 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-05T23:31:52.290 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-07-05T23:31:52.291 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/scratch_devs of=/dev/stdout 2023-07-05T23:31:52.312 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-05T23:31:52.312 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_1 2023-07-05T23:31:52.372 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-05T23:31:52.372 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-05T23:31:52.372 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 6h/6d Inode: 382159 Links: 1 2023-07-05T23:31:52.372 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-05T23:31:52.373 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2023-07-05T23:31:52.373 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2023-07-05 23:31:32.129694597 +0000 2023-07-05T23:31:52.373 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2023-07-05 23:28:39.872243679 +0000 2023-07-05T23:31:52.373 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2023-07-05 23:28:39.872243679 +0000 2023-07-05T23:31:52.373 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: - 2023-07-05T23:31:52.373 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-05T23:31:52.440 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2023-07-05T23:31:52.440 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2023-07-05T23:31:52.440 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000250955 s, 2.0 MB/s 2023-07-05T23:31:52.441 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-05T23:31:52.501 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_2 2023-07-05T23:31:52.561 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-05T23:31:52.562 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-05T23:31:52.562 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 6h/6d Inode: 378377 Links: 1 2023-07-05T23:31:52.562 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-05T23:31:52.562 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2023-07-05T23:31:52.562 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2023-07-05 23:31:32.129694597 +0000 2023-07-05T23:31:52.562 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2023-07-05 23:28:40.380232851 +0000 2023-07-05T23:31:52.563 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2023-07-05 23:28:40.380232851 +0000 2023-07-05T23:31:52.563 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: - 2023-07-05T23:31:52.563 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-05T23:31:52.631 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2023-07-05T23:31:52.631 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2023-07-05T23:31:52.632 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000251555 s, 2.0 MB/s 2023-07-05T23:31:52.633 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-05T23:31:52.693 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_3 2023-07-05T23:31:52.752 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-05T23:31:52.753 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-05T23:31:52.753 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 6h/6d Inode: 383138 Links: 1 2023-07-05T23:31:52.753 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-05T23:31:52.753 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2023-07-05T23:31:52.753 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2023-07-05 23:31:32.129694597 +0000 2023-07-05T23:31:52.754 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2023-07-05 23:28:40.910221554 +0000 2023-07-05T23:31:52.754 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2023-07-05 23:28:40.910221554 +0000 2023-07-05T23:31:52.754 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: - 2023-07-05T23:31:52.754 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-05T23:31:52.820 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2023-07-05T23:31:52.821 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2023-07-05T23:31:52.821 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000218135 s, 2.3 MB/s 2023-07-05T23:31:52.822 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-05T23:31:52.881 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_4 2023-07-05T23:31:52.940 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-05T23:31:52.940 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-05T23:31:52.940 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 6h/6d Inode: 382520 Links: 1 2023-07-05T23:31:52.940 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-05T23:31:52.940 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2023-07-05T23:31:52.941 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2023-07-05 23:31:32.129694597 +0000 2023-07-05T23:31:52.941 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2023-07-05 23:28:41.419210705 +0000 2023-07-05T23:31:52.941 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2023-07-05 23:28:41.419210705 +0000 2023-07-05T23:31:52.941 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: - 2023-07-05T23:31:52.941 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-05T23:31:53.009 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2023-07-05T23:31:53.010 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2023-07-05T23:31:53.010 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.0002471 s, 2.1 MB/s 2023-07-05T23:31:53.011 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-05T23:31:53.071 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-05T23:31:53.071 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi027.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi162.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-07-05T23:31:53.071 INFO:tasks.ceph:Generating config... 2023-07-05T23:31:53.073 INFO:tasks.ceph:[client] client mount timeout = 600 2023-07-05T23:31:53.073 INFO:tasks.ceph:[client] debug client = 20 2023-07-05T23:31:53.073 INFO:tasks.ceph:[client] debug ms = 1 2023-07-05T23:31:53.073 INFO:tasks.ceph:[client] pid file = 2023-07-05T23:31:53.074 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-07-05T23:31:53.074 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-07-05T23:31:53.074 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-07-05T23:31:53.074 INFO:tasks.ceph:[mds] debug mds = 20 2023-07-05T23:31:53.074 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-07-05T23:31:53.075 INFO:tasks.ceph:[mds] debug ms = 1 2023-07-05T23:31:53.075 INFO:tasks.ceph:[mds] mds debug frag = True 2023-07-05T23:31:53.075 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-07-05T23:31:53.075 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-07-05T23:31:53.075 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-07-05T23:31:53.076 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-07-05T23:31:53.076 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-07-05T23:31:53.076 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-07-05T23:31:53.076 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-07-05T23:31:53.076 INFO:tasks.ceph:[mgr] debug ms = 1 2023-07-05T23:31:53.077 INFO:tasks.ceph:[mon] debug mon = 20 2023-07-05T23:31:53.077 INFO:tasks.ceph:[mon] debug ms = 1 2023-07-05T23:31:53.077 INFO:tasks.ceph:[mon] debug paxos = 20 2023-07-05T23:31:53.078 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-07-05T23:31:53.078 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-07-05T23:31:53.078 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-07-05T23:31:53.078 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-07-05T23:31:53.079 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-07-05T23:31:53.079 INFO:tasks.ceph:[osd] debug ms = 1 2023-07-05T23:31:53.079 INFO:tasks.ceph:[osd] debug osd = 20 2023-07-05T23:31:53.079 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-07-05T23:31:53.079 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-07-05T23:31:53.080 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-07-05T23:31:53.080 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-07-05T23:31:53.080 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-07-05T23:31:53.080 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-07-05T23:31:53.080 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-07-05T23:31:53.081 INFO:tasks.ceph:Setting up mon.a... 2023-07-05T23:31:53.081 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-07-05T23:31:53.140 INFO:teuthology.orchestra.run.smithi027.stdout:creating /etc/ceph/ceph.keyring 2023-07-05T23:31:53.143 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-07-05T23:31:53.192 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-05T23:31:53.220 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.27'), ('mon.b', '172.21.15.162'), ('mon.c', '[v2:172.21.15.162:3301,v1:172.21.15.162:6790]')] 2023-07-05T23:31:53.221 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.27,172.21.15.162,[v2:172.21.15.162:3301,v1:172.21.15.162:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-07-05T23:31:53.222 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-07-05T23:31:53.223 DEBUG:teuthology.orchestra.run.smithi027:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-07-05T23:31:53.277 DEBUG:teuthology.orchestra.run.smithi027:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.27 --add b 172.21.15.162 --addv c '[v2:172.21.15.162:3301,v1:172.21.15.162:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-07-05T23:31:53.366 INFO:teuthology.orchestra.run.smithi027.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-07-05T23:31:53.367 INFO:teuthology.orchestra.run.smithi027.stdout:monmaptool: generated fsid 23eebe48-65f5-4d3c-8c2d-4aa171c055d5 2023-07-05T23:31:53.367 INFO:teuthology.orchestra.run.smithi027.stdout:setting min_mon_release = pacific 2023-07-05T23:31:53.367 INFO:teuthology.orchestra.run.smithi027.stdout:epoch 0 2023-07-05T23:31:53.367 INFO:teuthology.orchestra.run.smithi027.stdout:fsid 23eebe48-65f5-4d3c-8c2d-4aa171c055d5 2023-07-05T23:31:53.367 INFO:teuthology.orchestra.run.smithi027.stdout:last_changed 2023-07-05T23:31:53.365391+0000 2023-07-05T23:31:53.367 INFO:teuthology.orchestra.run.smithi027.stdout:created 2023-07-05T23:31:53.365391+0000 2023-07-05T23:31:53.368 INFO:teuthology.orchestra.run.smithi027.stdout:min_mon_release 16 (pacific) 2023-07-05T23:31:53.368 INFO:teuthology.orchestra.run.smithi027.stdout:election_strategy: 1 2023-07-05T23:31:53.368 INFO:teuthology.orchestra.run.smithi027.stdout:0: [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] mon.a 2023-07-05T23:31:53.368 INFO:teuthology.orchestra.run.smithi027.stdout:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2023-07-05T23:31:53.368 INFO:teuthology.orchestra.run.smithi027.stdout:2: [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] mon.c 2023-07-05T23:31:53.368 INFO:teuthology.orchestra.run.smithi027.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-07-05T23:31:53.370 DEBUG:teuthology.orchestra.run.smithi027:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-07-05T23:31:53.387 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 23eebe48-65f5-4d3c-8c2d-4aa171c055d5... 2023-07-05T23:31:53.389 DEBUG:teuthology.orchestra.run.smithi027:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-07-05T23:31:53.430 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-07-05T23:31:53.474 INFO:teuthology.orchestra.run.smithi027.stdout:[global] 2023-07-05T23:31:53.474 INFO:teuthology.orchestra.run.smithi027.stdout: chdir = "" 2023-07-05T23:31:53.475 INFO:teuthology.orchestra.run.smithi027.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-07-05T23:31:53.475 INFO:teuthology.orchestra.run.smithi027.stdout: auth supported = cephx 2023-07-05T23:31:53.475 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:31:53.475 INFO:teuthology.orchestra.run.smithi027.stdout: filestore xattr use omap = true 2023-07-05T23:31:53.475 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:31:53.475 INFO:teuthology.orchestra.run.smithi027.stdout: mon clock drift allowed = 1.000 2023-07-05T23:31:53.476 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:31:53.476 INFO:teuthology.orchestra.run.smithi027.stdout: osd crush chooseleaf type = 0 2023-07-05T23:31:53.476 INFO:teuthology.orchestra.run.smithi027.stdout: auth debug = true 2023-07-05T23:31:53.476 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:31:53.476 INFO:teuthology.orchestra.run.smithi027.stdout: ms die on old message = true 2023-07-05T23:31:53.476 INFO:teuthology.orchestra.run.smithi027.stdout: ms die on bug = true 2023-07-05T23:31:53.476 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:31:53.477 INFO:teuthology.orchestra.run.smithi027.stdout: mon max pg per osd = 10000 # >= luminous 2023-07-05T23:31:53.477 INFO:teuthology.orchestra.run.smithi027.stdout: mon pg warn max object skew = 0 2023-07-05T23:31:53.477 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:31:53.477 INFO:teuthology.orchestra.run.smithi027.stdout: # disable pg_autoscaler by default for new pools 2023-07-05T23:31:53.477 INFO:teuthology.orchestra.run.smithi027.stdout: osd_pool_default_pg_autoscale_mode = off 2023-07-05T23:31:53.477 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:31:53.477 INFO:teuthology.orchestra.run.smithi027.stdout: osd pool default size = 2 2023-07-05T23:31:53.477 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:31:53.478 INFO:teuthology.orchestra.run.smithi027.stdout: mon osd allow primary affinity = true 2023-07-05T23:31:53.478 INFO:teuthology.orchestra.run.smithi027.stdout: mon osd allow pg remap = true 2023-07-05T23:31:53.478 INFO:teuthology.orchestra.run.smithi027.stdout: mon warn on legacy crush tunables = false 2023-07-05T23:31:53.478 INFO:teuthology.orchestra.run.smithi027.stdout: mon warn on crush straw calc version zero = false 2023-07-05T23:31:53.478 INFO:teuthology.orchestra.run.smithi027.stdout: mon warn on no sortbitwise = false 2023-07-05T23:31:53.479 INFO:teuthology.orchestra.run.smithi027.stdout: mon warn on osd down out interval zero = false 2023-07-05T23:31:53.479 INFO:teuthology.orchestra.run.smithi027.stdout: mon warn on too few osds = false 2023-07-05T23:31:53.479 INFO:teuthology.orchestra.run.smithi027.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-07-05T23:31:53.479 INFO:teuthology.orchestra.run.smithi027.stdout: mon_warn_on_pool_no_redundancy = false 2023-07-05T23:31:53.479 INFO:teuthology.orchestra.run.smithi027.stdout: mon_allow_pool_size_one = true 2023-07-05T23:31:53.479 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:31:53.480 INFO:teuthology.orchestra.run.smithi027.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-07-05T23:31:53.480 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:31:53.480 INFO:teuthology.orchestra.run.smithi027.stdout: osd default data pool replay window = 5 2023-07-05T23:31:53.480 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:31:53.480 INFO:teuthology.orchestra.run.smithi027.stdout: mon allow pool delete = true 2023-07-05T23:31:53.480 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:31:53.480 INFO:teuthology.orchestra.run.smithi027.stdout: mon cluster log file level = debug 2023-07-05T23:31:53.481 INFO:teuthology.orchestra.run.smithi027.stdout: debug asserts on shutdown = true 2023-07-05T23:31:53.481 INFO:teuthology.orchestra.run.smithi027.stdout: mon health detail to clog = false 2023-07-05T23:31:53.481 INFO:teuthology.orchestra.run.smithi027.stdout: mon host = "172.21.15.27,172.21.15.162,[v2:172.21.15.162:3301,v1:172.21.15.162:6790]" 2023-07-05T23:31:53.482 INFO:teuthology.orchestra.run.smithi027.stdout: ms die on skipped message = False 2023-07-05T23:31:53.482 INFO:teuthology.orchestra.run.smithi027.stdout: fsid = 23eebe48-65f5-4d3c-8c2d-4aa171c055d5 2023-07-05T23:31:53.482 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:31:53.482 INFO:teuthology.orchestra.run.smithi027.stdout:[osd] 2023-07-05T23:31:53.482 INFO:teuthology.orchestra.run.smithi027.stdout: osd journal size = 100 2023-07-05T23:31:53.483 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:31:53.483 INFO:teuthology.orchestra.run.smithi027.stdout: osd scrub load threshold = 5.0 2023-07-05T23:31:53.483 INFO:teuthology.orchestra.run.smithi027.stdout: osd scrub max interval = 600 2023-07-05T23:31:53.483 INFO:teuthology.orchestra.run.smithi027.stdout: osd mclock profile = high_recovery_ops 2023-07-05T23:31:53.483 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:31:53.484 INFO:teuthology.orchestra.run.smithi027.stdout: osd recover clone overlap = true 2023-07-05T23:31:53.484 INFO:teuthology.orchestra.run.smithi027.stdout: osd recovery max chunk = 1048576 2023-07-05T23:31:53.484 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:31:53.484 INFO:teuthology.orchestra.run.smithi027.stdout: osd debug shutdown = true 2023-07-05T23:31:53.484 INFO:teuthology.orchestra.run.smithi027.stdout: osd debug op order = true 2023-07-05T23:31:53.485 INFO:teuthology.orchestra.run.smithi027.stdout: osd debug verify stray on activate = true 2023-07-05T23:31:53.485 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:31:53.485 INFO:teuthology.orchestra.run.smithi027.stdout: osd open classes on start = true 2023-07-05T23:31:53.485 INFO:teuthology.orchestra.run.smithi027.stdout: osd debug pg log writeout = true 2023-07-05T23:31:53.485 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:31:53.485 INFO:teuthology.orchestra.run.smithi027.stdout: osd deep scrub update digest min age = 30 2023-07-05T23:31:53.485 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:31:53.485 INFO:teuthology.orchestra.run.smithi027.stdout: osd map max advance = 10 2023-07-05T23:31:53.486 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:31:53.486 INFO:teuthology.orchestra.run.smithi027.stdout: journal zero on create = true 2023-07-05T23:31:53.486 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:31:53.486 INFO:teuthology.orchestra.run.smithi027.stdout: filestore ondisk finisher threads = 3 2023-07-05T23:31:53.486 INFO:teuthology.orchestra.run.smithi027.stdout: filestore apply finisher threads = 3 2023-07-05T23:31:53.486 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:31:53.486 INFO:teuthology.orchestra.run.smithi027.stdout: bdev debug aio = true 2023-07-05T23:31:53.486 INFO:teuthology.orchestra.run.smithi027.stdout: osd debug misdirected ops = true 2023-07-05T23:31:53.487 INFO:teuthology.orchestra.run.smithi027.stdout: bluestore block size = 96636764160 2023-07-05T23:31:53.487 INFO:teuthology.orchestra.run.smithi027.stdout: bluestore fsck on mount = True 2023-07-05T23:31:53.487 INFO:teuthology.orchestra.run.smithi027.stdout: debug bluefs = 20 2023-07-05T23:31:53.487 INFO:teuthology.orchestra.run.smithi027.stdout: debug bluestore = 20 2023-07-05T23:31:53.487 INFO:teuthology.orchestra.run.smithi027.stdout: debug ms = 1 2023-07-05T23:31:53.488 INFO:teuthology.orchestra.run.smithi027.stdout: debug osd = 20 2023-07-05T23:31:53.488 INFO:teuthology.orchestra.run.smithi027.stdout: debug rocksdb = 10 2023-07-05T23:31:53.488 INFO:teuthology.orchestra.run.smithi027.stdout: mon osd backfillfull_ratio = 0.85 2023-07-05T23:31:53.488 INFO:teuthology.orchestra.run.smithi027.stdout: mon osd full ratio = 0.9 2023-07-05T23:31:53.488 INFO:teuthology.orchestra.run.smithi027.stdout: mon osd nearfull ratio = 0.8 2023-07-05T23:31:53.488 INFO:teuthology.orchestra.run.smithi027.stdout: osd failsafe full ratio = 0.95 2023-07-05T23:31:53.488 INFO:teuthology.orchestra.run.smithi027.stdout: osd objectstore = bluestore 2023-07-05T23:31:53.488 INFO:teuthology.orchestra.run.smithi027.stdout: osd op complaint time = 180 2023-07-05T23:31:53.489 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:31:53.489 INFO:teuthology.orchestra.run.smithi027.stdout:[mgr] 2023-07-05T23:31:53.489 INFO:teuthology.orchestra.run.smithi027.stdout: debug ms = 1 2023-07-05T23:31:53.489 INFO:teuthology.orchestra.run.smithi027.stdout: debug mgr = 20 2023-07-05T23:31:53.489 INFO:teuthology.orchestra.run.smithi027.stdout: debug mon = 20 2023-07-05T23:31:53.489 INFO:teuthology.orchestra.run.smithi027.stdout: debug auth = 20 2023-07-05T23:31:53.489 INFO:teuthology.orchestra.run.smithi027.stdout: mon reweight min pgs per osd = 4 2023-07-05T23:31:53.489 INFO:teuthology.orchestra.run.smithi027.stdout: mon reweight min bytes per osd = 10 2023-07-05T23:31:53.490 INFO:teuthology.orchestra.run.smithi027.stdout: mgr/telemetry/nag = false 2023-07-05T23:31:53.490 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:31:53.490 INFO:teuthology.orchestra.run.smithi027.stdout:[mon] 2023-07-05T23:31:53.490 INFO:teuthology.orchestra.run.smithi027.stdout: debug ms = 1 2023-07-05T23:31:53.490 INFO:teuthology.orchestra.run.smithi027.stdout: debug mon = 20 2023-07-05T23:31:53.490 INFO:teuthology.orchestra.run.smithi027.stdout: debug paxos = 20 2023-07-05T23:31:53.490 INFO:teuthology.orchestra.run.smithi027.stdout: debug auth = 20 2023-07-05T23:31:53.490 INFO:teuthology.orchestra.run.smithi027.stdout: mon data avail warn = 5 2023-07-05T23:31:53.491 INFO:teuthology.orchestra.run.smithi027.stdout: mon mgr mkfs grace = 240 2023-07-05T23:31:53.491 INFO:teuthology.orchestra.run.smithi027.stdout: mon reweight min pgs per osd = 4 2023-07-05T23:31:53.491 INFO:teuthology.orchestra.run.smithi027.stdout: mon osd reporter subtree level = osd 2023-07-05T23:31:53.491 INFO:teuthology.orchestra.run.smithi027.stdout: mon osd prime pg temp = true 2023-07-05T23:31:53.491 INFO:teuthology.orchestra.run.smithi027.stdout: mon reweight min bytes per osd = 10 2023-07-05T23:31:53.491 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:31:53.491 INFO:teuthology.orchestra.run.smithi027.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-07-05T23:31:53.492 INFO:teuthology.orchestra.run.smithi027.stdout: auth mon ticket ttl = 660 # 11m 2023-07-05T23:31:53.492 INFO:teuthology.orchestra.run.smithi027.stdout: auth service ticket ttl = 240 # 4m 2023-07-05T23:31:53.492 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:31:53.492 INFO:teuthology.orchestra.run.smithi027.stdout: # don't complain about insecure global_id in the test suite 2023-07-05T23:31:53.492 INFO:teuthology.orchestra.run.smithi027.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-07-05T23:31:53.493 INFO:teuthology.orchestra.run.smithi027.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-07-05T23:31:53.493 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:31:53.493 INFO:teuthology.orchestra.run.smithi027.stdout: # 1m isn't quite enough 2023-07-05T23:31:53.493 INFO:teuthology.orchestra.run.smithi027.stdout: mon_down_mkfs_grace = 2m 2023-07-05T23:31:53.493 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:31:53.493 INFO:teuthology.orchestra.run.smithi027.stdout: mon_warn_on_filestore_osds = false 2023-07-05T23:31:53.493 INFO:teuthology.orchestra.run.smithi027.stdout: mon op complaint time = 120 2023-07-05T23:31:53.493 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:31:53.494 INFO:teuthology.orchestra.run.smithi027.stdout:[client] 2023-07-05T23:31:53.494 INFO:teuthology.orchestra.run.smithi027.stdout: rgw cache enabled = true 2023-07-05T23:31:53.494 INFO:teuthology.orchestra.run.smithi027.stdout: rgw enable ops log = true 2023-07-05T23:31:53.494 INFO:teuthology.orchestra.run.smithi027.stdout: rgw enable usage log = true 2023-07-05T23:31:53.495 INFO:teuthology.orchestra.run.smithi027.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-07-05T23:31:53.495 INFO:teuthology.orchestra.run.smithi027.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-07-05T23:31:53.495 INFO:teuthology.orchestra.run.smithi027.stdout: client mount timeout = 600 2023-07-05T23:31:53.495 INFO:teuthology.orchestra.run.smithi027.stdout: debug client = 20 2023-07-05T23:31:53.496 INFO:teuthology.orchestra.run.smithi027.stdout: debug ms = 1 2023-07-05T23:31:53.496 INFO:teuthology.orchestra.run.smithi027.stdout: pid file = "" 2023-07-05T23:31:53.496 INFO:teuthology.orchestra.run.smithi027.stdout: rados mon op timeout = 900 2023-07-05T23:31:53.496 INFO:teuthology.orchestra.run.smithi027.stdout: rados osd op timeout = 900 2023-07-05T23:31:53.497 INFO:teuthology.orchestra.run.smithi027.stdout:[mon.a] 2023-07-05T23:31:53.497 INFO:teuthology.orchestra.run.smithi027.stdout:[mon.b] 2023-07-05T23:31:53.497 INFO:teuthology.orchestra.run.smithi027.stdout:[mon.c] 2023-07-05T23:31:53.497 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.a] 2023-07-05T23:31:53.498 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.c] 2023-07-05T23:31:53.498 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.b] 2023-07-05T23:31:53.498 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.d] 2023-07-05T23:31:53.499 INFO:teuthology.orchestra.run.smithi027.stdout:[mds] 2023-07-05T23:31:53.499 INFO:teuthology.orchestra.run.smithi027.stdout: debug mds = 20 2023-07-05T23:31:53.499 INFO:teuthology.orchestra.run.smithi027.stdout: debug mds balancer = 20 2023-07-05T23:31:53.500 INFO:teuthology.orchestra.run.smithi027.stdout: debug ms = 1 2023-07-05T23:31:53.500 INFO:teuthology.orchestra.run.smithi027.stdout: mds debug frag = True 2023-07-05T23:31:53.500 INFO:teuthology.orchestra.run.smithi027.stdout: mds debug scatterstat = True 2023-07-05T23:31:53.501 INFO:teuthology.orchestra.run.smithi027.stdout: mds op complaint time = 180 2023-07-05T23:31:53.501 INFO:teuthology.orchestra.run.smithi027.stdout: mds verify scatter = True 2023-07-05T23:31:53.501 INFO:teuthology.orchestra.run.smithi027.stdout: osd op complaint time = 180 2023-07-05T23:31:53.501 INFO:teuthology.orchestra.run.smithi027.stdout: rados mon op timeout = 900 2023-07-05T23:31:53.501 INFO:teuthology.orchestra.run.smithi027.stdout: rados osd op timeout = 900 2023-07-05T23:31:53.502 INFO:teuthology.orchestra.run.smithi162.stdout:[global] 2023-07-05T23:31:53.502 INFO:teuthology.orchestra.run.smithi162.stdout: chdir = "" 2023-07-05T23:31:53.503 INFO:teuthology.orchestra.run.smithi162.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-07-05T23:31:53.503 INFO:teuthology.orchestra.run.smithi162.stdout: auth supported = cephx 2023-07-05T23:31:53.503 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-07-05T23:31:53.503 INFO:teuthology.orchestra.run.smithi162.stdout: filestore xattr use omap = true 2023-07-05T23:31:53.503 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-07-05T23:31:53.503 INFO:teuthology.orchestra.run.smithi162.stdout: mon clock drift allowed = 1.000 2023-07-05T23:31:53.503 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-07-05T23:31:53.504 INFO:teuthology.orchestra.run.smithi162.stdout: osd crush chooseleaf type = 0 2023-07-05T23:31:53.504 INFO:teuthology.orchestra.run.smithi162.stdout: auth debug = true 2023-07-05T23:31:53.504 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-07-05T23:31:53.504 INFO:teuthology.orchestra.run.smithi162.stdout: ms die on old message = true 2023-07-05T23:31:53.504 INFO:teuthology.orchestra.run.smithi162.stdout: ms die on bug = true 2023-07-05T23:31:53.504 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-07-05T23:31:53.504 INFO:teuthology.orchestra.run.smithi162.stdout: mon max pg per osd = 10000 # >= luminous 2023-07-05T23:31:53.504 INFO:teuthology.orchestra.run.smithi162.stdout: mon pg warn max object skew = 0 2023-07-05T23:31:53.505 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-07-05T23:31:53.505 INFO:teuthology.orchestra.run.smithi162.stdout: # disable pg_autoscaler by default for new pools 2023-07-05T23:31:53.505 INFO:teuthology.orchestra.run.smithi162.stdout: osd_pool_default_pg_autoscale_mode = off 2023-07-05T23:31:53.505 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-07-05T23:31:53.505 INFO:teuthology.orchestra.run.smithi162.stdout: osd pool default size = 2 2023-07-05T23:31:53.505 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-07-05T23:31:53.505 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd allow primary affinity = true 2023-07-05T23:31:53.506 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd allow pg remap = true 2023-07-05T23:31:53.506 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on legacy crush tunables = false 2023-07-05T23:31:53.506 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on crush straw calc version zero = false 2023-07-05T23:31:53.506 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on no sortbitwise = false 2023-07-05T23:31:53.506 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on osd down out interval zero = false 2023-07-05T23:31:53.506 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on too few osds = false 2023-07-05T23:31:53.506 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-07-05T23:31:53.506 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_pool_no_redundancy = false 2023-07-05T23:31:53.507 INFO:teuthology.orchestra.run.smithi162.stdout: mon_allow_pool_size_one = true 2023-07-05T23:31:53.507 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-07-05T23:31:53.507 INFO:teuthology.orchestra.run.smithi162.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-07-05T23:31:53.507 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-07-05T23:31:53.507 INFO:teuthology.orchestra.run.smithi162.stdout: osd default data pool replay window = 5 2023-07-05T23:31:53.507 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-07-05T23:31:53.507 INFO:teuthology.orchestra.run.smithi162.stdout: mon allow pool delete = true 2023-07-05T23:31:53.507 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-07-05T23:31:53.508 INFO:teuthology.orchestra.run.smithi162.stdout: mon cluster log file level = debug 2023-07-05T23:31:53.508 INFO:teuthology.orchestra.run.smithi162.stdout: debug asserts on shutdown = true 2023-07-05T23:31:53.508 INFO:teuthology.orchestra.run.smithi162.stdout: mon health detail to clog = false 2023-07-05T23:31:53.508 INFO:teuthology.orchestra.run.smithi162.stdout: mon host = "172.21.15.27,172.21.15.162,[v2:172.21.15.162:3301,v1:172.21.15.162:6790]" 2023-07-05T23:31:53.508 INFO:teuthology.orchestra.run.smithi162.stdout: ms die on skipped message = False 2023-07-05T23:31:53.508 INFO:teuthology.orchestra.run.smithi162.stdout: fsid = 23eebe48-65f5-4d3c-8c2d-4aa171c055d5 2023-07-05T23:31:53.509 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-07-05T23:31:53.509 INFO:teuthology.orchestra.run.smithi162.stdout:[osd] 2023-07-05T23:31:53.509 INFO:teuthology.orchestra.run.smithi162.stdout: osd journal size = 100 2023-07-05T23:31:53.509 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-07-05T23:31:53.509 INFO:teuthology.orchestra.run.smithi162.stdout: osd scrub load threshold = 5.0 2023-07-05T23:31:53.509 INFO:teuthology.orchestra.run.smithi162.stdout: osd scrub max interval = 600 2023-07-05T23:31:53.509 INFO:teuthology.orchestra.run.smithi162.stdout: osd mclock profile = high_recovery_ops 2023-07-05T23:31:53.509 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-07-05T23:31:53.510 INFO:teuthology.orchestra.run.smithi162.stdout: osd recover clone overlap = true 2023-07-05T23:31:53.510 INFO:teuthology.orchestra.run.smithi162.stdout: osd recovery max chunk = 1048576 2023-07-05T23:31:53.510 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-07-05T23:31:53.510 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug shutdown = true 2023-07-05T23:31:53.510 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug op order = true 2023-07-05T23:31:53.510 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug verify stray on activate = true 2023-07-05T23:31:53.510 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-07-05T23:31:53.510 INFO:teuthology.orchestra.run.smithi162.stdout: osd open classes on start = true 2023-07-05T23:31:53.511 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug pg log writeout = true 2023-07-05T23:31:53.511 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-07-05T23:31:53.511 INFO:teuthology.orchestra.run.smithi162.stdout: osd deep scrub update digest min age = 30 2023-07-05T23:31:53.511 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-07-05T23:31:53.511 INFO:teuthology.orchestra.run.smithi162.stdout: osd map max advance = 10 2023-07-05T23:31:53.511 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-07-05T23:31:53.511 INFO:teuthology.orchestra.run.smithi162.stdout: journal zero on create = true 2023-07-05T23:31:53.511 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-07-05T23:31:53.512 INFO:teuthology.orchestra.run.smithi162.stdout: filestore ondisk finisher threads = 3 2023-07-05T23:31:53.512 INFO:teuthology.orchestra.run.smithi162.stdout: filestore apply finisher threads = 3 2023-07-05T23:31:53.512 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-07-05T23:31:53.512 INFO:teuthology.orchestra.run.smithi162.stdout: bdev debug aio = true 2023-07-05T23:31:53.512 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug misdirected ops = true 2023-07-05T23:31:53.512 INFO:teuthology.orchestra.run.smithi162.stdout: bluestore block size = 96636764160 2023-07-05T23:31:53.512 INFO:teuthology.orchestra.run.smithi162.stdout: bluestore fsck on mount = True 2023-07-05T23:31:53.513 INFO:teuthology.orchestra.run.smithi162.stdout: debug bluefs = 20 2023-07-05T23:31:53.513 INFO:teuthology.orchestra.run.smithi162.stdout: debug bluestore = 20 2023-07-05T23:31:53.513 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2023-07-05T23:31:53.513 INFO:teuthology.orchestra.run.smithi162.stdout: debug osd = 20 2023-07-05T23:31:53.513 INFO:teuthology.orchestra.run.smithi162.stdout: debug rocksdb = 10 2023-07-05T23:31:53.513 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd backfillfull_ratio = 0.85 2023-07-05T23:31:53.513 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd full ratio = 0.9 2023-07-05T23:31:53.513 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd nearfull ratio = 0.8 2023-07-05T23:31:53.514 INFO:teuthology.orchestra.run.smithi162.stdout: osd failsafe full ratio = 0.95 2023-07-05T23:31:53.514 INFO:teuthology.orchestra.run.smithi162.stdout: osd objectstore = bluestore 2023-07-05T23:31:53.514 INFO:teuthology.orchestra.run.smithi162.stdout: osd op complaint time = 180 2023-07-05T23:31:53.514 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-07-05T23:31:53.514 INFO:teuthology.orchestra.run.smithi162.stdout:[mgr] 2023-07-05T23:31:53.514 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2023-07-05T23:31:53.514 INFO:teuthology.orchestra.run.smithi162.stdout: debug mgr = 20 2023-07-05T23:31:53.514 INFO:teuthology.orchestra.run.smithi162.stdout: debug mon = 20 2023-07-05T23:31:53.515 INFO:teuthology.orchestra.run.smithi162.stdout: debug auth = 20 2023-07-05T23:31:53.515 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min pgs per osd = 4 2023-07-05T23:31:53.515 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min bytes per osd = 10 2023-07-05T23:31:53.515 INFO:teuthology.orchestra.run.smithi162.stdout: mgr/telemetry/nag = false 2023-07-05T23:31:53.515 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-07-05T23:31:53.515 INFO:teuthology.orchestra.run.smithi162.stdout:[mon] 2023-07-05T23:31:53.515 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2023-07-05T23:31:53.515 INFO:teuthology.orchestra.run.smithi162.stdout: debug mon = 20 2023-07-05T23:31:53.516 INFO:teuthology.orchestra.run.smithi162.stdout: debug paxos = 20 2023-07-05T23:31:53.516 INFO:teuthology.orchestra.run.smithi162.stdout: debug auth = 20 2023-07-05T23:31:53.516 INFO:teuthology.orchestra.run.smithi162.stdout: mon data avail warn = 5 2023-07-05T23:31:53.516 INFO:teuthology.orchestra.run.smithi162.stdout: mon mgr mkfs grace = 240 2023-07-05T23:31:53.516 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min pgs per osd = 4 2023-07-05T23:31:53.516 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd reporter subtree level = osd 2023-07-05T23:31:53.516 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd prime pg temp = true 2023-07-05T23:31:53.516 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min bytes per osd = 10 2023-07-05T23:31:53.517 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-07-05T23:31:53.517 INFO:teuthology.orchestra.run.smithi162.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-07-05T23:31:53.517 INFO:teuthology.orchestra.run.smithi162.stdout: auth mon ticket ttl = 660 # 11m 2023-07-05T23:31:53.517 INFO:teuthology.orchestra.run.smithi162.stdout: auth service ticket ttl = 240 # 4m 2023-07-05T23:31:53.517 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-07-05T23:31:53.517 INFO:teuthology.orchestra.run.smithi162.stdout: # don't complain about insecure global_id in the test suite 2023-07-05T23:31:53.517 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-07-05T23:31:53.517 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-07-05T23:31:53.518 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-07-05T23:31:53.518 INFO:teuthology.orchestra.run.smithi162.stdout: # 1m isn't quite enough 2023-07-05T23:31:53.518 INFO:teuthology.orchestra.run.smithi162.stdout: mon_down_mkfs_grace = 2m 2023-07-05T23:31:53.518 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-07-05T23:31:53.518 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_filestore_osds = false 2023-07-05T23:31:53.519 INFO:teuthology.orchestra.run.smithi162.stdout: mon op complaint time = 120 2023-07-05T23:31:53.519 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-07-05T23:31:53.519 INFO:teuthology.orchestra.run.smithi162.stdout:[client] 2023-07-05T23:31:53.519 INFO:teuthology.orchestra.run.smithi162.stdout: rgw cache enabled = true 2023-07-05T23:31:53.519 INFO:teuthology.orchestra.run.smithi162.stdout: rgw enable ops log = true 2023-07-05T23:31:53.519 INFO:teuthology.orchestra.run.smithi162.stdout: rgw enable usage log = true 2023-07-05T23:31:53.519 INFO:teuthology.orchestra.run.smithi162.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-07-05T23:31:53.520 INFO:teuthology.orchestra.run.smithi162.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-07-05T23:31:53.520 INFO:teuthology.orchestra.run.smithi162.stdout: client mount timeout = 600 2023-07-05T23:31:53.520 INFO:teuthology.orchestra.run.smithi162.stdout: debug client = 20 2023-07-05T23:31:53.520 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2023-07-05T23:31:53.520 INFO:teuthology.orchestra.run.smithi162.stdout: pid file = "" 2023-07-05T23:31:53.520 INFO:teuthology.orchestra.run.smithi162.stdout: rados mon op timeout = 900 2023-07-05T23:31:53.520 INFO:teuthology.orchestra.run.smithi162.stdout: rados osd op timeout = 900 2023-07-05T23:31:53.521 INFO:teuthology.orchestra.run.smithi162.stdout:[mon.a] 2023-07-05T23:31:53.521 INFO:teuthology.orchestra.run.smithi162.stdout:[mon.b] 2023-07-05T23:31:53.521 INFO:teuthology.orchestra.run.smithi162.stdout:[mon.c] 2023-07-05T23:31:53.521 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.a] 2023-07-05T23:31:53.521 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.c] 2023-07-05T23:31:53.521 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.b] 2023-07-05T23:31:53.521 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.d] 2023-07-05T23:31:53.521 INFO:teuthology.orchestra.run.smithi162.stdout:[mds] 2023-07-05T23:31:53.522 INFO:teuthology.orchestra.run.smithi162.stdout: debug mds = 20 2023-07-05T23:31:53.522 INFO:teuthology.orchestra.run.smithi162.stdout: debug mds balancer = 20 2023-07-05T23:31:53.522 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2023-07-05T23:31:53.522 INFO:teuthology.orchestra.run.smithi162.stdout: mds debug frag = True 2023-07-05T23:31:53.522 INFO:teuthology.orchestra.run.smithi162.stdout: mds debug scatterstat = True 2023-07-05T23:31:53.522 INFO:teuthology.orchestra.run.smithi162.stdout: mds op complaint time = 180 2023-07-05T23:31:53.522 INFO:teuthology.orchestra.run.smithi162.stdout: mds verify scatter = True 2023-07-05T23:31:53.522 INFO:teuthology.orchestra.run.smithi162.stdout: osd op complaint time = 180 2023-07-05T23:31:53.523 INFO:teuthology.orchestra.run.smithi162.stdout: rados mon op timeout = 900 2023-07-05T23:31:53.523 INFO:teuthology.orchestra.run.smithi162.stdout: rados osd op timeout = 900 2023-07-05T23:31:53.523 INFO:tasks.ceph:Creating admin key on mon.a... 2023-07-05T23:31:53.523 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-07-05T23:31:53.601 INFO:tasks.ceph:Copying monmap to all nodes... 2023-07-05T23:31:53.601 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-07-05T23:31:53.601 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-07-05T23:31:53.618 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-07-05T23:31:53.618 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-07-05T23:31:53.674 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi027.front.sepia.ceph.com 2023-07-05T23:31:53.674 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-07-05T23:31:53.675 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/etc/ceph/ceph.keyring 2023-07-05T23:31:53.675 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-05T23:31:53.752 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-07-05T23:31:53.752 DEBUG:teuthology.orchestra.run.smithi027:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-07-05T23:31:53.809 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi162.front.sepia.ceph.com 2023-07-05T23:31:53.809 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-07-05T23:31:53.810 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/ceph/ceph.keyring 2023-07-05T23:31:53.810 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-05T23:31:53.853 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-07-05T23:31:53.854 DEBUG:teuthology.orchestra.run.smithi162:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-07-05T23:31:53.912 INFO:tasks.ceph:Setting up mon nodes... 2023-07-05T23:31:53.913 INFO:tasks.ceph:Setting up mgr nodes... 2023-07-05T23:31:53.913 DEBUG:teuthology.orchestra.run.smithi027:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-07-05T23:31:53.968 INFO:teuthology.orchestra.run.smithi027.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-07-05T23:31:53.971 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-07-05T23:31:54.032 INFO:teuthology.orchestra.run.smithi162.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-07-05T23:31:54.035 INFO:tasks.ceph:Setting up mds nodes... 2023-07-05T23:31:54.036 DEBUG:teuthology.orchestra.run.smithi027:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-07-05T23:31:54.090 INFO:teuthology.orchestra.run.smithi027.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-07-05T23:31:54.093 DEBUG:teuthology.orchestra.run.smithi027:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-07-05T23:31:54.120 DEBUG:teuthology.orchestra.run.smithi027:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-07-05T23:31:54.215 INFO:teuthology.orchestra.run.smithi027.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-07-05T23:31:54.217 DEBUG:teuthology.orchestra.run.smithi027:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-07-05T23:31:54.244 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-07-05T23:31:54.300 INFO:teuthology.orchestra.run.smithi162.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-07-05T23:31:54.302 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-07-05T23:31:54.330 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-07-05T23:31:54.423 INFO:teuthology.orchestra.run.smithi162.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-07-05T23:31:54.425 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-07-05T23:31:54.452 INFO:tasks.ceph_client:Setting up client nodes... 2023-07-05T23:31:54.453 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-07-05T23:31:54.498 INFO:teuthology.orchestra.run.smithi027.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-07-05T23:31:54.512 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-07-05T23:31:54.557 INFO:teuthology.orchestra.run.smithi027.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-07-05T23:31:54.570 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-07-05T23:31:54.613 INFO:teuthology.orchestra.run.smithi162.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-07-05T23:31:54.626 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-07-05T23:31:54.709 INFO:teuthology.orchestra.run.smithi162.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-07-05T23:31:54.722 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-07-05T23:31:54.723 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi027.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi162.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-07-05T23:31:54.723 DEBUG:teuthology.orchestra.run.smithi027:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-07-05T23:31:54.751 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-05T23:31:54.751 INFO:tasks.ceph:role: osd.0 2023-07-05T23:31:54.751 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi027.front.sepia.ceph.com 2023-07-05T23:31:54.752 DEBUG:teuthology.orchestra.run.smithi027:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-07-05T23:31:54.825 INFO:teuthology.orchestra.run.smithi027.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-07-05T23:31:54.825 INFO:teuthology.orchestra.run.smithi027.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-05T23:31:54.825 INFO:teuthology.orchestra.run.smithi027.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-05T23:31:54.826 INFO:teuthology.orchestra.run.smithi027.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-05T23:31:54.826 INFO:teuthology.orchestra.run.smithi027.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-05T23:31:54.826 INFO:teuthology.orchestra.run.smithi027.stdout: = sunit=0 swidth=0 blks 2023-07-05T23:31:54.826 INFO:teuthology.orchestra.run.smithi027.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-05T23:31:54.826 INFO:teuthology.orchestra.run.smithi027.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-05T23:31:54.826 INFO:teuthology.orchestra.run.smithi027.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-05T23:31:54.826 INFO:teuthology.orchestra.run.smithi027.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-05T23:31:55.251 INFO:teuthology.orchestra.run.smithi027.stdout:Discarding blocks...Done. 2023-07-05T23:31:55.253 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi027.front.sepia.ceph.com -o noatime 2023-07-05T23:31:55.253 DEBUG:teuthology.orchestra.run.smithi027:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-07-05T23:31:55.440 DEBUG:teuthology.orchestra.run.smithi027:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-07-05T23:31:55.479 DEBUG:teuthology.orchestra.run.smithi027:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-07-05T23:31:55.552 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-05T23:31:55.552 INFO:tasks.ceph:role: osd.1 2023-07-05T23:31:55.553 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi027.front.sepia.ceph.com 2023-07-05T23:31:55.553 DEBUG:teuthology.orchestra.run.smithi027:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-07-05T23:31:55.629 INFO:teuthology.orchestra.run.smithi027.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-07-05T23:31:55.630 INFO:teuthology.orchestra.run.smithi027.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-05T23:31:55.630 INFO:teuthology.orchestra.run.smithi027.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-05T23:31:55.630 INFO:teuthology.orchestra.run.smithi027.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-05T23:31:55.630 INFO:teuthology.orchestra.run.smithi027.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-05T23:31:55.630 INFO:teuthology.orchestra.run.smithi027.stdout: = sunit=0 swidth=0 blks 2023-07-05T23:31:55.630 INFO:teuthology.orchestra.run.smithi027.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-05T23:31:55.630 INFO:teuthology.orchestra.run.smithi027.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-05T23:31:55.631 INFO:teuthology.orchestra.run.smithi027.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-05T23:31:55.631 INFO:teuthology.orchestra.run.smithi027.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-05T23:31:56.042 INFO:teuthology.orchestra.run.smithi027.stdout:Discarding blocks...Done. 2023-07-05T23:31:56.044 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi027.front.sepia.ceph.com -o noatime 2023-07-05T23:31:56.044 DEBUG:teuthology.orchestra.run.smithi027:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-07-05T23:31:56.161 DEBUG:teuthology.orchestra.run.smithi027:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-07-05T23:31:56.197 DEBUG:teuthology.orchestra.run.smithi027:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-07-05T23:31:56.267 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-05T23:31:56.267 INFO:tasks.ceph:role: osd.2 2023-07-05T23:31:56.268 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi027.front.sepia.ceph.com 2023-07-05T23:31:56.268 DEBUG:teuthology.orchestra.run.smithi027:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-07-05T23:31:56.345 INFO:teuthology.orchestra.run.smithi027.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-07-05T23:31:56.345 INFO:teuthology.orchestra.run.smithi027.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-05T23:31:56.345 INFO:teuthology.orchestra.run.smithi027.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-05T23:31:56.345 INFO:teuthology.orchestra.run.smithi027.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-05T23:31:56.345 INFO:teuthology.orchestra.run.smithi027.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-05T23:31:56.346 INFO:teuthology.orchestra.run.smithi027.stdout: = sunit=0 swidth=0 blks 2023-07-05T23:31:56.346 INFO:teuthology.orchestra.run.smithi027.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-05T23:31:56.346 INFO:teuthology.orchestra.run.smithi027.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-05T23:31:56.346 INFO:teuthology.orchestra.run.smithi027.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-05T23:31:56.346 INFO:teuthology.orchestra.run.smithi027.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-05T23:31:56.791 INFO:teuthology.orchestra.run.smithi027.stdout:Discarding blocks...Done. 2023-07-05T23:31:56.793 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi027.front.sepia.ceph.com -o noatime 2023-07-05T23:31:56.794 DEBUG:teuthology.orchestra.run.smithi027:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-07-05T23:31:56.958 DEBUG:teuthology.orchestra.run.smithi027:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-07-05T23:31:56.994 DEBUG:teuthology.orchestra.run.smithi027:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-07-05T23:31:57.065 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-05T23:31:57.066 INFO:tasks.ceph:role: osd.3 2023-07-05T23:31:57.066 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi027.front.sepia.ceph.com 2023-07-05T23:31:57.066 DEBUG:teuthology.orchestra.run.smithi027:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-07-05T23:31:57.143 INFO:teuthology.orchestra.run.smithi027.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-07-05T23:31:57.144 INFO:teuthology.orchestra.run.smithi027.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-05T23:31:57.144 INFO:teuthology.orchestra.run.smithi027.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-05T23:31:57.144 INFO:teuthology.orchestra.run.smithi027.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-05T23:31:57.144 INFO:teuthology.orchestra.run.smithi027.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-05T23:31:57.144 INFO:teuthology.orchestra.run.smithi027.stdout: = sunit=0 swidth=0 blks 2023-07-05T23:31:57.144 INFO:teuthology.orchestra.run.smithi027.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-05T23:31:57.145 INFO:teuthology.orchestra.run.smithi027.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-05T23:31:57.145 INFO:teuthology.orchestra.run.smithi027.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-05T23:31:57.145 INFO:teuthology.orchestra.run.smithi027.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-05T23:31:57.579 INFO:teuthology.orchestra.run.smithi027.stdout:Discarding blocks...Done. 2023-07-05T23:31:57.581 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi027.front.sepia.ceph.com -o noatime 2023-07-05T23:31:57.582 DEBUG:teuthology.orchestra.run.smithi027:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-07-05T23:31:57.759 DEBUG:teuthology.orchestra.run.smithi027:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-07-05T23:31:57.796 DEBUG:teuthology.orchestra.run.smithi027:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-05T23:31:57.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:31:57.904+0000 7fb9ed6e2640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-07-05T23:31:57.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:31:57.904+0000 7fb9ed6e2640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-07-05T23:31:57.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:31:57.904+0000 7fb9ed6e2640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-05T23:31:57.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:31:57.904+0000 7fb9ed6e2640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-05T23:31:57.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:31:57.904+0000 7fb9ed6e2640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-05T23:31:57.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:31:57.905+0000 7fb9ed6e2640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-07-05T23:32:00.781 DEBUG:teuthology.orchestra.run.smithi027:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-07-05T23:32:00.815 DEBUG:teuthology.orchestra.run.smithi027:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-05T23:32:00.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:00.905+0000 7f42d56ff640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-07-05T23:32:00.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:00.905+0000 7f42d56ff640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-07-05T23:32:00.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:00.905+0000 7f42d56ff640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-05T23:32:00.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:00.905+0000 7f42d56ff640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-05T23:32:00.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:00.905+0000 7f42d56ff640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-05T23:32:00.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:00.906+0000 7f42d56ff640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-07-05T23:32:03.776 DEBUG:teuthology.orchestra.run.smithi027:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-07-05T23:32:03.809 DEBUG:teuthology.orchestra.run.smithi027:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-05T23:32:03.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:03.902+0000 7f901688a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-07-05T23:32:03.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:03.902+0000 7f901688a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-07-05T23:32:03.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:03.902+0000 7f901688a640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-05T23:32:03.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:03.902+0000 7f901688a640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-05T23:32:03.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:03.902+0000 7f901688a640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-05T23:32:03.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:03.902+0000 7f901688a640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-07-05T23:32:06.783 DEBUG:teuthology.orchestra.run.smithi027:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-07-05T23:32:06.817 DEBUG:teuthology.orchestra.run.smithi027:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-05T23:32:06.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:06.908+0000 7fe67f36c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-07-05T23:32:06.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:06.909+0000 7fe67f36c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-07-05T23:32:06.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:06.909+0000 7fe67f36c640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-05T23:32:06.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:06.909+0000 7fe67f36c640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-05T23:32:06.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:06.909+0000 7fe67f36c640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-05T23:32:06.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:06.909+0000 7fe67f36c640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-07-05T23:32:09.774 DEBUG:teuthology.orchestra.run.smithi027:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-07-05T23:32:09.807 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-07-05T23:32:09.841 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-05T23:32:09.841 INFO:tasks.ceph:role: osd.4 2023-07-05T23:32:09.841 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi162.front.sepia.ceph.com 2023-07-05T23:32:09.841 DEBUG:teuthology.orchestra.run.smithi162:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-07-05T23:32:09.919 INFO:teuthology.orchestra.run.smithi162.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-07-05T23:32:09.920 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-05T23:32:09.920 INFO:teuthology.orchestra.run.smithi162.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-05T23:32:09.920 INFO:teuthology.orchestra.run.smithi162.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-05T23:32:09.920 INFO:teuthology.orchestra.run.smithi162.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-05T23:32:09.920 INFO:teuthology.orchestra.run.smithi162.stdout: = sunit=0 swidth=0 blks 2023-07-05T23:32:09.920 INFO:teuthology.orchestra.run.smithi162.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-05T23:32:09.920 INFO:teuthology.orchestra.run.smithi162.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-05T23:32:09.921 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-05T23:32:09.921 INFO:teuthology.orchestra.run.smithi162.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-05T23:32:10.364 INFO:teuthology.orchestra.run.smithi162.stdout:Discarding blocks...Done. 2023-07-05T23:32:10.366 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi162.front.sepia.ceph.com -o noatime 2023-07-05T23:32:10.366 DEBUG:teuthology.orchestra.run.smithi162:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-07-05T23:32:10.537 DEBUG:teuthology.orchestra.run.smithi162:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-07-05T23:32:10.577 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-07-05T23:32:10.646 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-05T23:32:10.647 INFO:tasks.ceph:role: osd.5 2023-07-05T23:32:10.647 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi162.front.sepia.ceph.com 2023-07-05T23:32:10.647 DEBUG:teuthology.orchestra.run.smithi162:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-07-05T23:32:10.723 INFO:teuthology.orchestra.run.smithi162.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-07-05T23:32:10.723 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-05T23:32:10.724 INFO:teuthology.orchestra.run.smithi162.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-05T23:32:10.724 INFO:teuthology.orchestra.run.smithi162.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-05T23:32:10.724 INFO:teuthology.orchestra.run.smithi162.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-05T23:32:10.724 INFO:teuthology.orchestra.run.smithi162.stdout: = sunit=0 swidth=0 blks 2023-07-05T23:32:10.724 INFO:teuthology.orchestra.run.smithi162.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-05T23:32:10.724 INFO:teuthology.orchestra.run.smithi162.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-05T23:32:10.724 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-05T23:32:10.725 INFO:teuthology.orchestra.run.smithi162.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-05T23:32:11.151 INFO:teuthology.orchestra.run.smithi162.stdout:Discarding blocks...Done. 2023-07-05T23:32:11.153 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi162.front.sepia.ceph.com -o noatime 2023-07-05T23:32:11.154 DEBUG:teuthology.orchestra.run.smithi162:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-07-05T23:32:11.268 DEBUG:teuthology.orchestra.run.smithi162:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-07-05T23:32:11.301 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-07-05T23:32:11.371 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-05T23:32:11.371 INFO:tasks.ceph:role: osd.6 2023-07-05T23:32:11.371 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi162.front.sepia.ceph.com 2023-07-05T23:32:11.372 DEBUG:teuthology.orchestra.run.smithi162:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-07-05T23:32:11.448 INFO:teuthology.orchestra.run.smithi162.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-07-05T23:32:11.448 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-05T23:32:11.448 INFO:teuthology.orchestra.run.smithi162.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-05T23:32:11.449 INFO:teuthology.orchestra.run.smithi162.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-05T23:32:11.449 INFO:teuthology.orchestra.run.smithi162.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-05T23:32:11.449 INFO:teuthology.orchestra.run.smithi162.stdout: = sunit=0 swidth=0 blks 2023-07-05T23:32:11.449 INFO:teuthology.orchestra.run.smithi162.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-05T23:32:11.449 INFO:teuthology.orchestra.run.smithi162.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-05T23:32:11.449 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-05T23:32:11.450 INFO:teuthology.orchestra.run.smithi162.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-05T23:32:11.898 INFO:teuthology.orchestra.run.smithi162.stdout:Discarding blocks...Done. 2023-07-05T23:32:11.900 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi162.front.sepia.ceph.com -o noatime 2023-07-05T23:32:11.901 DEBUG:teuthology.orchestra.run.smithi162:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-07-05T23:32:12.071 DEBUG:teuthology.orchestra.run.smithi162:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-07-05T23:32:12.109 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-07-05T23:32:12.180 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-05T23:32:12.180 INFO:tasks.ceph:role: osd.7 2023-07-05T23:32:12.180 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi162.front.sepia.ceph.com 2023-07-05T23:32:12.181 DEBUG:teuthology.orchestra.run.smithi162:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-07-05T23:32:12.256 INFO:teuthology.orchestra.run.smithi162.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-07-05T23:32:12.257 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-05T23:32:12.257 INFO:teuthology.orchestra.run.smithi162.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-05T23:32:12.258 INFO:teuthology.orchestra.run.smithi162.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-05T23:32:12.258 INFO:teuthology.orchestra.run.smithi162.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-05T23:32:12.258 INFO:teuthology.orchestra.run.smithi162.stdout: = sunit=0 swidth=0 blks 2023-07-05T23:32:12.259 INFO:teuthology.orchestra.run.smithi162.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-05T23:32:12.259 INFO:teuthology.orchestra.run.smithi162.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-05T23:32:12.259 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-05T23:32:12.259 INFO:teuthology.orchestra.run.smithi162.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-05T23:32:12.701 INFO:teuthology.orchestra.run.smithi162.stdout:Discarding blocks...Done. 2023-07-05T23:32:12.703 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi162.front.sepia.ceph.com -o noatime 2023-07-05T23:32:12.703 DEBUG:teuthology.orchestra.run.smithi162:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-07-05T23:32:12.872 DEBUG:teuthology.orchestra.run.smithi162:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-07-05T23:32:12.910 DEBUG:teuthology.orchestra.run.smithi162:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-05T23:32:13.022 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:13.018+0000 7f2d8f0e5640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-07-05T23:32:13.022 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:13.019+0000 7f2d8f0e5640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-07-05T23:32:13.022 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:13.019+0000 7f2d8f0e5640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-05T23:32:13.022 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:13.019+0000 7f2d8f0e5640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-05T23:32:13.023 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:13.019+0000 7f2d8f0e5640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-05T23:32:13.023 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:13.019+0000 7f2d8f0e5640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-07-05T23:32:15.891 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-07-05T23:32:15.922 DEBUG:teuthology.orchestra.run.smithi162:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-05T23:32:16.014 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:16.010+0000 7fca725d4640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-07-05T23:32:16.014 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:16.011+0000 7fca725d4640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-07-05T23:32:16.014 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:16.011+0000 7fca725d4640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-05T23:32:16.014 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:16.011+0000 7fca725d4640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-05T23:32:16.015 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:16.011+0000 7fca725d4640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-05T23:32:16.015 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:16.011+0000 7fca725d4640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-07-05T23:32:18.880 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-07-05T23:32:18.912 DEBUG:teuthology.orchestra.run.smithi162:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-05T23:32:19.004 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:19.001+0000 7f7e06a2b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-07-05T23:32:19.004 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:19.001+0000 7f7e06a2b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-07-05T23:32:19.004 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:19.001+0000 7f7e06a2b640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-05T23:32:19.005 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:19.001+0000 7f7e06a2b640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-05T23:32:19.005 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:19.001+0000 7f7e06a2b640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-05T23:32:19.005 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:19.001+0000 7f7e06a2b640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-07-05T23:32:21.416 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:32:21.419 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:32:21.877 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-07-05T23:32:21.908 DEBUG:teuthology.orchestra.run.smithi162:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-05T23:32:21.998 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:21.995+0000 7f4de7513640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-07-05T23:32:21.998 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:21.995+0000 7f4de7513640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-07-05T23:32:21.999 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:21.995+0000 7f4de7513640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-05T23:32:21.999 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:21.995+0000 7f4de7513640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-05T23:32:21.999 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:21.995+0000 7f4de7513640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-05T23:32:21.999 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:21.996+0000 7f4de7513640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-07-05T23:32:24.868 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-07-05T23:32:24.900 INFO:tasks.ceph:Reading keys from all nodes... 2023-07-05T23:32:24.901 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-07-05T23:32:24.901 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-07-05T23:32:24.934 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-07-05T23:32:24.935 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-07-05T23:32:25.006 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-07-05T23:32:25.006 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-07-05T23:32:25.076 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-07-05T23:32:25.077 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-07-05T23:32:25.145 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-07-05T23:32:25.146 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-07-05T23:32:25.214 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-07-05T23:32:25.215 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-07-05T23:32:25.283 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-07-05T23:32:25.284 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-07-05T23:32:25.352 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-07-05T23:32:25.352 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-07-05T23:32:25.385 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-07-05T23:32:25.385 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-07-05T23:32:25.455 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-07-05T23:32:25.455 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-07-05T23:32:25.524 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-07-05T23:32:25.525 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-07-05T23:32:25.592 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-07-05T23:32:25.592 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-07-05T23:32:25.659 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-07-05T23:32:25.660 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-07-05T23:32:25.727 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-07-05T23:32:25.727 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-07-05T23:32:25.793 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-07-05T23:32:25.794 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-07-05T23:32:25.813 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-07-05T23:32:25.814 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-07-05T23:32:25.873 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-07-05T23:32:25.874 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-07-05T23:32:25.892 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-07-05T23:32:25.892 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-07-05T23:32:25.948 INFO:tasks.ceph:Adding keys to all mons... 2023-07-05T23:32:25.948 DEBUG:teuthology.orchestra.run.smithi027:> sudo tee -a /etc/ceph/ceph.keyring 2023-07-05T23:32:25.951 DEBUG:teuthology.orchestra.run.smithi162:> sudo tee -a /etc/ceph/ceph.keyring 2023-07-05T23:32:25.990 INFO:teuthology.orchestra.run.smithi027.stdout:[mgr.y] 2023-07-05T23:32:25.991 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQBp/aVk77CnORAAmYjcNGSHStUHu3v+JyD7Sw== 2023-07-05T23:32:25.991 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.a] 2023-07-05T23:32:25.991 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQBq/aVk/D5SBRAAgdtOkaQ+xz52uuaxH5Gr6A== 2023-07-05T23:32:25.991 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.c] 2023-07-05T23:32:25.991 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQBq/aVke6zFDBAAHZ0xJF9D+aQa5mnEUu0IGg== 2023-07-05T23:32:25.991 INFO:teuthology.orchestra.run.smithi027.stdout:[osd.0] 2023-07-05T23:32:25.992 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQBt/aVkGaj7NRAANty794uD85/Ha0NmkF2anw== 2023-07-05T23:32:25.992 INFO:teuthology.orchestra.run.smithi027.stdout:[osd.1] 2023-07-05T23:32:25.992 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQBw/aVkUKX9NRAAFVP+yHmHZfANJH5yYrueDA== 2023-07-05T23:32:25.992 INFO:teuthology.orchestra.run.smithi027.stdout:[osd.2] 2023-07-05T23:32:25.992 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQBz/aVkU2PJNRAAKVZYkDJ8v3Z9I6IeuwD2Rg== 2023-07-05T23:32:25.993 INFO:teuthology.orchestra.run.smithi027.stdout:[osd.3] 2023-07-05T23:32:25.993 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQB2/aVkFNUvNhAA5yJ5D6jS4h8AeWus3QEXsQ== 2023-07-05T23:32:25.993 INFO:teuthology.orchestra.run.smithi027.stdout:[mgr.x] 2023-07-05T23:32:25.993 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQBq/aVkHRzhARAAInBgUeN3Cer74Lg1J2Q0+A== 2023-07-05T23:32:25.993 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.b] 2023-07-05T23:32:25.993 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQBq/aVkhHDSERAA3A5iTAAE8wJRJRLEOo3Srg== 2023-07-05T23:32:25.993 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.d] 2023-07-05T23:32:25.994 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQBq/aVkb2IkGRAA266nuppMstoFgSfSJsjI1A== 2023-07-05T23:32:25.994 INFO:teuthology.orchestra.run.smithi027.stdout:[osd.4] 2023-07-05T23:32:25.994 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQB9/aVkFSc5ARAAGWhUcK7u+H1tDAJlDEqRoA== 2023-07-05T23:32:25.994 INFO:teuthology.orchestra.run.smithi027.stdout:[osd.5] 2023-07-05T23:32:25.994 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQCA/aVkffe9ABAAAc3lIlh8VwD+fRTKllgFog== 2023-07-05T23:32:25.994 INFO:teuthology.orchestra.run.smithi027.stdout:[osd.6] 2023-07-05T23:32:25.994 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQCD/aVkLo4oABAAA5L26Kc0jSBDZmDaLpuqjA== 2023-07-05T23:32:25.994 INFO:teuthology.orchestra.run.smithi027.stdout:[osd.7] 2023-07-05T23:32:25.995 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQCF/aVkyBFrOxAAkD+j+EMbdt8xfP1onN6lhQ== 2023-07-05T23:32:25.995 INFO:teuthology.orchestra.run.smithi027.stdout:[client.0] 2023-07-05T23:32:25.995 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQBq/aVkB2ClHRAAv5LAsDv59S03Seqgtrxvcw== 2023-07-05T23:32:25.995 INFO:teuthology.orchestra.run.smithi027.stdout:[client.2] 2023-07-05T23:32:25.995 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQBq/aVkvm0jIRAA+7CAxtHyY11QiT4NQ01Mng== 2023-07-05T23:32:25.996 INFO:teuthology.orchestra.run.smithi027.stdout:[client.1] 2023-07-05T23:32:25.996 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQBq/aVkMi5+JBAA+fi/Hc83oZ0N71jAySlpYQ== 2023-07-05T23:32:25.996 INFO:teuthology.orchestra.run.smithi027.stdout:[client.3] 2023-07-05T23:32:25.996 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQBq/aVkau85KhAAmbQNu3B9IJEo+xP1tolGHw== 2023-07-05T23:32:26.012 INFO:teuthology.orchestra.run.smithi162.stdout:[mgr.y] 2023-07-05T23:32:26.013 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBp/aVk77CnORAAmYjcNGSHStUHu3v+JyD7Sw== 2023-07-05T23:32:26.014 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.a] 2023-07-05T23:32:26.014 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBq/aVk/D5SBRAAgdtOkaQ+xz52uuaxH5Gr6A== 2023-07-05T23:32:26.014 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.c] 2023-07-05T23:32:26.014 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBq/aVke6zFDBAAHZ0xJF9D+aQa5mnEUu0IGg== 2023-07-05T23:32:26.015 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.0] 2023-07-05T23:32:26.015 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBt/aVkGaj7NRAANty794uD85/Ha0NmkF2anw== 2023-07-05T23:32:26.015 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.1] 2023-07-05T23:32:26.016 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBw/aVkUKX9NRAAFVP+yHmHZfANJH5yYrueDA== 2023-07-05T23:32:26.016 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.2] 2023-07-05T23:32:26.016 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBz/aVkU2PJNRAAKVZYkDJ8v3Z9I6IeuwD2Rg== 2023-07-05T23:32:26.017 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.3] 2023-07-05T23:32:26.017 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQB2/aVkFNUvNhAA5yJ5D6jS4h8AeWus3QEXsQ== 2023-07-05T23:32:26.018 INFO:teuthology.orchestra.run.smithi162.stdout:[mgr.x] 2023-07-05T23:32:26.018 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBq/aVkHRzhARAAInBgUeN3Cer74Lg1J2Q0+A== 2023-07-05T23:32:26.019 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.b] 2023-07-05T23:32:26.019 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBq/aVkhHDSERAA3A5iTAAE8wJRJRLEOo3Srg== 2023-07-05T23:32:26.019 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.d] 2023-07-05T23:32:26.019 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBq/aVkb2IkGRAA266nuppMstoFgSfSJsjI1A== 2023-07-05T23:32:26.020 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.4] 2023-07-05T23:32:26.020 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQB9/aVkFSc5ARAAGWhUcK7u+H1tDAJlDEqRoA== 2023-07-05T23:32:26.020 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.5] 2023-07-05T23:32:26.020 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQCA/aVkffe9ABAAAc3lIlh8VwD+fRTKllgFog== 2023-07-05T23:32:26.021 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.6] 2023-07-05T23:32:26.022 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQCD/aVkLo4oABAAA5L26Kc0jSBDZmDaLpuqjA== 2023-07-05T23:32:26.022 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.7] 2023-07-05T23:32:26.022 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQCF/aVkyBFrOxAAkD+j+EMbdt8xfP1onN6lhQ== 2023-07-05T23:32:26.022 INFO:teuthology.orchestra.run.smithi162.stdout:[client.0] 2023-07-05T23:32:26.022 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBq/aVkB2ClHRAAv5LAsDv59S03Seqgtrxvcw== 2023-07-05T23:32:26.022 INFO:teuthology.orchestra.run.smithi162.stdout:[client.2] 2023-07-05T23:32:26.023 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBq/aVkvm0jIRAA+7CAxtHyY11QiT4NQ01Mng== 2023-07-05T23:32:26.023 INFO:teuthology.orchestra.run.smithi162.stdout:[client.1] 2023-07-05T23:32:26.023 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBq/aVkMi5+JBAA+fi/Hc83oZ0N71jAySlpYQ== 2023-07-05T23:32:26.023 INFO:teuthology.orchestra.run.smithi162.stdout:[client.3] 2023-07-05T23:32:26.023 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBq/aVkau85KhAAmbQNu3B9IJEo+xP1tolGHw== 2023-07-05T23:32:26.024 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-05T23:32:26.040 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-05T23:32:26.117 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-05T23:32:26.119 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-05T23:32:26.179 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-05T23:32:26.181 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-05T23:32:26.238 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-05T23:32:26.242 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-05T23:32:26.296 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-05T23:32:26.299 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-05T23:32:26.352 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-05T23:32:26.363 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-05T23:32:26.416 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-05T23:32:26.418 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-05T23:32:26.471 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-05T23:32:26.473 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-05T23:32:26.526 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-05T23:32:26.528 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-05T23:32:26.584 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-05T23:32:26.586 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-05T23:32:26.641 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-05T23:32:26.644 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-05T23:32:26.697 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-05T23:32:26.706 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-05T23:32:26.759 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-05T23:32:26.761 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-05T23:32:26.814 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-05T23:32:26.816 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-05T23:32:26.870 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-05T23:32:26.872 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-05T23:32:26.928 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-05T23:32:26.930 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-05T23:32:26.986 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-05T23:32:26.989 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-05T23:32:27.046 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-05T23:32:27.048 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-05T23:32:27.104 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-07-05T23:32:27.105 DEBUG:teuthology.orchestra.run.smithi027:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-07-05T23:32:27.132 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-05T23:32:27.231 DEBUG:teuthology.orchestra.run.smithi027:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-07-05T23:32:27.257 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-07-05T23:32:27.285 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-05T23:32:27.382 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-07-05T23:32:27.408 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-07-05T23:32:27.475 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-05T23:32:27.573 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-07-05T23:32:27.599 DEBUG:teuthology.orchestra.run.smithi027:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-07-05T23:32:27.602 DEBUG:teuthology.orchestra.run.smithi162:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-07-05T23:32:27.655 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-07-05T23:32:27.656 INFO:tasks.ceph.mon.a:Restarting daemon 2023-07-05T23:32:27.656 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-07-05T23:32:27.659 INFO:tasks.ceph.mon.a:Started 2023-07-05T23:32:27.660 INFO:tasks.ceph.mon.b:Restarting daemon 2023-07-05T23:32:27.660 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-07-05T23:32:27.698 INFO:tasks.ceph.mon.b:Started 2023-07-05T23:32:27.698 INFO:tasks.ceph.mon.c:Restarting daemon 2023-07-05T23:32:27.699 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-07-05T23:32:27.700 INFO:tasks.ceph.mon.c:Started 2023-07-05T23:32:27.701 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-07-05T23:32:27.701 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-07-05T23:32:27.701 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-07-05T23:32:27.704 INFO:tasks.ceph.mgr.y:Started 2023-07-05T23:32:27.704 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-07-05T23:32:27.705 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-07-05T23:32:27.706 INFO:tasks.ceph.mgr.x:Started 2023-07-05T23:32:27.707 INFO:tasks.ceph:Setting crush tunables to default 2023-07-05T23:32:27.707 DEBUG:teuthology.orchestra.run.smithi027:> sudo ceph --cluster ceph osd crush tunables default 2023-07-05T23:32:27.834 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:27.831+0000 7f4775939700 1 Processor -- start 2023-07-05T23:32:27.834 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:27.831+0000 7f4775939700 1 -- start start 2023-07-05T23:32:27.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:27.832+0000 7f4775939700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f477015c430 0x7f47700ceb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:27.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:27.832+0000 7f4775939700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f477006b410 0x7f477006ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:27.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:27.832+0000 7f4775939700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f477006d660 con 0x7f477006d210 2023-07-05T23:32:27.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:27.832+0000 7f4775939700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47700660e0 con 0x7f477015c430 2023-07-05T23:32:27.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:27.832+0000 7f4775939700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f477015c800 con 0x7f477006b410 2023-07-05T23:32:27.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:27.832+0000 7f476effd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f477015c430 0x7f47700ceb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:27.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:27.832+0000 7f476effd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f477015c430 0x7f47700ceb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44056/0 (socket says 172.21.15.27:44056) 2023-07-05T23:32:27.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:27.832+0000 7f476effd700 1 -- 172.21.15.27:0/1571354943 learned_addr learned my addr 172.21.15.27:0/1571354943 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:32:27.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:27.832+0000 7f476effd700 1 -- 172.21.15.27:0/1571354943 >> v2:172.21.15.27:3300/0 conn(0x7f477015c430 msgr2=0x7f47700ceb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-07-05T23:32:27.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:27.832+0000 7f476effd700 1 -- 172.21.15.27:0/1571354943 >> v2:172.21.15.27:3300/0 conn(0x7f477015c430 msgr2=0x7f47700ceb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-05T23:32:27.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:27.832+0000 7f476effd700 1 --2- 172.21.15.27:0/1571354943 >> v2:172.21.15.27:3300/0 conn(0x7f477015c430 0x7f47700ceb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-05T23:32:27.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:27.832+0000 7f476effd700 1 --2- 172.21.15.27:0/1571354943 >> v2:172.21.15.27:3300/0 conn(0x7f477015c430 0x7f47700ceb00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-05T23:32:27.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:27.832+0000 7f476e7fc700 1 --2- 172.21.15.27:0/1571354943 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f477006b410 0x7f477006ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:27.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:27.832+0000 7f476e7fc700 1 -- 172.21.15.27:0/1571354943 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f477006b410 msgr2=0x7f477006ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-07-05T23:32:27.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:27.832+0000 7f476e7fc700 1 -- 172.21.15.27:0/1571354943 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f477006b410 msgr2=0x7f477006ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-05T23:32:27.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:27.833+0000 7f476e7fc700 1 --2- 172.21.15.27:0/1571354943 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f477006b410 0x7f477006ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-05T23:32:27.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:27.833+0000 7f476e7fc700 1 --2- 172.21.15.27:0/1571354943 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f477006b410 0x7f477006ccd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-05T23:32:28.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.018+0000 7f476dffb700 1 -- 172.21.15.27:0/1571354943 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1006836180 0 0) 0x7f4760001490 con 0x7f477006d210 2023-07-05T23:32:28.022 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.018+0000 7f476dffb700 1 -- 172.21.15.27:0/1571354943 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f475c0035b0 con 0x7f477006d210 2023-07-05T23:32:28.027 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.023+0000 7f476dffb700 1 -- 172.21.15.27:0/1571354943 <== mon.1 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 122804708 0 0) 0x7f475c0035b0 con 0x7f477006d210 2023-07-05T23:32:28.027 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.023+0000 7f476dffb700 1 -- 172.21.15.27:0/1571354943 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f477006b410 msgr2=0x7f477006ccd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-05T23:32:28.027 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.023+0000 7f476dffb700 1 --2- 172.21.15.27:0/1571354943 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f477006b410 0x7f477006ccd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:28.027 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.023+0000 7f476dffb700 1 -- 172.21.15.27:0/1571354943 >> v2:172.21.15.27:3300/0 conn(0x7f477015c430 msgr2=0x7f47700ceb00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-05T23:32:28.027 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.023+0000 7f476dffb700 1 --2- 172.21.15.27:0/1571354943 >> v2:172.21.15.27:3300/0 conn(0x7f477015c430 0x7f47700ceb00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:28.027 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.023+0000 7f476dffb700 1 -- 172.21.15.27:0/1571354943 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4770070f60 con 0x7f477006d210 2023-07-05T23:32:28.028 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.023+0000 7f476dffb700 1 -- 172.21.15.27:0/1571354943 <== mon.1 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1246168953 0 0) 0x7f4760001b80 con 0x7f477006d210 2023-07-05T23:32:28.028 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.023+0000 7f476dffb700 1 -- 172.21.15.27:0/1571354943 >> v1:172.21.15.162:6789/0 conn(0x7f477006d210 legacy=0x7f4770069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:28.028 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.023+0000 7f476dffb700 1 --2- 172.21.15.27:0/1571354943 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f475c003a00 0x7f475c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:28.028 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.023+0000 7f476dffb700 1 --2- 172.21.15.27:0/1571354943 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f475c004850 0x7f475c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:28.028 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.023+0000 7f476dffb700 1 --2- 172.21.15.27:0/1571354943 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f477006b410 0x7f475c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:28.028 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.023+0000 7f476dffb700 1 -- 172.21.15.27:0/1571354943 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f477015c800 con 0x7f475c003a00 2023-07-05T23:32:28.028 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.023+0000 7f476dffb700 1 -- 172.21.15.27:0/1571354943 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f475c00bac0 con 0x7f475c004850 2023-07-05T23:32:28.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.023+0000 7f476dffb700 1 -- 172.21.15.27:0/1571354943 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f475c00bc50 con 0x7f477006b410 2023-07-05T23:32:28.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.023+0000 7f476effd700 1 --2- 172.21.15.27:0/1571354943 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f475c003a00 0x7f475c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:28.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.023+0000 7f476e7fc700 1 --2- 172.21.15.27:0/1571354943 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f475c004850 0x7f475c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:28.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.023+0000 7f476f7fe700 1 --2- 172.21.15.27:0/1571354943 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f477006b410 0x7f475c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:28.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.023+0000 7f476effd700 1 -- 172.21.15.27:0/1571354943 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f477006b410 msgr2=0x7f475c005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:32:28.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.023+0000 7f476effd700 1 --2- 172.21.15.27:0/1571354943 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f477006b410 0x7f475c005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:28.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.023+0000 7f476effd700 1 -- 172.21.15.27:0/1571354943 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f475c004850 msgr2=0x7f475c004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:32:28.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.024+0000 7f476effd700 1 --2- 172.21.15.27:0/1571354943 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f475c004850 0x7f475c004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:28.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.024+0000 7f476effd700 1 -- 172.21.15.27:0/1571354943 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f475c0035b0 con 0x7f475c003a00 2023-07-05T23:32:28.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.024+0000 7f476effd700 1 --2- 172.21.15.27:0/1571354943 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f475c003a00 0x7f475c003e10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4768009960 tx=0x7f475c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62b2edbd17621d1e server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:28.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.024+0000 7f476dffb700 1 -- 172.21.15.27:0/1571354943 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476800c070 con 0x7f475c003a00 2023-07-05T23:32:28.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.024+0000 7f476dffb700 1 -- 172.21.15.27:0/1571354943 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4768013610 con 0x7f475c003a00 2023-07-05T23:32:28.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.024+0000 7f476dffb700 1 -- 172.21.15.27:0/1571354943 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47680139c0 con 0x7f475c003a00 2023-07-05T23:32:28.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.025+0000 7f4775939700 1 -- 172.21.15.27:0/1571354943 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f475c003a00 msgr2=0x7f475c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:28.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.025+0000 7f4775939700 1 --2- 172.21.15.27:0/1571354943 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f475c003a00 0x7f475c003e10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4768009960 tx=0x7f475c005880 comp rx=0 tx=0).stop 2023-07-05T23:32:28.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.025+0000 7f476f7fe700 1 -- 172.21.15.27:0/1571354943 reap_dead start 2023-07-05T23:32:28.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.025+0000 7f4775939700 1 -- 172.21.15.27:0/1571354943 shutdown_connections 2023-07-05T23:32:28.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.025+0000 7f4775939700 1 -- 172.21.15.27:0/1571354943 >> 172.21.15.27:0/1571354943 conn(0x7f47700b1990 msgr2=0x7f47700cf1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:32:28.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.025+0000 7f4775939700 1 -- 172.21.15.27:0/1571354943 shutdown_connections 2023-07-05T23:32:28.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.025+0000 7f4775939700 1 -- 172.21.15.27:0/1571354943 wait complete. 2023-07-05T23:32:28.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.026+0000 7f4775939700 1 Processor -- start 2023-07-05T23:32:28.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.027+0000 7f4775939700 1 -- start start 2023-07-05T23:32:28.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.027+0000 7f4775939700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f475c003a00 0x7f47701f2730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:28.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.027+0000 7f4775939700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f47700c8e70 0x7f47700aceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:28.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.027+0000 7f4775939700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47700ad3f0 0x7f47700c6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:28.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.027+0000 7f4775939700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47700ad890 con 0x7f47700c8e70 2023-07-05T23:32:28.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.027+0000 7f4775939700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47700c89e0 con 0x7f475c003a00 2023-07-05T23:32:28.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.027+0000 7f4775939700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47700c7dd0 con 0x7f47700ad3f0 2023-07-05T23:32:28.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.027+0000 7f476e7fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f47700c8e70 0x7f47700aceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:28.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.027+0000 7f476e7fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f47700c8e70 0x7f47700aceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44090/0 (socket says 172.21.15.27:44090) 2023-07-05T23:32:28.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.027+0000 7f476e7fc700 1 -- 172.21.15.27:0/880035719 learned_addr learned my addr 172.21.15.27:0/880035719 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:32:28.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.027+0000 7f476effd700 1 --2- 172.21.15.27:0/880035719 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f475c003a00 0x7f47701f2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:28.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.027+0000 7f476f7fe700 1 --2- 172.21.15.27:0/880035719 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47700ad3f0 0x7f47700c6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:28.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.028+0000 7f476e7fc700 1 -- 172.21.15.27:0/880035719 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47700ad3f0 msgr2=0x7f47700c6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:28.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.028+0000 7f476e7fc700 1 --2- 172.21.15.27:0/880035719 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47700ad3f0 0x7f47700c6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:28.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.028+0000 7f476e7fc700 1 -- 172.21.15.27:0/880035719 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f475c003a00 msgr2=0x7f47701f2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:28.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.028+0000 7f476e7fc700 1 --2- 172.21.15.27:0/880035719 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f475c003a00 0x7f47701f2730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:28.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.028+0000 7f476e7fc700 1 -- 172.21.15.27:0/880035719 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47700c80b0 con 0x7f47700c8e70 2023-07-05T23:32:28.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.028+0000 7f476e7fc700 1 --2- 172.21.15.27:0/880035719 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f47700c8e70 0x7f47700aceb0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4758010a00 tx=0x7f4758010d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:28.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.028+0000 7f4767fff700 1 -- 172.21.15.27:0/880035719 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4758006ea0 con 0x7f47700c8e70 2023-07-05T23:32:28.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.028+0000 7f4767fff700 1 -- 172.21.15.27:0/880035719 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f475800ea10 con 0x7f47700c8e70 2023-07-05T23:32:28.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.028+0000 7f4767fff700 1 -- 172.21.15.27:0/880035719 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475800edc0 con 0x7f47700c8e70 2023-07-05T23:32:28.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.028+0000 7f4775939700 1 -- 172.21.15.27:0/880035719 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47700c8390 con 0x7f47700c8e70 2023-07-05T23:32:28.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.028+0000 7f4775939700 1 -- 172.21.15.27:0/880035719 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47701f2c70 con 0x7f47700c8e70 2023-07-05T23:32:28.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.028+0000 7f4767fff700 1 -- 172.21.15.27:0/880035719 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4758015470 con 0x7f47700c8e70 2023-07-05T23:32:28.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.028+0000 7f4767fff700 1 -- 172.21.15.27:0/880035719 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f4758016420 con 0x7f47700c8e70 2023-07-05T23:32:28.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.029+0000 7f4775939700 1 -- 172.21.15.27:0/880035719 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47701f2e90 con 0x7f47700c8e70 2023-07-05T23:32:28.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.031+0000 7f4767fff700 1 -- 172.21.15.27:0/880035719 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f47701f2e90 con 0x7f47700c8e70 2023-07-05T23:32:28.111 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.108+0000 7f4775939700 1 -- 172.21.15.27:0/880035719 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f47700711f0 con 0x7f47700c8e70 2023-07-05T23:32:28.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.111+0000 7f4767fff700 1 -- 172.21.15.27:0/880035719 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f475802d020 con 0x7f47700c8e70 2023-07-05T23:32:28.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.112+0000 7f4775939700 1 -- 172.21.15.27:0/880035719 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f47700c8e70 msgr2=0x7f47700aceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:28.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.112+0000 7f4775939700 1 --2- 172.21.15.27:0/880035719 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f47700c8e70 0x7f47700aceb0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4758010a00 tx=0x7f4758010d10 comp rx=0 tx=0).stop 2023-07-05T23:32:28.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.112+0000 7f4775939700 1 -- 172.21.15.27:0/880035719 shutdown_connections 2023-07-05T23:32:28.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.112+0000 7f4775939700 1 --2- 172.21.15.27:0/880035719 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f475c003a00 0x7f47701f2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:28.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.112+0000 7f4775939700 1 --2- 172.21.15.27:0/880035719 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47700ad3f0 0x7f47700c6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:28.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.112+0000 7f4775939700 1 --2- 172.21.15.27:0/880035719 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f47700c8e70 0x7f47700aceb0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:28.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.112+0000 7f4775939700 1 -- 172.21.15.27:0/880035719 >> 172.21.15.27:0/880035719 conn(0x7f47700b1990 msgr2=0x7f47700ae0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:32:28.116 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.112+0000 7f4775939700 1 -- 172.21.15.27:0/880035719 shutdown_connections 2023-07-05T23:32:28.116 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:28.112+0000 7f4775939700 1 -- 172.21.15.27:0/880035719 wait complete. 2023-07-05T23:32:28.116 INFO:teuthology.orchestra.run.smithi027.stderr:adjusted tunables profile to default 2023-07-05T23:32:28.127 INFO:tasks.ceph:check_enable_crimson: False 2023-07-05T23:32:28.127 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-07-05T23:32:28.127 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-07-05T23:32:28.127 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-07-05T23:32:28.135 INFO:tasks.ceph.mgr.x.smithi162.stderr:2023-07-05T23:32:28.133+0000 7f92f6ea6200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-05T23:32:28.145 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-07-05T23:32:28.142+0000 7fd3a3e13200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-05T23:32:28.156 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-07-05T23:32:28.156 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-07-05T23:32:28.200 INFO:tasks.ceph.mgr.x.smithi162.stderr:2023-07-05T23:32:28.198+0000 7f92f6ea6200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-05T23:32:28.215 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-07-05T23:32:28.212+0000 7fd3a3e13200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-05T23:32:28.225 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-07-05T23:32:28.226 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-07-05T23:32:28.274 INFO:tasks.ceph.mgr.x.smithi162.stderr:2023-07-05T23:32:28.272+0000 7f92f6ea6200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-05T23:32:28.292 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-07-05T23:32:28.292 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-07-05T23:32:28.298 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-07-05T23:32:28.295+0000 7fd3a3e13200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-05T23:32:28.325 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-07-05T23:32:28.326 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-07-05T23:32:28.354 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-07-05T23:32:28.355 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-07-05T23:32:28.356 INFO:tasks.ceph.mgr.x.smithi162.stderr:2023-07-05T23:32:28.354+0000 7f92f6ea6200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-05T23:32:28.383 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-07-05T23:32:28.381+0000 7fd3a3e13200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-05T23:32:28.384 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-07-05T23:32:28.385 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-07-05T23:32:28.452 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-07-05T23:32:28.453 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-07-05T23:32:28.511 INFO:tasks.ceph.mgr.x.smithi162.stderr:2023-07-05T23:32:28.509+0000 7f92f6ea6200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-05T23:32:28.518 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new ac2071e4-394b-4385-b9ba-fad5265efc65 0 2023-07-05T23:32:28.533 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-07-05T23:32:28.531+0000 7fd3a3e13200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-05T23:32:28.680 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.678+0000 7f9bd450f700 1 Processor -- start 2023-07-05T23:32:28.680 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.678+0000 7f9bd450f700 1 -- start start 2023-07-05T23:32:28.682 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.679+0000 7f9bd450f700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9bcc0cb0f0 0x7f9bcc0cb560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:28.682 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.679+0000 7f9bd450f700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f9bcc069ef0 0x7f9bcc06a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:28.683 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.679+0000 7f9bd450f700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bcc0cac60 con 0x7f9bcc070dc0 2023-07-05T23:32:28.683 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.679+0000 7f9bd450f700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bcc15dca0 con 0x7f9bcc069ef0 2023-07-05T23:32:28.683 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.679+0000 7f9bd450f700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bcc0ca370 con 0x7f9bcc0cb0f0 2023-07-05T23:32:28.683 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.679+0000 7f9bd22ab700 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f9bcc070dc0 0x7f9bcc071190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:48298/0 (socket says 172.21.15.162:48298) 2023-07-05T23:32:28.684 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.679+0000 7f9bd22ab700 1 -- 172.21.15.162:0/2030028926 learned_addr learned my addr 172.21.15.162:0/2030028926 (peer_addr_for_me v1:172.21.15.162:0/0) 2023-07-05T23:32:28.684 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.679+0000 7f9bd1aaa700 1 --2- 172.21.15.162:0/2030028926 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9bcc0cb0f0 0x7f9bcc0cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:28.684 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.679+0000 7f9bd2aac700 1 --2- 172.21.15.162:0/2030028926 >> v2:172.21.15.27:3300/0 conn(0x7f9bcc069ef0 0x7f9bcc06a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:28.684 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.679+0000 7f9bd12a9700 1 -- 172.21.15.162:0/2030028926 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3507853366 0 0) 0x7f9bcc0cac60 con 0x7f9bcc070dc0 2023-07-05T23:32:28.684 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.679+0000 7f9bd12a9700 1 -- 172.21.15.162:0/2030028926 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9bb80035b0 con 0x7f9bcc070dc0 2023-07-05T23:32:28.685 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.680+0000 7f9bd1aaa700 1 -- 172.21.15.162:0/2030028926 >> v2:172.21.15.27:3300/0 conn(0x7f9bcc069ef0 msgr2=0x7f9bcc06a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:32:28.685 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.680+0000 7f9bd1aaa700 1 --2- 172.21.15.162:0/2030028926 >> v2:172.21.15.27:3300/0 conn(0x7f9bcc069ef0 0x7f9bcc06a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:28.685 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.680+0000 7f9bd1aaa700 1 -- 172.21.15.162:0/2030028926 >> v1:172.21.15.162:6789/0 conn(0x7f9bcc070dc0 legacy=0x7f9bcc071190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:28.685 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.680+0000 7f9bd1aaa700 1 -- 172.21.15.162:0/2030028926 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bcc15d9c0 con 0x7f9bcc0cb0f0 2023-07-05T23:32:28.685 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.680+0000 7f9bd1aaa700 1 --2- 172.21.15.162:0/2030028926 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9bcc0cb0f0 0x7f9bcc0cb560 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc009840 tx=0x7f9bbc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=519cb55d481c9fd7 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:28.685 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.680+0000 7f9bd12a9700 1 -- 172.21.15.162:0/2030028926 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bbc011830 con 0x7f9bcc0cb0f0 2023-07-05T23:32:28.685 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.680+0000 7f9bd12a9700 1 -- 172.21.15.162:0/2030028926 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bbc011990 con 0x7f9bcc0cb0f0 2023-07-05T23:32:28.685 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.680+0000 7f9bd12a9700 1 -- 172.21.15.162:0/2030028926 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bbc011d20 con 0x7f9bcc0cb0f0 2023-07-05T23:32:28.688 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.680+0000 7f9bd450f700 1 -- 172.21.15.162:0/2030028926 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9bcc0cb0f0 msgr2=0x7f9bcc0cb560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:28.688 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.680+0000 7f9bd450f700 1 --2- 172.21.15.162:0/2030028926 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9bcc0cb0f0 0x7f9bcc0cb560 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc009840 tx=0x7f9bbc009b50 comp rx=0 tx=0).stop 2023-07-05T23:32:28.689 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.681+0000 7f9bd450f700 1 -- 172.21.15.162:0/2030028926 shutdown_connections 2023-07-05T23:32:28.689 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.681+0000 7f9bd450f700 1 --2- 172.21.15.162:0/2030028926 >> v2:172.21.15.27:3300/0 conn(0x7f9bcc069ef0 0x7f9bcc06a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:28.689 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.681+0000 7f9bd450f700 1 --2- 172.21.15.162:0/2030028926 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9bcc0cb0f0 0x7f9bcc0cb560 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:28.689 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.681+0000 7f9bd450f700 1 -- 172.21.15.162:0/2030028926 >> 172.21.15.162:0/2030028926 conn(0x7f9bcc0b1990 msgr2=0x7f9bcc0cf1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:32:28.689 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.681+0000 7f9bd450f700 1 -- 172.21.15.162:0/2030028926 shutdown_connections 2023-07-05T23:32:28.689 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.681+0000 7f9bd450f700 1 -- 172.21.15.162:0/2030028926 wait complete. 2023-07-05T23:32:28.690 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.682+0000 7f9bd450f700 1 Processor -- start 2023-07-05T23:32:28.690 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.682+0000 7f9bd450f700 1 -- start start 2023-07-05T23:32:28.690 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.683+0000 7f9bd450f700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9bcc069ef0 0x7f9bcc158740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:28.690 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.683+0000 7f9bd450f700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9bcc070dc0 0x7f9bcc1e3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:28.691 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.683+0000 7f9bd450f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9bcc0cb0f0 0x7f9bcc0c8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:28.691 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.683+0000 7f9bd450f700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bcc15ac10 con 0x7f9bcc0cb0f0 2023-07-05T23:32:28.691 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.683+0000 7f9bd450f700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bcc158c80 con 0x7f9bcc069ef0 2023-07-05T23:32:28.691 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.683+0000 7f9bd450f700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bcc1e59e0 con 0x7f9bcc070dc0 2023-07-05T23:32:28.692 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.683+0000 7f9bd22ab700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9bcc069ef0 0x7f9bcc158740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:28.692 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.683+0000 7f9bd1aaa700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9bcc070dc0 0x7f9bcc1e3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:28.692 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.683+0000 7f9bd1aaa700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9bcc070dc0 0x7f9bcc1e3710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.162:37476/0 (socket says 172.21.15.162:37476) 2023-07-05T23:32:28.693 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.683+0000 7f9bd22ab700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9bcc069ef0 0x7f9bcc158740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:52462/0 (socket says 172.21.15.162:52462) 2023-07-05T23:32:28.693 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.683+0000 7f9bd1aaa700 1 -- 172.21.15.162:0/824222953 learned_addr learned my addr 172.21.15.162:0/824222953 (peer_addr_for_me v2:172.21.15.162:0/0) 2023-07-05T23:32:28.693 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.683+0000 7f9bd2aac700 1 --2- 172.21.15.162:0/824222953 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9bcc0cb0f0 0x7f9bcc0c8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:28.694 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.684+0000 7f9bd1aaa700 1 -- 172.21.15.162:0/824222953 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9bcc069ef0 msgr2=0x7f9bcc158740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:28.694 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.684+0000 7f9bd1aaa700 1 --2- 172.21.15.162:0/824222953 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9bcc069ef0 0x7f9bcc158740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:28.694 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.684+0000 7f9bd1aaa700 1 -- 172.21.15.162:0/824222953 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9bcc0cb0f0 msgr2=0x7f9bcc0c8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:28.695 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.684+0000 7f9bd1aaa700 1 --2- 172.21.15.162:0/824222953 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9bcc0cb0f0 0x7f9bcc0c8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:28.695 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.684+0000 7f9bd1aaa700 1 -- 172.21.15.162:0/824222953 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bbc0094a0 con 0x7f9bcc070dc0 2023-07-05T23:32:28.695 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.684+0000 7f9bd22ab700 1 --2- 172.21.15.162:0/824222953 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9bcc069ef0 0x7f9bcc158740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T23:32:28.695 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.684+0000 7f9bd2aac700 1 --2- 172.21.15.162:0/824222953 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9bcc0cb0f0 0x7f9bcc0c8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T23:32:28.696 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.684+0000 7f9bd1aaa700 1 --2- 172.21.15.162:0/824222953 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9bcc070dc0 0x7f9bcc1e3710 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc000c00 tx=0x7f9bbc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:28.696 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.684+0000 7f9bc2ffd700 1 -- 172.21.15.162:0/824222953 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bbc004450 con 0x7f9bcc070dc0 2023-07-05T23:32:28.696 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.684+0000 7f9bc2ffd700 1 -- 172.21.15.162:0/824222953 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bbc01f070 con 0x7f9bcc070dc0 2023-07-05T23:32:28.696 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.684+0000 7f9bd450f700 1 -- 172.21.15.162:0/824222953 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bcc1e5700 con 0x7f9bcc070dc0 2023-07-05T23:32:28.697 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.684+0000 7f9bc2ffd700 1 -- 172.21.15.162:0/824222953 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bbc0038e0 con 0x7f9bcc070dc0 2023-07-05T23:32:28.697 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.684+0000 7f9bd450f700 1 -- 172.21.15.162:0/824222953 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bcc15a830 con 0x7f9bcc070dc0 2023-07-05T23:32:28.697 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.684+0000 7f9bc2ffd700 1 -- 172.21.15.162:0/824222953 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9bbc003d40 con 0x7f9bcc070dc0 2023-07-05T23:32:28.698 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.684+0000 7f9bc2ffd700 1 -- 172.21.15.162:0/824222953 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f9bbc021070 con 0x7f9bcc070dc0 2023-07-05T23:32:28.698 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.685+0000 7f9bd450f700 1 -- 172.21.15.162:0/824222953 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bcc0ceff0 con 0x7f9bcc070dc0 2023-07-05T23:32:28.699 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.687+0000 7f9bc2ffd700 1 -- 172.21.15.162:0/824222953 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f9bbc045b00 con 0x7f9bcc070dc0 2023-07-05T23:32:28.773 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.771+0000 7f9bd450f700 1 -- 172.21.15.162:0/824222953 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ac2071e4-394b-4385-b9ba-fad5265efc65", "id": 0} v 0) v1 -- 0x7f9bcc15ad50 con 0x7f9bcc070dc0 2023-07-05T23:32:28.779 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.776+0000 7f9bc2ffd700 1 -- 172.21.15.162:0/824222953 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ac2071e4-394b-4385-b9ba-fad5265efc65", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9bcc15ad50 con 0x7f9bcc070dc0 2023-07-05T23:32:28.780 INFO:teuthology.orchestra.run.smithi162.stdout:0 2023-07-05T23:32:28.781 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.777+0000 7f9bd450f700 1 -- 172.21.15.162:0/824222953 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9bcc070dc0 msgr2=0x7f9bcc1e3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:28.781 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.777+0000 7f9bd450f700 1 --2- 172.21.15.162:0/824222953 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9bcc070dc0 0x7f9bcc1e3710 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc000c00 tx=0x7f9bbc004750 comp rx=0 tx=0).stop 2023-07-05T23:32:28.781 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.777+0000 7f9bd450f700 1 -- 172.21.15.162:0/824222953 shutdown_connections 2023-07-05T23:32:28.781 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.777+0000 7f9bd450f700 1 --2- 172.21.15.162:0/824222953 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9bcc069ef0 0x7f9bcc158740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:28.781 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.777+0000 7f9bd450f700 1 --2- 172.21.15.162:0/824222953 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9bcc0cb0f0 0x7f9bcc0c8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:28.781 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.777+0000 7f9bd450f700 1 --2- 172.21.15.162:0/824222953 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9bcc070dc0 0x7f9bcc1e3710 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:28.782 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.777+0000 7f9bd450f700 1 -- 172.21.15.162:0/824222953 >> 172.21.15.162:0/824222953 conn(0x7f9bcc0b1990 msgr2=0x7f9bcc0cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:32:28.782 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.778+0000 7f9bd450f700 1 -- 172.21.15.162:0/824222953 shutdown_connections 2023-07-05T23:32:28.782 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.778+0000 7f9bd450f700 1 -- 172.21.15.162:0/824222953 wait complete. 2023-07-05T23:32:28.792 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new 8c9b61a0-39d5-46bf-afd6-5add78453ce9 1 2023-07-05T23:32:28.850 INFO:tasks.ceph.mgr.x.smithi162.stderr:2023-07-05T23:32:28.848+0000 7f92f6ea6200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-05T23:32:28.883 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-07-05T23:32:28.880+0000 7fd3a3e13200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-05T23:32:28.912 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.909+0000 7fdae43c4700 1 Processor -- start 2023-07-05T23:32:28.912 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.910+0000 7fdae43c4700 1 -- start start 2023-07-05T23:32:28.914 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.910+0000 7fdae43c4700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdadc0ae8b0 0x7fdadc06e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:28.914 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.910+0000 7fdae43c4700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fdadc0acd10 0x7fdadc15e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:28.915 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.910+0000 7fdae43c4700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdadc0aee00 con 0x7fdadc15a430 2023-07-05T23:32:28.915 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.910+0000 7fdae43c4700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdadc0af330 con 0x7fdadc0acd10 2023-07-05T23:32:28.915 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.910+0000 7fdae43c4700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdadc06e340 con 0x7fdadc0ae8b0 2023-07-05T23:32:28.915 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.911+0000 7fdae195f700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdadc0ae8b0 0x7fdadc06e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:28.915 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.911+0000 7fdae195f700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdadc0ae8b0 0x7fdadc06e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.162:37482/0 (socket says 172.21.15.162:37482) 2023-07-05T23:32:28.915 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.911+0000 7fdae195f700 1 -- 172.21.15.162:0/3024248382 learned_addr learned my addr 172.21.15.162:0/3024248382 (peer_addr_for_me v2:172.21.15.162:0/0) 2023-07-05T23:32:28.916 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.911+0000 7fdae2961700 1 --2- 172.21.15.162:0/3024248382 >> v2:172.21.15.27:3300/0 conn(0x7fdadc0acd10 0x7fdadc15e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:28.916 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.911+0000 7fdae195f700 1 -- 172.21.15.162:0/3024248382 >> v2:172.21.15.27:3300/0 conn(0x7fdadc0acd10 msgr2=0x7fdadc15e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:32:28.916 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.911+0000 7fdae195f700 1 --2- 172.21.15.162:0/3024248382 >> v2:172.21.15.27:3300/0 conn(0x7fdadc0acd10 0x7fdadc15e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:28.916 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.911+0000 7fdae195f700 1 -- 172.21.15.162:0/3024248382 >> v1:172.21.15.27:6789/0 conn(0x7fdadc15a430 legacy=0x7fdadc0ac600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:28.916 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.911+0000 7fdae195f700 1 -- 172.21.15.162:0/3024248382 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdadc0af050 con 0x7fdadc0ae8b0 2023-07-05T23:32:28.916 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.911+0000 7fdae195f700 1 --2- 172.21.15.162:0/3024248382 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdadc0ae8b0 0x7fdadc06e7d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fdacc0098f0 tx=0x7fdacc009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10be8708d62cf66e server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:28.916 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.911+0000 7fdae115e700 1 -- 172.21.15.162:0/3024248382 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdacc011830 con 0x7fdadc0ae8b0 2023-07-05T23:32:28.917 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.911+0000 7fdae115e700 1 -- 172.21.15.162:0/3024248382 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdacc011990 con 0x7fdadc0ae8b0 2023-07-05T23:32:28.917 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.911+0000 7fdae115e700 1 -- 172.21.15.162:0/3024248382 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdacc011d20 con 0x7fdadc0ae8b0 2023-07-05T23:32:28.917 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.912+0000 7fdae43c4700 1 -- 172.21.15.162:0/3024248382 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdadc0ae8b0 msgr2=0x7fdadc06e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:28.917 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.912+0000 7fdae43c4700 1 --2- 172.21.15.162:0/3024248382 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdadc0ae8b0 0x7fdadc06e7d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fdacc0098f0 tx=0x7fdacc009c00 comp rx=0 tx=0).stop 2023-07-05T23:32:28.918 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.912+0000 7fdae43c4700 1 -- 172.21.15.162:0/3024248382 shutdown_connections 2023-07-05T23:32:28.918 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.912+0000 7fdae43c4700 1 --2- 172.21.15.162:0/3024248382 >> v2:172.21.15.27:3300/0 conn(0x7fdadc0acd10 0x7fdadc15e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:28.918 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.912+0000 7fdae43c4700 1 --2- 172.21.15.162:0/3024248382 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdadc0ae8b0 0x7fdadc06e7d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:28.918 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.912+0000 7fdae43c4700 1 -- 172.21.15.162:0/3024248382 >> 172.21.15.162:0/3024248382 conn(0x7fdadc06b920 msgr2=0x7fdadc0cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:32:28.919 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.912+0000 7fdae43c4700 1 -- 172.21.15.162:0/3024248382 shutdown_connections 2023-07-05T23:32:28.919 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.912+0000 7fdae43c4700 1 -- 172.21.15.162:0/3024248382 wait complete. 2023-07-05T23:32:28.923 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.913+0000 7fdae43c4700 1 Processor -- start 2023-07-05T23:32:28.923 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.913+0000 7fdae43c4700 1 -- start start 2023-07-05T23:32:28.924 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.914+0000 7fdae43c4700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdadc0acd10 0x7fdadc0c7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:28.924 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.914+0000 7fdae43c4700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdadc0ae8b0 0x7fdadc0b1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:28.924 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.914+0000 7fdae43c4700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdadc15a430 0x7fdadc0af830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:28.924 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.914+0000 7fdae43c4700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdadc1f25b0 con 0x7fdadc0acd10 2023-07-05T23:32:28.925 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.914+0000 7fdae43c4700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdadc0c8fc0 con 0x7fdadc0ae8b0 2023-07-05T23:32:28.925 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.914+0000 7fdae43c4700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdadc0cd680 con 0x7fdadc15a430 2023-07-05T23:32:28.925 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.914+0000 7fdae2961700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdadc15a430 0x7fdadc0af830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:28.926 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.914+0000 7fdae2160700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdadc0acd10 0x7fdadc0c7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:28.926 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.915+0000 7fdae195f700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdadc0ae8b0 0x7fdadc0b1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:28.926 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.915+0000 7fdae2961700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdadc15a430 0x7fdadc0af830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.162:37490/0 (socket says 172.21.15.162:37490) 2023-07-05T23:32:28.926 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.915+0000 7fdae2961700 1 -- 172.21.15.162:0/1122843407 learned_addr learned my addr 172.21.15.162:0/1122843407 (peer_addr_for_me v2:172.21.15.162:0/0) 2023-07-05T23:32:28.926 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.915+0000 7fdae2961700 1 -- 172.21.15.162:0/1122843407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdadc0ae8b0 msgr2=0x7fdadc0b1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:28.927 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.915+0000 7fdae2961700 1 --2- 172.21.15.162:0/1122843407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdadc0ae8b0 0x7fdadc0b1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:28.927 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.915+0000 7fdae2961700 1 -- 172.21.15.162:0/1122843407 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdadc0acd10 msgr2=0x7fdadc0c7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:28.927 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.915+0000 7fdae2961700 1 --2- 172.21.15.162:0/1122843407 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdadc0acd10 0x7fdadc0c7340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:28.927 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.915+0000 7fdae2961700 1 -- 172.21.15.162:0/1122843407 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdacc009550 con 0x7fdadc15a430 2023-07-05T23:32:28.927 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.915+0000 7fdae2160700 1 --2- 172.21.15.162:0/1122843407 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdadc0acd10 0x7fdadc0c7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T23:32:28.927 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.915+0000 7fdae195f700 1 --2- 172.21.15.162:0/1122843407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdadc0ae8b0 0x7fdadc0b1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T23:32:28.927 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.915+0000 7fdae2961700 1 --2- 172.21.15.162:0/1122843407 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdadc15a430 0x7fdadc0af830 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fdad400efc0 tx=0x7fdad400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:28.927 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.915+0000 7fdad2ffd700 1 -- 172.21.15.162:0/1122843407 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad4009ea0 con 0x7fdadc15a430 2023-07-05T23:32:28.928 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.915+0000 7fdad2ffd700 1 -- 172.21.15.162:0/1122843407 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdad400f040 con 0x7fdadc15a430 2023-07-05T23:32:28.928 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.915+0000 7fdae43c4700 1 -- 172.21.15.162:0/1122843407 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdadc0cd960 con 0x7fdadc15a430 2023-07-05T23:32:28.928 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.915+0000 7fdad2ffd700 1 -- 172.21.15.162:0/1122843407 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad400ced0 con 0x7fdadc15a430 2023-07-05T23:32:28.928 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.915+0000 7fdae43c4700 1 -- 172.21.15.162:0/1122843407 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdadc0c92a0 con 0x7fdadc15a430 2023-07-05T23:32:28.928 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.915+0000 7fdad2ffd700 1 -- 172.21.15.162:0/1122843407 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fdad4014780 con 0x7fdadc15a430 2023-07-05T23:32:28.928 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.915+0000 7fdad2ffd700 1 -- 172.21.15.162:0/1122843407 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fdad40133e0 con 0x7fdadc15a430 2023-07-05T23:32:28.929 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.916+0000 7fdae43c4700 1 -- 172.21.15.162:0/1122843407 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdadc04ea20 con 0x7fdadc15a430 2023-07-05T23:32:28.929 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:28.918+0000 7fdad2ffd700 1 -- 172.21.15.162:0/1122843407 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fdad401de60 con 0x7fdadc15a430 2023-07-05T23:32:28.930 INFO:tasks.ceph.mgr.x.smithi162.stderr:2023-07-05T23:32:28.928+0000 7f92f6ea6200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-05T23:32:28.962 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-07-05T23:32:28.959+0000 7fd3a3e13200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-05T23:32:29.002 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.000+0000 7fdae43c4700 1 -- 172.21.15.162:0/1122843407 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8c9b61a0-39d5-46bf-afd6-5add78453ce9", "id": 1} v 0) v1 -- 0x7fdadc0b5990 con 0x7fdadc15a430 2023-07-05T23:32:29.010 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.008+0000 7fdad2ffd700 1 -- 172.21.15.162:0/1122843407 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8c9b61a0-39d5-46bf-afd6-5add78453ce9", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fdad4018020 con 0x7fdadc15a430 2023-07-05T23:32:29.010 INFO:teuthology.orchestra.run.smithi162.stdout:1 2023-07-05T23:32:29.011 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.009+0000 7fdae43c4700 1 -- 172.21.15.162:0/1122843407 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdadc15a430 msgr2=0x7fdadc0af830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:29.011 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.009+0000 7fdae43c4700 1 --2- 172.21.15.162:0/1122843407 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdadc15a430 0x7fdadc0af830 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fdad400efc0 tx=0x7fdad400c3a0 comp rx=0 tx=0).stop 2023-07-05T23:32:29.012 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.009+0000 7fdae43c4700 1 -- 172.21.15.162:0/1122843407 shutdown_connections 2023-07-05T23:32:29.012 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.009+0000 7fdae43c4700 1 --2- 172.21.15.162:0/1122843407 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdadc15a430 0x7fdadc0af830 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:29.012 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.009+0000 7fdae43c4700 1 --2- 172.21.15.162:0/1122843407 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdadc0acd10 0x7fdadc0c7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:29.012 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.009+0000 7fdae43c4700 1 --2- 172.21.15.162:0/1122843407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdadc0ae8b0 0x7fdadc0b1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:29.012 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.009+0000 7fdae43c4700 1 -- 172.21.15.162:0/1122843407 >> 172.21.15.162:0/1122843407 conn(0x7fdadc06b920 msgr2=0x7fdadc0b2840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:32:29.013 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.009+0000 7fdae43c4700 1 -- 172.21.15.162:0/1122843407 shutdown_connections 2023-07-05T23:32:29.013 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.009+0000 7fdae43c4700 1 -- 172.21.15.162:0/1122843407 wait complete. 2023-07-05T23:32:29.023 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new dcd032a2-06b1-4055-b798-b86c71a7107d 2 2023-07-05T23:32:29.056 INFO:tasks.ceph.mgr.x.smithi162.stderr:2023-07-05T23:32:29.054+0000 7f92f6ea6200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-05T23:32:29.099 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-07-05T23:32:29.096+0000 7fd3a3e13200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-05T23:32:29.140 INFO:tasks.ceph.mgr.x.smithi162.stderr:2023-07-05T23:32:29.138+0000 7f92f6ea6200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-05T23:32:29.143 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.141+0000 7f55d1f92700 1 Processor -- start 2023-07-05T23:32:29.143 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.141+0000 7f55d1f92700 1 -- start start 2023-07-05T23:32:29.145 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.142+0000 7f55d1f92700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f55cc06d7b0 0x7f55cc160800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:29.145 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.142+0000 7f55d1f92700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f55cc160d40 0x7f55cc0ce3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:29.145 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.142+0000 7f55d1f92700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55cc0cce30 con 0x7f55cc069ef0 2023-07-05T23:32:29.146 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.142+0000 7f55d1f92700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55cc0cd360 con 0x7f55cc160d40 2023-07-05T23:32:29.146 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.142+0000 7f55d1f92700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55cc160370 con 0x7f55cc06d7b0 2023-07-05T23:32:29.146 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.142+0000 7f55caffd700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f55cc06d7b0 0x7f55cc160800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:29.146 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.142+0000 7f55caffd700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f55cc06d7b0 0x7f55cc160800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.162:37494/0 (socket says 172.21.15.162:37494) 2023-07-05T23:32:29.147 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.142+0000 7f55caffd700 1 -- 172.21.15.162:0/85340732 learned_addr learned my addr 172.21.15.162:0/85340732 (peer_addr_for_me v2:172.21.15.162:0/0) 2023-07-05T23:32:29.147 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.142+0000 7f55cbfff700 1 --2- 172.21.15.162:0/85340732 >> v2:172.21.15.162:3300/0 conn(0x7f55cc160d40 0x7f55cc0ce3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:29.147 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.142+0000 7f55caffd700 1 -- 172.21.15.162:0/85340732 >> v2:172.21.15.162:3300/0 conn(0x7f55cc160d40 msgr2=0x7f55cc0ce3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:32:29.147 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.142+0000 7f55caffd700 1 --2- 172.21.15.162:0/85340732 >> v2:172.21.15.162:3300/0 conn(0x7f55cc160d40 0x7f55cc0ce3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:29.147 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.142+0000 7f55caffd700 1 -- 172.21.15.162:0/85340732 >> v1:172.21.15.27:6789/0 conn(0x7f55cc069ef0 legacy=0x7f55cc06a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:29.147 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.142+0000 7f55caffd700 1 -- 172.21.15.162:0/85340732 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55cc15ca50 con 0x7f55cc06d7b0 2023-07-05T23:32:29.147 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.142+0000 7f55caffd700 1 --2- 172.21.15.162:0/85340732 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f55cc06d7b0 0x7f55cc160800 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f55c00098f0 tx=0x7f55c0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42a7daafa96e5033 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:29.148 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.142+0000 7f55ca7fc700 1 -- 172.21.15.162:0/85340732 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c0011830 con 0x7f55cc06d7b0 2023-07-05T23:32:29.148 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.142+0000 7f55ca7fc700 1 -- 172.21.15.162:0/85340732 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55c0011990 con 0x7f55cc06d7b0 2023-07-05T23:32:29.148 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.142+0000 7f55ca7fc700 1 -- 172.21.15.162:0/85340732 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c0011d20 con 0x7f55cc06d7b0 2023-07-05T23:32:29.148 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.143+0000 7f55d1f92700 1 -- 172.21.15.162:0/85340732 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f55cc06d7b0 msgr2=0x7f55cc160800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:29.148 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.143+0000 7f55d1f92700 1 --2- 172.21.15.162:0/85340732 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f55cc06d7b0 0x7f55cc160800 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f55c00098f0 tx=0x7f55c0009c00 comp rx=0 tx=0).stop 2023-07-05T23:32:29.149 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.143+0000 7f55d1f92700 1 -- 172.21.15.162:0/85340732 shutdown_connections 2023-07-05T23:32:29.149 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.143+0000 7f55d1f92700 1 --2- 172.21.15.162:0/85340732 >> v2:172.21.15.162:3300/0 conn(0x7f55cc160d40 0x7f55cc0ce3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:29.149 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.143+0000 7f55d1f92700 1 --2- 172.21.15.162:0/85340732 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f55cc06d7b0 0x7f55cc160800 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:29.149 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.143+0000 7f55d1f92700 1 -- 172.21.15.162:0/85340732 >> 172.21.15.162:0/85340732 conn(0x7f55cc06b920 msgr2=0x7f55cc0cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:32:29.149 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.143+0000 7f55d1f92700 1 -- 172.21.15.162:0/85340732 shutdown_connections 2023-07-05T23:32:29.149 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.143+0000 7f55d1f92700 1 -- 172.21.15.162:0/85340732 wait complete. 2023-07-05T23:32:29.151 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.145+0000 7f55d1f92700 1 Processor -- start 2023-07-05T23:32:29.152 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.145+0000 7f55d1f92700 1 -- start start 2023-07-05T23:32:29.152 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.146+0000 7f55d1f92700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f55cc069ef0 0x7f55cc0b19b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:29.152 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.146+0000 7f55d1f92700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f55cc06d7b0 0x7f55cc0af470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:29.152 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.146+0000 7f55d1f92700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f55cc160d40 0x7f55cc1f2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:29.152 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.146+0000 7f55d1f92700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55cc0b2ae0 con 0x7f55cc069ef0 2023-07-05T23:32:29.152 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.146+0000 7f55d1f92700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55cc0b05f0 con 0x7f55cc160d40 2023-07-05T23:32:29.152 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.146+0000 7f55d1f92700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55cc0b1ef0 con 0x7f55cc06d7b0 2023-07-05T23:32:29.153 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.146+0000 7f55cbfff700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f55cc160d40 0x7f55cc1f2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:29.153 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.146+0000 7f55caffd700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f55cc06d7b0 0x7f55cc0af470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:29.153 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.146+0000 7f55cbfff700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f55cc160d40 0x7f55cc1f2eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:52490/0 (socket says 172.21.15.162:52490) 2023-07-05T23:32:29.153 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.146+0000 7f55cbfff700 1 -- 172.21.15.162:0/3743422127 learned_addr learned my addr 172.21.15.162:0/3743422127 (peer_addr_for_me v2:172.21.15.162:0/0) 2023-07-05T23:32:29.153 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.146+0000 7f55cb7fe700 1 --2- 172.21.15.162:0/3743422127 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f55cc069ef0 0x7f55cc0b19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:29.153 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.146+0000 7f55cbfff700 1 -- 172.21.15.162:0/3743422127 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f55cc06d7b0 msgr2=0x7f55cc0af470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:29.153 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.146+0000 7f55cbfff700 1 --2- 172.21.15.162:0/3743422127 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f55cc06d7b0 0x7f55cc0af470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:29.154 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.146+0000 7f55cbfff700 1 -- 172.21.15.162:0/3743422127 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f55cc069ef0 msgr2=0x7f55cc0b19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:29.154 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.146+0000 7f55cbfff700 1 --2- 172.21.15.162:0/3743422127 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f55cc069ef0 0x7f55cc0b19b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:29.154 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.146+0000 7f55cbfff700 1 -- 172.21.15.162:0/3743422127 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55c0009550 con 0x7f55cc160d40 2023-07-05T23:32:29.154 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.146+0000 7f55cbfff700 1 --2- 172.21.15.162:0/3743422127 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f55cc160d40 0x7f55cc1f2eb0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f55c4009cb0 tx=0x7f55c400c0c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:29.154 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.146+0000 7f55b3fff700 1 -- 172.21.15.162:0/3743422127 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c4009b20 con 0x7f55cc160d40 2023-07-05T23:32:29.154 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.147+0000 7f55b3fff700 1 -- 172.21.15.162:0/3743422127 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55c400f040 con 0x7f55cc160d40 2023-07-05T23:32:29.154 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.147+0000 7f55d1f92700 1 -- 172.21.15.162:0/3743422127 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55cc0afd50 con 0x7f55cc160d40 2023-07-05T23:32:29.154 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.147+0000 7f55b3fff700 1 -- 172.21.15.162:0/3743422127 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c400cd30 con 0x7f55cc160d40 2023-07-05T23:32:29.155 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.147+0000 7f55d1f92700 1 -- 172.21.15.162:0/3743422127 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55cc0b0310 con 0x7f55cc160d40 2023-07-05T23:32:29.155 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.147+0000 7f55b3fff700 1 -- 172.21.15.162:0/3743422127 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f55c4014780 con 0x7f55cc160d40 2023-07-05T23:32:29.155 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.147+0000 7f55b3fff700 1 -- 172.21.15.162:0/3743422127 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f55c401d400 con 0x7f55cc160d40 2023-07-05T23:32:29.155 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.148+0000 7f55d1f92700 1 -- 172.21.15.162:0/3743422127 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55cc0b2840 con 0x7f55cc160d40 2023-07-05T23:32:29.155 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.150+0000 7f55b3fff700 1 -- 172.21.15.162:0/3743422127 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f55c403bb00 con 0x7f55cc160d40 2023-07-05T23:32:29.184 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-07-05T23:32:29.182+0000 7fd3a3e13200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-05T23:32:29.238 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.236+0000 7f55d1f92700 1 -- 172.21.15.162:0/3743422127 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd new", "uuid": "dcd032a2-06b1-4055-b798-b86c71a7107d", "id": 2} v 0) v1 -- 0x7f55cc0b2c20 con 0x7f55cc160d40 2023-07-05T23:32:29.245 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.243+0000 7f55b3fff700 1 -- 172.21.15.162:0/3743422127 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "dcd032a2-06b1-4055-b798-b86c71a7107d", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f55cc0b2c20 con 0x7f55cc160d40 2023-07-05T23:32:29.245 INFO:teuthology.orchestra.run.smithi162.stdout:2 2023-07-05T23:32:29.246 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.244+0000 7f55d1f92700 1 -- 172.21.15.162:0/3743422127 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f55cc160d40 msgr2=0x7f55cc1f2eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:29.246 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.244+0000 7f55d1f92700 1 --2- 172.21.15.162:0/3743422127 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f55cc160d40 0x7f55cc1f2eb0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f55c4009cb0 tx=0x7f55c400c0c0 comp rx=0 tx=0).stop 2023-07-05T23:32:29.247 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.244+0000 7f55d1f92700 1 -- 172.21.15.162:0/3743422127 shutdown_connections 2023-07-05T23:32:29.247 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.244+0000 7f55d1f92700 1 --2- 172.21.15.162:0/3743422127 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f55cc160d40 0x7f55cc1f2eb0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:29.247 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.244+0000 7f55d1f92700 1 --2- 172.21.15.162:0/3743422127 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f55cc069ef0 0x7f55cc0b19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:29.247 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.244+0000 7f55d1f92700 1 --2- 172.21.15.162:0/3743422127 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f55cc06d7b0 0x7f55cc0af470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:29.247 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.244+0000 7f55d1f92700 1 -- 172.21.15.162:0/3743422127 >> 172.21.15.162:0/3743422127 conn(0x7f55cc06b920 msgr2=0x7f55cc0ca140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:32:29.247 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.244+0000 7f55d1f92700 1 -- 172.21.15.162:0/3743422127 shutdown_connections 2023-07-05T23:32:29.247 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.244+0000 7f55d1f92700 1 -- 172.21.15.162:0/3743422127 wait complete. 2023-07-05T23:32:29.258 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new b0ffe0fc-47ba-4636-b5ea-6bab637642c8 3 2023-07-05T23:32:29.419 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.417+0000 7f8562d2c700 1 Processor -- start 2023-07-05T23:32:29.419 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.417+0000 7f8562d2c700 1 -- start start 2023-07-05T23:32:29.421 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.418+0000 7f8562d2c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f855c0cd5e0 0x7f855c0cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:29.421 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.418+0000 7f8562d2c700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f855c06e030 0x7f855c06e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:29.422 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.418+0000 7f8562d2c700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f855c06f0e0 con 0x7f855c15cf70 2023-07-05T23:32:29.422 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.418+0000 7f8562d2c700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f855c0ce2c0 con 0x7f855c0cd5e0 2023-07-05T23:32:29.422 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.418+0000 7f8562d2c700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f855c0cdef0 con 0x7f855c06e030 2023-07-05T23:32:29.422 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.418+0000 7f85612c9700 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f855c15cf70 0x7f855c15d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:48338/0 (socket says 172.21.15.162:48338) 2023-07-05T23:32:29.422 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.418+0000 7f855bfff700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f855c06e030 0x7f855c06e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:29.422 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.418+0000 7f85612c9700 1 -- 172.21.15.162:0/1090439393 learned_addr learned my addr 172.21.15.162:0/1090439393 (peer_addr_for_me v1:172.21.15.162:0/0) 2023-07-05T23:32:29.422 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.418+0000 7f8560ac8700 1 --2- 172.21.15.162:0/1090439393 >> v2:172.21.15.27:3300/0 conn(0x7f855c0cd5e0 0x7f855c0cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:29.423 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.418+0000 7f855b7fe700 1 -- 172.21.15.162:0/1090439393 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3223148455 0 0) 0x7f855c06f0e0 con 0x7f855c15cf70 2023-07-05T23:32:29.423 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.418+0000 7f855b7fe700 1 -- 172.21.15.162:0/1090439393 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85440035b0 con 0x7f855c15cf70 2023-07-05T23:32:29.423 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.418+0000 7f855bfff700 1 -- 172.21.15.162:0/1090439393 >> v2:172.21.15.27:3300/0 conn(0x7f855c0cd5e0 msgr2=0x7f855c0cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:32:29.423 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.418+0000 7f855bfff700 1 --2- 172.21.15.162:0/1090439393 >> v2:172.21.15.27:3300/0 conn(0x7f855c0cd5e0 0x7f855c0cd9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:29.423 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.418+0000 7f855bfff700 1 -- 172.21.15.162:0/1090439393 >> v1:172.21.15.162:6789/0 conn(0x7f855c15cf70 legacy=0x7f855c15d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:29.423 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.418+0000 7f855bfff700 1 -- 172.21.15.162:0/1090439393 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f855c06eb20 con 0x7f855c06e030 2023-07-05T23:32:29.423 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.418+0000 7f8560ac8700 1 --2- 172.21.15.162:0/1090439393 >> v2:172.21.15.27:3300/0 conn(0x7f855c0cd5e0 0x7f855c0cd9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T23:32:29.424 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.418+0000 7f855bfff700 1 --2- 172.21.15.162:0/1090439393 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f855c06e030 0x7f855c06e4a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8550009840 tx=0x7f8550009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f158c3502fa07db server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:29.424 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.419+0000 7f855b7fe700 1 -- 172.21.15.162:0/1090439393 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8550011830 con 0x7f855c06e030 2023-07-05T23:32:29.424 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.419+0000 7f855b7fe700 1 -- 172.21.15.162:0/1090439393 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8550011990 con 0x7f855c06e030 2023-07-05T23:32:29.424 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.419+0000 7f855b7fe700 1 -- 172.21.15.162:0/1090439393 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8550011d20 con 0x7f855c06e030 2023-07-05T23:32:29.424 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.419+0000 7f8562d2c700 1 -- 172.21.15.162:0/1090439393 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f855c06e030 msgr2=0x7f855c06e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:29.424 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.419+0000 7f8562d2c700 1 --2- 172.21.15.162:0/1090439393 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f855c06e030 0x7f855c06e4a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8550009840 tx=0x7f8550009b50 comp rx=0 tx=0).stop 2023-07-05T23:32:29.424 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.419+0000 7f8562d2c700 1 -- 172.21.15.162:0/1090439393 shutdown_connections 2023-07-05T23:32:29.425 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.419+0000 7f8562d2c700 1 --2- 172.21.15.162:0/1090439393 >> v2:172.21.15.27:3300/0 conn(0x7f855c0cd5e0 0x7f855c0cd9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:29.425 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.419+0000 7f8562d2c700 1 --2- 172.21.15.162:0/1090439393 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f855c06e030 0x7f855c06e4a0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:29.425 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.419+0000 7f8562d2c700 1 -- 172.21.15.162:0/1090439393 >> 172.21.15.162:0/1090439393 conn(0x7f855c06b920 msgr2=0x7f855c0cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:32:29.425 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.419+0000 7f8562d2c700 1 -- 172.21.15.162:0/1090439393 shutdown_connections 2023-07-05T23:32:29.425 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.419+0000 7f8562d2c700 1 -- 172.21.15.162:0/1090439393 wait complete. 2023-07-05T23:32:29.428 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.420+0000 7f8562d2c700 1 Processor -- start 2023-07-05T23:32:29.428 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.420+0000 7f8562d2c700 1 -- start start 2023-07-05T23:32:29.429 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.421+0000 7f8562d2c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f855c06e030 0x7f855c144f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:29.429 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.421+0000 7f8562d2c700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f855c0cd5e0 0x7f855c15a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:29.429 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.421+0000 7f8562d2c700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f855c15cf70 0x7f855c15ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:29.429 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.421+0000 7f8562d2c700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f855c153f10 con 0x7f855c06e030 2023-07-05T23:32:29.429 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.421+0000 7f8562d2c700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f855c15abd0 con 0x7f855c0cd5e0 2023-07-05T23:32:29.429 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.421+0000 7f8562d2c700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f855c15a8f0 con 0x7f855c15cf70 2023-07-05T23:32:29.429 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.421+0000 7f855bfff700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f855c0cd5e0 0x7f855c15a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:29.430 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.421+0000 7f85612c9700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f855c15cf70 0x7f855c15ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:29.430 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.421+0000 7f855bfff700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f855c0cd5e0 0x7f855c15a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:52500/0 (socket says 172.21.15.162:52500) 2023-07-05T23:32:29.430 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.421+0000 7f855bfff700 1 -- 172.21.15.162:0/126813796 learned_addr learned my addr 172.21.15.162:0/126813796 (peer_addr_for_me v2:172.21.15.162:0/0) 2023-07-05T23:32:29.430 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.421+0000 7f8560ac8700 1 --2- 172.21.15.162:0/126813796 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f855c06e030 0x7f855c144f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:29.430 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.422+0000 7f855bfff700 1 -- 172.21.15.162:0/126813796 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f855c15cf70 msgr2=0x7f855c15ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:29.430 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.422+0000 7f855bfff700 1 --2- 172.21.15.162:0/126813796 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f855c15cf70 0x7f855c15ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:29.430 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.422+0000 7f855bfff700 1 -- 172.21.15.162:0/126813796 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f855c06e030 msgr2=0x7f855c144f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:29.431 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.422+0000 7f855bfff700 1 --2- 172.21.15.162:0/126813796 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f855c06e030 0x7f855c144f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:29.431 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.422+0000 7f855bfff700 1 -- 172.21.15.162:0/126813796 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85500094a0 con 0x7f855c0cd5e0 2023-07-05T23:32:29.431 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.422+0000 7f85612c9700 1 --2- 172.21.15.162:0/126813796 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f855c15cf70 0x7f855c15ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T23:32:29.431 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.422+0000 7f855bfff700 1 --2- 172.21.15.162:0/126813796 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f855c0cd5e0 0x7f855c15a070 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8550009fd0 tx=0x7f8550004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:29.431 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.422+0000 7f85597fa700 1 -- 172.21.15.162:0/126813796 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85500036a0 con 0x7f855c0cd5e0 2023-07-05T23:32:29.431 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.422+0000 7f85597fa700 1 -- 172.21.15.162:0/126813796 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f855001e070 con 0x7f855c0cd5e0 2023-07-05T23:32:29.431 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.422+0000 7f85597fa700 1 -- 172.21.15.162:0/126813796 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8550003a40 con 0x7f855c0cd5e0 2023-07-05T23:32:29.431 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.422+0000 7f8562d2c700 1 -- 172.21.15.162:0/126813796 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f855c153850 con 0x7f855c0cd5e0 2023-07-05T23:32:29.432 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.422+0000 7f8562d2c700 1 -- 172.21.15.162:0/126813796 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f855c1454b0 con 0x7f855c0cd5e0 2023-07-05T23:32:29.432 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.422+0000 7f85597fa700 1 -- 172.21.15.162:0/126813796 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f855002d450 con 0x7f855c0cd5e0 2023-07-05T23:32:29.432 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.422+0000 7f85597fa700 1 -- 172.21.15.162:0/126813796 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f855001a8b0 con 0x7f855c0cd5e0 2023-07-05T23:32:29.432 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.423+0000 7f8562d2c700 1 -- 172.21.15.162:0/126813796 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f855c04ea20 con 0x7f855c0cd5e0 2023-07-05T23:32:29.432 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.425+0000 7f85597fa700 1 -- 172.21.15.162:0/126813796 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f8550020070 con 0x7f855c0cd5e0 2023-07-05T23:32:29.510 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.508+0000 7f8562d2c700 1 -- 172.21.15.162:0/126813796 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b0ffe0fc-47ba-4636-b5ea-6bab637642c8", "id": 3} v 0) v1 -- 0x7f855c0b5990 con 0x7f855c0cd5e0 2023-07-05T23:32:29.518 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.516+0000 7f85597fa700 1 -- 172.21.15.162:0/126813796 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b0ffe0fc-47ba-4636-b5ea-6bab637642c8", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8550015020 con 0x7f855c0cd5e0 2023-07-05T23:32:29.518 INFO:teuthology.orchestra.run.smithi162.stdout:3 2023-07-05T23:32:29.519 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.517+0000 7f8562d2c700 1 -- 172.21.15.162:0/126813796 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f855c0cd5e0 msgr2=0x7f855c15a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:29.519 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.517+0000 7f8562d2c700 1 --2- 172.21.15.162:0/126813796 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f855c0cd5e0 0x7f855c15a070 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8550009fd0 tx=0x7f8550004750 comp rx=0 tx=0).stop 2023-07-05T23:32:29.519 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.517+0000 7f8562d2c700 1 -- 172.21.15.162:0/126813796 shutdown_connections 2023-07-05T23:32:29.519 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.517+0000 7f8562d2c700 1 --2- 172.21.15.162:0/126813796 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f855c15cf70 0x7f855c15ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:29.520 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.517+0000 7f8562d2c700 1 --2- 172.21.15.162:0/126813796 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f855c06e030 0x7f855c144f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:29.520 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.517+0000 7f8562d2c700 1 --2- 172.21.15.162:0/126813796 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f855c0cd5e0 0x7f855c15a070 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:29.520 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.517+0000 7f8562d2c700 1 -- 172.21.15.162:0/126813796 >> 172.21.15.162:0/126813796 conn(0x7f855c06b920 msgr2=0x7f855c0af470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:32:29.520 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.517+0000 7f8562d2c700 1 -- 172.21.15.162:0/126813796 shutdown_connections 2023-07-05T23:32:29.520 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.517+0000 7f8562d2c700 1 -- 172.21.15.162:0/126813796 wait complete. 2023-07-05T23:32:29.531 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new 7fab4e5a-1246-4efe-9562-10c4a6c789ff 4 2023-07-05T23:32:29.589 INFO:tasks.ceph.mgr.x.smithi162.stderr:2023-07-05T23:32:29.587+0000 7f92f6ea6200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-05T23:32:29.654 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.651+0000 7f2c021ac700 1 Processor -- start 2023-07-05T23:32:29.654 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.652+0000 7f2c021ac700 1 -- start start 2023-07-05T23:32:29.655 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.652+0000 7f2c021ac700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2bfc0cd330 0x7f2bfc070980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:29.656 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.652+0000 7f2c021ac700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2bfc15a330 0x7f2bfc0cd700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:29.656 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.652+0000 7f2c021ac700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bfc0caf70 con 0x7f2bfc0afc40 2023-07-05T23:32:29.656 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.652+0000 7f2c021ac700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bfc15e360 con 0x7f2bfc15a330 2023-07-05T23:32:29.656 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.652+0000 7f2c021ac700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bfc0cdc40 con 0x7f2bfc0cd330 2023-07-05T23:32:29.656 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.652+0000 7f2bfaffd700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2bfc15a330 0x7f2bfc0cd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:29.656 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.652+0000 7f2bfb7fe700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2bfc0cd330 0x7f2bfc070980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:29.656 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.652+0000 7f2bfaffd700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2bfc15a330 0x7f2bfc0cd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:52506/0 (socket says 172.21.15.162:52506) 2023-07-05T23:32:29.657 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.652+0000 7f2bfaffd700 1 -- 172.21.15.162:0/1322426604 learned_addr learned my addr 172.21.15.162:0/1322426604 (peer_addr_for_me v2:172.21.15.162:0/0) 2023-07-05T23:32:29.657 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.653+0000 7f2bfb7fe700 1 -- 172.21.15.162:0/1322426604 >> v2:172.21.15.162:3300/0 conn(0x7f2bfc15a330 msgr2=0x7f2bfc0cd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:32:29.657 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.653+0000 7f2bfb7fe700 1 --2- 172.21.15.162:0/1322426604 >> v2:172.21.15.162:3300/0 conn(0x7f2bfc15a330 0x7f2bfc0cd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:29.657 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.653+0000 7f2bfb7fe700 1 -- 172.21.15.162:0/1322426604 >> v1:172.21.15.27:6789/0 conn(0x7f2bfc0afc40 legacy=0x7f2bfc15dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:29.657 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.653+0000 7f2bfb7fe700 1 -- 172.21.15.162:0/1322426604 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bfc0cb210 con 0x7f2bfc0cd330 2023-07-05T23:32:29.657 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.653+0000 7f2bfaffd700 1 --2- 172.21.15.162:0/1322426604 >> v2:172.21.15.162:3300/0 conn(0x7f2bfc15a330 0x7f2bfc0cd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T23:32:29.657 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.653+0000 7f2bfb7fe700 1 --2- 172.21.15.162:0/1322426604 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2bfc0cd330 0x7f2bfc070980 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2bec009d90 tx=0x7f2bec00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72b669ad00cfd0eb server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:29.657 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.653+0000 7f2bfa7fc700 1 -- 172.21.15.162:0/1322426604 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bec00e070 con 0x7f2bfc0cd330 2023-07-05T23:32:29.658 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.653+0000 7f2bfa7fc700 1 -- 172.21.15.162:0/1322426604 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bec00bb20 con 0x7f2bfc0cd330 2023-07-05T23:32:29.658 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.653+0000 7f2bfa7fc700 1 -- 172.21.15.162:0/1322426604 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bec012430 con 0x7f2bfc0cd330 2023-07-05T23:32:29.660 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.654+0000 7f2c021ac700 1 -- 172.21.15.162:0/1322426604 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2bfc0cd330 msgr2=0x7f2bfc070980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:29.660 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.654+0000 7f2c021ac700 1 --2- 172.21.15.162:0/1322426604 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2bfc0cd330 0x7f2bfc070980 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2bec009d90 tx=0x7f2bec00b330 comp rx=0 tx=0).stop 2023-07-05T23:32:29.660 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.654+0000 7f2c021ac700 1 -- 172.21.15.162:0/1322426604 shutdown_connections 2023-07-05T23:32:29.660 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.654+0000 7f2c021ac700 1 --2- 172.21.15.162:0/1322426604 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2bfc0cd330 0x7f2bfc070980 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:29.660 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.654+0000 7f2c021ac700 1 --2- 172.21.15.162:0/1322426604 >> v2:172.21.15.162:3300/0 conn(0x7f2bfc15a330 0x7f2bfc0cd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:29.661 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.654+0000 7f2c021ac700 1 -- 172.21.15.162:0/1322426604 >> 172.21.15.162:0/1322426604 conn(0x7f2bfc06e5c0 msgr2=0x7f2bfc06e990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:32:29.661 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.654+0000 7f2c021ac700 1 -- 172.21.15.162:0/1322426604 shutdown_connections 2023-07-05T23:32:29.661 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.654+0000 7f2c021ac700 1 -- 172.21.15.162:0/1322426604 wait complete. 2023-07-05T23:32:29.661 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.655+0000 7f2c021ac700 1 Processor -- start 2023-07-05T23:32:29.661 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.655+0000 7f2c021ac700 1 -- start start 2023-07-05T23:32:29.661 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.656+0000 7f2c021ac700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2bfc0afc40 0x7f2bfc15d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:29.661 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.656+0000 7f2c021ac700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2bfc0cd330 0x7f2bfc14f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:29.662 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.656+0000 7f2c021ac700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2bfc15a330 0x7f2bfc1e4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:29.662 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.656+0000 7f2c021ac700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bfc0b3750 con 0x7f2bfc0cd330 2023-07-05T23:32:29.662 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.656+0000 7f2c021ac700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bfc0b3ff0 con 0x7f2bfc0afc40 2023-07-05T23:32:29.662 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.656+0000 7f2c021ac700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bfc15bf40 con 0x7f2bfc15a330 2023-07-05T23:32:29.662 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.656+0000 7f2bfb7fe700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2bfc0afc40 0x7f2bfc15d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:29.662 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.656+0000 7f2bfbfff700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2bfc15a330 0x7f2bfc1e4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:29.662 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.656+0000 7f2bfb7fe700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2bfc0afc40 0x7f2bfc15d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:52510/0 (socket says 172.21.15.162:52510) 2023-07-05T23:32:29.663 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.656+0000 7f2bfb7fe700 1 -- 172.21.15.162:0/3306084246 learned_addr learned my addr 172.21.15.162:0/3306084246 (peer_addr_for_me v2:172.21.15.162:0/0) 2023-07-05T23:32:29.663 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.656+0000 7f2bfaffd700 1 --2- 172.21.15.162:0/3306084246 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2bfc0cd330 0x7f2bfc14f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:29.663 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.657+0000 7f2bfb7fe700 1 -- 172.21.15.162:0/3306084246 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2bfc15a330 msgr2=0x7f2bfc1e4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:29.663 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.657+0000 7f2bfb7fe700 1 --2- 172.21.15.162:0/3306084246 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2bfc15a330 0x7f2bfc1e4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:29.663 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.657+0000 7f2bfb7fe700 1 -- 172.21.15.162:0/3306084246 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2bfc0cd330 msgr2=0x7f2bfc14f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:29.663 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.657+0000 7f2bfb7fe700 1 --2- 172.21.15.162:0/3306084246 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2bfc0cd330 0x7f2bfc14f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:29.663 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.657+0000 7f2bfb7fe700 1 -- 172.21.15.162:0/3306084246 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2be4009550 con 0x7f2bfc0afc40 2023-07-05T23:32:29.663 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.657+0000 7f2bfbfff700 1 --2- 172.21.15.162:0/3306084246 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2bfc15a330 0x7f2bfc1e4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T23:32:29.664 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.657+0000 7f2bfb7fe700 1 --2- 172.21.15.162:0/3306084246 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2bfc0afc40 0x7f2bfc15d1e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2bec014040 tx=0x7f2bec004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:29.664 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.657+0000 7f2bf3fff700 1 -- 172.21.15.162:0/3306084246 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bec012430 con 0x7f2bfc0afc40 2023-07-05T23:32:29.664 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.657+0000 7f2bf3fff700 1 -- 172.21.15.162:0/3306084246 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bec020070 con 0x7f2bfc0afc40 2023-07-05T23:32:29.664 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.657+0000 7f2c021ac700 1 -- 172.21.15.162:0/3306084246 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bec009a70 con 0x7f2bfc0afc40 2023-07-05T23:32:29.664 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.657+0000 7f2bf3fff700 1 -- 172.21.15.162:0/3306084246 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bec004280 con 0x7f2bfc0afc40 2023-07-05T23:32:29.664 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.657+0000 7f2c021ac700 1 -- 172.21.15.162:0/3306084246 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bfc0b3c80 con 0x7f2bfc0afc40 2023-07-05T23:32:29.664 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.657+0000 7f2bf3fff700 1 -- 172.21.15.162:0/3306084246 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2bec0046e0 con 0x7f2bfc0afc40 2023-07-05T23:32:29.664 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.657+0000 7f2bf3fff700 1 -- 172.21.15.162:0/3306084246 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f2bec022070 con 0x7f2bfc0afc40 2023-07-05T23:32:29.665 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.658+0000 7f2c021ac700 1 -- 172.21.15.162:0/3306084246 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bfc04ea20 con 0x7f2bfc0afc40 2023-07-05T23:32:29.665 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.660+0000 7f2bf3fff700 1 -- 172.21.15.162:0/3306084246 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f2bec045b00 con 0x7f2bfc0afc40 2023-07-05T23:32:29.732 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-07-05T23:32:29.730+0000 7fd3a3e13200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-05T23:32:29.748 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.746+0000 7f2c021ac700 1 -- 172.21.15.162:0/3306084246 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7fab4e5a-1246-4efe-9562-10c4a6c789ff", "id": 4} v 0) v1 -- 0x7f2bfc0b68a0 con 0x7f2bfc0afc40 2023-07-05T23:32:29.756 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.754+0000 7f2bf3fff700 1 -- 172.21.15.162:0/3306084246 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7fab4e5a-1246-4efe-9562-10c4a6c789ff", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2bec034030 con 0x7f2bfc0afc40 2023-07-05T23:32:29.756 INFO:teuthology.orchestra.run.smithi162.stdout:4 2023-07-05T23:32:29.757 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.755+0000 7f2c021ac700 1 -- 172.21.15.162:0/3306084246 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2bfc0afc40 msgr2=0x7f2bfc15d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:29.757 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.755+0000 7f2c021ac700 1 --2- 172.21.15.162:0/3306084246 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2bfc0afc40 0x7f2bfc15d1e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2bec014040 tx=0x7f2bec004ad0 comp rx=0 tx=0).stop 2023-07-05T23:32:29.757 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.755+0000 7f2c021ac700 1 -- 172.21.15.162:0/3306084246 shutdown_connections 2023-07-05T23:32:29.757 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.755+0000 7f2c021ac700 1 --2- 172.21.15.162:0/3306084246 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2bfc0afc40 0x7f2bfc15d1e0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:29.758 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.755+0000 7f2c021ac700 1 --2- 172.21.15.162:0/3306084246 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2bfc15a330 0x7f2bfc1e4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:29.758 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.755+0000 7f2c021ac700 1 --2- 172.21.15.162:0/3306084246 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2bfc0cd330 0x7f2bfc14f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:29.758 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.755+0000 7f2c021ac700 1 -- 172.21.15.162:0/3306084246 >> 172.21.15.162:0/3306084246 conn(0x7f2bfc06e5c0 msgr2=0x7f2bfc0ce050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:32:29.758 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.755+0000 7f2c021ac700 1 -- 172.21.15.162:0/3306084246 shutdown_connections 2023-07-05T23:32:29.758 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.755+0000 7f2c021ac700 1 -- 172.21.15.162:0/3306084246 wait complete. 2023-07-05T23:32:29.769 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new 110c4d9f-cef6-48ab-a818-5a81e72372af 5 2023-07-05T23:32:29.890 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.887+0000 7f7a96195700 1 Processor -- start 2023-07-05T23:32:29.890 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.887+0000 7f7a96195700 1 -- start start 2023-07-05T23:32:29.892 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.888+0000 7f7a96195700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f7a9015a430 0x7f7a9006e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:29.892 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.888+0000 7f7a96195700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a900ae8b0 0x7f7a900ac600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:29.892 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.888+0000 7f7a96195700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7a900acb40 0x7f7a900acfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:29.892 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.888+0000 7f7a96195700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a900af330 con 0x7f7a9015a430 2023-07-05T23:32:29.892 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.888+0000 7f7a96195700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a900aee00 con 0x7f7a900acb40 2023-07-05T23:32:29.893 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.888+0000 7f7a96195700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a9006e340 con 0x7f7a900ae8b0 2023-07-05T23:32:29.893 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.888+0000 7f7a8effd700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a900ae8b0 0x7f7a900ac600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:29.893 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.888+0000 7f7a8effd700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a900ae8b0 0x7f7a900ac600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.162:37528/0 (socket says 172.21.15.162:37528) 2023-07-05T23:32:29.893 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.888+0000 7f7a8effd700 1 -- 172.21.15.162:0/3141004877 learned_addr learned my addr 172.21.15.162:0/3141004877 (peer_addr_for_me v2:172.21.15.162:0/0) 2023-07-05T23:32:29.893 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.888+0000 7f7a8ffff700 1 --2- 172.21.15.162:0/3141004877 >> v2:172.21.15.162:3300/0 conn(0x7f7a900acb40 0x7f7a900acfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:29.893 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.889+0000 7f7a8f7fe700 1 --2- 172.21.15.162:0/3141004877 >> v2:172.21.15.27:3300/0 conn(0x7f7a9015a430 0x7f7a9006e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:29.893 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.889+0000 7f7a8ffff700 1 -- 172.21.15.162:0/3141004877 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a900ae8b0 msgr2=0x7f7a900ac600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:32:29.894 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.889+0000 7f7a8ffff700 1 --2- 172.21.15.162:0/3141004877 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a900ae8b0 0x7f7a900ac600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:29.894 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.889+0000 7f7a8ffff700 1 -- 172.21.15.162:0/3141004877 >> v2:172.21.15.27:3300/0 conn(0x7f7a9015a430 msgr2=0x7f7a9006e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:32:29.894 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.889+0000 7f7a8ffff700 1 --2- 172.21.15.162:0/3141004877 >> v2:172.21.15.27:3300/0 conn(0x7f7a9015a430 0x7f7a9006e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:29.894 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.889+0000 7f7a8ffff700 1 -- 172.21.15.162:0/3141004877 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a900af050 con 0x7f7a900acb40 2023-07-05T23:32:29.894 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.889+0000 7f7a8effd700 1 --2- 172.21.15.162:0/3141004877 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a900ae8b0 0x7f7a900ac600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T23:32:29.894 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.889+0000 7f7a8ffff700 1 --2- 172.21.15.162:0/3141004877 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a900acb40 0x7f7a900acfc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7a9008a290 tx=0x7f7a88009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d694ccc92bd1bb58 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:29.894 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.889+0000 7f7a8e7fc700 1 -- 172.21.15.162:0/3141004877 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a88011830 con 0x7f7a900acb40 2023-07-05T23:32:29.895 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.889+0000 7f7a8e7fc700 1 -- 172.21.15.162:0/3141004877 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a88011990 con 0x7f7a900acb40 2023-07-05T23:32:29.895 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.889+0000 7f7a8e7fc700 1 -- 172.21.15.162:0/3141004877 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a88011d20 con 0x7f7a900acb40 2023-07-05T23:32:29.895 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.890+0000 7f7a96195700 1 -- 172.21.15.162:0/3141004877 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a900acb40 msgr2=0x7f7a900acfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:29.895 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.890+0000 7f7a96195700 1 --2- 172.21.15.162:0/3141004877 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a900acb40 0x7f7a900acfc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7a9008a290 tx=0x7f7a88009b20 comp rx=0 tx=0).stop 2023-07-05T23:32:29.895 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.890+0000 7f7a96195700 1 -- 172.21.15.162:0/3141004877 shutdown_connections 2023-07-05T23:32:29.895 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.890+0000 7f7a96195700 1 --2- 172.21.15.162:0/3141004877 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a900acb40 0x7f7a900acfc0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:29.895 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.890+0000 7f7a96195700 1 --2- 172.21.15.162:0/3141004877 >> v2:172.21.15.27:3300/0 conn(0x7f7a9015a430 0x7f7a9006e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:29.895 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.890+0000 7f7a96195700 1 --2- 172.21.15.162:0/3141004877 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a900ae8b0 0x7f7a900ac600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:29.896 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.890+0000 7f7a96195700 1 -- 172.21.15.162:0/3141004877 >> 172.21.15.162:0/3141004877 conn(0x7f7a9006b920 msgr2=0x7f7a900cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:32:29.896 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.890+0000 7f7a96195700 1 -- 172.21.15.162:0/3141004877 shutdown_connections 2023-07-05T23:32:29.896 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.890+0000 7f7a96195700 1 -- 172.21.15.162:0/3141004877 wait complete. 2023-07-05T23:32:29.898 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.891+0000 7f7a96195700 1 Processor -- start 2023-07-05T23:32:29.898 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.891+0000 7f7a96195700 1 -- start start 2023-07-05T23:32:29.898 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.892+0000 7f7a96195700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7a900acb40 0x7f7a900c3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:29.898 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.892+0000 7f7a96195700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a900ae8b0 0x7f7a90154e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:29.898 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.892+0000 7f7a96195700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a9015a430 0x7f7a900c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:29.898 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.892+0000 7f7a96195700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a900c3a80 con 0x7f7a900acb40 2023-07-05T23:32:29.899 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.892+0000 7f7a96195700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a90158810 con 0x7f7a900ae8b0 2023-07-05T23:32:29.899 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.892+0000 7f7a96195700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a90158af0 con 0x7f7a9015a430 2023-07-05T23:32:29.899 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.892+0000 7f7a8ffff700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a9015a430 0x7f7a900c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:29.899 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.892+0000 7f7a8effd700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a900ae8b0 0x7f7a90154e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:29.899 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.892+0000 7f7a8ffff700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a9015a430 0x7f7a900c52a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.162:37538/0 (socket says 172.21.15.162:37538) 2023-07-05T23:32:29.899 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.892+0000 7f7a8ffff700 1 -- 172.21.15.162:0/1123737832 learned_addr learned my addr 172.21.15.162:0/1123737832 (peer_addr_for_me v2:172.21.15.162:0/0) 2023-07-05T23:32:29.899 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.892+0000 7f7a8f7fe700 1 --2- 172.21.15.162:0/1123737832 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7a900acb40 0x7f7a900c3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:29.899 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.892+0000 7f7a8ffff700 1 -- 172.21.15.162:0/1123737832 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a900ae8b0 msgr2=0x7f7a90154e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:29.900 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.892+0000 7f7a8ffff700 1 --2- 172.21.15.162:0/1123737832 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a900ae8b0 0x7f7a90154e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:29.900 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.892+0000 7f7a8ffff700 1 -- 172.21.15.162:0/1123737832 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7a900acb40 msgr2=0x7f7a900c3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:29.900 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.892+0000 7f7a8ffff700 1 --2- 172.21.15.162:0/1123737832 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7a900acb40 0x7f7a900c3540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:29.900 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.892+0000 7f7a8ffff700 1 -- 172.21.15.162:0/1123737832 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a84009550 con 0x7f7a9015a430 2023-07-05T23:32:29.900 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.892+0000 7f7a8f7fe700 1 --2- 172.21.15.162:0/1123737832 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7a900acb40 0x7f7a900c3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T23:32:29.900 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.893+0000 7f7a8ffff700 1 --2- 172.21.15.162:0/1123737832 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a9015a430 0x7f7a900c52a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7a880090b0 tx=0x7f7a88004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:29.900 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.893+0000 7f7a77fff700 1 -- 172.21.15.162:0/1123737832 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a88004450 con 0x7f7a9015a430 2023-07-05T23:32:29.901 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.893+0000 7f7a77fff700 1 -- 172.21.15.162:0/1123737832 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a8801e070 con 0x7f7a9015a430 2023-07-05T23:32:29.901 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.893+0000 7f7a77fff700 1 -- 172.21.15.162:0/1123737832 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a880038e0 con 0x7f7a9015a430 2023-07-05T23:32:29.901 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.893+0000 7f7a96195700 1 -- 172.21.15.162:0/1123737832 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a880094a0 con 0x7f7a9015a430 2023-07-05T23:32:29.901 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.893+0000 7f7a96195700 1 -- 172.21.15.162:0/1123737832 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a901590b0 con 0x7f7a9015a430 2023-07-05T23:32:29.901 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.893+0000 7f7a77fff700 1 -- 172.21.15.162:0/1123737832 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7a88003d40 con 0x7f7a9015a430 2023-07-05T23:32:29.901 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.893+0000 7f7a77fff700 1 -- 172.21.15.162:0/1123737832 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f7a8801ab00 con 0x7f7a9015a430 2023-07-05T23:32:29.901 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.894+0000 7f7a96195700 1 -- 172.21.15.162:0/1123737832 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a9004ea20 con 0x7f7a9015a430 2023-07-05T23:32:29.902 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.896+0000 7f7a77fff700 1 -- 172.21.15.162:0/1123737832 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f7a88032060 con 0x7f7a9015a430 2023-07-05T23:32:29.986 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.983+0000 7f7a96195700 1 -- 172.21.15.162:0/1123737832 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd new", "uuid": "110c4d9f-cef6-48ab-a818-5a81e72372af", "id": 5} v 0) v1 -- 0x7f7a9006fa60 con 0x7f7a9015a430 2023-07-05T23:32:29.993 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.991+0000 7f7a77fff700 1 -- 172.21.15.162:0/1123737832 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "110c4d9f-cef6-48ab-a818-5a81e72372af", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7a88020070 con 0x7f7a9015a430 2023-07-05T23:32:29.994 INFO:teuthology.orchestra.run.smithi162.stdout:5 2023-07-05T23:32:29.994 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.992+0000 7f7a96195700 1 -- 172.21.15.162:0/1123737832 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a9015a430 msgr2=0x7f7a900c52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:29.995 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.992+0000 7f7a96195700 1 --2- 172.21.15.162:0/1123737832 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a9015a430 0x7f7a900c52a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7a880090b0 tx=0x7f7a88004750 comp rx=0 tx=0).stop 2023-07-05T23:32:29.995 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.992+0000 7f7a96195700 1 -- 172.21.15.162:0/1123737832 shutdown_connections 2023-07-05T23:32:29.995 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.992+0000 7f7a96195700 1 --2- 172.21.15.162:0/1123737832 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a9015a430 0x7f7a900c52a0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:29.995 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.992+0000 7f7a96195700 1 --2- 172.21.15.162:0/1123737832 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7a900acb40 0x7f7a900c3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:29.995 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.992+0000 7f7a96195700 1 --2- 172.21.15.162:0/1123737832 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a900ae8b0 0x7f7a90154e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:29.995 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.992+0000 7f7a96195700 1 -- 172.21.15.162:0/1123737832 >> 172.21.15.162:0/1123737832 conn(0x7f7a9006b920 msgr2=0x7f7a900cf970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:32:29.996 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.992+0000 7f7a96195700 1 -- 172.21.15.162:0/1123737832 shutdown_connections 2023-07-05T23:32:29.996 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:29.992+0000 7f7a96195700 1 -- 172.21.15.162:0/1123737832 wait complete. 2023-07-05T23:32:30.010 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new 16803bcc-2c92-4aed-954e-487938c9f24a 6 2023-07-05T23:32:30.159 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.157+0000 7f8336a22700 1 Processor -- start 2023-07-05T23:32:30.160 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.157+0000 7f8336a22700 1 -- start start 2023-07-05T23:32:30.162 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.158+0000 7f8336a22700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f83300cfd80 0x7f833015b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:30.163 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.158+0000 7f8336a22700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8330069ef0 0x7f833006a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:30.163 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.158+0000 7f8336a22700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83300cb380 con 0x7f833006ccd0 2023-07-05T23:32:30.163 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.158+0000 7f8336a22700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f833015b7a0 con 0x7f83300cfd80 2023-07-05T23:32:30.163 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.158+0000 7f8336a22700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83300c97f0 con 0x7f8330069ef0 2023-07-05T23:32:30.163 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.158+0000 7f8334fbf700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8330069ef0 0x7f833006a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:30.163 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.158+0000 7f8334fbf700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8330069ef0 0x7f833006a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.162:37544/0 (socket says 172.21.15.162:37544) 2023-07-05T23:32:30.164 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.158+0000 7f8334fbf700 1 -- 172.21.15.162:0/703980360 learned_addr learned my addr 172.21.15.162:0/703980360 (peer_addr_for_me v2:172.21.15.162:0/0) 2023-07-05T23:32:30.164 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.158+0000 7f832ffff700 1 --1- 172.21.15.162:0/703980360 >> v1:172.21.15.162:6789/0 conn(0x7f833006ccd0 0x7f833006d0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:48370/0 (socket says 172.21.15.162:48370) 2023-07-05T23:32:30.164 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.158+0000 7f832f7fe700 1 --2- 172.21.15.162:0/703980360 >> v2:172.21.15.27:3300/0 conn(0x7f83300cfd80 0x7f833015b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:30.164 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.159+0000 7f832effd700 1 -- 172.21.15.162:0/703980360 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 372428106 0 0) 0x7f83300cb380 con 0x7f833006ccd0 2023-07-05T23:32:30.164 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.159+0000 7f8334fbf700 1 -- 172.21.15.162:0/703980360 >> v2:172.21.15.27:3300/0 conn(0x7f83300cfd80 msgr2=0x7f833015b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:32:30.164 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.159+0000 7f8334fbf700 1 --2- 172.21.15.162:0/703980360 >> v2:172.21.15.27:3300/0 conn(0x7f83300cfd80 0x7f833015b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:30.164 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.159+0000 7f8334fbf700 1 -- 172.21.15.162:0/703980360 >> v1:172.21.15.162:6789/0 conn(0x7f833006ccd0 legacy=0x7f833006d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:30.165 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.159+0000 7f8334fbf700 1 -- 172.21.15.162:0/703980360 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83300cb620 con 0x7f8330069ef0 2023-07-05T23:32:30.165 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.159+0000 7f832f7fe700 1 --2- 172.21.15.162:0/703980360 >> v2:172.21.15.27:3300/0 conn(0x7f83300cfd80 0x7f833015b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T23:32:30.165 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.159+0000 7f8334fbf700 1 --2- 172.21.15.162:0/703980360 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8330069ef0 0x7f833006a370 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8328009e50 tx=0x7f832800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a7a90fa7f9ec6c8 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:30.165 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.159+0000 7f832effd700 1 -- 172.21.15.162:0/703980360 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f832800e070 con 0x7f8330069ef0 2023-07-05T23:32:30.165 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.159+0000 7f832effd700 1 -- 172.21.15.162:0/703980360 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f832800b9c0 con 0x7f8330069ef0 2023-07-05T23:32:30.165 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.159+0000 7f832effd700 1 -- 172.21.15.162:0/703980360 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f832800bd70 con 0x7f8330069ef0 2023-07-05T23:32:30.165 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.160+0000 7f8336a22700 1 -- 172.21.15.162:0/703980360 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8330069ef0 msgr2=0x7f833006a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:30.166 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.160+0000 7f8336a22700 1 --2- 172.21.15.162:0/703980360 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8330069ef0 0x7f833006a370 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8328009e50 tx=0x7f832800b330 comp rx=0 tx=0).stop 2023-07-05T23:32:30.166 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.160+0000 7f8336a22700 1 -- 172.21.15.162:0/703980360 shutdown_connections 2023-07-05T23:32:30.166 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.160+0000 7f8336a22700 1 --2- 172.21.15.162:0/703980360 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8330069ef0 0x7f833006a370 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:30.166 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.160+0000 7f8336a22700 1 --2- 172.21.15.162:0/703980360 >> v2:172.21.15.27:3300/0 conn(0x7f83300cfd80 0x7f833015b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:30.166 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.160+0000 7f8336a22700 1 -- 172.21.15.162:0/703980360 >> 172.21.15.162:0/703980360 conn(0x7f83300b1990 msgr2=0x7f83300cf1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:32:30.166 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.160+0000 7f8336a22700 1 -- 172.21.15.162:0/703980360 shutdown_connections 2023-07-05T23:32:30.166 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.160+0000 7f8336a22700 1 -- 172.21.15.162:0/703980360 wait complete. 2023-07-05T23:32:30.168 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.161+0000 7f8336a22700 1 Processor -- start 2023-07-05T23:32:30.169 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.162+0000 7f8336a22700 1 -- start start 2023-07-05T23:32:30.169 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.162+0000 7f8336a22700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8330069ef0 0x7f83300c6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:30.169 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.162+0000 7f8336a22700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f833006ccd0 0x7f833014f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:30.170 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.162+0000 7f8336a22700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f83300cfd80 0x7f8330156a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:30.170 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.162+0000 7f8336a22700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f833014f610 con 0x7f8330069ef0 2023-07-05T23:32:30.170 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.162+0000 7f8336a22700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8330154f70 con 0x7f833006ccd0 2023-07-05T23:32:30.170 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.162+0000 7f8336a22700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8330155250 con 0x7f83300cfd80 2023-07-05T23:32:30.171 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.162+0000 7f832f7fe700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f833006ccd0 0x7f833014f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:30.171 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.162+0000 7f8334fbf700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f83300cfd80 0x7f8330156a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:30.171 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.162+0000 7f832f7fe700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f833006ccd0 0x7f833014f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:52536/0 (socket says 172.21.15.162:52536) 2023-07-05T23:32:30.171 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.163+0000 7f8334fbf700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f83300cfd80 0x7f8330156a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.162:37550/0 (socket says 172.21.15.162:37550) 2023-07-05T23:32:30.172 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.163+0000 7f832f7fe700 1 -- 172.21.15.162:0/2583731099 learned_addr learned my addr 172.21.15.162:0/2583731099 (peer_addr_for_me v2:172.21.15.162:0/0) 2023-07-05T23:32:30.172 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.163+0000 7f832ffff700 1 --2- 172.21.15.162:0/2583731099 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8330069ef0 0x7f83300c6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:30.172 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.163+0000 7f8334fbf700 1 -- 172.21.15.162:0/2583731099 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f833006ccd0 msgr2=0x7f833014f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:30.173 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.163+0000 7f8334fbf700 1 --2- 172.21.15.162:0/2583731099 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f833006ccd0 0x7f833014f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:30.173 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.163+0000 7f8334fbf700 1 -- 172.21.15.162:0/2583731099 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8330069ef0 msgr2=0x7f83300c6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:30.173 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.163+0000 7f8334fbf700 1 --2- 172.21.15.162:0/2583731099 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8330069ef0 0x7f83300c6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:30.173 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.163+0000 7f8334fbf700 1 -- 172.21.15.162:0/2583731099 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8328009b30 con 0x7f83300cfd80 2023-07-05T23:32:30.174 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.163+0000 7f832f7fe700 1 --2- 172.21.15.162:0/2583731099 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f833006ccd0 0x7f833014f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T23:32:30.174 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.163+0000 7f8334fbf700 1 --2- 172.21.15.162:0/2583731099 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f83300cfd80 0x7f8330156a00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f83300b1df0 tx=0x7f8328004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:30.174 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.163+0000 7f832cff9700 1 -- 172.21.15.162:0/2583731099 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83280092e0 con 0x7f83300cfd80 2023-07-05T23:32:30.175 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.163+0000 7f832cff9700 1 -- 172.21.15.162:0/2583731099 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8328004250 con 0x7f83300cfd80 2023-07-05T23:32:30.175 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.163+0000 7f8336a22700 1 -- 172.21.15.162:0/2583731099 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8330155530 con 0x7f83300cfd80 2023-07-05T23:32:30.175 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.163+0000 7f832cff9700 1 -- 172.21.15.162:0/2583731099 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8328004620 con 0x7f83300cfd80 2023-07-05T23:32:30.175 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.163+0000 7f8336a22700 1 -- 172.21.15.162:0/2583731099 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8330155af0 con 0x7f83300cfd80 2023-07-05T23:32:30.176 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.163+0000 7f832cff9700 1 -- 172.21.15.162:0/2583731099 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f832801b430 con 0x7f83300cfd80 2023-07-05T23:32:30.176 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.163+0000 7f832cff9700 1 -- 172.21.15.162:0/2583731099 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f8328024aa0 con 0x7f83300cfd80 2023-07-05T23:32:30.176 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.164+0000 7f8336a22700 1 -- 172.21.15.162:0/2583731099 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f833004ea20 con 0x7f83300cfd80 2023-07-05T23:32:30.177 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.168+0000 7f832cff9700 1 -- 172.21.15.162:0/2583731099 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f832801f030 con 0x7f83300cfd80 2023-07-05T23:32:30.177 INFO:tasks.ceph.mgr.x.smithi162.stderr:2023-07-05T23:32:30.169+0000 7f92f6ea6200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-05T23:32:30.252 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.250+0000 7f8336a22700 1 -- 172.21.15.162:0/2583731099 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd new", "uuid": "16803bcc-2c92-4aed-954e-487938c9f24a", "id": 6} v 0) v1 -- 0x7f83300c6030 con 0x7f83300cfd80 2023-07-05T23:32:30.260 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.258+0000 7f832cff9700 1 -- 172.21.15.162:0/2583731099 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "16803bcc-2c92-4aed-954e-487938c9f24a", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f83280246f0 con 0x7f83300cfd80 2023-07-05T23:32:30.261 INFO:teuthology.orchestra.run.smithi162.stdout:6 2023-07-05T23:32:30.262 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.259+0000 7f8336a22700 1 -- 172.21.15.162:0/2583731099 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f83300cfd80 msgr2=0x7f8330156a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:30.262 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.259+0000 7f8336a22700 1 --2- 172.21.15.162:0/2583731099 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f83300cfd80 0x7f8330156a00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f83300b1df0 tx=0x7f8328004ad0 comp rx=0 tx=0).stop 2023-07-05T23:32:30.262 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.259+0000 7f8336a22700 1 -- 172.21.15.162:0/2583731099 shutdown_connections 2023-07-05T23:32:30.262 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.259+0000 7f8336a22700 1 --2- 172.21.15.162:0/2583731099 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f83300cfd80 0x7f8330156a00 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:30.262 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.259+0000 7f8336a22700 1 --2- 172.21.15.162:0/2583731099 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8330069ef0 0x7f83300c6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:30.262 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.259+0000 7f8336a22700 1 --2- 172.21.15.162:0/2583731099 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f833006ccd0 0x7f833014f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:30.262 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.259+0000 7f8336a22700 1 -- 172.21.15.162:0/2583731099 >> 172.21.15.162:0/2583731099 conn(0x7f83300b1990 msgr2=0x7f83300b3270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:32:30.263 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.259+0000 7f8336a22700 1 -- 172.21.15.162:0/2583731099 shutdown_connections 2023-07-05T23:32:30.263 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.259+0000 7f8336a22700 1 -- 172.21.15.162:0/2583731099 wait complete. 2023-07-05T23:32:30.273 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new b7c35377-3cf2-4569-b6b9-72376eb463bc 7 2023-07-05T23:32:30.322 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-07-05T23:32:30.320+0000 7fd3a3e13200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-05T23:32:30.335 INFO:tasks.ceph.mgr.x.smithi162.stderr:2023-07-05T23:32:30.333+0000 7f92f6ea6200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-05T23:32:30.403 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.392+0000 7f35d3849700 1 Processor -- start 2023-07-05T23:32:30.403 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.393+0000 7f35d3849700 1 -- start start 2023-07-05T23:32:30.404 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.393+0000 7f35d3849700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f35cc06e970 0x7f35cc06a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:30.404 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.393+0000 7f35d3849700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35cc0ce620 con 0x7f35cc0aecc0 2023-07-05T23:32:30.407 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.393+0000 7f35d3849700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35cc160580 con 0x7f35cc15fc60 2023-07-05T23:32:30.407 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.393+0000 7f35d3849700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35cc160860 con 0x7f35cc06e970 2023-07-05T23:32:30.407 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.393+0000 7f35d1de6700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f35cc06e970 0x7f35cc06a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:30.408 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.393+0000 7f35d15e5700 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f35cc15fc60 0x7f35cc06e260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:48382/0 (socket says 172.21.15.162:48382) 2023-07-05T23:32:30.408 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.394+0000 7f35d15e5700 1 -- 172.21.15.162:0/1844067170 learned_addr learned my addr 172.21.15.162:0/1844067170 (peer_addr_for_me v1:172.21.15.162:0/0) 2023-07-05T23:32:30.408 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.394+0000 7f35d1de6700 1 -- 172.21.15.162:0/1844067170 >> v1:172.21.15.162:6789/0 conn(0x7f35cc15fc60 legacy=0x7f35cc06e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:30.408 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.394+0000 7f35d1de6700 1 -- 172.21.15.162:0/1844067170 >> v1:172.21.15.27:6789/0 conn(0x7f35cc0aecc0 legacy=0x7f35cc0cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:30.408 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.394+0000 7f35c3fff700 1 -- 172.21.15.162:0/1844067170 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1564773273 0 0) 0x7f35cc160580 con 0x7f35cc15fc60 2023-07-05T23:32:30.408 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.394+0000 7f35d1de6700 1 -- 172.21.15.162:0/1844067170 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35cc160b40 con 0x7f35cc06e970 2023-07-05T23:32:30.408 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.394+0000 7f35d1de6700 1 --2- 172.21.15.162:0/1844067170 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35cc06e970 0x7f35cc06a900 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f35c4009d90 tx=0x7f35c400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b01b2484cb91039 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:30.409 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.394+0000 7f35c3fff700 1 -- 172.21.15.162:0/1844067170 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c400e070 con 0x7f35cc06e970 2023-07-05T23:32:30.409 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.394+0000 7f35c3fff700 1 -- 172.21.15.162:0/1844067170 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35c400bbd0 con 0x7f35cc06e970 2023-07-05T23:32:30.409 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.394+0000 7f35c3fff700 1 -- 172.21.15.162:0/1844067170 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c4012430 con 0x7f35cc06e970 2023-07-05T23:32:30.409 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.395+0000 7f35d3849700 1 -- 172.21.15.162:0/1844067170 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35cc06e970 msgr2=0x7f35cc06a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:30.409 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.395+0000 7f35d3849700 1 --2- 172.21.15.162:0/1844067170 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35cc06e970 0x7f35cc06a900 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f35c4009d90 tx=0x7f35c400b330 comp rx=0 tx=0).stop 2023-07-05T23:32:30.409 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.395+0000 7f35d3849700 1 -- 172.21.15.162:0/1844067170 shutdown_connections 2023-07-05T23:32:30.409 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.395+0000 7f35d3849700 1 --2- 172.21.15.162:0/1844067170 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35cc06e970 0x7f35cc06a900 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:30.410 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.395+0000 7f35d3849700 1 -- 172.21.15.162:0/1844067170 >> 172.21.15.162:0/1844067170 conn(0x7f35cc06b920 msgr2=0x7f35cc0cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:32:30.410 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.395+0000 7f35d3849700 1 -- 172.21.15.162:0/1844067170 shutdown_connections 2023-07-05T23:32:30.410 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.395+0000 7f35d3849700 1 -- 172.21.15.162:0/1844067170 wait complete. 2023-07-05T23:32:30.410 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.397+0000 7f35d3849700 1 Processor -- start 2023-07-05T23:32:30.410 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.397+0000 7f35d3849700 1 -- start start 2023-07-05T23:32:30.410 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.398+0000 7f35d3849700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f35cc06e970 0x7f35cc1e6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:30.410 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.398+0000 7f35d3849700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f35cc0aecc0 0x7f35cc14fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:30.410 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.398+0000 7f35d3849700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35cc15fc60 0x7f35cc0cf390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:30.411 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.398+0000 7f35d3849700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35cc1e6b00 con 0x7f35cc06e970 2023-07-05T23:32:30.411 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.398+0000 7f35d3849700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35cc1e7460 con 0x7f35cc15fc60 2023-07-05T23:32:30.411 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.398+0000 7f35d3849700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35cc1e5f10 con 0x7f35cc0aecc0 2023-07-05T23:32:30.411 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.398+0000 7f35d1de6700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35cc15fc60 0x7f35cc0cf390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:30.411 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.398+0000 7f35d1de6700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35cc15fc60 0x7f35cc0cf390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:52550/0 (socket says 172.21.15.162:52550) 2023-07-05T23:32:30.411 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.398+0000 7f35d0de4700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f35cc0aecc0 0x7f35cc14fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:30.411 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.398+0000 7f35d1de6700 1 -- 172.21.15.162:0/3443492573 learned_addr learned my addr 172.21.15.162:0/3443492573 (peer_addr_for_me v2:172.21.15.162:0/0) 2023-07-05T23:32:30.412 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.398+0000 7f35d15e5700 1 --2- 172.21.15.162:0/3443492573 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f35cc06e970 0x7f35cc1e6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:30.412 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.398+0000 7f35d1de6700 1 -- 172.21.15.162:0/3443492573 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f35cc0aecc0 msgr2=0x7f35cc14fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:30.412 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.398+0000 7f35d1de6700 1 --2- 172.21.15.162:0/3443492573 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f35cc0aecc0 0x7f35cc14fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:30.412 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.398+0000 7f35d1de6700 1 -- 172.21.15.162:0/3443492573 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f35cc06e970 msgr2=0x7f35cc1e6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:30.412 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.398+0000 7f35d1de6700 1 --2- 172.21.15.162:0/3443492573 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f35cc06e970 0x7f35cc1e6f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:30.412 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.398+0000 7f35d1de6700 1 -- 172.21.15.162:0/3443492573 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c4009a70 con 0x7f35cc15fc60 2023-07-05T23:32:30.412 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.398+0000 7f35d0de4700 1 --2- 172.21.15.162:0/3443492573 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f35cc0aecc0 0x7f35cc14fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T23:32:30.413 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.398+0000 7f35d1de6700 1 --2- 172.21.15.162:0/3443492573 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35cc15fc60 0x7f35cc0cf390 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f35c4009d60 tx=0x7f35c4004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:30.413 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.398+0000 7f35c1ffb700 1 -- 172.21.15.162:0/3443492573 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c401b8d0 con 0x7f35cc15fc60 2023-07-05T23:32:30.413 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.398+0000 7f35c1ffb700 1 -- 172.21.15.162:0/3443492573 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35c4020070 con 0x7f35cc15fc60 2023-07-05T23:32:30.413 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.398+0000 7f35d3849700 1 -- 172.21.15.162:0/3443492573 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35cc150250 con 0x7f35cc15fc60 2023-07-05T23:32:30.413 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.398+0000 7f35c1ffb700 1 -- 172.21.15.162:0/3443492573 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c401bc90 con 0x7f35cc15fc60 2023-07-05T23:32:30.413 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.398+0000 7f35d3849700 1 -- 172.21.15.162:0/3443492573 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35cc1e6440 con 0x7f35cc15fc60 2023-07-05T23:32:30.413 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.399+0000 7f35c1ffb700 1 -- 172.21.15.162:0/3443492573 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f35c4027780 con 0x7f35cc15fc60 2023-07-05T23:32:30.413 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.399+0000 7f35c1ffb700 1 -- 172.21.15.162:0/3443492573 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f35c4022070 con 0x7f35cc15fc60 2023-07-05T23:32:30.414 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.399+0000 7f35d3849700 1 -- 172.21.15.162:0/3443492573 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35cc04ea20 con 0x7f35cc15fc60 2023-07-05T23:32:30.414 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.403+0000 7f35c1ffb700 1 -- 172.21.15.162:0/3443492573 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f35c401c680 con 0x7f35cc15fc60 2023-07-05T23:32:30.484 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-07-05T23:32:30.481+0000 7fd3a3e13200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-05T23:32:30.488 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.486+0000 7f35d3849700 1 -- 172.21.15.162:0/3443492573 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b7c35377-3cf2-4569-b6b9-72376eb463bc", "id": 7} v 0) v1 -- 0x7f35cc0b5990 con 0x7f35cc15fc60 2023-07-05T23:32:30.496 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.494+0000 7f35c1ffb700 1 -- 172.21.15.162:0/3443492573 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b7c35377-3cf2-4569-b6b9-72376eb463bc", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f35c401c820 con 0x7f35cc15fc60 2023-07-05T23:32:30.496 INFO:teuthology.orchestra.run.smithi162.stdout:7 2023-07-05T23:32:30.497 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.495+0000 7f35d3849700 1 -- 172.21.15.162:0/3443492573 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35cc15fc60 msgr2=0x7f35cc0cf390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:30.497 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.495+0000 7f35d3849700 1 --2- 172.21.15.162:0/3443492573 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35cc15fc60 0x7f35cc0cf390 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f35c4009d60 tx=0x7f35c4004ad0 comp rx=0 tx=0).stop 2023-07-05T23:32:30.497 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.495+0000 7f35d3849700 1 -- 172.21.15.162:0/3443492573 shutdown_connections 2023-07-05T23:32:30.498 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.495+0000 7f35d3849700 1 --2- 172.21.15.162:0/3443492573 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35cc15fc60 0x7f35cc0cf390 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:30.498 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.495+0000 7f35d3849700 1 --2- 172.21.15.162:0/3443492573 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f35cc06e970 0x7f35cc1e6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:30.498 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.495+0000 7f35d3849700 1 --2- 172.21.15.162:0/3443492573 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f35cc0aecc0 0x7f35cc14fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:30.498 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.495+0000 7f35d3849700 1 -- 172.21.15.162:0/3443492573 >> 172.21.15.162:0/3443492573 conn(0x7f35cc06b920 msgr2=0x7f35cc069ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:32:30.498 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.495+0000 7f35d3849700 1 -- 172.21.15.162:0/3443492573 shutdown_connections 2023-07-05T23:32:30.499 INFO:teuthology.orchestra.run.smithi162.stderr:2023-07-05T23:32:30.495+0000 7f35d3849700 1 -- 172.21.15.162:0/3443492573 wait complete. 2023-07-05T23:32:30.508 INFO:tasks.ceph.osd.0:Restarting daemon 2023-07-05T23:32:30.509 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-07-05T23:32:30.511 INFO:tasks.ceph.osd.0:Started 2023-07-05T23:32:30.511 INFO:tasks.ceph.osd.1:Restarting daemon 2023-07-05T23:32:30.512 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-07-05T23:32:30.514 INFO:tasks.ceph.osd.1:Started 2023-07-05T23:32:30.514 INFO:tasks.ceph.osd.2:Restarting daemon 2023-07-05T23:32:30.514 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-07-05T23:32:30.516 INFO:tasks.ceph.osd.2:Started 2023-07-05T23:32:30.516 INFO:tasks.ceph.osd.3:Restarting daemon 2023-07-05T23:32:30.517 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-07-05T23:32:30.518 INFO:tasks.ceph.osd.3:Started 2023-07-05T23:32:30.519 INFO:tasks.ceph.osd.4:Restarting daemon 2023-07-05T23:32:30.519 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-07-05T23:32:30.521 INFO:tasks.ceph.osd.4:Started 2023-07-05T23:32:30.522 INFO:tasks.ceph.osd.5:Restarting daemon 2023-07-05T23:32:30.522 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-07-05T23:32:30.524 INFO:tasks.ceph.osd.5:Started 2023-07-05T23:32:30.524 INFO:tasks.ceph.osd.6:Restarting daemon 2023-07-05T23:32:30.525 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-07-05T23:32:30.526 INFO:tasks.ceph.osd.6:Started 2023-07-05T23:32:30.527 INFO:tasks.ceph.osd.7:Restarting daemon 2023-07-05T23:32:30.527 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-07-05T23:32:30.529 INFO:tasks.ceph.osd.7:Started 2023-07-05T23:32:30.529 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-05T23:32:30.695 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:30.692+0000 7f1178a83700 1 Processor -- start 2023-07-05T23:32:30.696 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:30.692+0000 7f1178a83700 1 -- start start 2023-07-05T23:32:30.697 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:30.693+0000 7f1178a83700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f11740aed30 0x7f1174160580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:30.697 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:30.693+0000 7f1178a83700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11740cee80 con 0x7f11740cc1d0 2023-07-05T23:32:30.697 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:30.693+0000 7f1178a83700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11740cf100 con 0x7f1174156880 2023-07-05T23:32:30.697 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:30.693+0000 7f1178a83700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11740cf3e0 con 0x7f11740aed30 2023-07-05T23:32:30.698 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:30.693+0000 7f1172d9d700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f11740cc1d0 0x7f117415cb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:51286/0 (socket says 172.21.15.27:51286) 2023-07-05T23:32:30.698 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:30.693+0000 7f1172d9d700 1 -- 172.21.15.27:0/3404494590 learned_addr learned my addr 172.21.15.27:0/3404494590 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-07-05T23:32:30.698 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:30.693+0000 7f1171d9b700 1 --2- 172.21.15.27:0/3404494590 >> v2:172.21.15.162:3300/0 conn(0x7f11740aed30 0x7f1174160580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:30.698 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:30.694+0000 7f117159a700 1 -- 172.21.15.27:0/3404494590 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3907275995 0 0) 0x7f11740cee80 con 0x7f11740cc1d0 2023-07-05T23:32:30.698 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:30.694+0000 7f117159a700 1 -- 172.21.15.27:0/3404494590 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11600035b0 con 0x7f11740cc1d0 2023-07-05T23:32:30.698 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:30.694+0000 7f117159a700 1 -- 172.21.15.27:0/3404494590 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 304318415 0 0) 0x7f11740cf100 con 0x7f1174156880 2023-07-05T23:32:30.698 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:30.694+0000 7f117159a700 1 -- 172.21.15.27:0/3404494590 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11740cee80 con 0x7f1174156880 2023-07-05T23:32:30.699 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:30.694+0000 7f1171d9b700 1 -- 172.21.15.27:0/3404494590 >> v1:172.21.15.162:6789/0 conn(0x7f1174156880 legacy=0x7f1174069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:30.699 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:30.694+0000 7f1171d9b700 1 -- 172.21.15.27:0/3404494590 >> v1:172.21.15.27:6789/0 conn(0x7f11740cc1d0 legacy=0x7f117415cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:30.699 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:30.694+0000 7f1171d9b700 1 -- 172.21.15.27:0/3404494590 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11740cd390 con 0x7f11740aed30 2023-07-05T23:32:30.699 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:30.694+0000 7f1171d9b700 1 --2- 172.21.15.27:0/3404494590 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11740aed30 0x7f1174160580 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f115c009840 tx=0x7f115c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2030747f999f8fac server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:30.699 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:30.694+0000 7f117159a700 1 -- 172.21.15.27:0/3404494590 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115c011830 con 0x7f11740aed30 2023-07-05T23:32:30.699 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:30.694+0000 7f117159a700 1 -- 172.21.15.27:0/3404494590 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f115c011990 con 0x7f11740aed30 2023-07-05T23:32:30.699 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:30.694+0000 7f117159a700 1 -- 172.21.15.27:0/3404494590 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115c011d20 con 0x7f11740aed30 2023-07-05T23:32:30.702 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:30.695+0000 7f1178a83700 1 -- 172.21.15.27:0/3404494590 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11740aed30 msgr2=0x7f1174160580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:30.703 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:30.695+0000 7f1178a83700 1 --2- 172.21.15.27:0/3404494590 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11740aed30 0x7f1174160580 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f115c009840 tx=0x7f115c009b50 comp rx=0 tx=0).stop 2023-07-05T23:32:30.703 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:30.695+0000 7f1178a83700 1 -- 172.21.15.27:0/3404494590 shutdown_connections 2023-07-05T23:32:30.703 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:30.695+0000 7f1178a83700 1 --2- 172.21.15.27:0/3404494590 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11740aed30 0x7f1174160580 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:30.703 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:30.695+0000 7f1178a83700 1 -- 172.21.15.27:0/3404494590 >> 172.21.15.27:0/3404494590 conn(0x7f117406d4a0 msgr2=0x7f117406d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:32:30.703 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:30.695+0000 7f1178a83700 1 -- 172.21.15.27:0/3404494590 shutdown_connections 2023-07-05T23:32:30.703 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:30.695+0000 7f1178a83700 1 -- 172.21.15.27:0/3404494590 wait complete. 2023-07-05T23:32:30.704 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:30.696+0000 7f1178a83700 1 Processor -- start 2023-07-05T23:32:30.704 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:30.696+0000 7f1178a83700 1 -- start start 2023-07-05T23:32:30.704 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:30.697+0000 7f1178a83700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f11740aed30 0x7f11740c5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:30.704 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:30.697+0000 7f1178a83700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11740cc1d0 0x7f11741f50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:30.704 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:30.697+0000 7f1178a83700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1174156880 0x7f11740c32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:30.704 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:30.697+0000 7f1178a83700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11740c49f0 con 0x7f11740aed30 2023-07-05T23:32:30.705 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:30.697+0000 7f1178a83700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11740b4830 con 0x7f1174156880 2023-07-05T23:32:30.705 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:30.697+0000 7f1178a83700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11740c61e0 con 0x7f11740cc1d0 2023-07-05T23:32:30.705 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:30.697+0000 7f117259c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f11740aed30 0x7f11740c5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:30.705 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:30.697+0000 7f117259c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f11740aed30 0x7f11740c5ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44122/0 (socket says 172.21.15.27:44122) 2023-07-05T23:32:30.705 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:30.697+0000 7f117259c700 1 -- 172.21.15.27:0/1214995272 learned_addr learned my addr 172.21.15.27:0/1214995272 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:32:30.705 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:30.697+0000 7f1172d9d700 1 --2- 172.21.15.27:0/1214995272 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1174156880 0x7f11740c32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:30.705 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:30.697+0000 7f1171d9b700 1 --2- 172.21.15.27:0/1214995272 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11740cc1d0 0x7f11741f50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:30.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:30.698+0000 7f117259c700 1 -- 172.21.15.27:0/1214995272 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11740cc1d0 msgr2=0x7f11741f50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:30.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:30.698+0000 7f117259c700 1 --2- 172.21.15.27:0/1214995272 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11740cc1d0 0x7f11741f50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:30.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:30.698+0000 7f117259c700 1 -- 172.21.15.27:0/1214995272 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1174156880 msgr2=0x7f11740c32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:30.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:30.698+0000 7f117259c700 1 --2- 172.21.15.27:0/1214995272 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1174156880 0x7f11740c32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:30.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:30.698+0000 7f117259c700 1 -- 172.21.15.27:0/1214995272 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f115c0094a0 con 0x7f11740aed30 2023-07-05T23:32:30.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:30.698+0000 7f117259c700 1 --2- 172.21.15.27:0/1214995272 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f11740aed30 0x7f11740c5ca0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f116400cc50 tx=0x7f116400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:30.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:30.698+0000 7f116affd700 1 -- 172.21.15.27:0/1214995272 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1164003c00 con 0x7f11740aed30 2023-07-05T23:32:30.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:30.698+0000 7f116affd700 1 -- 172.21.15.27:0/1214995272 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1164003d60 con 0x7f11740aed30 2023-07-05T23:32:30.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:30.698+0000 7f1178a83700 1 -- 172.21.15.27:0/1214995272 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11740b3c20 con 0x7f11740aed30 2023-07-05T23:32:30.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:30.698+0000 7f116affd700 1 -- 172.21.15.27:0/1214995272 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116400ab10 con 0x7f11740aed30 2023-07-05T23:32:30.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:30.698+0000 7f1178a83700 1 -- 172.21.15.27:0/1214995272 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11740b41e0 con 0x7f11740aed30 2023-07-05T23:32:30.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:30.698+0000 7f116affd700 1 -- 172.21.15.27:0/1214995272 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f11640050d0 con 0x7f11740aed30 2023-07-05T23:32:30.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:30.698+0000 7f116affd700 1 -- 172.21.15.27:0/1214995272 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f1164012650 con 0x7f11740aed30 2023-07-05T23:32:30.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:30.699+0000 7f1178a83700 1 -- 172.21.15.27:0/1214995272 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1174073910 con 0x7f11740aed30 2023-07-05T23:32:30.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:30.701+0000 7f116affd700 1 -- 172.21.15.27:0/1214995272 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f1164005380 con 0x7f11740aed30 2023-07-05T23:32:30.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:30.771+0000 7f1178a83700 1 -- 172.21.15.27:0/1214995272 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1174071cf0 con 0x7f11740aed30 2023-07-05T23:32:30.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:30.772+0000 7f116affd700 1 -- 172.21.15.27:0/1214995272 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f1164005520 con 0x7f11740aed30 2023-07-05T23:32:30.775 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:32:30.775 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":10,"fsid":"23eebe48-65f5-4d3c-8c2d-4aa171c055d5","created":"2023-07-05T23:32:27.989612+0000","modified":"2023-07-05T23:32:30.488261+0000","last_up_change":"0.000000","last_in_change":"2023-07-05T23:32:30.488261+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ac2071e4-394b-4385-b9ba-fad5265efc65","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8c9b61a0-39d5-46bf-afd6-5add78453ce9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"dcd032a2-06b1-4055-b798-b86c71a7107d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b0ffe0fc-47ba-4636-b5ea-6bab637642c8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7fab4e5a-1246-4efe-9562-10c4a6c789ff","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"110c4d9f-cef6-48ab-a818-5a81e72372af","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"16803bcc-2c92-4aed-954e-487938c9f24a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"b7c35377-3cf2-4569-b6b9-72376eb463bc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-05T23:32:30.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:30.773+0000 7f1178a83700 1 -- 172.21.15.27:0/1214995272 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f11740aed30 msgr2=0x7f11740c5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:30.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:30.773+0000 7f1178a83700 1 --2- 172.21.15.27:0/1214995272 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f11740aed30 0x7f11740c5ca0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f116400cc50 tx=0x7f116400cf60 comp rx=0 tx=0).stop 2023-07-05T23:32:30.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:30.773+0000 7f1178a83700 1 -- 172.21.15.27:0/1214995272 shutdown_connections 2023-07-05T23:32:30.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:30.773+0000 7f1178a83700 1 --2- 172.21.15.27:0/1214995272 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1174156880 0x7f11740c32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:30.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:30.773+0000 7f1178a83700 1 --2- 172.21.15.27:0/1214995272 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f11740aed30 0x7f11740c5ca0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:30.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:30.773+0000 7f1178a83700 1 --2- 172.21.15.27:0/1214995272 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11740cc1d0 0x7f11741f50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:30.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:30.773+0000 7f1178a83700 1 -- 172.21.15.27:0/1214995272 >> 172.21.15.27:0/1214995272 conn(0x7f117406d4a0 msgr2=0x7f117406d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:32:30.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:30.773+0000 7f1178a83700 1 -- 172.21.15.27:0/1214995272 shutdown_connections 2023-07-05T23:32:30.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:30.773+0000 7f1178a83700 1 -- 172.21.15.27:0/1214995272 wait complete. 2023-07-05T23:32:30.788 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-07-05T23:32:30.788 INFO:tasks.ceph:Waiting for OSDs to come up 2023-07-05T23:32:31.062 INFO:tasks.ceph.mgr.x.smithi162.stderr:2023-07-05T23:32:31.060+0000 7f92f6ea6200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-05T23:32:31.135 INFO:tasks.ceph.osd.4.smithi162.stderr:2023-07-05T23:32:31.133+0000 7f70e9e28640 -1 Falling back to public interface 2023-07-05T23:32:31.136 INFO:tasks.ceph.osd.1.smithi027.stderr:2023-07-05T23:32:31.133+0000 7f0514a90640 -1 Falling back to public interface 2023-07-05T23:32:31.140 INFO:tasks.ceph.mgr.x.smithi162.stderr:2023-07-05T23:32:31.138+0000 7f92f6ea6200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-05T23:32:31.140 INFO:tasks.ceph.osd.6.smithi162.stderr:2023-07-05T23:32:31.138+0000 7f544bc21640 -1 Falling back to public interface 2023-07-05T23:32:31.153 INFO:tasks.ceph.osd.7.smithi162.stderr:2023-07-05T23:32:31.151+0000 7f4fb5ea0640 -1 Falling back to public interface 2023-07-05T23:32:31.158 INFO:tasks.ceph.osd.3.smithi027.stderr:2023-07-05T23:32:31.155+0000 7f5103472640 -1 Falling back to public interface 2023-07-05T23:32:31.158 INFO:tasks.ceph.osd.5.smithi162.stderr:2023-07-05T23:32:31.156+0000 7f3db34d7640 -1 Falling back to public interface 2023-07-05T23:32:31.159 INFO:tasks.ceph.osd.0.smithi027.stderr:2023-07-05T23:32:31.156+0000 7f14bdf95640 -1 Falling back to public interface 2023-07-05T23:32:31.165 INFO:tasks.ceph.osd.2.smithi027.stderr:2023-07-05T23:32:31.162+0000 7f11a72a0640 -1 Falling back to public interface 2023-07-05T23:32:31.246 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-07-05T23:32:31.243+0000 7fd3a3e13200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-05T23:32:31.282 INFO:tasks.ceph.mgr.x.smithi162.stderr:2023-07-05T23:32:31.280+0000 7f92f6ea6200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-05T23:32:31.327 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-07-05T23:32:31.325+0000 7fd3a3e13200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-05T23:32:31.474 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-07-05T23:32:31.471+0000 7fd3a3e13200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-05T23:32:31.514 INFO:tasks.ceph.mgr.x.smithi162.stderr:2023-07-05T23:32:31.512+0000 7f92f6ea6200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-07-05T23:32:31.588 INFO:tasks.ceph.mgr.x.smithi162.stderr:2023-07-05T23:32:31.586+0000 7f92f6ea6200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-05T23:32:31.593 DEBUG:teuthology.orchestra.run.smithi027:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-05T23:32:31.709 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:31.706+0000 7fb076bdf700 1 Processor -- start 2023-07-05T23:32:31.709 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:31.706+0000 7fb076bdf700 1 -- start start 2023-07-05T23:32:31.711 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:31.707+0000 7fb076bdf700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb07015c2a0 0x7fb07006c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:31.711 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:31.707+0000 7fb076bdf700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb0700b2880 0x7fb07006cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:31.712 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:31.707+0000 7fb076bdf700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb0700ae230 0x7fb070070bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:31.712 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:31.707+0000 7fb076bdf700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb07015c670 con 0x7fb0700ae230 2023-07-05T23:32:31.712 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:31.707+0000 7fb076bdf700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb07015fd80 con 0x7fb07015c2a0 2023-07-05T23:32:31.712 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:31.707+0000 7fb076bdf700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb070160060 con 0x7fb0700b2880 2023-07-05T23:32:31.712 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:31.707+0000 7fb07517c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb0700ae230 0x7fb070070bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:31.712 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:31.707+0000 7fb07517c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb0700ae230 0x7fb070070bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44132/0 (socket says 172.21.15.27:44132) 2023-07-05T23:32:31.713 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:31.707+0000 7fb07517c700 1 -- 172.21.15.27:0/1650617063 learned_addr learned my addr 172.21.15.27:0/1650617063 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:32:31.713 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:31.707+0000 7fb06ffff700 1 --2- 172.21.15.27:0/1650617063 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb0700b2880 0x7fb07006cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:31.713 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:31.707+0000 7fb07497b700 1 --2- 172.21.15.27:0/1650617063 >> v2:172.21.15.162:3300/0 conn(0x7fb07015c2a0 0x7fb07006c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:31.713 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:31.707+0000 7fb07517c700 1 -- 172.21.15.27:0/1650617063 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb0700b2880 msgr2=0x7fb07006cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:32:31.713 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:31.707+0000 7fb07517c700 1 --2- 172.21.15.27:0/1650617063 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb0700b2880 0x7fb07006cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:31.713 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:31.707+0000 7fb07517c700 1 -- 172.21.15.27:0/1650617063 >> v2:172.21.15.162:3300/0 conn(0x7fb07015c2a0 msgr2=0x7fb07006c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:32:31.714 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:31.707+0000 7fb07517c700 1 --2- 172.21.15.27:0/1650617063 >> v2:172.21.15.162:3300/0 conn(0x7fb07015c2a0 0x7fb07006c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:31.714 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:31.707+0000 7fb07517c700 1 -- 172.21.15.27:0/1650617063 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb070160340 con 0x7fb0700ae230 2023-07-05T23:32:31.714 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:31.707+0000 7fb07497b700 1 --2- 172.21.15.27:0/1650617063 >> v2:172.21.15.162:3300/0 conn(0x7fb07015c2a0 0x7fb07006c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T23:32:31.714 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:31.707+0000 7fb07517c700 1 --2- 172.21.15.27:0/1650617063 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb0700ae230 0x7fb070070bc0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb0700cff70 tx=0x7fb06800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e2aa99acd201adf server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:31.714 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:31.708+0000 7fb06f7fe700 1 -- 172.21.15.27:0/1650617063 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06800e070 con 0x7fb0700ae230 2023-07-05T23:32:31.714 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:31.708+0000 7fb06f7fe700 1 -- 172.21.15.27:0/1650617063 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb06800b910 con 0x7fb0700ae230 2023-07-05T23:32:31.714 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:31.708+0000 7fb06f7fe700 1 -- 172.21.15.27:0/1650617063 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06800bcc0 con 0x7fb0700ae230 2023-07-05T23:32:31.715 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:31.708+0000 7fb076bdf700 1 -- 172.21.15.27:0/1650617063 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb0700ae230 msgr2=0x7fb070070bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:31.715 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:31.708+0000 7fb076bdf700 1 --2- 172.21.15.27:0/1650617063 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb0700ae230 0x7fb070070bc0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb0700cff70 tx=0x7fb06800b330 comp rx=0 tx=0).stop 2023-07-05T23:32:31.715 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:31.708+0000 7fb076bdf700 1 -- 172.21.15.27:0/1650617063 shutdown_connections 2023-07-05T23:32:31.715 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:31.708+0000 7fb076bdf700 1 --2- 172.21.15.27:0/1650617063 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb0700ae230 0x7fb070070bc0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:31.715 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:31.708+0000 7fb076bdf700 1 --2- 172.21.15.27:0/1650617063 >> v2:172.21.15.162:3300/0 conn(0x7fb07015c2a0 0x7fb07006c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:31.715 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:31.708+0000 7fb076bdf700 1 --2- 172.21.15.27:0/1650617063 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb0700b2880 0x7fb07006cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:31.715 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:31.708+0000 7fb076bdf700 1 -- 172.21.15.27:0/1650617063 >> 172.21.15.27:0/1650617063 conn(0x7fb0700b0b70 msgr2=0x7fb0700b0f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:32:31.716 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:31.708+0000 7fb076bdf700 1 -- 172.21.15.27:0/1650617063 shutdown_connections 2023-07-05T23:32:31.716 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:31.708+0000 7fb076bdf700 1 -- 172.21.15.27:0/1650617063 wait complete. 2023-07-05T23:32:31.718 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:31.709+0000 7fb076bdf700 1 Processor -- start 2023-07-05T23:32:31.718 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:31.710+0000 7fb076bdf700 1 -- start start 2023-07-05T23:32:31.718 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:31.710+0000 7fb076bdf700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb0700ae230 0x7fb0701578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:31.718 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:31.710+0000 7fb076bdf700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb0700b2880 0x7fb07014fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:31.719 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:31.710+0000 7fb076bdf700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb07015c2a0 0x7fb0700cdf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:31.719 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:31.710+0000 7fb076bdf700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb070157df0 con 0x7fb0700ae230 2023-07-05T23:32:31.719 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:31.710+0000 7fb076bdf700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb070150190 con 0x7fb07015c2a0 2023-07-05T23:32:31.719 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:31.710+0000 7fb076bdf700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb070156810 con 0x7fb0700b2880 2023-07-05T23:32:31.719 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:31.710+0000 7fb07497b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb0700ae230 0x7fb0701578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:31.719 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:31.710+0000 7fb07497b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb0700ae230 0x7fb0701578b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44134/0 (socket says 172.21.15.27:44134) 2023-07-05T23:32:31.720 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:31.710+0000 7fb07497b700 1 -- 172.21.15.27:0/1950530537 learned_addr learned my addr 172.21.15.27:0/1950530537 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:32:31.720 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:31.711+0000 7fb07517c700 1 --2- 172.21.15.27:0/1950530537 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb07015c2a0 0x7fb0700cdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:31.720 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:31.711+0000 7fb06ffff700 1 --2- 172.21.15.27:0/1950530537 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb0700b2880 0x7fb07014fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:31.720 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:31.711+0000 7fb07497b700 1 -- 172.21.15.27:0/1950530537 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb0700b2880 msgr2=0x7fb07014fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:31.720 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:31.711+0000 7fb07497b700 1 --2- 172.21.15.27:0/1950530537 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb0700b2880 0x7fb07014fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:31.720 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:31.711+0000 7fb07497b700 1 -- 172.21.15.27:0/1950530537 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb07015c2a0 msgr2=0x7fb0700cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:31.720 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:31.711+0000 7fb07497b700 1 --2- 172.21.15.27:0/1950530537 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb07015c2a0 0x7fb0700cdf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:31.721 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:31.711+0000 7fb07497b700 1 -- 172.21.15.27:0/1950530537 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0640094a0 con 0x7fb0700ae230 2023-07-05T23:32:31.721 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:31.711+0000 7fb07497b700 1 --2- 172.21.15.27:0/1950530537 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb0700ae230 0x7fb0701578b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb06400ebe0 tx=0x7fb06400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:31.721 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:31.711+0000 7fb06d7fa700 1 -- 172.21.15.27:0/1950530537 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb064009760 con 0x7fb0700ae230 2023-07-05T23:32:31.721 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:31.711+0000 7fb06d7fa700 1 -- 172.21.15.27:0/1950530537 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb06400c850 con 0x7fb0700ae230 2023-07-05T23:32:31.721 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:31.711+0000 7fb076bdf700 1 -- 172.21.15.27:0/1950530537 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb068009b30 con 0x7fb0700ae230 2023-07-05T23:32:31.722 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:31.711+0000 7fb06d7fa700 1 -- 172.21.15.27:0/1950530537 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06400cbe0 con 0x7fb0700ae230 2023-07-05T23:32:31.722 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:31.711+0000 7fb076bdf700 1 -- 172.21.15.27:0/1950530537 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb070156dd0 con 0x7fb0700ae230 2023-07-05T23:32:31.722 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:31.711+0000 7fb06d7fa700 1 -- 172.21.15.27:0/1950530537 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb064005a20 con 0x7fb0700ae230 2023-07-05T23:32:31.722 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:31.711+0000 7fb06d7fa700 1 -- 172.21.15.27:0/1950530537 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fb064006750 con 0x7fb0700ae230 2023-07-05T23:32:31.722 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:31.712+0000 7fb076bdf700 1 -- 172.21.15.27:0/1950530537 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb070157700 con 0x7fb0700ae230 2023-07-05T23:32:31.722 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:31.715+0000 7fb06d7fa700 1 -- 172.21.15.27:0/1950530537 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fb064021060 con 0x7fb0700ae230 2023-07-05T23:32:31.725 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-07-05T23:32:31.722+0000 7fd3a3e13200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-07-05T23:32:31.788 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:31.785+0000 7fb076bdf700 1 -- 172.21.15.27:0/1950530537 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb070067290 con 0x7fb0700ae230 2023-07-05T23:32:31.789 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:31.785+0000 7fb06d7fa700 1 -- 172.21.15.27:0/1950530537 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fb064017070 con 0x7fb0700ae230 2023-07-05T23:32:31.789 INFO:teuthology.misc.health.smithi027.stdout: 2023-07-05T23:32:31.790 INFO:teuthology.misc.health.smithi027.stdout:{"epoch":10,"fsid":"23eebe48-65f5-4d3c-8c2d-4aa171c055d5","created":"2023-07-05T23:32:27.989612+0000","modified":"2023-07-05T23:32:30.488261+0000","last_up_change":"0.000000","last_in_change":"2023-07-05T23:32:30.488261+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ac2071e4-394b-4385-b9ba-fad5265efc65","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8c9b61a0-39d5-46bf-afd6-5add78453ce9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"dcd032a2-06b1-4055-b798-b86c71a7107d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b0ffe0fc-47ba-4636-b5ea-6bab637642c8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7fab4e5a-1246-4efe-9562-10c4a6c789ff","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"110c4d9f-cef6-48ab-a818-5a81e72372af","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"16803bcc-2c92-4aed-954e-487938c9f24a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"b7c35377-3cf2-4569-b6b9-72376eb463bc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-05T23:32:31.791 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:31.786+0000 7fb076bdf700 1 -- 172.21.15.27:0/1950530537 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb0700ae230 msgr2=0x7fb0701578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:31.791 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:31.786+0000 7fb076bdf700 1 --2- 172.21.15.27:0/1950530537 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb0700ae230 0x7fb0701578b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb06400ebe0 tx=0x7fb06400eef0 comp rx=0 tx=0).stop 2023-07-05T23:32:31.792 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:31.786+0000 7fb076bdf700 1 -- 172.21.15.27:0/1950530537 shutdown_connections 2023-07-05T23:32:31.792 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:31.786+0000 7fb076bdf700 1 --2- 172.21.15.27:0/1950530537 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb07015c2a0 0x7fb0700cdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:31.793 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:31.786+0000 7fb076bdf700 1 --2- 172.21.15.27:0/1950530537 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb0700ae230 0x7fb0701578b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:31.793 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:31.786+0000 7fb076bdf700 1 --2- 172.21.15.27:0/1950530537 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb0700b2880 0x7fb07014fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:31.793 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:31.786+0000 7fb076bdf700 1 -- 172.21.15.27:0/1950530537 >> 172.21.15.27:0/1950530537 conn(0x7fb0700b0b70 msgr2=0x7fb070159bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:32:31.794 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:31.786+0000 7fb076bdf700 1 -- 172.21.15.27:0/1950530537 shutdown_connections 2023-07-05T23:32:31.794 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:31.786+0000 7fb076bdf700 1 -- 172.21.15.27:0/1950530537 wait complete. 2023-07-05T23:32:31.800 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-07-05T23:32:31.805 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-07-05T23:32:31.802+0000 7fd3a3e13200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-05T23:32:31.863 INFO:tasks.ceph.mgr.x.smithi162.stderr:2023-07-05T23:32:31.861+0000 7f92f6ea6200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-05T23:32:32.081 INFO:tasks.ceph.mgr.x.smithi162.stderr:2023-07-05T23:32:32.079+0000 7f92f6ea6200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-05T23:32:32.089 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-07-05T23:32:32.086+0000 7fd3a3e13200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-05T23:32:32.235 INFO:tasks.ceph.mgr.x.smithi162.stderr:2023-07-05T23:32:32.233+0000 7f92f6ea6200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-05T23:32:32.317 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-07-05T23:32:32.314+0000 7fd3a3e13200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-05T23:32:32.351 INFO:tasks.ceph.mgr.x.smithi162.stderr:2023-07-05T23:32:32.349+0000 7f92f6ea6200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-05T23:32:32.479 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-07-05T23:32:32.476+0000 7fd3a3e13200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-05T23:32:32.498 INFO:tasks.ceph.mgr.x.smithi162.stderr:2023-07-05T23:32:32.496+0000 7f92f6ea6200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-05T23:32:32.600 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-07-05T23:32:32.597+0000 7fd3a3e13200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-05T23:32:32.756 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-07-05T23:32:32.753+0000 7fd3a3e13200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-05T23:32:32.778 INFO:tasks.ceph.mgr.x.smithi162.stderr:2023-07-05T23:32:32.776+0000 7f92f6ea6200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-05T23:32:32.963 INFO:tasks.ceph.mgr.x.smithi162.stderr:2023-07-05T23:32:32.961+0000 7f92f6ea6200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-05T23:32:33.042 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-07-05T23:32:33.039+0000 7fd3a3e13200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-05T23:32:33.235 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-07-05T23:32:33.232+0000 7fd3a3e13200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-05T23:32:33.547 INFO:tasks.ceph.mgr.x.smithi162.stderr:2023-07-05T23:32:33.545+0000 7f92f6ea6200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-05T23:32:33.864 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-07-05T23:32:33.861+0000 7fd3a3e13200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-05T23:32:34.572 INFO:tasks.ceph.mgr.x.smithi162.stderr:2023-07-05T23:32:34.570+0000 7f92af0d2700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-07-05T23:32:34.572 INFO:tasks.ceph.mgr.x.smithi162.stderr:2023-07-05T23:32:34.570+0000 7f92af0d2700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-07-05T23:32:34.671 INFO:tasks.ceph.osd.3.smithi027.stderr:2023-07-05T23:32:34.668+0000 7f5103472640 -1 osd.3 0 log_to_monitors true 2023-07-05T23:32:34.673 INFO:tasks.ceph.osd.1.smithi027.stderr:2023-07-05T23:32:34.671+0000 7f0514a90640 -1 osd.1 0 log_to_monitors true 2023-07-05T23:32:34.694 INFO:tasks.ceph.osd.4.smithi162.stderr:2023-07-05T23:32:34.692+0000 7f70e9e28640 -1 osd.4 0 log_to_monitors true 2023-07-05T23:32:34.716 INFO:tasks.ceph.osd.6.smithi162.stderr:2023-07-05T23:32:34.714+0000 7f544bc21640 -1 osd.6 0 log_to_monitors true 2023-07-05T23:32:34.717 INFO:tasks.ceph.osd.5.smithi162.stderr:2023-07-05T23:32:34.715+0000 7f3db34d7640 -1 osd.5 0 log_to_monitors true 2023-07-05T23:32:34.723 INFO:tasks.ceph.osd.7.smithi162.stderr:2023-07-05T23:32:34.719+0000 7f4fb5ea0640 -1 osd.7 0 log_to_monitors true 2023-07-05T23:32:34.730 INFO:tasks.ceph.osd.2.smithi027.stderr:2023-07-05T23:32:34.727+0000 7f11a72a0640 -1 osd.2 0 log_to_monitors true 2023-07-05T23:32:34.731 INFO:tasks.ceph.osd.0.smithi027.stderr:2023-07-05T23:32:34.728+0000 7f14bdf95640 -1 osd.0 0 log_to_monitors true 2023-07-05T23:32:38.600 INFO:tasks.ceph.osd.3.smithi027.stderr:2023-07-05T23:32:38.597+0000 7f50f782a700 -1 osd.3 0 waiting for initial osdmap 2023-07-05T23:32:38.605 INFO:tasks.ceph.osd.3.smithi027.stderr:2023-07-05T23:32:38.601+0000 7f50ef404700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-05T23:32:38.606 DEBUG:teuthology.orchestra.run.smithi027:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-05T23:32:38.607 INFO:tasks.ceph.osd.0.smithi027.stderr:2023-07-05T23:32:38.604+0000 7f14b234d700 -1 osd.0 0 waiting for initial osdmap 2023-07-05T23:32:38.608 INFO:tasks.ceph.osd.7.smithi162.stderr:2023-07-05T23:32:38.604+0000 7f4faa258700 -1 osd.7 0 waiting for initial osdmap 2023-07-05T23:32:38.616 INFO:tasks.ceph.osd.0.smithi027.stderr:2023-07-05T23:32:38.613+0000 7f14a9f27700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-05T23:32:38.626 INFO:tasks.ceph.osd.7.smithi162.stderr:2023-07-05T23:32:38.624+0000 7f4fa1e32700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-05T23:32:38.627 INFO:tasks.ceph.osd.2.smithi027.stderr:2023-07-05T23:32:38.623+0000 7f119b658700 -1 osd.2 0 waiting for initial osdmap 2023-07-05T23:32:38.631 INFO:tasks.ceph.osd.5.smithi162.stderr:2023-07-05T23:32:38.629+0000 7f3da788f700 -1 osd.5 0 waiting for initial osdmap 2023-07-05T23:32:38.633 INFO:tasks.ceph.osd.6.smithi162.stderr:2023-07-05T23:32:38.631+0000 7f543ffd9700 -1 osd.6 0 waiting for initial osdmap 2023-07-05T23:32:38.635 INFO:tasks.ceph.osd.4.smithi162.stderr:2023-07-05T23:32:38.632+0000 7f70de1e0700 -1 osd.4 0 waiting for initial osdmap 2023-07-05T23:32:38.638 INFO:tasks.ceph.osd.2.smithi027.stderr:2023-07-05T23:32:38.636+0000 7f1193232700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-05T23:32:38.646 INFO:tasks.ceph.osd.5.smithi162.stderr:2023-07-05T23:32:38.644+0000 7f3d9f469700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-05T23:32:38.649 INFO:tasks.ceph.osd.4.smithi162.stderr:2023-07-05T23:32:38.647+0000 7f70d5dba700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-05T23:32:38.649 INFO:tasks.ceph.osd.6.smithi162.stderr:2023-07-05T23:32:38.647+0000 7f5437bb3700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-05T23:32:38.650 INFO:tasks.ceph.osd.1.smithi027.stderr:2023-07-05T23:32:38.647+0000 7f0508e48700 -1 osd.1 0 waiting for initial osdmap 2023-07-05T23:32:38.663 INFO:tasks.ceph.osd.1.smithi027.stderr:2023-07-05T23:32:38.661+0000 7f0500a22700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-05T23:32:38.736 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.734+0000 7fdfe2b0b700 1 Processor -- start 2023-07-05T23:32:38.737 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.734+0000 7fdfe2b0b700 1 -- start start 2023-07-05T23:32:38.739 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.734+0000 7fdfe2b0b700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdfdc0b1250 0x7fdfdc15ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:38.739 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.734+0000 7fdfe2b0b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fdfdc0ca470 0x7fdfdc0ca8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:38.740 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.735+0000 7fdfe2b0b700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfdc160ef0 con 0x7fdfdc0b1620 2023-07-05T23:32:38.740 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.735+0000 7fdfe2b0b700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfdc1460a0 con 0x7fdfdc0ca470 2023-07-05T23:32:38.740 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.735+0000 7fdfe2b0b700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfdc160650 con 0x7fdfdc0b1250 2023-07-05T23:32:38.740 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.735+0000 7fdfe10a8700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fdfdc0ca470 0x7fdfdc0ca8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:38.740 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.735+0000 7fdfe10a8700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fdfdc0ca470 0x7fdfdc0ca8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44198/0 (socket says 172.21.15.27:44198) 2023-07-05T23:32:38.741 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.735+0000 7fdfe10a8700 1 -- 172.21.15.27:0/3083342841 learned_addr learned my addr 172.21.15.27:0/3083342841 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:32:38.741 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.735+0000 7fdfe08a7700 1 --2- 172.21.15.27:0/3083342841 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdfdc0b1250 0x7fdfdc15ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:38.741 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.735+0000 7fdfe10a8700 1 -- 172.21.15.27:0/3083342841 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdfdc0b1250 msgr2=0x7fdfdc15ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:32:38.741 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.735+0000 7fdfe10a8700 1 --2- 172.21.15.27:0/3083342841 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdfdc0b1250 0x7fdfdc15ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:38.741 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.735+0000 7fdfe10a8700 1 -- 172.21.15.27:0/3083342841 >> v1:172.21.15.162:6789/0 conn(0x7fdfdc0b1620 legacy=0x7fdfdc0cd600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:38.741 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.735+0000 7fdfe10a8700 1 -- 172.21.15.27:0/3083342841 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfdc160930 con 0x7fdfdc0ca470 2023-07-05T23:32:38.742 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.735+0000 7fdfe10a8700 1 --2- 172.21.15.27:0/3083342841 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdfdc0ca470 0x7fdfdc0ca8f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fdfd4009e50 tx=0x7fdfd400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38b8c178f0699575 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:38.742 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.735+0000 7fdfdb7fe700 1 -- 172.21.15.27:0/3083342841 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd400e070 con 0x7fdfdc0ca470 2023-07-05T23:32:38.742 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.735+0000 7fdfdb7fe700 1 -- 172.21.15.27:0/3083342841 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfd400b910 con 0x7fdfdc0ca470 2023-07-05T23:32:38.742 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.735+0000 7fdfdb7fe700 1 -- 172.21.15.27:0/3083342841 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd400bcc0 con 0x7fdfdc0ca470 2023-07-05T23:32:38.742 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.736+0000 7fdfe2b0b700 1 -- 172.21.15.27:0/3083342841 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdfdc0ca470 msgr2=0x7fdfdc0ca8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:38.743 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.736+0000 7fdfe2b0b700 1 --2- 172.21.15.27:0/3083342841 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdfdc0ca470 0x7fdfdc0ca8f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fdfd4009e50 tx=0x7fdfd400b330 comp rx=0 tx=0).stop 2023-07-05T23:32:38.743 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.736+0000 7fdfe2b0b700 1 -- 172.21.15.27:0/3083342841 shutdown_connections 2023-07-05T23:32:38.743 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.736+0000 7fdfe2b0b700 1 --2- 172.21.15.27:0/3083342841 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdfdc0ca470 0x7fdfdc0ca8f0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:38.743 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.736+0000 7fdfe2b0b700 1 --2- 172.21.15.27:0/3083342841 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdfdc0b1250 0x7fdfdc15ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:38.743 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.736+0000 7fdfe2b0b700 1 -- 172.21.15.27:0/3083342841 >> 172.21.15.27:0/3083342841 conn(0x7fdfdc06e0a0 msgr2=0x7fdfdc0cc250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:32:38.743 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.736+0000 7fdfe2b0b700 1 -- 172.21.15.27:0/3083342841 shutdown_connections 2023-07-05T23:32:38.743 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.736+0000 7fdfe2b0b700 1 -- 172.21.15.27:0/3083342841 wait complete. 2023-07-05T23:32:38.746 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.737+0000 7fdfe2b0b700 1 Processor -- start 2023-07-05T23:32:38.746 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.737+0000 7fdfe2b0b700 1 -- start start 2023-07-05T23:32:38.747 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.738+0000 7fdfe2b0b700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdfdc0b1250 0x7fdfdc15ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:38.747 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.738+0000 7fdfe2b0b700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdfdc0b1620 0x7fdfdc0ad790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:38.747 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.738+0000 7fdfe2b0b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdfdc0ca470 0x7fdfdc0c48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:38.747 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.738+0000 7fdfe2b0b700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfdc0ac480 con 0x7fdfdc0ca470 2023-07-05T23:32:38.747 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.738+0000 7fdfe2b0b700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfdc0ac720 con 0x7fdfdc0b1250 2023-07-05T23:32:38.748 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.738+0000 7fdfe2b0b700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfdc0aca00 con 0x7fdfdc0b1620 2023-07-05T23:32:38.748 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.738+0000 7fdfe10a8700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdfdc0ca470 0x7fdfdc0c48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:38.748 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.738+0000 7fdfe10a8700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdfdc0ca470 0x7fdfdc0c48c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44204/0 (socket says 172.21.15.27:44204) 2023-07-05T23:32:38.748 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.738+0000 7fdfe10a8700 1 -- 172.21.15.27:0/3221001208 learned_addr learned my addr 172.21.15.27:0/3221001208 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:32:38.748 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.738+0000 7fdfe08a7700 1 --2- 172.21.15.27:0/3221001208 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdfdc0b1250 0x7fdfdc15ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:38.749 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.738+0000 7fdfdbfff700 1 --2- 172.21.15.27:0/3221001208 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdfdc0b1620 0x7fdfdc0ad790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:38.749 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.738+0000 7fdfe10a8700 1 -- 172.21.15.27:0/3221001208 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdfdc0b1620 msgr2=0x7fdfdc0ad790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:38.749 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.738+0000 7fdfe10a8700 1 --2- 172.21.15.27:0/3221001208 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdfdc0b1620 0x7fdfdc0ad790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:38.749 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.738+0000 7fdfe10a8700 1 -- 172.21.15.27:0/3221001208 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdfdc0b1250 msgr2=0x7fdfdc15ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:38.749 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.738+0000 7fdfe10a8700 1 --2- 172.21.15.27:0/3221001208 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdfdc0b1250 0x7fdfdc15ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:38.749 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.738+0000 7fdfe10a8700 1 -- 172.21.15.27:0/3221001208 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd4009b30 con 0x7fdfdc0ca470 2023-07-05T23:32:38.749 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.739+0000 7fdfe10a8700 1 --2- 172.21.15.27:0/3221001208 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdfdc0ca470 0x7fdfdc0c48c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc070d00 tx=0x7fdfd4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:38.749 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.739+0000 7fdfd97fa700 1 -- 172.21.15.27:0/3221001208 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd4003ea0 con 0x7fdfdc0ca470 2023-07-05T23:32:38.750 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.739+0000 7fdfd97fa700 1 -- 172.21.15.27:0/3221001208 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfd4004920 con 0x7fdfdc0ca470 2023-07-05T23:32:38.750 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.739+0000 7fdfe2b0b700 1 -- 172.21.15.27:0/3221001208 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfdc0acce0 con 0x7fdfdc0ca470 2023-07-05T23:32:38.750 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.739+0000 7fdfd97fa700 1 -- 172.21.15.27:0/3221001208 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd401c680 con 0x7fdfdc0ca470 2023-07-05T23:32:38.750 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.739+0000 7fdfe2b0b700 1 -- 172.21.15.27:0/3221001208 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfdc0adcd0 con 0x7fdfdc0ca470 2023-07-05T23:32:38.750 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.740+0000 7fdfe2b0b700 1 -- 172.21.15.27:0/3221001208 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfdc0ad200 con 0x7fdfdc0ca470 2023-07-05T23:32:38.750 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.740+0000 7fdfd97fa700 1 -- 172.21.15.27:0/3221001208 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7fdfd401c7e0 con 0x7fdfdc0ca470 2023-07-05T23:32:38.750 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.740+0000 7fdfd97fa700 1 --2- 172.21.15.27:0/3221001208 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fdfc006ac80 0x7fdfc006d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:38.751 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.741+0000 7fdfd97fa700 1 -- 172.21.15.27:0/3221001208 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7fdfd408a010 con 0x7fdfdc0ca470 2023-07-05T23:32:38.751 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.741+0000 7fdfe08a7700 1 --2- 172.21.15.27:0/3221001208 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fdfc006ac80 0x7fdfc006d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:38.751 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.741+0000 7fdfe08a7700 1 --2- 172.21.15.27:0/3221001208 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fdfc006ac80 0x7fdfc006d130 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdfd0009b40 tx=0x7fdfd0009210 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:38.751 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.745+0000 7fdfd97fa700 1 -- 172.21.15.27:0/3221001208 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdfdc0ad200 con 0x7fdfdc0ca470 2023-07-05T23:32:38.946 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.943+0000 7fdfe2b0b700 1 -- 172.21.15.27:0/3221001208 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdfdc0ad200 con 0x7fdfdc0ca470 2023-07-05T23:32:38.947 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.944+0000 7fdfd97fa700 1 -- 172.21.15.27:0/3221001208 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fdfdc0ad200 con 0x7fdfdc0ca470 2023-07-05T23:32:38.947 INFO:teuthology.misc.health.smithi027.stdout: 2023-07-05T23:32:38.947 INFO:teuthology.misc.health.smithi027.stdout:{"epoch":12,"fsid":"23eebe48-65f5-4d3c-8c2d-4aa171c055d5","created":"2023-07-05T23:32:27.989612+0000","modified":"2023-07-05T23:32:36.566287+0000","last_up_change":"0.000000","last_in_change":"2023-07-05T23:32:30.488261+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ac2071e4-394b-4385-b9ba-fad5265efc65","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8c9b61a0-39d5-46bf-afd6-5add78453ce9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"dcd032a2-06b1-4055-b798-b86c71a7107d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b0ffe0fc-47ba-4636-b5ea-6bab637642c8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7fab4e5a-1246-4efe-9562-10c4a6c789ff","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"110c4d9f-cef6-48ab-a818-5a81e72372af","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"16803bcc-2c92-4aed-954e-487938c9f24a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"b7c35377-3cf2-4569-b6b9-72376eb463bc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-05T23:32:38.949 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.946+0000 7fdfe2b0b700 1 -- 172.21.15.27:0/3221001208 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fdfc006ac80 msgr2=0x7fdfc006d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:38.949 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.946+0000 7fdfe2b0b700 1 --2- 172.21.15.27:0/3221001208 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fdfc006ac80 0x7fdfc006d130 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdfd0009b40 tx=0x7fdfd0009210 comp rx=0 tx=0).stop 2023-07-05T23:32:38.949 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.946+0000 7fdfe2b0b700 1 -- 172.21.15.27:0/3221001208 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdfdc0ca470 msgr2=0x7fdfdc0c48c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:38.950 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.946+0000 7fdfe2b0b700 1 --2- 172.21.15.27:0/3221001208 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdfdc0ca470 0x7fdfdc0c48c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc070d00 tx=0x7fdfd4004ad0 comp rx=0 tx=0).stop 2023-07-05T23:32:38.950 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.946+0000 7fdfe2b0b700 1 -- 172.21.15.27:0/3221001208 shutdown_connections 2023-07-05T23:32:38.950 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.946+0000 7fdfe2b0b700 1 --2- 172.21.15.27:0/3221001208 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdfdc0b1250 0x7fdfdc15ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:38.950 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.946+0000 7fdfe2b0b700 1 --2- 172.21.15.27:0/3221001208 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fdfc006ac80 0x7fdfc006d130 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:38.950 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.946+0000 7fdfe2b0b700 1 --2- 172.21.15.27:0/3221001208 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdfdc0ca470 0x7fdfdc0c48c0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:38.950 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.946+0000 7fdfe2b0b700 1 --2- 172.21.15.27:0/3221001208 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdfdc0b1620 0x7fdfdc0ad790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:38.950 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.946+0000 7fdfe2b0b700 1 -- 172.21.15.27:0/3221001208 >> 172.21.15.27:0/3221001208 conn(0x7fdfdc06e0a0 msgr2=0x7fdfdc15e170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:32:38.951 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.946+0000 7fdfe2b0b700 1 -- 172.21.15.27:0/3221001208 shutdown_connections 2023-07-05T23:32:38.951 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:38.946+0000 7fdfe2b0b700 1 -- 172.21.15.27:0/3221001208 wait complete. 2023-07-05T23:32:38.960 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-07-05T23:32:45.769 DEBUG:teuthology.orchestra.run.smithi027:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-05T23:32:45.897 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:45.895+0000 7f0345e2d700 1 Processor -- start 2023-07-05T23:32:45.897 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:45.895+0000 7f0345e2d700 1 -- start start 2023-07-05T23:32:45.902 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:45.895+0000 7f0345e2d700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f034015c550 0x7f03400d1b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:45.903 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:45.895+0000 7f0345e2d700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0340145b90 0x7f03400cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:45.903 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:45.895+0000 7f0345e2d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f03401460e0 0x7f03400cf850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:45.903 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:45.895+0000 7f0345e2d700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03400d1700 con 0x7f03401460e0 2023-07-05T23:32:45.903 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:45.895+0000 7f0345e2d700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03400d0a80 con 0x7f0340145b90 2023-07-05T23:32:45.903 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:45.895+0000 7f0345e2d700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03400d0d60 con 0x7f034015c550 2023-07-05T23:32:45.903 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:45.896+0000 7f033ffff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f03401460e0 0x7f03400cf850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:45.904 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:45.896+0000 7f033ffff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f03401460e0 0x7f03400cf850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44396/0 (socket says 172.21.15.27:44396) 2023-07-05T23:32:45.904 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:45.896+0000 7f033ffff700 1 -- 172.21.15.27:0/1886503437 learned_addr learned my addr 172.21.15.27:0/1886503437 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:32:45.904 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:45.896+0000 7f033f7fe700 1 --2- 172.21.15.27:0/1886503437 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f034015c550 0x7f03400d1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:45.904 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:45.896+0000 7f033effd700 1 --2- 172.21.15.27:0/1886503437 >> v2:172.21.15.162:3300/0 conn(0x7f0340145b90 0x7f03400cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:45.904 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:45.896+0000 7f033ffff700 1 -- 172.21.15.27:0/1886503437 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f034015c550 msgr2=0x7f03400d1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:32:45.904 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:45.896+0000 7f033ffff700 1 --2- 172.21.15.27:0/1886503437 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f034015c550 0x7f03400d1b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:45.905 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:45.896+0000 7f033ffff700 1 -- 172.21.15.27:0/1886503437 >> v2:172.21.15.162:3300/0 conn(0x7f0340145b90 msgr2=0x7f03400cf310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:32:45.905 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:45.896+0000 7f033ffff700 1 --2- 172.21.15.27:0/1886503437 >> v2:172.21.15.162:3300/0 conn(0x7f0340145b90 0x7f03400cf310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:45.905 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:45.896+0000 7f033ffff700 1 -- 172.21.15.27:0/1886503437 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03400d1040 con 0x7f03401460e0 2023-07-05T23:32:45.905 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:45.896+0000 7f033f7fe700 1 --2- 172.21.15.27:0/1886503437 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f034015c550 0x7f03400d1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T23:32:45.905 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:45.896+0000 7f033ffff700 1 --2- 172.21.15.27:0/1886503437 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f03401460e0 0x7f03400cf850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0340067160 tx=0x7f033800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b82604b22f677d2e server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:45.905 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:45.896+0000 7f033e7fc700 1 -- 172.21.15.27:0/1886503437 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033800e070 con 0x7f03401460e0 2023-07-05T23:32:45.905 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:45.896+0000 7f033e7fc700 1 -- 172.21.15.27:0/1886503437 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f033800b910 con 0x7f03401460e0 2023-07-05T23:32:45.905 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:45.896+0000 7f033e7fc700 1 -- 172.21.15.27:0/1886503437 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033800bcc0 con 0x7f03401460e0 2023-07-05T23:32:45.906 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:45.897+0000 7f0345e2d700 1 -- 172.21.15.27:0/1886503437 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f03401460e0 msgr2=0x7f03400cf850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:45.906 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:45.897+0000 7f0345e2d700 1 --2- 172.21.15.27:0/1886503437 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f03401460e0 0x7f03400cf850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0340067160 tx=0x7f033800b330 comp rx=0 tx=0).stop 2023-07-05T23:32:45.906 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:45.897+0000 7f0345e2d700 1 -- 172.21.15.27:0/1886503437 shutdown_connections 2023-07-05T23:32:45.906 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:45.897+0000 7f0345e2d700 1 --2- 172.21.15.27:0/1886503437 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f03401460e0 0x7f03400cf850 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:45.907 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:45.897+0000 7f0345e2d700 1 --2- 172.21.15.27:0/1886503437 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f034015c550 0x7f03400d1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:45.907 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:45.897+0000 7f0345e2d700 1 --2- 172.21.15.27:0/1886503437 >> v2:172.21.15.162:3300/0 conn(0x7f0340145b90 0x7f03400cf310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:45.907 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:45.897+0000 7f0345e2d700 1 -- 172.21.15.27:0/1886503437 >> 172.21.15.27:0/1886503437 conn(0x7f0340071620 msgr2=0x7f0340071a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:32:45.907 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:45.897+0000 7f0345e2d700 1 -- 172.21.15.27:0/1886503437 shutdown_connections 2023-07-05T23:32:45.907 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:45.897+0000 7f0345e2d700 1 -- 172.21.15.27:0/1886503437 wait complete. 2023-07-05T23:32:45.907 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:45.898+0000 7f0345e2d700 1 Processor -- start 2023-07-05T23:32:45.907 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:45.898+0000 7f0345e2d700 1 -- start start 2023-07-05T23:32:45.907 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:45.899+0000 7f0345e2d700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0340145b90 0x7f03400c6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:45.908 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:45.899+0000 7f0345e2d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f03401460e0 0x7f03400c8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:45.908 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:45.899+0000 7f0345e2d700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f034015c550 0x7f03400c9090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:45.908 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:45.899+0000 7f0345e2d700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0340159340 con 0x7f03401460e0 2023-07-05T23:32:45.908 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:45.899+0000 7f0345e2d700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03400c71d0 con 0x7f034015c550 2023-07-05T23:32:45.908 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:45.899+0000 7f0345e2d700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0340158770 con 0x7f0340145b90 2023-07-05T23:32:45.908 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:45.899+0000 7f033effd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f03401460e0 0x7f03400c8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:45.908 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:45.899+0000 7f033effd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f03401460e0 0x7f03400c8b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44400/0 (socket says 172.21.15.27:44400) 2023-07-05T23:32:45.909 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:45.899+0000 7f033effd700 1 -- 172.21.15.27:0/368035430 learned_addr learned my addr 172.21.15.27:0/368035430 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:32:45.909 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:45.899+0000 7f033f7fe700 1 --2- 172.21.15.27:0/368035430 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0340145b90 0x7f03400c6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:45.909 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:45.899+0000 7f033ffff700 1 --2- 172.21.15.27:0/368035430 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f034015c550 0x7f03400c9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:45.909 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:45.899+0000 7f033effd700 1 -- 172.21.15.27:0/368035430 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0340145b90 msgr2=0x7f03400c6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:45.909 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:45.899+0000 7f033effd700 1 --2- 172.21.15.27:0/368035430 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0340145b90 0x7f03400c6c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:45.909 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:45.899+0000 7f033effd700 1 -- 172.21.15.27:0/368035430 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f034015c550 msgr2=0x7f03400c9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:45.909 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:45.899+0000 7f033effd700 1 --2- 172.21.15.27:0/368035430 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f034015c550 0x7f03400c9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:45.910 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:45.900+0000 7f033effd700 1 -- 172.21.15.27:0/368035430 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0338009b30 con 0x7f03401460e0 2023-07-05T23:32:45.910 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:45.900+0000 7f033ffff700 1 --2- 172.21.15.27:0/368035430 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f034015c550 0x7f03400c9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T23:32:45.910 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:45.900+0000 7f033effd700 1 --2- 172.21.15.27:0/368035430 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f03401460e0 0x7f03400c8b50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f033400e960 tx=0x7f033400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:45.910 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:45.900+0000 7f0327fff700 1 -- 172.21.15.27:0/368035430 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033400eeb0 con 0x7f03401460e0 2023-07-05T23:32:45.910 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:45.900+0000 7f0327fff700 1 -- 172.21.15.27:0/368035430 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f033400c850 con 0x7f03401460e0 2023-07-05T23:32:45.910 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:45.900+0000 7f0345e2d700 1 -- 172.21.15.27:0/368035430 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0340158a10 con 0x7f03401460e0 2023-07-05T23:32:45.910 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:45.900+0000 7f0327fff700 1 -- 172.21.15.27:0/368035430 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033400cbe0 con 0x7f03401460e0 2023-07-05T23:32:45.910 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:45.900+0000 7f0345e2d700 1 -- 172.21.15.27:0/368035430 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0340158fd0 con 0x7f03401460e0 2023-07-05T23:32:45.911 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:45.901+0000 7f0345e2d700 1 -- 172.21.15.27:0/368035430 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0340067290 con 0x7f03401460e0 2023-07-05T23:32:45.912 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:45.901+0000 7f0327fff700 1 -- 172.21.15.27:0/368035430 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f033400cd40 con 0x7f03401460e0 2023-07-05T23:32:45.912 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:45.902+0000 7f0327fff700 1 --2- 172.21.15.27:0/368035430 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f032c06ace0 0x7f032c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:45.912 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:45.902+0000 7f0327fff700 1 -- 172.21.15.27:0/368035430 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0334088fa0 con 0x7f03401460e0 2023-07-05T23:32:45.912 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:45.902+0000 7f033f7fe700 1 --2- 172.21.15.27:0/368035430 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f032c06ace0 0x7f032c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:45.912 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:45.902+0000 7f033f7fe700 1 --2- 172.21.15.27:0/368035430 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f032c06ace0 0x7f032c06d190 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f033000c940 tx=0x7f0330008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:45.912 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:45.907+0000 7f0327fff700 1 -- 172.21.15.27:0/368035430 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f03340bb310 con 0x7f03401460e0 2023-07-05T23:32:46.107 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:46.105+0000 7f0345e2d700 1 -- 172.21.15.27:0/368035430 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f03400b42a0 con 0x7f03401460e0 2023-07-05T23:32:46.108 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:46.106+0000 7f0327fff700 1 -- 172.21.15.27:0/368035430 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12850 (secure 0 0 0) 0x7f0334017090 con 0x7f03401460e0 2023-07-05T23:32:46.108 INFO:teuthology.misc.health.smithi027.stdout: 2023-07-05T23:32:46.108 INFO:teuthology.misc.health.smithi027.stdout:{"epoch":17,"fsid":"23eebe48-65f5-4d3c-8c2d-4aa171c055d5","created":"2023-07-05T23:32:27.989612+0000","modified":"2023-07-05T23:32:43.735010+0000","last_up_change":"2023-07-05T23:32:39.601570+0000","last_in_change":"2023-07-05T23:32:30.488261+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-05T23:32:41.624598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ac2071e4-394b-4385-b9ba-fad5265efc65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6814","nonce":3766536605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6818","nonce":3766536605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6823","nonce":3766536605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6821","nonce":3766536605}]},"public_addr":"172.21.15.27:6814/3766536605","cluster_addr":"172.21.15.27:6818/3766536605","heartbeat_back_addr":"172.21.15.27:6823/3766536605","heartbeat_front_addr":"172.21.15.27:6821/3766536605","state":["exists","up"]},{"osd":1,"uuid":"8c9b61a0-39d5-46bf-afd6-5add78453ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6801","nonce":1579117455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6803","nonce":1579117455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6807","nonce":1579117455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6805","nonce":1579117455}]},"public_addr":"172.21.15.27:6801/1579117455","cluster_addr":"172.21.15.27:6803/1579117455","heartbeat_back_addr":"172.21.15.27:6807/1579117455","heartbeat_front_addr":"172.21.15.27:6805/1579117455","state":["exists","up"]},{"osd":2,"uuid":"dcd032a2-06b1-4055-b798-b86c71a7107d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6825","nonce":807520271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6827","nonce":807520271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6831","nonce":807520271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6829","nonce":807520271}]},"public_addr":"172.21.15.27:6825/807520271","cluster_addr":"172.21.15.27:6827/807520271","heartbeat_back_addr":"172.21.15.27:6831/807520271","heartbeat_front_addr":"172.21.15.27:6829/807520271","state":["exists","up"]},{"osd":3,"uuid":"b0ffe0fc-47ba-4636-b5ea-6bab637642c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6809","nonce":2125656143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6811","nonce":2125656143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6817","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6819","nonce":2125656143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6813","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6815","nonce":2125656143}]},"public_addr":"172.21.15.27:6809/2125656143","cluster_addr":"172.21.15.27:6811/2125656143","heartbeat_back_addr":"172.21.15.27:6819/2125656143","heartbeat_front_addr":"172.21.15.27:6815/2125656143","state":["exists","up"]},{"osd":4,"uuid":"7fab4e5a-1246-4efe-9562-10c4a6c789ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6801","nonce":2111223016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6803","nonce":2111223016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6807","nonce":2111223016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6805","nonce":2111223016}]},"public_addr":"172.21.15.162:6801/2111223016","cluster_addr":"172.21.15.162:6803/2111223016","heartbeat_back_addr":"172.21.15.162:6807/2111223016","heartbeat_front_addr":"172.21.15.162:6805/2111223016","state":["exists","up"]},{"osd":5,"uuid":"110c4d9f-cef6-48ab-a818-5a81e72372af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6825","nonce":3102609008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6827","nonce":3102609008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6831","nonce":3102609008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6829","nonce":3102609008}]},"public_addr":"172.21.15.162:6825/3102609008","cluster_addr":"172.21.15.162:6827/3102609008","heartbeat_back_addr":"172.21.15.162:6831/3102609008","heartbeat_front_addr":"172.21.15.162:6829/3102609008","state":["exists","up"]},{"osd":6,"uuid":"16803bcc-2c92-4aed-954e-487938c9f24a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6809","nonce":2657688865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6811","nonce":2657688865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6815","nonce":2657688865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6813","nonce":2657688865}]},"public_addr":"172.21.15.162:6809/2657688865","cluster_addr":"172.21.15.162:6811/2657688865","heartbeat_back_addr":"172.21.15.162:6815/2657688865","heartbeat_front_addr":"172.21.15.162:6813/2657688865","state":["exists","up"]},{"osd":7,"uuid":"b7c35377-3cf2-4569-b6b9-72376eb463bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6817","nonce":2096609978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6819","nonce":2096609978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6823","nonce":2096609978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6821","nonce":2096609978}]},"public_addr":"172.21.15.162:6817/2096609978","cluster_addr":"172.21.15.162:6819/2096609978","heartbeat_back_addr":"172.21.15.162:6823/2096609978","heartbeat_front_addr":"172.21.15.162:6821/2096609978","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.735448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.645561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.759120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.682507+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.736228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.694664+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.716002+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.680485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-05T23:32:46.110 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:46.108+0000 7f0345e2d700 1 -- 172.21.15.27:0/368035430 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f032c06ace0 msgr2=0x7f032c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:46.111 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:46.108+0000 7f0345e2d700 1 --2- 172.21.15.27:0/368035430 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f032c06ace0 0x7f032c06d190 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f033000c940 tx=0x7f0330008040 comp rx=0 tx=0).stop 2023-07-05T23:32:46.111 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:46.108+0000 7f0345e2d700 1 -- 172.21.15.27:0/368035430 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f03401460e0 msgr2=0x7f03400c8b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:46.111 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:46.108+0000 7f0345e2d700 1 --2- 172.21.15.27:0/368035430 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f03401460e0 0x7f03400c8b50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f033400e960 tx=0x7f033400ec70 comp rx=0 tx=0).stop 2023-07-05T23:32:46.111 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:46.108+0000 7f0345e2d700 1 -- 172.21.15.27:0/368035430 shutdown_connections 2023-07-05T23:32:46.111 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:46.108+0000 7f0345e2d700 1 --2- 172.21.15.27:0/368035430 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f034015c550 0x7f03400c9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:46.111 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:46.108+0000 7f0345e2d700 1 --2- 172.21.15.27:0/368035430 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f032c06ace0 0x7f032c06d190 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:46.111 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:46.108+0000 7f0345e2d700 1 --2- 172.21.15.27:0/368035430 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0340145b90 0x7f03400c6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:46.112 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:46.108+0000 7f0345e2d700 1 --2- 172.21.15.27:0/368035430 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f03401460e0 0x7f03400c8b50 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:46.112 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:46.108+0000 7f0345e2d700 1 -- 172.21.15.27:0/368035430 >> 172.21.15.27:0/368035430 conn(0x7f0340071620 msgr2=0x7f03400c7610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:32:46.112 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:46.109+0000 7f0345e2d700 1 -- 172.21.15.27:0/368035430 shutdown_connections 2023-07-05T23:32:46.112 INFO:teuthology.misc.health.smithi027.stderr:2023-07-05T23:32:46.109+0000 7f0345e2d700 1 -- 172.21.15.27:0/368035430 wait complete. 2023-07-05T23:32:46.121 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-07-05T23:32:46.122 INFO:tasks.ceph:Creating RBD pool 2023-07-05T23:32:46.122 DEBUG:teuthology.orchestra.run.smithi027:> sudo ceph --cluster ceph osd pool create rbd 8 2023-07-05T23:32:46.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.244+0000 7f431f39f700 1 Processor -- start 2023-07-05T23:32:46.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.244+0000 7f431f39f700 1 -- start start 2023-07-05T23:32:46.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.245+0000 7f431f39f700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f43180ccbf0 0x7f43180ceb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:46.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.245+0000 7f431f39f700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4318160bd0 con 0x7f43180711c0 2023-07-05T23:32:46.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.245+0000 7f431f39f700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f431815fe10 con 0x7f4318069ef0 2023-07-05T23:32:46.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.245+0000 7f431f39f700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43180cf460 con 0x7f43180ccbf0 2023-07-05T23:32:46.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.245+0000 7f431eb9e700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f43180711c0 0x7f43180715c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:51574/0 (socket says 172.21.15.27:51574) 2023-07-05T23:32:46.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.245+0000 7f431eb9e700 1 -- 172.21.15.27:0/1673755912 learned_addr learned my addr 172.21.15.27:0/1673755912 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-07-05T23:32:46.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.245+0000 7f431d39b700 1 -- 172.21.15.27:0/1673755912 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 645890908 0 0) 0x7f4318160bd0 con 0x7f43180711c0 2023-07-05T23:32:46.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.245+0000 7f431db9c700 1 --2- 172.21.15.27:0/1673755912 >> v2:172.21.15.162:3300/0 conn(0x7f43180ccbf0 0x7f43180ceb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:46.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.246+0000 7f431d39b700 1 -- 172.21.15.27:0/1673755912 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43040035b0 con 0x7f43180711c0 2023-07-05T23:32:46.250 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.246+0000 7f431d39b700 1 -- 172.21.15.27:0/1673755912 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 80106237 0 0) 0x7f43040035b0 con 0x7f43180711c0 2023-07-05T23:32:46.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.246+0000 7f431d39b700 1 -- 172.21.15.27:0/1673755912 >> v2:172.21.15.162:3300/0 conn(0x7f43180ccbf0 msgr2=0x7f43180ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:32:46.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.246+0000 7f431d39b700 1 --2- 172.21.15.27:0/1673755912 >> v2:172.21.15.162:3300/0 conn(0x7f43180ccbf0 0x7f43180ceb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:46.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.246+0000 7f431d39b700 1 -- 172.21.15.27:0/1673755912 >> v1:172.21.15.162:6789/0 conn(0x7f4318069ef0 legacy=0x7f431806a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:46.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.246+0000 7f431d39b700 1 -- 172.21.15.27:0/1673755912 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43181600f0 con 0x7f43180711c0 2023-07-05T23:32:46.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.246+0000 7f431d39b700 1 -- 172.21.15.27:0/1673755912 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1246168953 0 0) 0x7f43100019f0 con 0x7f43180711c0 2023-07-05T23:32:46.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.246+0000 7f431d39b700 1 -- 172.21.15.27:0/1673755912 >> v1:172.21.15.27:6789/0 conn(0x7f43180711c0 legacy=0x7f43180715c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:46.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.246+0000 7f431d39b700 1 --2- 172.21.15.27:0/1673755912 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4304003a00 0x7f4304003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:46.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.246+0000 7f431d39b700 1 --2- 172.21.15.27:0/1673755912 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4304004850 0x7f4304004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:46.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.246+0000 7f431d39b700 1 --2- 172.21.15.27:0/1673755912 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4304005200 0x7f430400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:46.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.246+0000 7f431d39b700 1 -- 172.21.15.27:0/1673755912 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43180cf460 con 0x7f4304005200 2023-07-05T23:32:46.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.246+0000 7f431d39b700 1 -- 172.21.15.27:0/1673755912 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f430400c110 con 0x7f4304004850 2023-07-05T23:32:46.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.246+0000 7f431d39b700 1 -- 172.21.15.27:0/1673755912 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f430400c2d0 con 0x7f4304003a00 2023-07-05T23:32:46.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.246+0000 7f431eb9e700 1 --2- 172.21.15.27:0/1673755912 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4304005200 0x7f430400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:46.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.246+0000 7f431db9c700 1 --2- 172.21.15.27:0/1673755912 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4304004850 0x7f4304004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:46.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.246+0000 7f431e39d700 1 --2- 172.21.15.27:0/1673755912 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4304003a00 0x7f4304003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:46.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.246+0000 7f431eb9e700 1 -- 172.21.15.27:0/1673755912 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4304003a00 msgr2=0x7f4304003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:32:46.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.246+0000 7f431eb9e700 1 --2- 172.21.15.27:0/1673755912 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4304003a00 0x7f4304003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:46.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.246+0000 7f431eb9e700 1 -- 172.21.15.27:0/1673755912 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4304004850 msgr2=0x7f4304004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:32:46.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.246+0000 7f431eb9e700 1 --2- 172.21.15.27:0/1673755912 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4304004850 0x7f4304004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:46.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.246+0000 7f431eb9e700 1 -- 172.21.15.27:0/1673755912 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43040035b0 con 0x7f4304005200 2023-07-05T23:32:46.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.246+0000 7f431db9c700 1 --2- 172.21.15.27:0/1673755912 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4304004850 0x7f4304004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T23:32:46.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.246+0000 7f431eb9e700 1 -- 172.21.15.27:0/1673755912 reap_dead start 2023-07-05T23:32:46.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.246+0000 7f431eb9e700 1 --2- 172.21.15.27:0/1673755912 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4304005200 0x7f430400ba10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f431000a830 tx=0x7f4304005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5043a397d080e95 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:46.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.247+0000 7f431d39b700 1 -- 172.21.15.27:0/1673755912 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431000a2f0 con 0x7f4304005200 2023-07-05T23:32:46.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.247+0000 7f431d39b700 1 -- 172.21.15.27:0/1673755912 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4310012620 con 0x7f4304005200 2023-07-05T23:32:46.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.247+0000 7f431d39b700 1 -- 172.21.15.27:0/1673755912 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43100129d0 con 0x7f4304005200 2023-07-05T23:32:46.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.247+0000 7f431f39f700 1 -- 172.21.15.27:0/1673755912 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4304005200 msgr2=0x7f430400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:46.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.247+0000 7f431f39f700 1 --2- 172.21.15.27:0/1673755912 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4304005200 0x7f430400ba10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f431000a830 tx=0x7f4304005880 comp rx=0 tx=0).stop 2023-07-05T23:32:46.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.247+0000 7f431f39f700 1 -- 172.21.15.27:0/1673755912 shutdown_connections 2023-07-05T23:32:46.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.247+0000 7f431f39f700 1 --2- 172.21.15.27:0/1673755912 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4304005200 0x7f430400ba10 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:46.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.247+0000 7f431f39f700 1 -- 172.21.15.27:0/1673755912 >> 172.21.15.27:0/1673755912 conn(0x7f431806de10 msgr2=0x7f43180cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:32:46.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.247+0000 7f431f39f700 1 -- 172.21.15.27:0/1673755912 shutdown_connections 2023-07-05T23:32:46.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.247+0000 7f431f39f700 1 -- 172.21.15.27:0/1673755912 wait complete. 2023-07-05T23:32:46.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.249+0000 7f431f39f700 1 Processor -- start 2023-07-05T23:32:46.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.249+0000 7f431f39f700 1 -- start start 2023-07-05T23:32:46.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.249+0000 7f431f39f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4304005200 0x7f4318157d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:46.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.249+0000 7f431f39f700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f43181f6700 0x7f43180adc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:46.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.249+0000 7f431f39f700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f43180b13b0 0x7f43180b1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:46.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.249+0000 7f431f39f700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43180cd090 con 0x7f4304005200 2023-07-05T23:32:46.258 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.249+0000 7f431f39f700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43180b1d90 con 0x7f43180b13b0 2023-07-05T23:32:46.258 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.249+0000 7f431f39f700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43180ae780 con 0x7f43181f6700 2023-07-05T23:32:46.258 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.249+0000 7f431e39d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4304005200 0x7f4318157d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:46.258 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.249+0000 7f431e39d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4304005200 0x7f4318157d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44418/0 (socket says 172.21.15.27:44418) 2023-07-05T23:32:46.258 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.249+0000 7f431e39d700 1 -- 172.21.15.27:0/3737102804 learned_addr learned my addr 172.21.15.27:0/3737102804 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:32:46.258 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.250+0000 7f431eb9e700 1 --2- 172.21.15.27:0/3737102804 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f43180b13b0 0x7f43180b1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:46.258 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.250+0000 7f431db9c700 1 --2- 172.21.15.27:0/3737102804 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f43181f6700 0x7f43180adc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:46.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.250+0000 7f431e39d700 1 -- 172.21.15.27:0/3737102804 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f43181f6700 msgr2=0x7f43180adc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:46.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.250+0000 7f431e39d700 1 --2- 172.21.15.27:0/3737102804 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f43181f6700 0x7f43180adc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:46.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.250+0000 7f431e39d700 1 -- 172.21.15.27:0/3737102804 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f43180b13b0 msgr2=0x7f43180b1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:46.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.250+0000 7f431e39d700 1 --2- 172.21.15.27:0/3737102804 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f43180b13b0 0x7f43180b1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:46.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.250+0000 7f431e39d700 1 -- 172.21.15.27:0/3737102804 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f431815cf50 con 0x7f4304005200 2023-07-05T23:32:46.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.250+0000 7f431e39d700 1 --2- 172.21.15.27:0/3737102804 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4304005200 0x7f4318157d10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f430800f880 tx=0x7f430800fc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:46.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.250+0000 7f430effd700 1 -- 172.21.15.27:0/3737102804 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43080050d0 con 0x7f4304005200 2023-07-05T23:32:46.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.250+0000 7f430effd700 1 -- 172.21.15.27:0/3737102804 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4308005230 con 0x7f4304005200 2023-07-05T23:32:46.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.250+0000 7f431f39f700 1 -- 172.21.15.27:0/3737102804 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43181554a0 con 0x7f4304005200 2023-07-05T23:32:46.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.250+0000 7f430effd700 1 -- 172.21.15.27:0/3737102804 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4308003680 con 0x7f4304005200 2023-07-05T23:32:46.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.250+0000 7f431f39f700 1 -- 172.21.15.27:0/3737102804 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f431815c900 con 0x7f4304005200 2023-07-05T23:32:46.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.251+0000 7f431f39f700 1 -- 172.21.15.27:0/3737102804 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f431804ea20 con 0x7f4304005200 2023-07-05T23:32:46.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.252+0000 7f430effd700 1 -- 172.21.15.27:0/3737102804 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f43080037e0 con 0x7f4304005200 2023-07-05T23:32:46.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.252+0000 7f430effd700 1 --2- 172.21.15.27:0/3737102804 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f42fc06ace0 0x7f42fc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:46.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.252+0000 7f430effd700 1 -- 172.21.15.27:0/3737102804 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4308088d10 con 0x7f4304005200 2023-07-05T23:32:46.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.252+0000 7f431db9c700 1 --2- 172.21.15.27:0/3737102804 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f42fc06ace0 0x7f42fc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:46.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.253+0000 7f431db9c700 1 --2- 172.21.15.27:0/3737102804 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f42fc06ace0 0x7f42fc06d190 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f431815f8d0 tx=0x7f4314008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:46.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.256+0000 7f430effd700 1 -- 172.21.15.27:0/3737102804 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4308054270 con 0x7f4304005200 2023-07-05T23:32:46.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.451+0000 7f431f39f700 1 -- 172.21.15.27:0/3737102804 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f431815aa00 con 0x7f4304005200 2023-07-05T23:32:46.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.751+0000 7f430effd700 1 -- 172.21.15.27:0/3737102804 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v18) v1 ==== 109+0+0 (secure 0 0 0) 0x7f4308057890 con 0x7f4304005200 2023-07-05T23:32:46.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.754+0000 7f431f39f700 1 -- 172.21.15.27:0/3737102804 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f42fc06ace0 msgr2=0x7f42fc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:46.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.754+0000 7f431f39f700 1 --2- 172.21.15.27:0/3737102804 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f42fc06ace0 0x7f42fc06d190 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f431815f8d0 tx=0x7f4314008040 comp rx=0 tx=0).stop 2023-07-05T23:32:46.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.754+0000 7f431f39f700 1 -- 172.21.15.27:0/3737102804 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4304005200 msgr2=0x7f4318157d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:46.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.754+0000 7f431f39f700 1 --2- 172.21.15.27:0/3737102804 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4304005200 0x7f4318157d10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f430800f880 tx=0x7f430800fc40 comp rx=0 tx=0).stop 2023-07-05T23:32:46.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.754+0000 7f431f39f700 1 -- 172.21.15.27:0/3737102804 shutdown_connections 2023-07-05T23:32:46.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.754+0000 7f431f39f700 1 --2- 172.21.15.27:0/3737102804 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f43180b13b0 0x7f43180b1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:46.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.754+0000 7f431f39f700 1 --2- 172.21.15.27:0/3737102804 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f42fc06ace0 0x7f42fc06d190 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:46.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.754+0000 7f431f39f700 1 --2- 172.21.15.27:0/3737102804 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4304005200 0x7f4318157d10 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:46.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.754+0000 7f431f39f700 1 --2- 172.21.15.27:0/3737102804 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f43181f6700 0x7f43180adc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:46.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.754+0000 7f431f39f700 1 -- 172.21.15.27:0/3737102804 >> 172.21.15.27:0/3737102804 conn(0x7f431806de10 msgr2=0x7f43180caa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:32:46.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.755+0000 7f431f39f700 1 -- 172.21.15.27:0/3737102804 shutdown_connections 2023-07-05T23:32:46.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.755+0000 7f431f39f700 1 -- 172.21.15.27:0/3737102804 wait complete. 2023-07-05T23:32:46.758 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'rbd' created 2023-07-05T23:32:46.769 DEBUG:teuthology.orchestra.run.smithi027:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-07-05T23:32:46.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.894+0000 7ff320257700 1 Processor -- start 2023-07-05T23:32:46.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.894+0000 7ff320257700 1 -- start start 2023-07-05T23:32:46.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.895+0000 7ff320257700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff3180cf590 0x7ff3180d3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:46.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.895+0000 7ff320257700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff3180cd1d0 0x7ff31815d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:46.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.895+0000 7ff320257700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff31815d7c0 con 0x7ff3180cf960 2023-07-05T23:32:46.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.895+0000 7ff320257700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3180cd9b0 con 0x7ff3180cf590 2023-07-05T23:32:46.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.895+0000 7ff320257700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3180b55b0 con 0x7ff3180cd1d0 2023-07-05T23:32:46.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.895+0000 7ff31e7f4700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7ff3180cf960 0x7ff3180d0750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:51596/0 (socket says 172.21.15.27:51596) 2023-07-05T23:32:46.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.895+0000 7ff31e7f4700 1 -- 172.21.15.27:0/3746313300 learned_addr learned my addr 172.21.15.27:0/3746313300 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-07-05T23:32:46.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.895+0000 7ff31d7f2700 1 --2- 172.21.15.27:0/3746313300 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff3180cd1d0 0x7ff31815d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:46.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.895+0000 7ff31dff3700 1 --2- 172.21.15.27:0/3746313300 >> v2:172.21.15.162:3300/0 conn(0x7ff3180cf590 0x7ff3180d3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:46.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.895+0000 7ff31cff1700 1 -- 172.21.15.27:0/3746313300 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3707866815 0 0) 0x7ff31815d7c0 con 0x7ff3180cf960 2023-07-05T23:32:46.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.895+0000 7ff31cff1700 1 -- 172.21.15.27:0/3746313300 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3040035b0 con 0x7ff3180cf960 2023-07-05T23:32:46.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.895+0000 7ff31cff1700 1 -- 172.21.15.27:0/3746313300 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3719166428 0 0) 0x7ff3040035b0 con 0x7ff3180cf960 2023-07-05T23:32:46.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.895+0000 7ff31cff1700 1 -- 172.21.15.27:0/3746313300 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff3180cd1d0 msgr2=0x7ff31815d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:32:46.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.895+0000 7ff31cff1700 1 --2- 172.21.15.27:0/3746313300 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff3180cd1d0 0x7ff31815d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:46.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.895+0000 7ff31cff1700 1 -- 172.21.15.27:0/3746313300 >> v2:172.21.15.162:3300/0 conn(0x7ff3180cf590 msgr2=0x7ff3180d3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:32:46.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.895+0000 7ff31cff1700 1 --2- 172.21.15.27:0/3746313300 >> v2:172.21.15.162:3300/0 conn(0x7ff3180cf590 0x7ff3180d3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:46.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.895+0000 7ff31cff1700 1 -- 172.21.15.27:0/3746313300 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3180cd6d0 con 0x7ff3180cf960 2023-07-05T23:32:46.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.895+0000 7ff31cff1700 1 -- 172.21.15.27:0/3746313300 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1246168953 0 0) 0x7ff3100019f0 con 0x7ff3180cf960 2023-07-05T23:32:46.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.895+0000 7ff31cff1700 1 -- 172.21.15.27:0/3746313300 >> v1:172.21.15.27:6789/0 conn(0x7ff3180cf960 legacy=0x7ff3180d0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:46.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.896+0000 7ff31cff1700 1 --2- 172.21.15.27:0/3746313300 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff304003a00 0x7ff304003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:46.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.896+0000 7ff31cff1700 1 --2- 172.21.15.27:0/3746313300 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff3180cd1d0 0x7ff304004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:46.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.896+0000 7ff31cff1700 1 --2- 172.21.15.27:0/3746313300 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff304004d90 0x7ff304005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:46.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.896+0000 7ff31cff1700 1 -- 172.21.15.27:0/3746313300 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3180cd9b0 con 0x7ff304003a00 2023-07-05T23:32:46.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.896+0000 7ff31cff1700 1 -- 172.21.15.27:0/3746313300 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3180b55b0 con 0x7ff304004d90 2023-07-05T23:32:46.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.896+0000 7ff31cff1700 1 -- 172.21.15.27:0/3746313300 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff30400ba10 con 0x7ff3180cd1d0 2023-07-05T23:32:46.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.896+0000 7ff31dff3700 1 --2- 172.21.15.27:0/3746313300 >> v2:172.21.15.162:3300/0 conn(0x7ff3180cf590 0x7ff3180d3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T23:32:46.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.896+0000 7ff31d7f2700 1 --2- 172.21.15.27:0/3746313300 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff3180cd1d0 0x7ff304004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:46.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.896+0000 7ff31dff3700 1 --2- 172.21.15.27:0/3746313300 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff304003a00 0x7ff304003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:46.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.896+0000 7ff31e7f4700 1 --2- 172.21.15.27:0/3746313300 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff304004d90 0x7ff304005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:46.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.896+0000 7ff31dff3700 1 -- 172.21.15.27:0/3746313300 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff3180cd1d0 msgr2=0x7ff304004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:32:46.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.896+0000 7ff31dff3700 1 --2- 172.21.15.27:0/3746313300 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff3180cd1d0 0x7ff304004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:46.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.896+0000 7ff31dff3700 1 -- 172.21.15.27:0/3746313300 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff304004d90 msgr2=0x7ff304005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:32:46.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.896+0000 7ff31dff3700 1 --2- 172.21.15.27:0/3746313300 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff304004d90 0x7ff304005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:46.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.896+0000 7ff31dff3700 1 -- 172.21.15.27:0/3746313300 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3040035b0 con 0x7ff304003a00 2023-07-05T23:32:46.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.896+0000 7ff31dff3700 1 --2- 172.21.15.27:0/3746313300 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff304003a00 0x7ff304003e10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff314009d10 tx=0x7ff304005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf6df800bbb556e7 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:46.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.896+0000 7ff31cff1700 1 -- 172.21.15.27:0/3746313300 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff314009e60 con 0x7ff304003a00 2023-07-05T23:32:46.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.896+0000 7ff31cff1700 1 -- 172.21.15.27:0/3746313300 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff314004030 con 0x7ff304003a00 2023-07-05T23:32:46.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.896+0000 7ff31cff1700 1 -- 172.21.15.27:0/3746313300 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3140043a0 con 0x7ff304003a00 2023-07-05T23:32:46.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.897+0000 7ff320257700 1 -- 172.21.15.27:0/3746313300 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff304003a00 msgr2=0x7ff304003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:46.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.897+0000 7ff320257700 1 --2- 172.21.15.27:0/3746313300 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff304003a00 0x7ff304003e10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff314009d10 tx=0x7ff304005880 comp rx=0 tx=0).stop 2023-07-05T23:32:46.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.897+0000 7ff31e7f4700 1 -- 172.21.15.27:0/3746313300 reap_dead start 2023-07-05T23:32:46.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.897+0000 7ff320257700 1 -- 172.21.15.27:0/3746313300 shutdown_connections 2023-07-05T23:32:46.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.897+0000 7ff320257700 1 -- 172.21.15.27:0/3746313300 >> 172.21.15.27:0/3746313300 conn(0x7ff31806b3b0 msgr2=0x7ff31806b780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:32:46.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.897+0000 7ff320257700 1 -- 172.21.15.27:0/3746313300 shutdown_connections 2023-07-05T23:32:46.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.897+0000 7ff320257700 1 -- 172.21.15.27:0/3746313300 wait complete. 2023-07-05T23:32:46.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.898+0000 7ff320257700 1 Processor -- start 2023-07-05T23:32:46.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.898+0000 7ff320257700 1 -- start start 2023-07-05T23:32:46.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.899+0000 7ff320257700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff304003a00 0x7ff3181f1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:46.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.899+0000 7ff320257700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff3180c9580 0x7ff3180b6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:46.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.899+0000 7ff320257700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff3180b6f40 0x7ff3180b73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:46.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.899+0000 7ff320257700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3181e4ac0 con 0x7ff304003a00 2023-07-05T23:32:46.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.899+0000 7ff320257700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3180b84a0 con 0x7ff3180c9580 2023-07-05T23:32:46.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.899+0000 7ff320257700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3181e4fb0 con 0x7ff3180b6f40 2023-07-05T23:32:46.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.899+0000 7ff31dff3700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff304003a00 0x7ff3181f1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:46.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.899+0000 7ff31dff3700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff304003a00 0x7ff3181f1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44438/0 (socket says 172.21.15.27:44438) 2023-07-05T23:32:46.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.899+0000 7ff31dff3700 1 -- 172.21.15.27:0/3819041175 learned_addr learned my addr 172.21.15.27:0/3819041175 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:32:46.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.899+0000 7ff31d7f2700 1 --2- 172.21.15.27:0/3819041175 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff3180c9580 0x7ff3180b6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:46.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.899+0000 7ff31e7f4700 1 --2- 172.21.15.27:0/3819041175 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff3180b6f40 0x7ff3180b73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:46.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.899+0000 7ff31dff3700 1 -- 172.21.15.27:0/3819041175 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff3180b6f40 msgr2=0x7ff3180b73b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:46.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.899+0000 7ff31dff3700 1 --2- 172.21.15.27:0/3819041175 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff3180b6f40 0x7ff3180b73b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:46.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.899+0000 7ff31dff3700 1 -- 172.21.15.27:0/3819041175 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff3180c9580 msgr2=0x7ff3180b6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:46.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.899+0000 7ff31dff3700 1 --2- 172.21.15.27:0/3819041175 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff3180c9580 0x7ff3180b6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:46.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.899+0000 7ff31dff3700 1 -- 172.21.15.27:0/3819041175 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3181e4cd0 con 0x7ff304003a00 2023-07-05T23:32:46.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.900+0000 7ff31dff3700 1 --2- 172.21.15.27:0/3819041175 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff304003a00 0x7ff3181f1b70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff31400e790 tx=0x7ff3140047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:46.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.900+0000 7ff30e7fc700 1 -- 172.21.15.27:0/3819041175 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff314021070 con 0x7ff304003a00 2023-07-05T23:32:46.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.900+0000 7ff30e7fc700 1 -- 172.21.15.27:0/3819041175 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff314004590 con 0x7ff304003a00 2023-07-05T23:32:46.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.900+0000 7ff320257700 1 -- 172.21.15.27:0/3819041175 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff318142db0 con 0x7ff304003a00 2023-07-05T23:32:46.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.900+0000 7ff30e7fc700 1 -- 172.21.15.27:0/3819041175 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff314003af0 con 0x7ff304003a00 2023-07-05T23:32:46.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.900+0000 7ff320257700 1 -- 172.21.15.27:0/3819041175 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff318143370 con 0x7ff304003a00 2023-07-05T23:32:46.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.901+0000 7ff320257700 1 -- 172.21.15.27:0/3819041175 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff318143530 con 0x7ff304003a00 2023-07-05T23:32:46.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.901+0000 7ff30e7fc700 1 -- 172.21.15.27:0/3819041175 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff314003c50 con 0x7ff304003a00 2023-07-05T23:32:46.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.902+0000 7ff30e7fc700 1 --2- 172.21.15.27:0/3819041175 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7ff2fc06ace0 0x7ff2fc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:46.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.902+0000 7ff30e7fc700 1 -- 172.21.15.27:0/3819041175 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5199+0+0 (secure 0 0 0) 0x7ff31408a530 con 0x7ff304003a00 2023-07-05T23:32:46.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.902+0000 7ff31d7f2700 1 --2- 172.21.15.27:0/3819041175 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7ff2fc06ace0 0x7ff2fc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:46.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.903+0000 7ff31d7f2700 1 --2- 172.21.15.27:0/3819041175 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7ff2fc06ace0 0x7ff2fc06d190 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff3180c94e0 tx=0x7ff308009210 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:46.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:46.906+0000 7ff30e7fc700 1 -- 172.21.15.27:0/3819041175 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff314055930 con 0x7ff304003a00 2023-07-05T23:32:47.108 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.106+0000 7ff320257700 1 -- 172.21.15.27:0/3819041175 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff31804ea20 con 0x7ff304003a00 2023-07-05T23:32:47.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.755+0000 7ff30e7fc700 1 -- 172.21.15.27:0/3819041175 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v19) v1 ==== 173+0+0 (secure 0 0 0) 0x7ff314058f50 con 0x7ff304003a00 2023-07-05T23:32:47.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.758+0000 7ff320257700 1 -- 172.21.15.27:0/3819041175 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7ff2fc06ace0 msgr2=0x7ff2fc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:47.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.758+0000 7ff320257700 1 --2- 172.21.15.27:0/3819041175 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7ff2fc06ace0 0x7ff2fc06d190 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff3180c94e0 tx=0x7ff308009210 comp rx=0 tx=0).stop 2023-07-05T23:32:47.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.758+0000 7ff320257700 1 -- 172.21.15.27:0/3819041175 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff304003a00 msgr2=0x7ff3181f1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:47.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.758+0000 7ff320257700 1 --2- 172.21.15.27:0/3819041175 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff304003a00 0x7ff3181f1b70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff31400e790 tx=0x7ff3140047c0 comp rx=0 tx=0).stop 2023-07-05T23:32:47.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.758+0000 7ff320257700 1 -- 172.21.15.27:0/3819041175 shutdown_connections 2023-07-05T23:32:47.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.758+0000 7ff320257700 1 --2- 172.21.15.27:0/3819041175 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7ff2fc06ace0 0x7ff2fc06d190 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:47.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.758+0000 7ff320257700 1 --2- 172.21.15.27:0/3819041175 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff3180b6f40 0x7ff3180b73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:47.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.758+0000 7ff320257700 1 --2- 172.21.15.27:0/3819041175 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff304003a00 0x7ff3181f1b70 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:47.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.758+0000 7ff320257700 1 --2- 172.21.15.27:0/3819041175 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff3180c9580 0x7ff3180b6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:47.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.758+0000 7ff320257700 1 -- 172.21.15.27:0/3819041175 >> 172.21.15.27:0/3819041175 conn(0x7ff31806b3b0 msgr2=0x7ff3180b25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:32:47.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.759+0000 7ff320257700 1 -- 172.21.15.27:0/3819041175 shutdown_connections 2023-07-05T23:32:47.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.759+0000 7ff320257700 1 -- 172.21.15.27:0/3819041175 wait complete. 2023-07-05T23:32:47.763 INFO:teuthology.orchestra.run.smithi027.stderr:enabled application 'rbd' on pool 'rbd' 2023-07-05T23:32:47.777 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-07-05T23:32:47.778 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-05T23:32:47.778 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-05T23:32:47.780 INFO:tasks.ceph.mds.a:Started 2023-07-05T23:32:47.780 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-05T23:32:47.781 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-05T23:32:47.782 INFO:tasks.ceph.mds.c:Started 2023-07-05T23:32:47.783 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-05T23:32:47.783 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-05T23:32:47.785 INFO:tasks.ceph.mds.b:Started 2023-07-05T23:32:47.786 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-05T23:32:47.786 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-05T23:32:47.788 INFO:tasks.ceph.mds.d:Started 2023-07-05T23:32:47.788 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-07-05T23:32:47.789 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-05T23:32:47.870 INFO:tasks.ceph.mds.c.smithi027.stdout:starting mds.c at 2023-07-05T23:32:47.870 INFO:tasks.ceph.mds.a.smithi027.stdout:starting mds.a at 2023-07-05T23:32:47.874 INFO:tasks.ceph.mds.b.smithi162.stdout:starting mds.b at 2023-07-05T23:32:47.874 INFO:tasks.ceph.mds.d.smithi162.stdout:starting mds.d at 2023-07-05T23:32:47.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.926+0000 7f0365a9e700 1 Processor -- start 2023-07-05T23:32:47.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.926+0000 7f0365a9e700 1 -- start start 2023-07-05T23:32:47.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.927+0000 7f0365a9e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f036015c570 0x7f03600cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:47.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.927+0000 7f0365a9e700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f03600cd660 0x7f0360160340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:47.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.927+0000 7f0365a9e700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03600cdab0 con 0x7f0360160880 2023-07-05T23:32:47.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.927+0000 7f0365a9e700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f036015d670 con 0x7f036015c570 2023-07-05T23:32:47.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.927+0000 7f0365a9e700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03601610a0 con 0x7f03600cd660 2023-07-05T23:32:47.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.927+0000 7f035f7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f036015c570 0x7f03600cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:47.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.927+0000 7f035f7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f036015c570 0x7f03600cd120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44472/0 (socket says 172.21.15.27:44472) 2023-07-05T23:32:47.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.927+0000 7f035f7fe700 1 -- 172.21.15.27:0/2631476374 learned_addr learned my addr 172.21.15.27:0/2631476374 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:32:47.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.927+0000 7f035effd700 1 --2- 172.21.15.27:0/2631476374 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f03600cd660 0x7f0360160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:47.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.927+0000 7f035f7fe700 1 -- 172.21.15.27:0/2631476374 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f03600cd660 msgr2=0x7f0360160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:32:47.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.928+0000 7f035f7fe700 1 --2- 172.21.15.27:0/2631476374 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f03600cd660 0x7f0360160340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:47.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.928+0000 7f035f7fe700 1 -- 172.21.15.27:0/2631476374 >> v1:172.21.15.27:6789/0 conn(0x7f0360160880 legacy=0x7f036006b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:47.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.928+0000 7f035e7fc700 1 -- 172.21.15.27:0/2631476374 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2272018602 0 0) 0x7f0358001490 con 0x7f0360160880 2023-07-05T23:32:47.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.928+0000 7f035f7fe700 1 -- 172.21.15.27:0/2631476374 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f036015da90 con 0x7f036015c570 2023-07-05T23:32:47.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.928+0000 7f035f7fe700 1 --2- 172.21.15.27:0/2631476374 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f036015c570 0x7f03600cd120 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f03480098f0 tx=0x7f0348009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e370852452aadef server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:47.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.928+0000 7f035e7fc700 1 -- 172.21.15.27:0/2631476374 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0348011830 con 0x7f036015c570 2023-07-05T23:32:47.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.928+0000 7f035e7fc700 1 -- 172.21.15.27:0/2631476374 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0348011990 con 0x7f036015c570 2023-07-05T23:32:47.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.928+0000 7f035e7fc700 1 -- 172.21.15.27:0/2631476374 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0348011d20 con 0x7f036015c570 2023-07-05T23:32:47.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.928+0000 7f0365a9e700 1 -- 172.21.15.27:0/2631476374 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f036015c570 msgr2=0x7f03600cd120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:47.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.928+0000 7f0365a9e700 1 --2- 172.21.15.27:0/2631476374 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f036015c570 0x7f03600cd120 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f03480098f0 tx=0x7f0348009c00 comp rx=0 tx=0).stop 2023-07-05T23:32:47.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.928+0000 7f0365a9e700 1 -- 172.21.15.27:0/2631476374 shutdown_connections 2023-07-05T23:32:47.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.928+0000 7f0365a9e700 1 --2- 172.21.15.27:0/2631476374 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f036015c570 0x7f03600cd120 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:47.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.928+0000 7f0365a9e700 1 --2- 172.21.15.27:0/2631476374 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f03600cd660 0x7f0360160340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:47.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.928+0000 7f0365a9e700 1 -- 172.21.15.27:0/2631476374 >> 172.21.15.27:0/2631476374 conn(0x7f0360071620 msgr2=0x7f03600719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:32:47.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.928+0000 7f0365a9e700 1 -- 172.21.15.27:0/2631476374 shutdown_connections 2023-07-05T23:32:47.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.928+0000 7f0365a9e700 1 -- 172.21.15.27:0/2631476374 wait complete. 2023-07-05T23:32:47.938 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.930+0000 7f0365a9e700 1 Processor -- start 2023-07-05T23:32:47.938 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.930+0000 7f0365a9e700 1 -- start start 2023-07-05T23:32:47.938 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.931+0000 7f0365a9e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f03600cd660 0x7f03601f2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:47.938 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.931+0000 7f0365a9e700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f036015c570 0x7f0360156d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:47.938 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.931+0000 7f0365a9e700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0360160880 0x7f0360152ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:47.938 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.931+0000 7f0365a9e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03600b3600 con 0x7f03600cd660 2023-07-05T23:32:47.938 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.931+0000 7f0365a9e700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03601f3150 con 0x7f036015c570 2023-07-05T23:32:47.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.931+0000 7f0365a9e700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03600b4420 con 0x7f0360160880 2023-07-05T23:32:47.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.931+0000 7f035f7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f03600cd660 0x7f03601f2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:47.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.931+0000 7f035f7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f03600cd660 0x7f03601f2c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44478/0 (socket says 172.21.15.27:44478) 2023-07-05T23:32:47.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.931+0000 7f035f7fe700 1 -- 172.21.15.27:0/291307248 learned_addr learned my addr 172.21.15.27:0/291307248 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:32:47.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.932+0000 7f035ffff700 1 --2- 172.21.15.27:0/291307248 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0360160880 0x7f0360152ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:47.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.932+0000 7f035effd700 1 --2- 172.21.15.27:0/291307248 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f036015c570 0x7f0360156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:47.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.932+0000 7f035f7fe700 1 -- 172.21.15.27:0/291307248 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0360160880 msgr2=0x7f0360152ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:47.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.932+0000 7f035f7fe700 1 --2- 172.21.15.27:0/291307248 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0360160880 0x7f0360152ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:47.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.932+0000 7f035f7fe700 1 -- 172.21.15.27:0/291307248 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f036015c570 msgr2=0x7f0360156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:47.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.932+0000 7f035f7fe700 1 --2- 172.21.15.27:0/291307248 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f036015c570 0x7f0360156d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:47.941 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.932+0000 7f035f7fe700 1 -- 172.21.15.27:0/291307248 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0348009550 con 0x7f03600cd660 2023-07-05T23:32:47.941 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.932+0000 7f035f7fe700 1 --2- 172.21.15.27:0/291307248 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f03600cd660 0x7f03601f2c10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0348009c40 tx=0x7f0348004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:47.941 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.932+0000 7f0357fff700 1 -- 172.21.15.27:0/291307248 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0348004480 con 0x7f03600cd660 2023-07-05T23:32:47.941 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.932+0000 7f0357fff700 1 -- 172.21.15.27:0/291307248 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f034801f070 con 0x7f03600cd660 2023-07-05T23:32:47.942 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.932+0000 7f0365a9e700 1 -- 172.21.15.27:0/291307248 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03600b29f0 con 0x7f03600cd660 2023-07-05T23:32:47.942 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.932+0000 7f0357fff700 1 -- 172.21.15.27:0/291307248 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03480038c0 con 0x7f03600cd660 2023-07-05T23:32:47.942 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.932+0000 7f0365a9e700 1 -- 172.21.15.27:0/291307248 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03600b2fb0 con 0x7f03600cd660 2023-07-05T23:32:47.942 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.933+0000 7f0365a9e700 1 -- 172.21.15.27:0/291307248 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0360073910 con 0x7f03600cd660 2023-07-05T23:32:47.942 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.933+0000 7f0357fff700 1 -- 172.21.15.27:0/291307248 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0348021030 con 0x7f03600cd660 2023-07-05T23:32:47.942 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.934+0000 7f0357fff700 1 --2- 172.21.15.27:0/291307248 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f034006ace0 0x7f034006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:47.943 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.934+0000 7f0357fff700 1 -- 172.21.15.27:0/291307248 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f034808a550 con 0x7f03600cd660 2023-07-05T23:32:47.943 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.934+0000 7f035effd700 1 --2- 172.21.15.27:0/291307248 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f034006ace0 0x7f034006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:47.943 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.934+0000 7f035effd700 1 --2- 172.21.15.27:0/291307248 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f034006ace0 0x7f034006d190 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0360154220 tx=0x7f0350008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:47.944 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:47.938+0000 7f0357fff700 1 -- 172.21.15.27:0/291307248 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f03480559e0 con 0x7f03600cd660 2023-07-05T23:32:48.140 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.138+0000 7f0365a9e700 1 -- 172.21.15.27:0/291307248 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f03600b68c0 con 0x7f03600cd660 2023-07-05T23:32:48.141 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.139+0000 7f0357fff700 1 -- 172.21.15.27:0/291307248 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+14649 (secure 0 0 0) 0x7f0348059000 con 0x7f03600cd660 2023-07-05T23:32:48.141 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:32:48.141 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":19,"fsid":"23eebe48-65f5-4d3c-8c2d-4aa171c055d5","created":"2023-07-05T23:32:27.989612+0000","modified":"2023-07-05T23:32:47.748219+0000","last_up_change":"2023-07-05T23:32:39.601570+0000","last_in_change":"2023-07-05T23:32:30.488261+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-05T23:32:41.624598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-05T23:32:46.481587+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ac2071e4-394b-4385-b9ba-fad5265efc65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6814","nonce":3766536605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6818","nonce":3766536605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6823","nonce":3766536605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6821","nonce":3766536605}]},"public_addr":"172.21.15.27:6814/3766536605","cluster_addr":"172.21.15.27:6818/3766536605","heartbeat_back_addr":"172.21.15.27:6823/3766536605","heartbeat_front_addr":"172.21.15.27:6821/3766536605","state":["exists","up"]},{"osd":1,"uuid":"8c9b61a0-39d5-46bf-afd6-5add78453ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6801","nonce":1579117455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6803","nonce":1579117455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6807","nonce":1579117455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6805","nonce":1579117455}]},"public_addr":"172.21.15.27:6801/1579117455","cluster_addr":"172.21.15.27:6803/1579117455","heartbeat_back_addr":"172.21.15.27:6807/1579117455","heartbeat_front_addr":"172.21.15.27:6805/1579117455","state":["exists","up"]},{"osd":2,"uuid":"dcd032a2-06b1-4055-b798-b86c71a7107d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6825","nonce":807520271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6827","nonce":807520271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6831","nonce":807520271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6829","nonce":807520271}]},"public_addr":"172.21.15.27:6825/807520271","cluster_addr":"172.21.15.27:6827/807520271","heartbeat_back_addr":"172.21.15.27:6831/807520271","heartbeat_front_addr":"172.21.15.27:6829/807520271","state":["exists","up"]},{"osd":3,"uuid":"b0ffe0fc-47ba-4636-b5ea-6bab637642c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6809","nonce":2125656143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6811","nonce":2125656143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6817","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6819","nonce":2125656143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6813","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6815","nonce":2125656143}]},"public_addr":"172.21.15.27:6809/2125656143","cluster_addr":"172.21.15.27:6811/2125656143","heartbeat_back_addr":"172.21.15.27:6819/2125656143","heartbeat_front_addr":"172.21.15.27:6815/2125656143","state":["exists","up"]},{"osd":4,"uuid":"7fab4e5a-1246-4efe-9562-10c4a6c789ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6801","nonce":2111223016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6803","nonce":2111223016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6807","nonce":2111223016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6805","nonce":2111223016}]},"public_addr":"172.21.15.162:6801/2111223016","cluster_addr":"172.21.15.162:6803/2111223016","heartbeat_back_addr":"172.21.15.162:6807/2111223016","heartbeat_front_addr":"172.21.15.162:6805/2111223016","state":["exists","up"]},{"osd":5,"uuid":"110c4d9f-cef6-48ab-a818-5a81e72372af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6825","nonce":3102609008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6827","nonce":3102609008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6831","nonce":3102609008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6829","nonce":3102609008}]},"public_addr":"172.21.15.162:6825/3102609008","cluster_addr":"172.21.15.162:6827/3102609008","heartbeat_back_addr":"172.21.15.162:6831/3102609008","heartbeat_front_addr":"172.21.15.162:6829/3102609008","state":["exists","up"]},{"osd":6,"uuid":"16803bcc-2c92-4aed-954e-487938c9f24a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6809","nonce":2657688865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6811","nonce":2657688865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6815","nonce":2657688865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6813","nonce":2657688865}]},"public_addr":"172.21.15.162:6809/2657688865","cluster_addr":"172.21.15.162:6811/2657688865","heartbeat_back_addr":"172.21.15.162:6815/2657688865","heartbeat_front_addr":"172.21.15.162:6813/2657688865","state":["exists","up"]},{"osd":7,"uuid":"b7c35377-3cf2-4569-b6b9-72376eb463bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6817","nonce":2096609978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6819","nonce":2096609978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6823","nonce":2096609978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6821","nonce":2096609978}]},"public_addr":"172.21.15.162:6817/2096609978","cluster_addr":"172.21.15.162:6819/2096609978","heartbeat_back_addr":"172.21.15.162:6823/2096609978","heartbeat_front_addr":"172.21.15.162:6821/2096609978","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.735448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.645561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.759120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.682507+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.736228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.694664+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.716002+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.680485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-05T23:32:48.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.141+0000 7f0365a9e700 1 -- 172.21.15.27:0/291307248 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f034006ace0 msgr2=0x7f034006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:48.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.141+0000 7f0365a9e700 1 --2- 172.21.15.27:0/291307248 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f034006ace0 0x7f034006d190 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0360154220 tx=0x7f0350008040 comp rx=0 tx=0).stop 2023-07-05T23:32:48.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.141+0000 7f0365a9e700 1 -- 172.21.15.27:0/291307248 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f03600cd660 msgr2=0x7f03601f2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:48.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.141+0000 7f0365a9e700 1 --2- 172.21.15.27:0/291307248 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f03600cd660 0x7f03601f2c10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0348009c40 tx=0x7f0348004750 comp rx=0 tx=0).stop 2023-07-05T23:32:48.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.141+0000 7f0365a9e700 1 -- 172.21.15.27:0/291307248 shutdown_connections 2023-07-05T23:32:48.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.141+0000 7f0365a9e700 1 --2- 172.21.15.27:0/291307248 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f034006ace0 0x7f034006d190 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:48.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.141+0000 7f0365a9e700 1 --2- 172.21.15.27:0/291307248 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0360160880 0x7f0360152ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:48.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.141+0000 7f0365a9e700 1 --2- 172.21.15.27:0/291307248 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f03600cd660 0x7f03601f2c10 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:48.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.141+0000 7f0365a9e700 1 --2- 172.21.15.27:0/291307248 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f036015c570 0x7f0360156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:48.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.141+0000 7f0365a9e700 1 -- 172.21.15.27:0/291307248 >> 172.21.15.27:0/291307248 conn(0x7f0360071620 msgr2=0x7f03600d0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:32:48.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.141+0000 7f0365a9e700 1 -- 172.21.15.27:0/291307248 shutdown_connections 2023-07-05T23:32:48.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.141+0000 7f0365a9e700 1 -- 172.21.15.27:0/291307248 wait complete. 2023-07-05T23:32:48.155 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-05T23:32:41.624598+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-05T23:32:46.481587+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-05T23:32:48.156 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-05T23:32:48.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.281+0000 7f9910c4f700 1 Processor -- start 2023-07-05T23:32:48.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.281+0000 7f9910c4f700 1 -- start start 2023-07-05T23:32:48.285 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.282+0000 7f9910c4f700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f990c0cfd80 0x7f990c15b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:48.285 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.282+0000 7f9910c4f700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f990c069ef0 0x7f990c06a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:48.285 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.282+0000 7f9910c4f700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f990c0cb380 con 0x7f990c06ccd0 2023-07-05T23:32:48.285 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.282+0000 7f9910c4f700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f990c15b7a0 con 0x7f990c0cfd80 2023-07-05T23:32:48.285 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.282+0000 7f9910c4f700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f990c0c97f0 con 0x7f990c069ef0 2023-07-05T23:32:48.285 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.282+0000 7f9909d9b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f990c0cfd80 0x7f990c15b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:48.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.282+0000 7f9909d9b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f990c0cfd80 0x7f990c15b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44488/0 (socket says 172.21.15.27:44488) 2023-07-05T23:32:48.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.282+0000 7f9909d9b700 1 -- 172.21.15.27:0/1488847861 learned_addr learned my addr 172.21.15.27:0/1488847861 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:32:48.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.282+0000 7f990ad9d700 1 --2- 172.21.15.27:0/1488847861 >> v2:172.21.15.162:3300/0 conn(0x7f990c069ef0 0x7f990c06a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:48.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.282+0000 7f9909d9b700 1 -- 172.21.15.27:0/1488847861 >> v2:172.21.15.162:3300/0 conn(0x7f990c069ef0 msgr2=0x7f990c06a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:32:48.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.282+0000 7f9909d9b700 1 --2- 172.21.15.27:0/1488847861 >> v2:172.21.15.162:3300/0 conn(0x7f990c069ef0 0x7f990c06a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:48.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.282+0000 7f9909d9b700 1 -- 172.21.15.27:0/1488847861 >> v1:172.21.15.162:6789/0 conn(0x7f990c06ccd0 legacy=0x7f990c06d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:48.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.283+0000 7f9909d9b700 1 -- 172.21.15.27:0/1488847861 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f990c0cb620 con 0x7f990c0cfd80 2023-07-05T23:32:48.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.283+0000 7f9909d9b700 1 --2- 172.21.15.27:0/1488847861 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f990c0cfd80 0x7f990c15b1c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f990c06dee0 tx=0x7f98fc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ab55c47a6a6f8de server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:48.287 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.283+0000 7f990959a700 1 -- 172.21.15.27:0/1488847861 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98fc011830 con 0x7f990c0cfd80 2023-07-05T23:32:48.287 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.283+0000 7f990959a700 1 -- 172.21.15.27:0/1488847861 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98fc011990 con 0x7f990c0cfd80 2023-07-05T23:32:48.287 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.283+0000 7f990959a700 1 -- 172.21.15.27:0/1488847861 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98fc011d20 con 0x7f990c0cfd80 2023-07-05T23:32:48.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.283+0000 7f9910c4f700 1 -- 172.21.15.27:0/1488847861 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f990c0cfd80 msgr2=0x7f990c15b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:48.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.283+0000 7f9910c4f700 1 --2- 172.21.15.27:0/1488847861 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f990c0cfd80 0x7f990c15b1c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f990c06dee0 tx=0x7f98fc009bd0 comp rx=0 tx=0).stop 2023-07-05T23:32:48.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.283+0000 7f9910c4f700 1 -- 172.21.15.27:0/1488847861 shutdown_connections 2023-07-05T23:32:48.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.283+0000 7f9910c4f700 1 --2- 172.21.15.27:0/1488847861 >> v2:172.21.15.162:3300/0 conn(0x7f990c069ef0 0x7f990c06a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:48.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.283+0000 7f9910c4f700 1 --2- 172.21.15.27:0/1488847861 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f990c0cfd80 0x7f990c15b1c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:48.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.283+0000 7f9910c4f700 1 -- 172.21.15.27:0/1488847861 >> 172.21.15.27:0/1488847861 conn(0x7f990c0b1990 msgr2=0x7f990c0cf1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:32:48.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.283+0000 7f9910c4f700 1 -- 172.21.15.27:0/1488847861 shutdown_connections 2023-07-05T23:32:48.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.284+0000 7f9910c4f700 1 -- 172.21.15.27:0/1488847861 wait complete. 2023-07-05T23:32:48.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.285+0000 7f9910c4f700 1 Processor -- start 2023-07-05T23:32:48.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.285+0000 7f9910c4f700 1 -- start start 2023-07-05T23:32:48.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.286+0000 7f9910c4f700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f990c069ef0 0x7f990c14b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:48.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.286+0000 7f9910c4f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f990c06ccd0 0x7f990c0c7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:48.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.286+0000 7f9910c4f700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f990c0cfd80 0x7f990c1595d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:48.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.286+0000 7f9910c4f700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f990c158630 con 0x7f990c06ccd0 2023-07-05T23:32:48.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.286+0000 7f9910c4f700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f990c158810 con 0x7f990c069ef0 2023-07-05T23:32:48.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.286+0000 7f9910c4f700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f990c158af0 con 0x7f990c0cfd80 2023-07-05T23:32:48.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.286+0000 7f9909d9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f990c06ccd0 0x7f990c0c7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:48.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.286+0000 7f9909d9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f990c06ccd0 0x7f990c0c7190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44494/0 (socket says 172.21.15.27:44494) 2023-07-05T23:32:48.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.286+0000 7f9909d9b700 1 -- 172.21.15.27:0/220367596 learned_addr learned my addr 172.21.15.27:0/220367596 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:32:48.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.286+0000 7f990a59c700 1 --2- 172.21.15.27:0/220367596 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f990c069ef0 0x7f990c14b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:48.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.286+0000 7f990ad9d700 1 --2- 172.21.15.27:0/220367596 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f990c0cfd80 0x7f990c1595d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:48.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.286+0000 7f9909d9b700 1 -- 172.21.15.27:0/220367596 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f990c0cfd80 msgr2=0x7f990c1595d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:48.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.286+0000 7f9909d9b700 1 --2- 172.21.15.27:0/220367596 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f990c0cfd80 0x7f990c1595d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:48.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.286+0000 7f9909d9b700 1 -- 172.21.15.27:0/220367596 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f990c069ef0 msgr2=0x7f990c14b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:48.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.286+0000 7f9909d9b700 1 --2- 172.21.15.27:0/220367596 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f990c069ef0 0x7f990c14b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:48.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.286+0000 7f9909d9b700 1 -- 172.21.15.27:0/220367596 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98fc009550 con 0x7f990c06ccd0 2023-07-05T23:32:48.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.286+0000 7f9909d9b700 1 --2- 172.21.15.27:0/220367596 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f990c06ccd0 0x7f990c0c7190 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f98fc009130 tx=0x7f98fc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:48.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.286+0000 7f98faffd700 1 -- 172.21.15.27:0/220367596 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98fc004510 con 0x7f990c06ccd0 2023-07-05T23:32:48.293 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.286+0000 7f98faffd700 1 -- 172.21.15.27:0/220367596 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98fc01e070 con 0x7f990c06ccd0 2023-07-05T23:32:48.293 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.286+0000 7f9910c4f700 1 -- 172.21.15.27:0/220367596 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f990c158dd0 con 0x7f990c06ccd0 2023-07-05T23:32:48.293 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.286+0000 7f98faffd700 1 -- 172.21.15.27:0/220367596 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98fc0038a0 con 0x7f990c06ccd0 2023-07-05T23:32:48.293 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.286+0000 7f9910c4f700 1 -- 172.21.15.27:0/220367596 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f990c0c76d0 con 0x7f990c06ccd0 2023-07-05T23:32:48.294 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.287+0000 7f9910c4f700 1 -- 172.21.15.27:0/220367596 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f990c1592f0 con 0x7f990c06ccd0 2023-07-05T23:32:48.294 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.288+0000 7f98faffd700 1 -- 172.21.15.27:0/220367596 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f98fc003a00 con 0x7f990c06ccd0 2023-07-05T23:32:48.294 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.288+0000 7f98faffd700 1 --2- 172.21.15.27:0/220367596 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f98ec06ace0 0x7f98ec06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:48.294 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.288+0000 7f98faffd700 1 -- 172.21.15.27:0/220367596 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f98fc089fd0 con 0x7f990c06ccd0 2023-07-05T23:32:48.294 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.289+0000 7f990a59c700 1 --2- 172.21.15.27:0/220367596 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f98ec06ace0 0x7f98ec06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:48.294 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.289+0000 7f990a59c700 1 --2- 172.21.15.27:0/220367596 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f98ec06ace0 0x7f98ec06d190 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f990c0ae650 tx=0x7f9900009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:48.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.293+0000 7f98faffd700 1 -- 172.21.15.27:0/220367596 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f990c1592f0 con 0x7f990c06ccd0 2023-07-05T23:32:48.489 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.487+0000 7f9910c4f700 1 -- 172.21.15.27:0/220367596 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f990c1592f0 con 0x7f990c06ccd0 2023-07-05T23:32:48.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.488+0000 7f98faffd700 1 -- 172.21.15.27:0/220367596 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7f990c1592f0 con 0x7f990c06ccd0 2023-07-05T23:32:48.490 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2023-07-05T23:32:48.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.490+0000 7f9910c4f700 1 -- 172.21.15.27:0/220367596 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f98ec06ace0 msgr2=0x7f98ec06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:48.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.490+0000 7f9910c4f700 1 --2- 172.21.15.27:0/220367596 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f98ec06ace0 0x7f98ec06d190 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f990c0ae650 tx=0x7f9900009040 comp rx=0 tx=0).stop 2023-07-05T23:32:48.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.490+0000 7f9910c4f700 1 -- 172.21.15.27:0/220367596 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f990c06ccd0 msgr2=0x7f990c0c7190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:48.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.490+0000 7f9910c4f700 1 --2- 172.21.15.27:0/220367596 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f990c06ccd0 0x7f990c0c7190 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f98fc009130 tx=0x7f98fc004750 comp rx=0 tx=0).stop 2023-07-05T23:32:48.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.490+0000 7f9910c4f700 1 -- 172.21.15.27:0/220367596 shutdown_connections 2023-07-05T23:32:48.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.490+0000 7f9910c4f700 1 --2- 172.21.15.27:0/220367596 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f990c069ef0 0x7f990c14b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:48.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.490+0000 7f9910c4f700 1 --2- 172.21.15.27:0/220367596 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f98ec06ace0 0x7f98ec06d190 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:48.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.490+0000 7f9910c4f700 1 --2- 172.21.15.27:0/220367596 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f990c0cfd80 0x7f990c1595d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:48.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.490+0000 7f9910c4f700 1 --2- 172.21.15.27:0/220367596 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f990c06ccd0 0x7f990c0c7190 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:48.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.490+0000 7f9910c4f700 1 -- 172.21.15.27:0/220367596 >> 172.21.15.27:0/220367596 conn(0x7f990c0b1990 msgr2=0x7f990c0b34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:32:48.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.490+0000 7f9910c4f700 1 -- 172.21.15.27:0/220367596 shutdown_connections 2023-07-05T23:32:48.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.490+0000 7f9910c4f700 1 -- 172.21.15.27:0/220367596 wait complete. 2023-07-05T23:32:48.503 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-05T23:32:48.632 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.629+0000 7f7c095c0700 1 Processor -- start 2023-07-05T23:32:48.632 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.629+0000 7f7c095c0700 1 -- start start 2023-07-05T23:32:48.640 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.630+0000 7f7c095c0700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7c040cd5e0 0x7f7c040cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:48.640 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.630+0000 7f7c095c0700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c040adf40 0x7f7c0406e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:48.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.630+0000 7f7c095c0700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c0406f0e0 con 0x7f7c0406e030 2023-07-05T23:32:48.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.630+0000 7f7c095c0700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c040ce2c0 con 0x7f7c040cd5e0 2023-07-05T23:32:48.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.630+0000 7f7c095c0700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c040cdef0 con 0x7f7c040adf40 2023-07-05T23:32:48.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.630+0000 7f7c027fc700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f7c0406e030 0x7f7c0415cf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:51668/0 (socket says 172.21.15.27:51668) 2023-07-05T23:32:48.642 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.630+0000 7f7c027fc700 1 -- 172.21.15.27:0/48849077 learned_addr learned my addr 172.21.15.27:0/48849077 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-07-05T23:32:48.642 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.631+0000 7f7c037fe700 1 --2- 172.21.15.27:0/48849077 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c040adf40 0x7f7c0406e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:48.642 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.631+0000 7f7c02ffd700 1 --2- 172.21.15.27:0/48849077 >> v2:172.21.15.162:3300/0 conn(0x7f7c040cd5e0 0x7f7c040cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:48.643 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.631+0000 7f7c01ffb700 1 -- 172.21.15.27:0/48849077 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2401146130 0 0) 0x7f7c0406f0e0 con 0x7f7c0406e030 2023-07-05T23:32:48.643 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.631+0000 7f7c01ffb700 1 -- 172.21.15.27:0/48849077 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bec0035b0 con 0x7f7c0406e030 2023-07-05T23:32:48.643 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.631+0000 7f7c01ffb700 1 -- 172.21.15.27:0/48849077 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1004813939 0 0) 0x7f7bec0035b0 con 0x7f7c0406e030 2023-07-05T23:32:48.643 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.631+0000 7f7c01ffb700 1 -- 172.21.15.27:0/48849077 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c040adf40 msgr2=0x7f7c0406e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:32:48.644 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.631+0000 7f7c01ffb700 1 --2- 172.21.15.27:0/48849077 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c040adf40 0x7f7c0406e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:48.644 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.631+0000 7f7c01ffb700 1 -- 172.21.15.27:0/48849077 >> v2:172.21.15.162:3300/0 conn(0x7f7c040cd5e0 msgr2=0x7f7c040cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:32:48.644 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.631+0000 7f7c01ffb700 1 --2- 172.21.15.27:0/48849077 >> v2:172.21.15.162:3300/0 conn(0x7f7c040cd5e0 0x7f7c040cd9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:48.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.631+0000 7f7c01ffb700 1 -- 172.21.15.27:0/48849077 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c0406eb20 con 0x7f7c0406e030 2023-07-05T23:32:48.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.631+0000 7f7c01ffb700 1 -- 172.21.15.27:0/48849077 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1246168953 0 0) 0x7f7bf4001670 con 0x7f7c0406e030 2023-07-05T23:32:48.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.631+0000 7f7c01ffb700 1 -- 172.21.15.27:0/48849077 >> v1:172.21.15.27:6789/0 conn(0x7f7c0406e030 legacy=0x7f7c0415cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:48.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.631+0000 7f7c01ffb700 1 --2- 172.21.15.27:0/48849077 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7bec003a00 0x7f7bec003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:48.646 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.631+0000 7f7c01ffb700 1 --2- 172.21.15.27:0/48849077 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7bec004430 0x7f7bec0048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:48.646 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.631+0000 7f7c01ffb700 1 --2- 172.21.15.27:0/48849077 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c040adf40 0x7f7bec005060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:48.646 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.631+0000 7f7c01ffb700 1 -- 172.21.15.27:0/48849077 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c040ce2c0 con 0x7f7bec003a00 2023-07-05T23:32:48.647 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.631+0000 7f7c01ffb700 1 -- 172.21.15.27:0/48849077 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c040cdef0 con 0x7f7bec004430 2023-07-05T23:32:48.647 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.631+0000 7f7c01ffb700 1 -- 172.21.15.27:0/48849077 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bec00ba10 con 0x7f7c040adf40 2023-07-05T23:32:48.647 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.631+0000 7f7c02ffd700 1 --2- 172.21.15.27:0/48849077 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7bec003a00 0x7f7bec003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:48.647 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.631+0000 7f7c027fc700 1 --2- 172.21.15.27:0/48849077 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7bec004430 0x7f7bec0048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:48.648 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.631+0000 7f7c037fe700 1 --2- 172.21.15.27:0/48849077 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c040adf40 0x7f7bec005060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:48.648 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.631+0000 7f7c02ffd700 1 -- 172.21.15.27:0/48849077 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c040adf40 msgr2=0x7f7bec005060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:32:48.648 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.631+0000 7f7c02ffd700 1 --2- 172.21.15.27:0/48849077 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c040adf40 0x7f7bec005060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:48.649 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.631+0000 7f7c02ffd700 1 -- 172.21.15.27:0/48849077 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7bec004430 msgr2=0x7f7bec0048f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:32:48.649 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.631+0000 7f7c02ffd700 1 --2- 172.21.15.27:0/48849077 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7bec004430 0x7f7bec0048f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:48.649 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.631+0000 7f7c02ffd700 1 -- 172.21.15.27:0/48849077 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bec0035b0 con 0x7f7bec003a00 2023-07-05T23:32:48.649 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.631+0000 7f7c037fe700 1 --2- 172.21.15.27:0/48849077 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c040adf40 0x7f7bec005060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T23:32:48.650 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.632+0000 7f7c02ffd700 1 --2- 172.21.15.27:0/48849077 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7bec003a00 0x7f7bec003e10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7bf80096d0 tx=0x7f7bec005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a09da49d18ebcd1 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:48.650 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.632+0000 7f7c01ffb700 1 -- 172.21.15.27:0/48849077 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf8005a20 con 0x7f7bec003a00 2023-07-05T23:32:48.650 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.632+0000 7f7c01ffb700 1 -- 172.21.15.27:0/48849077 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bf8005b80 con 0x7f7bec003a00 2023-07-05T23:32:48.651 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.632+0000 7f7c01ffb700 1 -- 172.21.15.27:0/48849077 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf800e6c0 con 0x7f7bec003a00 2023-07-05T23:32:48.651 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.632+0000 7f7c095c0700 1 -- 172.21.15.27:0/48849077 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7bec003a00 msgr2=0x7f7bec003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:48.651 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.632+0000 7f7c095c0700 1 --2- 172.21.15.27:0/48849077 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7bec003a00 0x7f7bec003e10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7bf80096d0 tx=0x7f7bec005880 comp rx=0 tx=0).stop 2023-07-05T23:32:48.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.632+0000 7f7c037fe700 1 -- 172.21.15.27:0/48849077 reap_dead start 2023-07-05T23:32:48.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.632+0000 7f7c095c0700 1 -- 172.21.15.27:0/48849077 shutdown_connections 2023-07-05T23:32:48.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.632+0000 7f7c095c0700 1 -- 172.21.15.27:0/48849077 >> 172.21.15.27:0/48849077 conn(0x7f7c0406b920 msgr2=0x7f7c040cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:32:48.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.632+0000 7f7c095c0700 1 -- 172.21.15.27:0/48849077 shutdown_connections 2023-07-05T23:32:48.653 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.632+0000 7f7c095c0700 1 -- 172.21.15.27:0/48849077 wait complete. 2023-07-05T23:32:48.653 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.634+0000 7f7c095c0700 1 Processor -- start 2023-07-05T23:32:48.653 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.634+0000 7f7c095c0700 1 -- start start 2023-07-05T23:32:48.653 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.634+0000 7f7c095c0700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7bec003a00 0x7f7c0414f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:48.653 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.634+0000 7f7c095c0700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c040c5be0 0x7f7c041e27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:48.654 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.634+0000 7f7c095c0700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c040c6050 0x7f7c041e2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:48.654 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.634+0000 7f7c095c0700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c04156840 con 0x7f7c040c5be0 2023-07-05T23:32:48.654 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.634+0000 7f7c095c0700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c041569b0 con 0x7f7bec003a00 2023-07-05T23:32:48.654 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.634+0000 7f7c095c0700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0414fee0 con 0x7f7c040c6050 2023-07-05T23:32:48.654 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.635+0000 7f7c027fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c040c5be0 0x7f7c041e27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:48.654 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.635+0000 7f7c027fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c040c5be0 0x7f7c041e27d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44514/0 (socket says 172.21.15.27:44514) 2023-07-05T23:32:48.654 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.635+0000 7f7c027fc700 1 -- 172.21.15.27:0/1739267771 learned_addr learned my addr 172.21.15.27:0/1739267771 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:32:48.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.635+0000 7f7c037fe700 1 --2- 172.21.15.27:0/1739267771 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c040c6050 0x7f7c041e2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:48.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.635+0000 7f7c027fc700 1 -- 172.21.15.27:0/1739267771 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c040c6050 msgr2=0x7f7c041e2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:48.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.635+0000 7f7c02ffd700 1 --2- 172.21.15.27:0/1739267771 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7bec003a00 0x7f7c0414f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:48.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.635+0000 7f7c027fc700 1 --2- 172.21.15.27:0/1739267771 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c040c6050 0x7f7c041e2d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:48.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.635+0000 7f7c027fc700 1 -- 172.21.15.27:0/1739267771 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7bec003a00 msgr2=0x7f7c0414f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:48.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.635+0000 7f7c027fc700 1 --2- 172.21.15.27:0/1739267771 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7bec003a00 0x7f7c0414f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:48.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.635+0000 7f7c027fc700 1 -- 172.21.15.27:0/1739267771 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c041501c0 con 0x7f7c040c5be0 2023-07-05T23:32:48.656 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.635+0000 7f7c027fc700 1 --2- 172.21.15.27:0/1739267771 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c040c5be0 0x7f7c041e27d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7bf4000fb0 tx=0x7f7bf40075f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:48.656 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.635+0000 7f7beb7fe700 1 -- 172.21.15.27:0/1739267771 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf40077d0 con 0x7f7c040c5be0 2023-07-05T23:32:48.656 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.635+0000 7f7beb7fe700 1 -- 172.21.15.27:0/1739267771 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bf400f8a0 con 0x7f7c040c5be0 2023-07-05T23:32:48.656 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.635+0000 7f7beb7fe700 1 -- 172.21.15.27:0/1739267771 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf400fc50 con 0x7f7c040c5be0 2023-07-05T23:32:48.656 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.635+0000 7f7c095c0700 1 -- 172.21.15.27:0/1739267771 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c041504a0 con 0x7f7c040c5be0 2023-07-05T23:32:48.656 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.635+0000 7f7c095c0700 1 -- 172.21.15.27:0/1739267771 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c041f3290 con 0x7f7c040c5be0 2023-07-05T23:32:48.657 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.636+0000 7f7c095c0700 1 -- 172.21.15.27:0/1739267771 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c04156b20 con 0x7f7c040c5be0 2023-07-05T23:32:48.657 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.637+0000 7f7beb7fe700 1 -- 172.21.15.27:0/1739267771 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7bf401d460 con 0x7f7c040c5be0 2023-07-05T23:32:48.657 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.637+0000 7f7beb7fe700 1 --2- 172.21.15.27:0/1739267771 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f7bf006ace0 0x7f7bf006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:48.657 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.637+0000 7f7beb7fe700 1 -- 172.21.15.27:0/1739267771 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7bf4089160 con 0x7f7c040c5be0 2023-07-05T23:32:48.657 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.637+0000 7f7c02ffd700 1 --2- 172.21.15.27:0/1739267771 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f7bf006ace0 0x7f7bf006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:48.657 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.638+0000 7f7c02ffd700 1 --2- 172.21.15.27:0/1739267771 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f7bf006ace0 0x7f7bf006d190 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7bf8009a90 tx=0x7f7bf8015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:48.658 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.641+0000 7f7beb7fe700 1 -- 172.21.15.27:0/1739267771 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7bf4054560 con 0x7f7c040c5be0 2023-07-05T23:32:48.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.838+0000 7f7c095c0700 1 -- 172.21.15.27:0/1739267771 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7c0404ea20 con 0x7f7c040c5be0 2023-07-05T23:32:48.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.839+0000 7f7beb7fe700 1 -- 172.21.15.27:0/1739267771 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7bf4057b80 con 0x7f7c040c5be0 2023-07-05T23:32:48.841 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 8 2023-07-05T23:32:48.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.841+0000 7f7c095c0700 1 -- 172.21.15.27:0/1739267771 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f7bf006ace0 msgr2=0x7f7bf006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:48.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.841+0000 7f7c095c0700 1 --2- 172.21.15.27:0/1739267771 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f7bf006ace0 0x7f7bf006d190 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7bf8009a90 tx=0x7f7bf8015000 comp rx=0 tx=0).stop 2023-07-05T23:32:48.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.841+0000 7f7c095c0700 1 -- 172.21.15.27:0/1739267771 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c040c5be0 msgr2=0x7f7c041e27d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:48.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.841+0000 7f7c095c0700 1 --2- 172.21.15.27:0/1739267771 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c040c5be0 0x7f7c041e27d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7bf4000fb0 tx=0x7f7bf40075f0 comp rx=0 tx=0).stop 2023-07-05T23:32:48.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.841+0000 7f7c095c0700 1 -- 172.21.15.27:0/1739267771 shutdown_connections 2023-07-05T23:32:48.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.841+0000 7f7c095c0700 1 --2- 172.21.15.27:0/1739267771 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7bec003a00 0x7f7c0414f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:48.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.841+0000 7f7c095c0700 1 --2- 172.21.15.27:0/1739267771 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f7bf006ace0 0x7f7bf006d190 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:48.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.841+0000 7f7c095c0700 1 --2- 172.21.15.27:0/1739267771 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c040c6050 0x7f7c041e2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:48.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.841+0000 7f7c095c0700 1 --2- 172.21.15.27:0/1739267771 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c040c5be0 0x7f7c041e27d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:48.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.841+0000 7f7c095c0700 1 -- 172.21.15.27:0/1739267771 >> 172.21.15.27:0/1739267771 conn(0x7f7c0406b920 msgr2=0x7f7c040b14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:32:48.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.841+0000 7f7c095c0700 1 -- 172.21.15.27:0/1739267771 shutdown_connections 2023-07-05T23:32:48.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.841+0000 7f7c095c0700 1 -- 172.21.15.27:0/1739267771 wait complete. 2023-07-05T23:32:48.855 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-05T23:32:48.980 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.978+0000 7f7fc6c53700 1 Processor -- start 2023-07-05T23:32:48.980 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.978+0000 7f7fc6c53700 1 -- start start 2023-07-05T23:32:48.982 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.979+0000 7f7fc6c53700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f7fc00ccf90 0x7f7fc00cd360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:48.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.979+0000 7f7fc6c53700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7fc0158850 0x7f7fc015c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:48.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.979+0000 7f7fc6c53700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7fc015c720 0x7f7fc006a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:48.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.979+0000 7f7fc6c53700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fc015d1f0 con 0x7f7fc00ccf90 2023-07-05T23:32:48.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.979+0000 7f7fc6c53700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fc00cd8a0 con 0x7f7fc015c720 2023-07-05T23:32:48.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.979+0000 7f7fc6c53700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc015cc30 con 0x7f7fc0158850 2023-07-05T23:32:48.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.979+0000 7f7fc49ef700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f7fc00ccf90 0x7f7fc00cd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:48.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.979+0000 7f7fc49ef700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f7fc00ccf90 0x7f7fc00cd360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44522/0 (socket says 172.21.15.27:44522) 2023-07-05T23:32:48.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.979+0000 7f7fc49ef700 1 -- 172.21.15.27:0/2492014616 learned_addr learned my addr 172.21.15.27:0/2492014616 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:32:48.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.980+0000 7f7fc49ef700 1 -- 172.21.15.27:0/2492014616 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7fc0158850 msgr2=0x7f7fc015c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:32:48.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.980+0000 7f7fbffff700 1 --2- 172.21.15.27:0/2492014616 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7fc0158850 0x7f7fc015c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:48.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.980+0000 7f7fc49ef700 1 --2- 172.21.15.27:0/2492014616 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7fc0158850 0x7f7fc015c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:48.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.980+0000 7f7fc49ef700 1 -- 172.21.15.27:0/2492014616 >> v2:172.21.15.162:3300/0 conn(0x7f7fc015c720 msgr2=0x7f7fc006a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:32:48.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.980+0000 7f7fc49ef700 1 --2- 172.21.15.27:0/2492014616 >> v2:172.21.15.162:3300/0 conn(0x7f7fc015c720 0x7f7fc006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:48.985 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.980+0000 7f7fc49ef700 1 -- 172.21.15.27:0/2492014616 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fc015cf10 con 0x7f7fc00ccf90 2023-07-05T23:32:48.985 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.980+0000 7f7fc49ef700 1 --2- 172.21.15.27:0/2492014616 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7fc00ccf90 0x7f7fc00cd360 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7fc006c8c0 tx=0x7f7fb400be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c80ed3b36aa6497 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:48.985 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.980+0000 7f7fbf7fe700 1 -- 172.21.15.27:0/2492014616 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb400dd30 con 0x7f7fc00ccf90 2023-07-05T23:32:48.985 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.980+0000 7f7fbf7fe700 1 -- 172.21.15.27:0/2492014616 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fb400de90 con 0x7f7fc00ccf90 2023-07-05T23:32:48.985 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.980+0000 7f7fbf7fe700 1 -- 172.21.15.27:0/2492014616 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb4010690 con 0x7f7fc00ccf90 2023-07-05T23:32:48.985 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.980+0000 7f7fc6c53700 1 -- 172.21.15.27:0/2492014616 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7fc00ccf90 msgr2=0x7f7fc00cd360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:48.985 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.980+0000 7f7fc6c53700 1 --2- 172.21.15.27:0/2492014616 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7fc00ccf90 0x7f7fc00cd360 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7fc006c8c0 tx=0x7f7fb400be70 comp rx=0 tx=0).stop 2023-07-05T23:32:48.986 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.981+0000 7f7fc6c53700 1 -- 172.21.15.27:0/2492014616 shutdown_connections 2023-07-05T23:32:48.986 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.981+0000 7f7fc6c53700 1 --2- 172.21.15.27:0/2492014616 >> v2:172.21.15.162:3300/0 conn(0x7f7fc015c720 0x7f7fc006a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:48.986 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.981+0000 7f7fc6c53700 1 --2- 172.21.15.27:0/2492014616 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7fc00ccf90 0x7f7fc00cd360 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:48.986 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.981+0000 7f7fc6c53700 1 --2- 172.21.15.27:0/2492014616 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7fc0158850 0x7f7fc015c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:48.986 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.981+0000 7f7fc6c53700 1 -- 172.21.15.27:0/2492014616 >> 172.21.15.27:0/2492014616 conn(0x7f7fc00b1740 msgr2=0x7f7fc006cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:32:48.986 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.981+0000 7f7fc6c53700 1 -- 172.21.15.27:0/2492014616 shutdown_connections 2023-07-05T23:32:48.987 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.981+0000 7f7fc6c53700 1 -- 172.21.15.27:0/2492014616 wait complete. 2023-07-05T23:32:48.989 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.982+0000 7f7fc6c53700 1 Processor -- start 2023-07-05T23:32:48.989 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.982+0000 7f7fc6c53700 1 -- start start 2023-07-05T23:32:48.989 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.983+0000 7f7fc6c53700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7fc00ccf90 0x7f7fc0159c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:48.990 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.983+0000 7f7fc6c53700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7fc0158850 0x7f7fc0154730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:48.990 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.983+0000 7f7fc6c53700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fc015c720 0x7f7fc00aa160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:48.990 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.983+0000 7f7fc6c53700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc0157f70 con 0x7f7fc00ccf90 2023-07-05T23:32:48.990 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.983+0000 7f7fc6c53700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc0154c70 con 0x7f7fc015c720 2023-07-05T23:32:48.990 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.983+0000 7f7fc6c53700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc015a370 con 0x7f7fc0158850 2023-07-05T23:32:48.990 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.983+0000 7f7fc49ef700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7fc00ccf90 0x7f7fc0159c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:48.991 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.983+0000 7f7fc49ef700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7fc00ccf90 0x7f7fc0159c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44528/0 (socket says 172.21.15.27:44528) 2023-07-05T23:32:48.991 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.983+0000 7f7fc49ef700 1 -- 172.21.15.27:0/2703547695 learned_addr learned my addr 172.21.15.27:0/2703547695 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:32:48.991 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.984+0000 7f7fbffff700 1 --2- 172.21.15.27:0/2703547695 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7fc0158850 0x7f7fc0154730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:48.991 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.984+0000 7f7fc51f0700 1 --2- 172.21.15.27:0/2703547695 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fc015c720 0x7f7fc00aa160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:48.991 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.984+0000 7f7fc49ef700 1 -- 172.21.15.27:0/2703547695 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7fc0158850 msgr2=0x7f7fc0154730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:48.991 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.984+0000 7f7fc49ef700 1 --2- 172.21.15.27:0/2703547695 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7fc0158850 0x7f7fc0154730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:48.991 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.984+0000 7f7fc49ef700 1 -- 172.21.15.27:0/2703547695 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fc015c720 msgr2=0x7f7fc00aa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:48.992 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.984+0000 7f7fc49ef700 1 --2- 172.21.15.27:0/2703547695 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fc015c720 0x7f7fc00aa160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:48.992 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.984+0000 7f7fc49ef700 1 -- 172.21.15.27:0/2703547695 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb400b7f0 con 0x7f7fc00ccf90 2023-07-05T23:32:48.992 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.984+0000 7f7fc51f0700 1 --2- 172.21.15.27:0/2703547695 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fc015c720 0x7f7fc00aa160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T23:32:48.992 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.984+0000 7f7fc49ef700 1 --2- 172.21.15.27:0/2703547695 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7fc00ccf90 0x7f7fc0159c70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4000c00 tx=0x7f7fb4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:48.992 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.984+0000 7f7fbd7fa700 1 -- 172.21.15.27:0/2703547695 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb4003e90 con 0x7f7fc00ccf90 2023-07-05T23:32:48.992 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.984+0000 7f7fbd7fa700 1 -- 172.21.15.27:0/2703547695 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fb4010470 con 0x7f7fc00ccf90 2023-07-05T23:32:48.992 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.984+0000 7f7fc6c53700 1 -- 172.21.15.27:0/2703547695 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fc015a650 con 0x7f7fc00ccf90 2023-07-05T23:32:48.993 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.984+0000 7f7fbd7fa700 1 -- 172.21.15.27:0/2703547695 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb4010820 con 0x7f7fc00ccf90 2023-07-05T23:32:48.993 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.984+0000 7f7fc6c53700 1 -- 172.21.15.27:0/2703547695 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fc015ac10 con 0x7f7fc00ccf90 2023-07-05T23:32:48.993 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.985+0000 7f7fc6c53700 1 -- 172.21.15.27:0/2703547695 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fc0073910 con 0x7f7fc00ccf90 2023-07-05T23:32:48.993 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.986+0000 7f7fbd7fa700 1 -- 172.21.15.27:0/2703547695 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7fb4019400 con 0x7f7fc00ccf90 2023-07-05T23:32:48.993 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.986+0000 7f7fbd7fa700 1 --2- 172.21.15.27:0/2703547695 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f7fa406ace0 0x7f7fa406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:48.993 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.986+0000 7f7fbd7fa700 1 -- 172.21.15.27:0/2703547695 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7fb408a6d0 con 0x7f7fc00ccf90 2023-07-05T23:32:48.993 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.986+0000 7f7fbffff700 1 --2- 172.21.15.27:0/2703547695 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f7fa406ace0 0x7f7fa406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:48.994 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.987+0000 7f7fbffff700 1 --2- 172.21.15.27:0/2703547695 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f7fa406ace0 0x7f7fa406d190 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0070fe0 tx=0x7f7fac008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:48.994 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:48.990+0000 7f7fbd7fa700 1 -- 172.21.15.27:0/2703547695 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7fb4055b60 con 0x7f7fc00ccf90 2023-07-05T23:32:49.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.233+0000 7f7fc6c53700 1 -- 172.21.15.27:0/2703547695 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7fc00cd480 con 0x7f7fc00ccf90 2023-07-05T23:32:49.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.234+0000 7f7fbd7fa700 1 -- 172.21.15.27:0/2703547695 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3527 (secure 0 0 0) 0x7f7fb4059180 con 0x7f7fc00ccf90 2023-07-05T23:32:49.237 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:32:49.237 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/4263442347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":4263442347},{"type":"v1","addr":"172.21.15.162:6837","nonce":4263442347}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/2486008632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2486008632},{"type":"v1","addr":"172.21.15.162:6836","nonce":2486008632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/217781445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":217781445},{"type":"v1","addr":"172.21.15.27:6834","nonce":217781445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/3387103520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":3387103520},{"type":"v1","addr":"172.21.15.27:6835","nonce":3387103520}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-07-05T23:32:49.239 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.235+0000 7f7fc6c53700 1 -- 172.21.15.27:0/2703547695 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f7fa406ace0 msgr2=0x7f7fa406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:49.239 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.235+0000 7f7fc6c53700 1 --2- 172.21.15.27:0/2703547695 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f7fa406ace0 0x7f7fa406d190 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0070fe0 tx=0x7f7fac008040 comp rx=0 tx=0).stop 2023-07-05T23:32:49.239 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.236+0000 7f7fc6c53700 1 -- 172.21.15.27:0/2703547695 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7fc00ccf90 msgr2=0x7f7fc0159c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:49.240 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.236+0000 7f7fc6c53700 1 --2- 172.21.15.27:0/2703547695 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7fc00ccf90 0x7f7fc0159c70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4000c00 tx=0x7f7fb4004750 comp rx=0 tx=0).stop 2023-07-05T23:32:49.240 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.236+0000 7f7fc6c53700 1 -- 172.21.15.27:0/2703547695 shutdown_connections 2023-07-05T23:32:49.240 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.236+0000 7f7fc6c53700 1 --2- 172.21.15.27:0/2703547695 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fc015c720 0x7f7fc00aa160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:49.241 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.236+0000 7f7fc6c53700 1 --2- 172.21.15.27:0/2703547695 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f7fa406ace0 0x7f7fa406d190 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:49.241 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.236+0000 7f7fc6c53700 1 --2- 172.21.15.27:0/2703547695 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7fc00ccf90 0x7f7fc0159c70 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:49.242 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.236+0000 7f7fc6c53700 1 --2- 172.21.15.27:0/2703547695 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7fc0158850 0x7f7fc0154730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:49.242 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.236+0000 7f7fc6c53700 1 -- 172.21.15.27:0/2703547695 >> 172.21.15.27:0/2703547695 conn(0x7f7fc00b1740 msgr2=0x7f7fc00b00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:32:49.242 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.236+0000 7f7fc6c53700 1 -- 172.21.15.27:0/2703547695 shutdown_connections 2023-07-05T23:32:49.242 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.236+0000 7f7fc6c53700 1 -- 172.21.15.27:0/2703547695 wait complete. 2023-07-05T23:32:49.243 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 3 2023-07-05T23:32:49.250 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-05T23:32:49.374 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.372+0000 7f2c0c3c8700 1 Processor -- start 2023-07-05T23:32:49.374 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.372+0000 7f2c0c3c8700 1 -- start start 2023-07-05T23:32:49.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.373+0000 7f2c0c3c8700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2c040ae6c0 0x7f2c0415a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:49.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.373+0000 7f2c0c3c8700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2c040aec10 0x7f2c040714a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:49.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.373+0000 7f2c0c3c8700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c040af090 con 0x7f2c040cddd0 2023-07-05T23:32:49.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.373+0000 7f2c0c3c8700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c040cdc80 con 0x7f2c040ae6c0 2023-07-05T23:32:49.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.373+0000 7f2c0c3c8700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c0415d6a0 con 0x7f2c040aec10 2023-07-05T23:32:49.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.373+0000 7f2c09963700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2c040ae6c0 0x7f2c0415a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:49.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.373+0000 7f2c09963700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2c040ae6c0 0x7f2c0415a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44538/0 (socket says 172.21.15.27:44538) 2023-07-05T23:32:49.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.373+0000 7f2c09963700 1 -- 172.21.15.27:0/247798597 learned_addr learned my addr 172.21.15.27:0/247798597 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:32:49.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.373+0000 7f2c0a965700 1 --2- 172.21.15.27:0/247798597 >> v2:172.21.15.162:3300/0 conn(0x7f2c040aec10 0x7f2c040714a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:49.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.373+0000 7f2c09963700 1 -- 172.21.15.27:0/247798597 >> v2:172.21.15.162:3300/0 conn(0x7f2c040aec10 msgr2=0x7f2c040714a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:32:49.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.373+0000 7f2c09963700 1 --2- 172.21.15.27:0/247798597 >> v2:172.21.15.162:3300/0 conn(0x7f2c040aec10 0x7f2c040714a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:49.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.373+0000 7f2c09963700 1 -- 172.21.15.27:0/247798597 >> v1:172.21.15.162:6789/0 conn(0x7f2c040cddd0 legacy=0x7f2c040ce1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:49.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.373+0000 7f2c09963700 1 -- 172.21.15.27:0/247798597 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c04159700 con 0x7f2c040ae6c0 2023-07-05T23:32:49.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.374+0000 7f2c09963700 1 --2- 172.21.15.27:0/247798597 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2c040ae6c0 0x7f2c0415a1e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2c040c3290 tx=0x7f2c0000be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b4aa22d349097b6 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:49.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.374+0000 7f2c09162700 1 -- 172.21.15.27:0/247798597 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0000dd30 con 0x7f2c040ae6c0 2023-07-05T23:32:49.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.374+0000 7f2c09162700 1 -- 172.21.15.27:0/247798597 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c0000de90 con 0x7f2c040ae6c0 2023-07-05T23:32:49.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.374+0000 7f2c09162700 1 -- 172.21.15.27:0/247798597 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c00010690 con 0x7f2c040ae6c0 2023-07-05T23:32:49.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.374+0000 7f2c0c3c8700 1 -- 172.21.15.27:0/247798597 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2c040ae6c0 msgr2=0x7f2c0415a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:49.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.374+0000 7f2c0c3c8700 1 --2- 172.21.15.27:0/247798597 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2c040ae6c0 0x7f2c0415a1e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2c040c3290 tx=0x7f2c0000be70 comp rx=0 tx=0).stop 2023-07-05T23:32:49.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.374+0000 7f2c0c3c8700 1 -- 172.21.15.27:0/247798597 shutdown_connections 2023-07-05T23:32:49.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.374+0000 7f2c0c3c8700 1 --2- 172.21.15.27:0/247798597 >> v2:172.21.15.162:3300/0 conn(0x7f2c040aec10 0x7f2c040714a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:49.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.374+0000 7f2c0c3c8700 1 --2- 172.21.15.27:0/247798597 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2c040ae6c0 0x7f2c0415a1e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:49.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.374+0000 7f2c0c3c8700 1 -- 172.21.15.27:0/247798597 >> 172.21.15.27:0/247798597 conn(0x7f2c0406d4a0 msgr2=0x7f2c0406d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:32:49.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.374+0000 7f2c0c3c8700 1 -- 172.21.15.27:0/247798597 shutdown_connections 2023-07-05T23:32:49.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.374+0000 7f2c0c3c8700 1 -- 172.21.15.27:0/247798597 wait complete. 2023-07-05T23:32:49.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.376+0000 7f2c0c3c8700 1 Processor -- start 2023-07-05T23:32:49.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.376+0000 7f2c0c3c8700 1 -- start start 2023-07-05T23:32:49.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.376+0000 7f2c0c3c8700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c040ae6c0 0x7f2c040b50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:49.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.376+0000 7f2c0c3c8700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c040aec10 0x7f2c04147ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:49.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.376+0000 7f2c0c3c8700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2c040cddd0 0x7f2c040cbd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:49.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.376+0000 7f2c0c3c8700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c04147ff0 con 0x7f2c040cddd0 2023-07-05T23:32:49.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.376+0000 7f2c0c3c8700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c040cb900 con 0x7f2c040aec10 2023-07-05T23:32:49.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.376+0000 7f2c0c3c8700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c040cacf0 con 0x7f2c040ae6c0 2023-07-05T23:32:49.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.377+0000 7f2c0a965700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2c040cddd0 0x7f2c040cbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:49.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.377+0000 7f2c0a965700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2c040cddd0 0x7f2c040cbd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44546/0 (socket says 172.21.15.27:44546) 2023-07-05T23:32:49.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.377+0000 7f2c0a965700 1 -- 172.21.15.27:0/913827763 learned_addr learned my addr 172.21.15.27:0/913827763 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:32:49.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.377+0000 7f2c0a164700 1 --2- 172.21.15.27:0/913827763 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c040ae6c0 0x7f2c040b50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:49.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.377+0000 7f2c0a965700 1 -- 172.21.15.27:0/913827763 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c040ae6c0 msgr2=0x7f2c040b50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:49.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.377+0000 7f2c0a965700 1 --2- 172.21.15.27:0/913827763 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c040ae6c0 0x7f2c040b50c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:49.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.377+0000 7f2c0a965700 1 -- 172.21.15.27:0/913827763 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c040aec10 msgr2=0x7f2c04147ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:49.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.377+0000 7f2c0a965700 1 --2- 172.21.15.27:0/913827763 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c040aec10 0x7f2c04147ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:49.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.377+0000 7f2c0a965700 1 -- 172.21.15.27:0/913827763 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c0000b7f0 con 0x7f2c040cddd0 2023-07-05T23:32:49.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.377+0000 7f2c0a965700 1 --2- 172.21.15.27:0/913827763 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2c040cddd0 0x7f2c040cbd90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc007e60 tx=0x7f2bfc00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:49.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.377+0000 7f2bfaffd700 1 -- 172.21.15.27:0/913827763 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bfc00ede0 con 0x7f2c040cddd0 2023-07-05T23:32:49.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.377+0000 7f2bfaffd700 1 -- 172.21.15.27:0/913827763 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bfc014420 con 0x7f2c040cddd0 2023-07-05T23:32:49.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.377+0000 7f2c0c3c8700 1 -- 172.21.15.27:0/913827763 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c040cafd0 con 0x7f2c040cddd0 2023-07-05T23:32:49.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.377+0000 7f2bfaffd700 1 -- 172.21.15.27:0/913827763 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bfc0147d0 con 0x7f2c040cddd0 2023-07-05T23:32:49.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.377+0000 7f2c0c3c8700 1 -- 172.21.15.27:0/913827763 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c040cb590 con 0x7f2c040cddd0 2023-07-05T23:32:49.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.378+0000 7f2c0c3c8700 1 -- 172.21.15.27:0/913827763 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c0406f120 con 0x7f2c040cddd0 2023-07-05T23:32:49.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.379+0000 7f2bfaffd700 1 -- 172.21.15.27:0/913827763 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2bfc014930 con 0x7f2c040cddd0 2023-07-05T23:32:49.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.379+0000 7f2bfaffd700 1 --2- 172.21.15.27:0/913827763 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f2be806ace0 0x7f2be806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:49.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.379+0000 7f2bfaffd700 1 -- 172.21.15.27:0/913827763 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f2bfc089920 con 0x7f2c040cddd0 2023-07-05T23:32:49.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.379+0000 7f2c0a164700 1 --2- 172.21.15.27:0/913827763 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f2be806ace0 0x7f2be806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:49.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.379+0000 7f2c0a164700 1 --2- 172.21.15.27:0/913827763 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f2be806ace0 0x7f2be806d190 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4000f60 tx=0x7f2bf4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:49.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.383+0000 7f2bfaffd700 1 -- 172.21.15.27:0/913827763 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2bfc054dd0 con 0x7f2c040cddd0 2023-07-05T23:32:49.584 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.582+0000 7f2c0c3c8700 1 -- 172.21.15.27:0/913827763 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2c040ccc40 con 0x7f2c040cddd0 2023-07-05T23:32:49.584 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.583+0000 7f2bfaffd700 1 -- 172.21.15.27:0/913827763 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+14636 (secure 0 0 0) 0x7f2bfc0583f0 con 0x7f2c040cddd0 2023-07-05T23:32:49.585 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:32:49.585 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":20,"fsid":"23eebe48-65f5-4d3c-8c2d-4aa171c055d5","created":"2023-07-05T23:32:27.989612+0000","modified":"2023-07-05T23:32:48.761739+0000","last_up_change":"2023-07-05T23:32:39.601570+0000","last_in_change":"2023-07-05T23:32:30.488261+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-05T23:32:41.624598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-05T23:32:46.481587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ac2071e4-394b-4385-b9ba-fad5265efc65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6814","nonce":3766536605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6818","nonce":3766536605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6823","nonce":3766536605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6821","nonce":3766536605}]},"public_addr":"172.21.15.27:6814/3766536605","cluster_addr":"172.21.15.27:6818/3766536605","heartbeat_back_addr":"172.21.15.27:6823/3766536605","heartbeat_front_addr":"172.21.15.27:6821/3766536605","state":["exists","up"]},{"osd":1,"uuid":"8c9b61a0-39d5-46bf-afd6-5add78453ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6801","nonce":1579117455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6803","nonce":1579117455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6807","nonce":1579117455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6805","nonce":1579117455}]},"public_addr":"172.21.15.27:6801/1579117455","cluster_addr":"172.21.15.27:6803/1579117455","heartbeat_back_addr":"172.21.15.27:6807/1579117455","heartbeat_front_addr":"172.21.15.27:6805/1579117455","state":["exists","up"]},{"osd":2,"uuid":"dcd032a2-06b1-4055-b798-b86c71a7107d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6825","nonce":807520271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6827","nonce":807520271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6831","nonce":807520271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6829","nonce":807520271}]},"public_addr":"172.21.15.27:6825/807520271","cluster_addr":"172.21.15.27:6827/807520271","heartbeat_back_addr":"172.21.15.27:6831/807520271","heartbeat_front_addr":"172.21.15.27:6829/807520271","state":["exists","up"]},{"osd":3,"uuid":"b0ffe0fc-47ba-4636-b5ea-6bab637642c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6809","nonce":2125656143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6811","nonce":2125656143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6817","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6819","nonce":2125656143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6813","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6815","nonce":2125656143}]},"public_addr":"172.21.15.27:6809/2125656143","cluster_addr":"172.21.15.27:6811/2125656143","heartbeat_back_addr":"172.21.15.27:6819/2125656143","heartbeat_front_addr":"172.21.15.27:6815/2125656143","state":["exists","up"]},{"osd":4,"uuid":"7fab4e5a-1246-4efe-9562-10c4a6c789ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6801","nonce":2111223016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6803","nonce":2111223016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6807","nonce":2111223016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6805","nonce":2111223016}]},"public_addr":"172.21.15.162:6801/2111223016","cluster_addr":"172.21.15.162:6803/2111223016","heartbeat_back_addr":"172.21.15.162:6807/2111223016","heartbeat_front_addr":"172.21.15.162:6805/2111223016","state":["exists","up"]},{"osd":5,"uuid":"110c4d9f-cef6-48ab-a818-5a81e72372af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6825","nonce":3102609008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6827","nonce":3102609008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6831","nonce":3102609008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6829","nonce":3102609008}]},"public_addr":"172.21.15.162:6825/3102609008","cluster_addr":"172.21.15.162:6827/3102609008","heartbeat_back_addr":"172.21.15.162:6831/3102609008","heartbeat_front_addr":"172.21.15.162:6829/3102609008","state":["exists","up"]},{"osd":6,"uuid":"16803bcc-2c92-4aed-954e-487938c9f24a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6809","nonce":2657688865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6811","nonce":2657688865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6815","nonce":2657688865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6813","nonce":2657688865}]},"public_addr":"172.21.15.162:6809/2657688865","cluster_addr":"172.21.15.162:6811/2657688865","heartbeat_back_addr":"172.21.15.162:6815/2657688865","heartbeat_front_addr":"172.21.15.162:6813/2657688865","state":["exists","up"]},{"osd":7,"uuid":"b7c35377-3cf2-4569-b6b9-72376eb463bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6817","nonce":2096609978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6819","nonce":2096609978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6823","nonce":2096609978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6821","nonce":2096609978}]},"public_addr":"172.21.15.162:6817/2096609978","cluster_addr":"172.21.15.162:6819/2096609978","heartbeat_back_addr":"172.21.15.162:6823/2096609978","heartbeat_front_addr":"172.21.15.162:6821/2096609978","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.735448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.645561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.759120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.682507+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.736228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.694664+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.716002+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.680485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-05T23:32:49.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.585+0000 7f2c0c3c8700 1 -- 172.21.15.27:0/913827763 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f2be806ace0 msgr2=0x7f2be806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:49.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.585+0000 7f2c0c3c8700 1 --2- 172.21.15.27:0/913827763 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f2be806ace0 0x7f2be806d190 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4000f60 tx=0x7f2bf4009040 comp rx=0 tx=0).stop 2023-07-05T23:32:49.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.585+0000 7f2c0c3c8700 1 -- 172.21.15.27:0/913827763 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2c040cddd0 msgr2=0x7f2c040cbd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:49.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.585+0000 7f2c0c3c8700 1 --2- 172.21.15.27:0/913827763 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2c040cddd0 0x7f2c040cbd90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc007e60 tx=0x7f2bfc00e3c0 comp rx=0 tx=0).stop 2023-07-05T23:32:49.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.585+0000 7f2c0c3c8700 1 -- 172.21.15.27:0/913827763 shutdown_connections 2023-07-05T23:32:49.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.585+0000 7f2c0c3c8700 1 --2- 172.21.15.27:0/913827763 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f2be806ace0 0x7f2be806d190 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:49.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.585+0000 7f2c0c3c8700 1 --2- 172.21.15.27:0/913827763 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2c040cddd0 0x7f2c040cbd90 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:49.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.585+0000 7f2c0c3c8700 1 --2- 172.21.15.27:0/913827763 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c040ae6c0 0x7f2c040b50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:49.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.585+0000 7f2c0c3c8700 1 --2- 172.21.15.27:0/913827763 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c040aec10 0x7f2c04147ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:49.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.585+0000 7f2c0c3c8700 1 -- 172.21.15.27:0/913827763 >> 172.21.15.27:0/913827763 conn(0x7f2c0406d4a0 msgr2=0x7f2c04156f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:32:49.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.585+0000 7f2c0c3c8700 1 -- 172.21.15.27:0/913827763 shutdown_connections 2023-07-05T23:32:49.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.585+0000 7f2c0c3c8700 1 -- 172.21.15.27:0/913827763 wait complete. 2023-07-05T23:32:49.599 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-05T23:32:41.624598+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-05T23:32:46.481587+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-05T23:32:49.600 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-05T23:32:49.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.726+0000 7f34ed5a9700 1 Processor -- start 2023-07-05T23:32:49.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.726+0000 7f34ed5a9700 1 -- start start 2023-07-05T23:32:49.729 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.727+0000 7f34ed5a9700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f34e815fc60 0x7f34e806a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:49.729 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.727+0000 7f34ed5a9700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34e80aecc0 0x7f34e80ac600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:49.730 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.727+0000 7f34ed5a9700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34e80ce620 con 0x7f34e806e260 2023-07-05T23:32:49.730 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.727+0000 7f34ed5a9700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34e8160580 con 0x7f34e815fc60 2023-07-05T23:32:49.730 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.727+0000 7f34ed5a9700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34e8160860 con 0x7f34e80aecc0 2023-07-05T23:32:49.730 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.728+0000 7f34e67fc700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34e80aecc0 0x7f34e80ac600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:49.730 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.728+0000 7f34e67fc700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34e80aecc0 0x7f34e80ac600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.27:44586/0 (socket says 172.21.15.27:44586) 2023-07-05T23:32:49.730 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.728+0000 7f34e67fc700 1 -- 172.21.15.27:0/1781217579 learned_addr learned my addr 172.21.15.27:0/1781217579 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:32:49.730 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.728+0000 7f34e6ffd700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f34e815fc60 0x7f34e806a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:49.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.728+0000 7f34e5ffb700 1 -- 172.21.15.27:0/1781217579 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2817334864 0 0) 0x7f34e80ce620 con 0x7f34e806e260 2023-07-05T23:32:49.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.728+0000 7f34e67fc700 1 -- 172.21.15.27:0/1781217579 >> v2:172.21.15.162:3300/0 conn(0x7f34e815fc60 msgr2=0x7f34e806a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:32:49.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.728+0000 7f34e67fc700 1 --2- 172.21.15.27:0/1781217579 >> v2:172.21.15.162:3300/0 conn(0x7f34e815fc60 0x7f34e806a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:49.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.728+0000 7f34e67fc700 1 -- 172.21.15.27:0/1781217579 >> v1:172.21.15.162:6789/0 conn(0x7f34e806e260 legacy=0x7f34e80cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:49.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.728+0000 7f34e67fc700 1 -- 172.21.15.27:0/1781217579 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e8160b40 con 0x7f34e80aecc0 2023-07-05T23:32:49.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.728+0000 7f34e67fc700 1 --2- 172.21.15.27:0/1781217579 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34e80aecc0 0x7f34e80ac600 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f34d80098f0 tx=0x7f34d8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=140377de0f57965a server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:49.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.728+0000 7f34e5ffb700 1 -- 172.21.15.27:0/1781217579 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d8011830 con 0x7f34e80aecc0 2023-07-05T23:32:49.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.728+0000 7f34e5ffb700 1 -- 172.21.15.27:0/1781217579 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34d8011990 con 0x7f34e80aecc0 2023-07-05T23:32:49.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.728+0000 7f34e5ffb700 1 -- 172.21.15.27:0/1781217579 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d8011d20 con 0x7f34e80aecc0 2023-07-05T23:32:49.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.729+0000 7f34ed5a9700 1 -- 172.21.15.27:0/1781217579 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34e80aecc0 msgr2=0x7f34e80ac600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:49.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.729+0000 7f34ed5a9700 1 --2- 172.21.15.27:0/1781217579 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34e80aecc0 0x7f34e80ac600 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f34d80098f0 tx=0x7f34d8009c00 comp rx=0 tx=0).stop 2023-07-05T23:32:49.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.729+0000 7f34ed5a9700 1 -- 172.21.15.27:0/1781217579 shutdown_connections 2023-07-05T23:32:49.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.729+0000 7f34ed5a9700 1 --2- 172.21.15.27:0/1781217579 >> v2:172.21.15.162:3300/0 conn(0x7f34e815fc60 0x7f34e806a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:49.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.729+0000 7f34ed5a9700 1 --2- 172.21.15.27:0/1781217579 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34e80aecc0 0x7f34e80ac600 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:49.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.729+0000 7f34ed5a9700 1 -- 172.21.15.27:0/1781217579 >> 172.21.15.27:0/1781217579 conn(0x7f34e806b920 msgr2=0x7f34e80cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:32:49.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.729+0000 7f34ed5a9700 1 -- 172.21.15.27:0/1781217579 shutdown_connections 2023-07-05T23:32:49.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.729+0000 7f34ed5a9700 1 -- 172.21.15.27:0/1781217579 wait complete. 2023-07-05T23:32:49.736 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.730+0000 7f34ed5a9700 1 Processor -- start 2023-07-05T23:32:49.736 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.730+0000 7f34ed5a9700 1 -- start start 2023-07-05T23:32:49.736 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.731+0000 7f34ed5a9700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34e806e260 0x7f34e80ca040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:49.737 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.731+0000 7f34ed5a9700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f34e80aecc0 0x7f34e8153300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:49.737 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.731+0000 7f34ed5a9700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34e815fc60 0x7f34e80c4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:49.737 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.731+0000 7f34ed5a9700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e80c3ef0 con 0x7f34e80aecc0 2023-07-05T23:32:49.737 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.731+0000 7f34ed5a9700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e80ca580 con 0x7f34e806e260 2023-07-05T23:32:49.737 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.731+0000 7f34ed5a9700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34e80c35c0 con 0x7f34e815fc60 2023-07-05T23:32:49.737 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.731+0000 7f34e67fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f34e80aecc0 0x7f34e8153300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:49.737 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.731+0000 7f34e67fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f34e80aecc0 0x7f34e8153300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44558/0 (socket says 172.21.15.27:44558) 2023-07-05T23:32:49.738 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.731+0000 7f34e67fc700 1 -- 172.21.15.27:0/138408807 learned_addr learned my addr 172.21.15.27:0/138408807 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:32:49.738 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.731+0000 7f34e77fe700 1 --2- 172.21.15.27:0/138408807 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34e815fc60 0x7f34e80c4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:49.738 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.731+0000 7f34e6ffd700 1 --2- 172.21.15.27:0/138408807 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34e806e260 0x7f34e80ca040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:49.738 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.732+0000 7f34e67fc700 1 -- 172.21.15.27:0/138408807 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34e815fc60 msgr2=0x7f34e80c4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:49.738 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.732+0000 7f34e67fc700 1 --2- 172.21.15.27:0/138408807 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34e815fc60 0x7f34e80c4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:49.738 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.732+0000 7f34e67fc700 1 -- 172.21.15.27:0/138408807 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34e806e260 msgr2=0x7f34e80ca040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:49.738 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.732+0000 7f34e67fc700 1 --2- 172.21.15.27:0/138408807 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34e806e260 0x7f34e80ca040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:49.739 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.732+0000 7f34e67fc700 1 -- 172.21.15.27:0/138408807 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34d8009550 con 0x7f34e80aecc0 2023-07-05T23:32:49.739 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.732+0000 7f34e67fc700 1 --2- 172.21.15.27:0/138408807 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f34e80aecc0 0x7f34e8153300 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f34d8009c40 tx=0x7f34d8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:49.739 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.732+0000 7f34df7fe700 1 -- 172.21.15.27:0/138408807 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d8004550 con 0x7f34e80aecc0 2023-07-05T23:32:49.739 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.732+0000 7f34df7fe700 1 -- 172.21.15.27:0/138408807 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34d801f070 con 0x7f34e80aecc0 2023-07-05T23:32:49.739 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.732+0000 7f34ed5a9700 1 -- 172.21.15.27:0/138408807 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34e80c38a0 con 0x7f34e80aecc0 2023-07-05T23:32:49.739 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.732+0000 7f34df7fe700 1 -- 172.21.15.27:0/138408807 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d80038e0 con 0x7f34e80aecc0 2023-07-05T23:32:49.739 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.732+0000 7f34ed5a9700 1 -- 172.21.15.27:0/138408807 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34e8153840 con 0x7f34e80aecc0 2023-07-05T23:32:49.739 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.733+0000 7f34ed5a9700 1 -- 172.21.15.27:0/138408807 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34e80c4060 con 0x7f34e80aecc0 2023-07-05T23:32:49.740 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.734+0000 7f34df7fe700 1 -- 172.21.15.27:0/138408807 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f34d8003a40 con 0x7f34e80aecc0 2023-07-05T23:32:49.740 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.734+0000 7f34df7fe700 1 --2- 172.21.15.27:0/138408807 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f34c806ace0 0x7f34c806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:49.740 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.734+0000 7f34df7fe700 1 -- 172.21.15.27:0/138408807 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f34d8021070 con 0x7f34e80aecc0 2023-07-05T23:32:49.740 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.734+0000 7f34e6ffd700 1 --2- 172.21.15.27:0/138408807 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f34c806ace0 0x7f34c806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:49.740 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.735+0000 7f34e6ffd700 1 --2- 172.21.15.27:0/138408807 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f34c806ace0 0x7f34c806d190 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f34d0009b20 tx=0x7f34d00091c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:49.741 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.738+0000 7f34df7fe700 1 -- 172.21.15.27:0/138408807 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f34d8056270 con 0x7f34e80aecc0 2023-07-05T23:32:49.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.934+0000 7f34ed5a9700 1 -- 172.21.15.27:0/138408807 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f34e804ea20 con 0x7f34e80aecc0 2023-07-05T23:32:49.937 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.935+0000 7f34df7fe700 1 -- 172.21.15.27:0/138408807 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f34d8015020 con 0x7f34e80aecc0 2023-07-05T23:32:49.937 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2023-07-05T23:32:49.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.937+0000 7f34ed5a9700 1 -- 172.21.15.27:0/138408807 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f34c806ace0 msgr2=0x7f34c806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:49.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.937+0000 7f34ed5a9700 1 --2- 172.21.15.27:0/138408807 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f34c806ace0 0x7f34c806d190 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f34d0009b20 tx=0x7f34d00091c0 comp rx=0 tx=0).stop 2023-07-05T23:32:49.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.937+0000 7f34ed5a9700 1 -- 172.21.15.27:0/138408807 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f34e80aecc0 msgr2=0x7f34e8153300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:49.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.937+0000 7f34ed5a9700 1 --2- 172.21.15.27:0/138408807 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f34e80aecc0 0x7f34e8153300 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f34d8009c40 tx=0x7f34d8004750 comp rx=0 tx=0).stop 2023-07-05T23:32:49.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.937+0000 7f34ed5a9700 1 -- 172.21.15.27:0/138408807 shutdown_connections 2023-07-05T23:32:49.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.937+0000 7f34ed5a9700 1 --2- 172.21.15.27:0/138408807 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34e806e260 0x7f34e80ca040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:49.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.937+0000 7f34ed5a9700 1 --2- 172.21.15.27:0/138408807 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f34c806ace0 0x7f34c806d190 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:49.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.937+0000 7f34ed5a9700 1 --2- 172.21.15.27:0/138408807 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34e815fc60 0x7f34e80c4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:49.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.937+0000 7f34ed5a9700 1 --2- 172.21.15.27:0/138408807 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f34e80aecc0 0x7f34e8153300 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:49.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.937+0000 7f34ed5a9700 1 -- 172.21.15.27:0/138408807 >> 172.21.15.27:0/138408807 conn(0x7f34e806b920 msgr2=0x7f34e80afcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:32:49.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.937+0000 7f34ed5a9700 1 -- 172.21.15.27:0/138408807 shutdown_connections 2023-07-05T23:32:49.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:49.937+0000 7f34ed5a9700 1 -- 172.21.15.27:0/138408807 wait complete. 2023-07-05T23:32:49.951 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-05T23:32:50.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.077+0000 7f61eb1a2700 1 Processor -- start 2023-07-05T23:32:50.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.077+0000 7f61eb1a2700 1 -- start start 2023-07-05T23:32:50.082 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.078+0000 7f61eb1a2700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f61e40aecc0 0x7f61e406a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:50.082 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.078+0000 7f61eb1a2700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61e40ce620 con 0x7f61e406e970 2023-07-05T23:32:50.082 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.078+0000 7f61eb1a2700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61e4160580 con 0x7f61e415fc60 2023-07-05T23:32:50.082 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.078+0000 7f61eb1a2700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61e4160860 con 0x7f61e40aecc0 2023-07-05T23:32:50.082 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.078+0000 7f61e973f700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f61e406e970 0x7f61e40cea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:51734/0 (socket says 172.21.15.27:51734) 2023-07-05T23:32:50.082 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.078+0000 7f61e973f700 1 -- 172.21.15.27:0/4231543918 learned_addr learned my addr 172.21.15.27:0/4231543918 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-07-05T23:32:50.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.078+0000 7f61e3fff700 1 --2- 172.21.15.27:0/4231543918 >> v2:172.21.15.162:3300/0 conn(0x7f61e40aecc0 0x7f61e406a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:50.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.078+0000 7f61e37fe700 1 -- 172.21.15.27:0/4231543918 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3455607141 0 0) 0x7f61e40ce620 con 0x7f61e406e970 2023-07-05T23:32:50.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.078+0000 7f61e37fe700 1 -- 172.21.15.27:0/4231543918 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61d40035b0 con 0x7f61e406e970 2023-07-05T23:32:50.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.079+0000 7f61e37fe700 1 -- 172.21.15.27:0/4231543918 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2294700265 0 0) 0x7f61d40035b0 con 0x7f61e406e970 2023-07-05T23:32:50.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.079+0000 7f61e37fe700 1 -- 172.21.15.27:0/4231543918 >> v2:172.21.15.162:3300/0 conn(0x7f61e40aecc0 msgr2=0x7f61e406a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:32:50.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.079+0000 7f61e37fe700 1 --2- 172.21.15.27:0/4231543918 >> v2:172.21.15.162:3300/0 conn(0x7f61e40aecc0 0x7f61e406a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:50.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.079+0000 7f61e37fe700 1 -- 172.21.15.27:0/4231543918 >> v1:172.21.15.162:6789/0 conn(0x7f61e415fc60 legacy=0x7f61e406e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:50.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.079+0000 7f61e37fe700 1 -- 172.21.15.27:0/4231543918 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e4160b40 con 0x7f61e406e970 2023-07-05T23:32:50.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.079+0000 7f61e37fe700 1 -- 172.21.15.27:0/4231543918 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1246168953 0 0) 0x7f61dc0019f0 con 0x7f61e406e970 2023-07-05T23:32:50.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.079+0000 7f61e37fe700 1 -- 172.21.15.27:0/4231543918 >> v1:172.21.15.27:6789/0 conn(0x7f61e406e970 legacy=0x7f61e40cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:50.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.079+0000 7f61e37fe700 1 --2- 172.21.15.27:0/4231543918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61d4003a00 0x7f61d4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:50.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.079+0000 7f61e37fe700 1 --2- 172.21.15.27:0/4231543918 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61d4004850 0x7f61d4004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:50.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.079+0000 7f61e37fe700 1 --2- 172.21.15.27:0/4231543918 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f61d4005200 0x7f61d400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:50.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.079+0000 7f61e37fe700 1 -- 172.21.15.27:0/4231543918 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e4160860 con 0x7f61d4005200 2023-07-05T23:32:50.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.079+0000 7f61e37fe700 1 -- 172.21.15.27:0/4231543918 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d400c080 con 0x7f61d4003a00 2023-07-05T23:32:50.085 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.079+0000 7f61e37fe700 1 -- 172.21.15.27:0/4231543918 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61d400c240 con 0x7f61d4004850 2023-07-05T23:32:50.085 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.079+0000 7f61e973f700 1 --2- 172.21.15.27:0/4231543918 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f61d4005200 0x7f61d400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:50.085 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.079+0000 7f61e8f3e700 1 --2- 172.21.15.27:0/4231543918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61d4003a00 0x7f61d4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:50.085 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.079+0000 7f61e3fff700 1 --2- 172.21.15.27:0/4231543918 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61d4004850 0x7f61d4004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:50.085 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.079+0000 7f61e973f700 1 -- 172.21.15.27:0/4231543918 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61d4004850 msgr2=0x7f61d4004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:32:50.085 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.079+0000 7f61e973f700 1 --2- 172.21.15.27:0/4231543918 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61d4004850 0x7f61d4004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:50.085 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.079+0000 7f61e973f700 1 -- 172.21.15.27:0/4231543918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61d4003a00 msgr2=0x7f61d4003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:32:50.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.079+0000 7f61e973f700 1 --2- 172.21.15.27:0/4231543918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61d4003a00 0x7f61d4003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:50.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.079+0000 7f61e973f700 1 -- 172.21.15.27:0/4231543918 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d40035b0 con 0x7f61d4005200 2023-07-05T23:32:50.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.079+0000 7f61e973f700 1 -- 172.21.15.27:0/4231543918 reap_dead start 2023-07-05T23:32:50.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.079+0000 7f61e973f700 1 --2- 172.21.15.27:0/4231543918 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f61d4005200 0x7f61d400ba10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f61dc00a800 tx=0x7f61d4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b756993a4f7af03 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:50.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.079+0000 7f61e37fe700 1 -- 172.21.15.27:0/4231543918 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61dc00a2f0 con 0x7f61d4005200 2023-07-05T23:32:50.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.079+0000 7f61e37fe700 1 -- 172.21.15.27:0/4231543918 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61dc012620 con 0x7f61d4005200 2023-07-05T23:32:50.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.079+0000 7f61e37fe700 1 -- 172.21.15.27:0/4231543918 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61dc0129d0 con 0x7f61d4005200 2023-07-05T23:32:50.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.080+0000 7f61eb1a2700 1 -- 172.21.15.27:0/4231543918 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f61d4005200 msgr2=0x7f61d400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:50.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.080+0000 7f61eb1a2700 1 --2- 172.21.15.27:0/4231543918 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f61d4005200 0x7f61d400ba10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f61dc00a800 tx=0x7f61d4005880 comp rx=0 tx=0).stop 2023-07-05T23:32:50.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.080+0000 7f61eb1a2700 1 -- 172.21.15.27:0/4231543918 shutdown_connections 2023-07-05T23:32:50.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.080+0000 7f61eb1a2700 1 --2- 172.21.15.27:0/4231543918 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f61d4005200 0x7f61d400ba10 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:50.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.080+0000 7f61eb1a2700 1 -- 172.21.15.27:0/4231543918 >> 172.21.15.27:0/4231543918 conn(0x7f61e406b920 msgr2=0x7f61e40cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:32:50.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.080+0000 7f61eb1a2700 1 -- 172.21.15.27:0/4231543918 shutdown_connections 2023-07-05T23:32:50.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.080+0000 7f61eb1a2700 1 -- 172.21.15.27:0/4231543918 wait complete. 2023-07-05T23:32:50.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.082+0000 7f61eb1a2700 1 Processor -- start 2023-07-05T23:32:50.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.082+0000 7f61eb1a2700 1 -- start start 2023-07-05T23:32:50.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.083+0000 7f61eb1a2700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61d4005200 0x7f61e40c5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:50.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.083+0000 7f61eb1a2700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f61e40c9380 0x7f61e4153cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:50.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.083+0000 7f61eb1a2700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61e4154230 0x7f61e40c3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:50.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.083+0000 7f61eb1a2700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e40c8210 con 0x7f61e40c9380 2023-07-05T23:32:50.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.083+0000 7f61eb1a2700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e41546a0 con 0x7f61e4154230 2023-07-05T23:32:50.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.083+0000 7f61eb1a2700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61e40c87d0 con 0x7f61d4005200 2023-07-05T23:32:50.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.083+0000 7f61e3fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f61e40c9380 0x7f61e4153cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:50.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.083+0000 7f61e3fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f61e40c9380 0x7f61e4153cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44578/0 (socket says 172.21.15.27:44578) 2023-07-05T23:32:50.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.083+0000 7f61e3fff700 1 -- 172.21.15.27:0/2692055456 learned_addr learned my addr 172.21.15.27:0/2692055456 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:32:50.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.083+0000 7f61e8f3e700 1 --2- 172.21.15.27:0/2692055456 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61d4005200 0x7f61e40c5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:50.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.083+0000 7f61e973f700 1 --2- 172.21.15.27:0/2692055456 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61e4154230 0x7f61e40c3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:50.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.083+0000 7f61e3fff700 1 -- 172.21.15.27:0/2692055456 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61d4005200 msgr2=0x7f61e40c5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:50.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.083+0000 7f61e3fff700 1 --2- 172.21.15.27:0/2692055456 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61d4005200 0x7f61e40c5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:50.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.083+0000 7f61e3fff700 1 -- 172.21.15.27:0/2692055456 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61e4154230 msgr2=0x7f61e40c3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:50.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.083+0000 7f61e3fff700 1 --2- 172.21.15.27:0/2692055456 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61e4154230 0x7f61e40c3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:50.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.083+0000 7f61e3fff700 1 -- 172.21.15.27:0/2692055456 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e40c7590 con 0x7f61e40c9380 2023-07-05T23:32:50.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.083+0000 7f61e3fff700 1 --2- 172.21.15.27:0/2692055456 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f61e40c9380 0x7f61e4153cf0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f61d00119d0 tx=0x7f61d0011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:50.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.083+0000 7f61e17fa700 1 -- 172.21.15.27:0/2692055456 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d0011e70 con 0x7f61e40c9380 2023-07-05T23:32:50.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.084+0000 7f61e17fa700 1 -- 172.21.15.27:0/2692055456 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61d000f940 con 0x7f61e40c9380 2023-07-05T23:32:50.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.084+0000 7f61e17fa700 1 -- 172.21.15.27:0/2692055456 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d000fcd0 con 0x7f61e40c9380 2023-07-05T23:32:50.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.084+0000 7f61eb1a2700 1 -- 172.21.15.27:0/2692055456 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61e40c7870 con 0x7f61e40c9380 2023-07-05T23:32:50.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.084+0000 7f61eb1a2700 1 -- 172.21.15.27:0/2692055456 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61e40c7e30 con 0x7f61e40c9380 2023-07-05T23:32:50.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.084+0000 7f61eb1a2700 1 -- 172.21.15.27:0/2692055456 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61e40c8480 con 0x7f61e40c9380 2023-07-05T23:32:50.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.085+0000 7f61e17fa700 1 -- 172.21.15.27:0/2692055456 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f61d0014440 con 0x7f61e40c9380 2023-07-05T23:32:50.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.085+0000 7f61e17fa700 1 --2- 172.21.15.27:0/2692055456 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f61c806ace0 0x7f61c806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:50.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.086+0000 7f61e17fa700 1 -- 172.21.15.27:0/2692055456 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f61d0089730 con 0x7f61e40c9380 2023-07-05T23:32:50.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.086+0000 7f61e8f3e700 1 --2- 172.21.15.27:0/2692055456 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f61c806ace0 0x7f61c806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:50.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.086+0000 7f61e8f3e700 1 --2- 172.21.15.27:0/2692055456 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f61c806ace0 0x7f61c806d190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f61d8000c00 tx=0x7f61d8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:50.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.090+0000 7f61e17fa700 1 -- 172.21.15.27:0/2692055456 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f61e40c8480 con 0x7f61e40c9380 2023-07-05T23:32:50.287 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.286+0000 7f61eb1a2700 1 -- 172.21.15.27:0/2692055456 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f61e40c8480 con 0x7f61e40c9380 2023-07-05T23:32:50.288 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.286+0000 7f61e17fa700 1 -- 172.21.15.27:0/2692055456 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f61d00585d0 con 0x7f61e40c9380 2023-07-05T23:32:50.288 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 8 2023-07-05T23:32:50.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.288+0000 7f61eb1a2700 1 -- 172.21.15.27:0/2692055456 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f61c806ace0 msgr2=0x7f61c806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:50.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.288+0000 7f61eb1a2700 1 --2- 172.21.15.27:0/2692055456 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f61c806ace0 0x7f61c806d190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f61d8000c00 tx=0x7f61d8009040 comp rx=0 tx=0).stop 2023-07-05T23:32:50.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.288+0000 7f61eb1a2700 1 -- 172.21.15.27:0/2692055456 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f61e40c9380 msgr2=0x7f61e4153cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:50.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.288+0000 7f61eb1a2700 1 --2- 172.21.15.27:0/2692055456 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f61e40c9380 0x7f61e4153cf0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f61d00119d0 tx=0x7f61d0011ce0 comp rx=0 tx=0).stop 2023-07-05T23:32:50.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.288+0000 7f61eb1a2700 1 -- 172.21.15.27:0/2692055456 shutdown_connections 2023-07-05T23:32:50.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.288+0000 7f61eb1a2700 1 --2- 172.21.15.27:0/2692055456 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61e4154230 0x7f61e40c3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:50.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.288+0000 7f61eb1a2700 1 --2- 172.21.15.27:0/2692055456 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f61c806ace0 0x7f61c806d190 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:50.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.288+0000 7f61eb1a2700 1 --2- 172.21.15.27:0/2692055456 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61d4005200 0x7f61e40c5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:50.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.288+0000 7f61eb1a2700 1 --2- 172.21.15.27:0/2692055456 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f61e40c9380 0x7f61e4153cf0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:50.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.288+0000 7f61eb1a2700 1 -- 172.21.15.27:0/2692055456 >> 172.21.15.27:0/2692055456 conn(0x7f61e406b920 msgr2=0x7f61e40cf030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:32:50.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.288+0000 7f61eb1a2700 1 -- 172.21.15.27:0/2692055456 shutdown_connections 2023-07-05T23:32:50.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.288+0000 7f61eb1a2700 1 -- 172.21.15.27:0/2692055456 wait complete. 2023-07-05T23:32:50.302 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-05T23:32:50.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.426+0000 7f6c14581700 1 Processor -- start 2023-07-05T23:32:50.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.426+0000 7f6c14581700 1 -- start start 2023-07-05T23:32:50.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.427+0000 7f6c14581700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6c0c156880 0x7f6c0c069ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:50.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.427+0000 7f6c14581700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f6c0c0cc1d0 0x7f6c0c0cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:50.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.427+0000 7f6c14581700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c0c0ccb50 con 0x7f6c0c0aed30 2023-07-05T23:32:50.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.427+0000 7f6c14581700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c0c0cee80 con 0x7f6c0c0cc1d0 2023-07-05T23:32:50.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.427+0000 7f6c14581700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c0c0cf100 con 0x7f6c0c156880 2023-07-05T23:32:50.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.427+0000 7f6c12b1e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f6c0c0cc1d0 0x7f6c0c0cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:50.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.427+0000 7f6c12b1e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f6c0c0cc1d0 0x7f6c0c0cc610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44588/0 (socket says 172.21.15.27:44588) 2023-07-05T23:32:50.437 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.427+0000 7f6c12b1e700 1 -- 172.21.15.27:0/608145226 learned_addr learned my addr 172.21.15.27:0/608145226 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:32:50.437 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.427+0000 7f6c1231d700 1 --2- 172.21.15.27:0/608145226 >> v2:172.21.15.162:3300/0 conn(0x7f6c0c156880 0x7f6c0c069ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:50.437 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.427+0000 7f6c12b1e700 1 -- 172.21.15.27:0/608145226 >> v2:172.21.15.162:3300/0 conn(0x7f6c0c156880 msgr2=0x7f6c0c069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:32:50.437 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.427+0000 7f6c12b1e700 1 --2- 172.21.15.27:0/608145226 >> v2:172.21.15.162:3300/0 conn(0x7f6c0c156880 0x7f6c0c069ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:50.437 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.427+0000 7f6c12b1e700 1 -- 172.21.15.27:0/608145226 >> v1:172.21.15.162:6789/0 conn(0x7f6c0c0aed30 legacy=0x7f6c0c160580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:32:50.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.427+0000 7f6c12b1e700 1 -- 172.21.15.27:0/608145226 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c0c0cf3e0 con 0x7f6c0c0cc1d0 2023-07-05T23:32:50.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.427+0000 7f6c1231d700 1 --2- 172.21.15.27:0/608145226 >> v2:172.21.15.162:3300/0 conn(0x7f6c0c156880 0x7f6c0c069ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T23:32:50.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.427+0000 7f6c12b1e700 1 --2- 172.21.15.27:0/608145226 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c0c0cc1d0 0x7f6c0c0cc610 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c0cf720 tx=0x7f6c0400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5407849c230985e2 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:50.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.427+0000 7f6c1131b700 1 -- 172.21.15.27:0/608145226 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0400e070 con 0x7f6c0c0cc1d0 2023-07-05T23:32:50.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.427+0000 7f6c1131b700 1 -- 172.21.15.27:0/608145226 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c04003a20 con 0x7f6c0c0cc1d0 2023-07-05T23:32:50.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.427+0000 7f6c1131b700 1 -- 172.21.15.27:0/608145226 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c04003dd0 con 0x7f6c0c0cc1d0 2023-07-05T23:32:50.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.428+0000 7f6c14581700 1 -- 172.21.15.27:0/608145226 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c0c0cc1d0 msgr2=0x7f6c0c0cc610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:50.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.428+0000 7f6c14581700 1 --2- 172.21.15.27:0/608145226 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c0c0cc1d0 0x7f6c0c0cc610 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c0cf720 tx=0x7f6c0400b330 comp rx=0 tx=0).stop 2023-07-05T23:32:50.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.428+0000 7f6c14581700 1 -- 172.21.15.27:0/608145226 shutdown_connections 2023-07-05T23:32:50.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.428+0000 7f6c14581700 1 --2- 172.21.15.27:0/608145226 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c0c0cc1d0 0x7f6c0c0cc610 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:50.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.428+0000 7f6c14581700 1 --2- 172.21.15.27:0/608145226 >> v2:172.21.15.162:3300/0 conn(0x7f6c0c156880 0x7f6c0c069ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:50.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.428+0000 7f6c14581700 1 -- 172.21.15.27:0/608145226 >> 172.21.15.27:0/608145226 conn(0x7f6c0c06d4a0 msgr2=0x7f6c0c06d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:32:50.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.428+0000 7f6c14581700 1 -- 172.21.15.27:0/608145226 shutdown_connections 2023-07-05T23:32:50.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.428+0000 7f6c14581700 1 -- 172.21.15.27:0/608145226 wait complete. 2023-07-05T23:32:50.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.429+0000 7f6c14581700 1 Processor -- start 2023-07-05T23:32:50.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.429+0000 7f6c14581700 1 -- start start 2023-07-05T23:32:50.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.430+0000 7f6c14581700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c0c0aed30 0x7f6c0c0ae360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:50.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.430+0000 7f6c14581700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c0c0cc1d0 0x7f6c0c0adb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:50.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.430+0000 7f6c14581700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c0c156880 0x7f6c0c0c5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:50.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.430+0000 7f6c14581700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0c0c5660 con 0x7f6c0c156880 2023-07-05T23:32:50.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.430+0000 7f6c14581700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0c0c4d70 con 0x7f6c0c0cc1d0 2023-07-05T23:32:50.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.430+0000 7f6c14581700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0c0c32f0 con 0x7f6c0c0aed30 2023-07-05T23:32:50.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.430+0000 7f6c12b1e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c0c156880 0x7f6c0c0c5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:50.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.430+0000 7f6c12b1e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c0c156880 0x7f6c0c0c5af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44594/0 (socket says 172.21.15.27:44594) 2023-07-05T23:32:50.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.430+0000 7f6c12b1e700 1 -- 172.21.15.27:0/4157281020 learned_addr learned my addr 172.21.15.27:0/4157281020 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:32:50.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.430+0000 7f6c1231d700 1 --2- 172.21.15.27:0/4157281020 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c0c0aed30 0x7f6c0c0ae360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:50.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.430+0000 7f6c11b1c700 1 --2- 172.21.15.27:0/4157281020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c0c0cc1d0 0x7f6c0c0adb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:50.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.430+0000 7f6c12b1e700 1 -- 172.21.15.27:0/4157281020 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c0c0aed30 msgr2=0x7f6c0c0ae360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:50.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.430+0000 7f6c12b1e700 1 --2- 172.21.15.27:0/4157281020 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c0c0aed30 0x7f6c0c0ae360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:50.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.430+0000 7f6c12b1e700 1 -- 172.21.15.27:0/4157281020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c0c0cc1d0 msgr2=0x7f6c0c0adb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:50.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.430+0000 7f6c12b1e700 1 --2- 172.21.15.27:0/4157281020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c0c0cc1d0 0x7f6c0c0adb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:50.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.430+0000 7f6c12b1e700 1 -- 172.21.15.27:0/4157281020 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c04009b30 con 0x7f6c0c156880 2023-07-05T23:32:50.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.430+0000 7f6c11b1c700 1 --2- 172.21.15.27:0/4157281020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c0c0cc1d0 0x7f6c0c0adb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T23:32:50.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.431+0000 7f6c12b1e700 1 --2- 172.21.15.27:0/4157281020 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c0c156880 0x7f6c0c0c5af0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6c04015040 tx=0x7f6c04004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:50.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.431+0000 7f6c02ffd700 1 -- 172.21.15.27:0/4157281020 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c04004440 con 0x7f6c0c156880 2023-07-05T23:32:50.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.431+0000 7f6c02ffd700 1 -- 172.21.15.27:0/4157281020 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c040045a0 con 0x7f6c0c156880 2023-07-05T23:32:50.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.431+0000 7f6c02ffd700 1 -- 172.21.15.27:0/4157281020 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c04004950 con 0x7f6c0c156880 2023-07-05T23:32:50.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.431+0000 7f6c14581700 1 -- 172.21.15.27:0/4157281020 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c0c0c35d0 con 0x7f6c0c156880 2023-07-05T23:32:50.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.431+0000 7f6c14581700 1 -- 172.21.15.27:0/4157281020 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c0c0c5010 con 0x7f6c0c156880 2023-07-05T23:32:50.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.432+0000 7f6c14581700 1 -- 172.21.15.27:0/4157281020 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c0c0c5810 con 0x7f6c0c156880 2023-07-05T23:32:50.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.432+0000 7f6c02ffd700 1 -- 172.21.15.27:0/4157281020 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6c04012430 con 0x7f6c0c156880 2023-07-05T23:32:50.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.433+0000 7f6c02ffd700 1 --2- 172.21.15.27:0/4157281020 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f6bf006ace0 0x7f6bf006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:50.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.433+0000 7f6c02ffd700 1 -- 172.21.15.27:0/4157281020 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6c0408a720 con 0x7f6c0c156880 2023-07-05T23:32:50.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.433+0000 7f6c1231d700 1 --2- 172.21.15.27:0/4157281020 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f6bf006ace0 0x7f6bf006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:50.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.433+0000 7f6c1231d700 1 --2- 172.21.15.27:0/4157281020 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f6bf006ace0 0x7f6bf006d190 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6c08006fd0 tx=0x7f6c08008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:50.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.437+0000 7f6c02ffd700 1 -- 172.21.15.27:0/4157281020 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6c0c0c5810 con 0x7f6c0c156880 2023-07-05T23:32:50.638 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.636+0000 7f6c14581700 1 -- 172.21.15.27:0/4157281020 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f6c0c073910 con 0x7f6c0c156880 2023-07-05T23:32:50.639 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.636+0000 7f6c02ffd700 1 -- 172.21.15.27:0/4157281020 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v20) v1 ==== 84+0+126 (secure 0 0 0) 0x7f6c04059520 con 0x7f6c0c156880 2023-07-05T23:32:50.639 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:32:50.639 INFO:teuthology.orchestra.run.smithi027.stdout:[ 2023-07-05T23:32:50.639 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-07-05T23:32:50.639 INFO:teuthology.orchestra.run.smithi027.stdout: "poolnum": 1, 2023-07-05T23:32:50.640 INFO:teuthology.orchestra.run.smithi027.stdout: "poolname": ".mgr" 2023-07-05T23:32:50.640 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-07-05T23:32:50.640 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-07-05T23:32:50.640 INFO:teuthology.orchestra.run.smithi027.stdout: "poolnum": 2, 2023-07-05T23:32:50.640 INFO:teuthology.orchestra.run.smithi027.stdout: "poolname": "rbd" 2023-07-05T23:32:50.640 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-07-05T23:32:50.640 INFO:teuthology.orchestra.run.smithi027.stdout:] 2023-07-05T23:32:50.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.638+0000 7f6c14581700 1 -- 172.21.15.27:0/4157281020 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f6bf006ace0 msgr2=0x7f6bf006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:50.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.639+0000 7f6c14581700 1 --2- 172.21.15.27:0/4157281020 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f6bf006ace0 0x7f6bf006d190 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6c08006fd0 tx=0x7f6c08008040 comp rx=0 tx=0).stop 2023-07-05T23:32:50.642 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.639+0000 7f6c14581700 1 -- 172.21.15.27:0/4157281020 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c0c156880 msgr2=0x7f6c0c0c5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:50.642 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.639+0000 7f6c14581700 1 --2- 172.21.15.27:0/4157281020 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c0c156880 0x7f6c0c0c5af0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6c04015040 tx=0x7f6c04004ad0 comp rx=0 tx=0).stop 2023-07-05T23:32:50.642 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.639+0000 7f6c14581700 1 -- 172.21.15.27:0/4157281020 shutdown_connections 2023-07-05T23:32:50.642 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.639+0000 7f6c14581700 1 --2- 172.21.15.27:0/4157281020 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f6bf006ace0 0x7f6bf006d190 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:50.642 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.639+0000 7f6c14581700 1 --2- 172.21.15.27:0/4157281020 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c0c156880 0x7f6c0c0c5af0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:50.642 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.639+0000 7f6c14581700 1 --2- 172.21.15.27:0/4157281020 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c0c0aed30 0x7f6c0c0ae360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:50.642 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.639+0000 7f6c14581700 1 --2- 172.21.15.27:0/4157281020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c0c0cc1d0 0x7f6c0c0adb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:50.642 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.639+0000 7f6c14581700 1 -- 172.21.15.27:0/4157281020 >> 172.21.15.27:0/4157281020 conn(0x7f6c0c06d4a0 msgr2=0x7f6c0c1547f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:32:50.643 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.639+0000 7f6c14581700 1 -- 172.21.15.27:0/4157281020 shutdown_connections 2023-07-05T23:32:50.643 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.639+0000 7f6c14581700 1 -- 172.21.15.27:0/4157281020 wait complete. 2023-07-05T23:32:50.653 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-05T23:32:50.654 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-05T23:32:50.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.780+0000 7f8a14b62700 1 Processor -- start 2023-07-05T23:32:50.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.780+0000 7f8a14b62700 1 -- start start 2023-07-05T23:32:50.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.781+0000 7f8a14b62700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a1015fc60 0x7f8a1006a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:50.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.781+0000 7f8a14b62700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f8a1006e970 0x7f8a100ac600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:50.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.781+0000 7f8a14b62700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a100ce620 con 0x7f8a100aecc0 2023-07-05T23:32:50.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.781+0000 7f8a14b62700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a10160580 con 0x7f8a1006e970 2023-07-05T23:32:50.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.781+0000 7f8a14b62700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a10160860 con 0x7f8a1015fc60 2023-07-05T23:32:50.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.781+0000 7f8a0ed9d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f8a1006e970 0x7f8a100ac600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:50.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.781+0000 7f8a0ed9d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f8a1006e970 0x7f8a100ac600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44602/0 (socket says 172.21.15.27:44602) 2023-07-05T23:32:50.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.781+0000 7f8a0ed9d700 1 -- 172.21.15.27:0/3235655752 learned_addr learned my addr 172.21.15.27:0/3235655752 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:32:50.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.782+0000 7f8a0e59c700 1 --2- 172.21.15.27:0/3235655752 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a1015fc60 0x7f8a1006a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:50.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.782+0000 7f8a0ed9d700 1 -- 172.21.15.27:0/3235655752 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a1015fc60 msgr2=0x7f8a1006a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:32:50.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.782+0000 7f8a0ed9d700 1 --2- 172.21.15.27:0/3235655752 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a1015fc60 0x7f8a1006a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:50.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.782+0000 7f8a0ed9d700 1 -- 172.21.15.27:0/3235655752 >> v1:172.21.15.27:6789/0 conn(0x7f8a100aecc0 legacy=0x7f8a1006e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:50.786 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.782+0000 7f8a0ed9d700 1 -- 172.21.15.27:0/3235655752 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a10160b40 con 0x7f8a1006e970 2023-07-05T23:32:50.786 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.782+0000 7f8a0ed9d700 1 --2- 172.21.15.27:0/3235655752 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a1006e970 0x7f8a100ac600 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8a08009e50 tx=0x7f8a0800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e81cc96fd36a08f4 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:50.786 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.782+0000 7f8a0d59a700 1 -- 172.21.15.27:0/3235655752 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0800e070 con 0x7f8a1006e970 2023-07-05T23:32:50.786 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.782+0000 7f8a0d59a700 1 -- 172.21.15.27:0/3235655752 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a0800b910 con 0x7f8a1006e970 2023-07-05T23:32:50.786 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.782+0000 7f8a0d59a700 1 -- 172.21.15.27:0/3235655752 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0800bcc0 con 0x7f8a1006e970 2023-07-05T23:32:50.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.783+0000 7f8a14b62700 1 -- 172.21.15.27:0/3235655752 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a1006e970 msgr2=0x7f8a100ac600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:50.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.783+0000 7f8a14b62700 1 --2- 172.21.15.27:0/3235655752 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a1006e970 0x7f8a100ac600 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8a08009e50 tx=0x7f8a0800b330 comp rx=0 tx=0).stop 2023-07-05T23:32:50.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.783+0000 7f8a14b62700 1 -- 172.21.15.27:0/3235655752 shutdown_connections 2023-07-05T23:32:50.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.783+0000 7f8a14b62700 1 --2- 172.21.15.27:0/3235655752 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a1006e970 0x7f8a100ac600 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:50.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.783+0000 7f8a14b62700 1 --2- 172.21.15.27:0/3235655752 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a1015fc60 0x7f8a1006a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:50.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.783+0000 7f8a14b62700 1 -- 172.21.15.27:0/3235655752 >> 172.21.15.27:0/3235655752 conn(0x7f8a1006b920 msgr2=0x7f8a100cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:32:50.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.783+0000 7f8a14b62700 1 -- 172.21.15.27:0/3235655752 shutdown_connections 2023-07-05T23:32:50.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.783+0000 7f8a14b62700 1 -- 172.21.15.27:0/3235655752 wait complete. 2023-07-05T23:32:50.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.784+0000 7f8a14b62700 1 Processor -- start 2023-07-05T23:32:50.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.784+0000 7f8a14b62700 1 -- start start 2023-07-05T23:32:50.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.785+0000 7f8a14b62700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a1006e970 0x7f8a100c6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:50.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.785+0000 7f8a14b62700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a100aecc0 0x7f8a1014ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:50.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.785+0000 7f8a14b62700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a1015fc60 0x7f8a100b5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:50.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.785+0000 7f8a14b62700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a100cb1d0 con 0x7f8a100aecc0 2023-07-05T23:32:50.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.785+0000 7f8a14b62700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a100cb4b0 con 0x7f8a1015fc60 2023-07-05T23:32:50.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.785+0000 7f8a14b62700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a100cb790 con 0x7f8a1006e970 2023-07-05T23:32:50.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.785+0000 7f8a0dd9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a100aecc0 0x7f8a1014ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:50.791 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.785+0000 7f8a0dd9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a100aecc0 0x7f8a1014ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44606/0 (socket says 172.21.15.27:44606) 2023-07-05T23:32:50.791 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.785+0000 7f8a0dd9b700 1 -- 172.21.15.27:0/2055850414 learned_addr learned my addr 172.21.15.27:0/2055850414 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:32:50.791 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.785+0000 7f8a0e59c700 1 --2- 172.21.15.27:0/2055850414 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a1006e970 0x7f8a100c6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:50.791 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.785+0000 7f8a0ed9d700 1 --2- 172.21.15.27:0/2055850414 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a1015fc60 0x7f8a100b5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:50.791 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.785+0000 7f8a0dd9b700 1 -- 172.21.15.27:0/2055850414 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a1006e970 msgr2=0x7f8a100c6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:50.791 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.785+0000 7f8a0dd9b700 1 --2- 172.21.15.27:0/2055850414 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a1006e970 0x7f8a100c6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:50.791 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.785+0000 7f8a0dd9b700 1 -- 172.21.15.27:0/2055850414 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a1015fc60 msgr2=0x7f8a100b5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:50.792 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.785+0000 7f8a0dd9b700 1 --2- 172.21.15.27:0/2055850414 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a1015fc60 0x7f8a100b5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:50.792 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.785+0000 7f8a0dd9b700 1 -- 172.21.15.27:0/2055850414 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a08009b30 con 0x7f8a100aecc0 2023-07-05T23:32:50.792 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.785+0000 7f8a0dd9b700 1 --2- 172.21.15.27:0/2055850414 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a100aecc0 0x7f8a1014ee30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8a0000c4b0 tx=0x7f8a0000c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:50.792 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.786+0000 7f89feffd700 1 -- 172.21.15.27:0/2055850414 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a000052d0 con 0x7f8a100aecc0 2023-07-05T23:32:50.792 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.786+0000 7f89feffd700 1 -- 172.21.15.27:0/2055850414 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a00005430 con 0x7f8a100aecc0 2023-07-05T23:32:50.792 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.786+0000 7f89feffd700 1 -- 172.21.15.27:0/2055850414 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a000038c0 con 0x7f8a100aecc0 2023-07-05T23:32:50.792 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.786+0000 7f8a14b62700 1 -- 172.21.15.27:0/2055850414 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a100cba70 con 0x7f8a100aecc0 2023-07-05T23:32:50.792 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.786+0000 7f8a14b62700 1 -- 172.21.15.27:0/2055850414 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a1014f370 con 0x7f8a100aecc0 2023-07-05T23:32:50.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.787+0000 7f8a14b62700 1 -- 172.21.15.27:0/2055850414 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a100cbf90 con 0x7f8a100aecc0 2023-07-05T23:32:50.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.787+0000 7f89feffd700 1 -- 172.21.15.27:0/2055850414 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8a00003a20 con 0x7f8a100aecc0 2023-07-05T23:32:50.794 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.787+0000 7f89feffd700 1 --2- 172.21.15.27:0/2055850414 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f89f006ace0 0x7f89f006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:50.794 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.788+0000 7f89feffd700 1 -- 172.21.15.27:0/2055850414 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8a000885f0 con 0x7f8a100aecc0 2023-07-05T23:32:50.794 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.788+0000 7f8a0e59c700 1 --2- 172.21.15.27:0/2055850414 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f89f006ace0 0x7f89f006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:50.794 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.788+0000 7f8a0e59c700 1 --2- 172.21.15.27:0/2055850414 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f89f006ace0 0x7f89f006d190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8a04009b20 tx=0x7f8a040091c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:50.794 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.792+0000 7f89feffd700 1 -- 172.21.15.27:0/2055850414 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8a000538c0 con 0x7f8a100aecc0 2023-07-05T23:32:50.997 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:50.995+0000 7f8a14b62700 1 -- 172.21.15.27:0/2055850414 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f8a1004ea20 con 0x7f8a100aecc0 2023-07-05T23:32:51.493 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:32:51.495 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:32:51.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:51.887+0000 7f89feffd700 1 -- 172.21.15.27:0/2055850414 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v21) v1 ==== 138+0+0 (secure 0 0 0) 0x7f8a000170b0 con 0x7f8a100aecc0 2023-07-05T23:32:51.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:51.891+0000 7f8a14b62700 1 -- 172.21.15.27:0/2055850414 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f89f006ace0 msgr2=0x7f89f006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:51.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:51.891+0000 7f8a14b62700 1 --2- 172.21.15.27:0/2055850414 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f89f006ace0 0x7f89f006d190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8a04009b20 tx=0x7f8a040091c0 comp rx=0 tx=0).stop 2023-07-05T23:32:51.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:51.891+0000 7f8a14b62700 1 -- 172.21.15.27:0/2055850414 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a100aecc0 msgr2=0x7f8a1014ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:51.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:51.891+0000 7f8a14b62700 1 --2- 172.21.15.27:0/2055850414 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a100aecc0 0x7f8a1014ee30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8a0000c4b0 tx=0x7f8a0000c7c0 comp rx=0 tx=0).stop 2023-07-05T23:32:51.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:51.891+0000 7f8a14b62700 1 -- 172.21.15.27:0/2055850414 shutdown_connections 2023-07-05T23:32:51.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:51.891+0000 7f8a14b62700 1 --2- 172.21.15.27:0/2055850414 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a1015fc60 0x7f8a100b5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:51.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:51.891+0000 7f8a14b62700 1 --2- 172.21.15.27:0/2055850414 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f89f006ace0 0x7f89f006d190 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:51.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:51.891+0000 7f8a14b62700 1 --2- 172.21.15.27:0/2055850414 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a1006e970 0x7f8a100c6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:51.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:51.891+0000 7f8a14b62700 1 --2- 172.21.15.27:0/2055850414 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a100aecc0 0x7f8a1014ee30 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:51.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:51.891+0000 7f8a14b62700 1 -- 172.21.15.27:0/2055850414 >> 172.21.15.27:0/2055850414 conn(0x7f8a1006b920 msgr2=0x7f8a100b14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:32:51.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:51.891+0000 7f8a14b62700 1 -- 172.21.15.27:0/2055850414 shutdown_connections 2023-07-05T23:32:51.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:51.891+0000 7f8a14b62700 1 -- 172.21.15.27:0/2055850414 wait complete. 2023-07-05T23:32:51.896 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_metadata' created 2023-07-05T23:32:51.910 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-07-05T23:32:52.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.048+0000 7f163003c700 1 Processor -- start 2023-07-05T23:32:52.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.048+0000 7f163003c700 1 -- start start 2023-07-05T23:32:52.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.049+0000 7f163003c700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f16280cd5e0 0x7f16280cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:52.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.049+0000 7f163003c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f16280adf40 0x7f162806e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:52.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.049+0000 7f163003c700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f162806f0e0 con 0x7f162806e030 2023-07-05T23:32:52.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.049+0000 7f163003c700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16280ce2c0 con 0x7f16280adf40 2023-07-05T23:32:52.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.049+0000 7f163003c700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16280cdef0 con 0x7f16280cd5e0 2023-07-05T23:32:52.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.049+0000 7f162d5d7700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f162806e030 0x7f162815cf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:51780/0 (socket says 172.21.15.27:51780) 2023-07-05T23:32:52.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.049+0000 7f162d5d7700 1 -- 172.21.15.27:0/4010545710 learned_addr learned my addr 172.21.15.27:0/4010545710 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-07-05T23:32:52.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.049+0000 7f162e5d9700 1 --2- 172.21.15.27:0/4010545710 >> v2:172.21.15.27:3300/0 conn(0x7f16280adf40 0x7f162806e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:52.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.050+0000 7f162ddd8700 1 --2- 172.21.15.27:0/4010545710 >> v2:172.21.15.162:3300/0 conn(0x7f16280cd5e0 0x7f16280cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:52.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.050+0000 7f162e5d9700 1 -- 172.21.15.27:0/4010545710 >> v2:172.21.15.162:3300/0 conn(0x7f16280cd5e0 msgr2=0x7f16280cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:32:52.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.050+0000 7f162e5d9700 1 --2- 172.21.15.27:0/4010545710 >> v2:172.21.15.162:3300/0 conn(0x7f16280cd5e0 0x7f16280cd9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:52.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.050+0000 7f162e5d9700 1 -- 172.21.15.27:0/4010545710 >> v1:172.21.15.27:6789/0 conn(0x7f162806e030 legacy=0x7f162815cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:52.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.050+0000 7f162e5d9700 1 -- 172.21.15.27:0/4010545710 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f162806eb20 con 0x7f16280adf40 2023-07-05T23:32:52.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.050+0000 7f162cdd6700 1 -- 172.21.15.27:0/4010545710 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1630487025 0 0) 0x7f162806f0e0 con 0x7f162806e030 2023-07-05T23:32:52.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.050+0000 7f162e5d9700 1 --2- 172.21.15.27:0/4010545710 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f16280adf40 0x7f162806e4d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1628071470 tx=0x7f162000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da5e07c8bd2d8b95 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:52.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.050+0000 7f162cdd6700 1 -- 172.21.15.27:0/4010545710 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162000e070 con 0x7f16280adf40 2023-07-05T23:32:52.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.050+0000 7f162cdd6700 1 -- 172.21.15.27:0/4010545710 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f162000bbd0 con 0x7f16280adf40 2023-07-05T23:32:52.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.050+0000 7f162cdd6700 1 -- 172.21.15.27:0/4010545710 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1620012430 con 0x7f16280adf40 2023-07-05T23:32:52.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.051+0000 7f163003c700 1 -- 172.21.15.27:0/4010545710 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f16280adf40 msgr2=0x7f162806e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:52.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.051+0000 7f163003c700 1 --2- 172.21.15.27:0/4010545710 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f16280adf40 0x7f162806e4d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1628071470 tx=0x7f162000b330 comp rx=0 tx=0).stop 2023-07-05T23:32:52.057 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.051+0000 7f163003c700 1 -- 172.21.15.27:0/4010545710 shutdown_connections 2023-07-05T23:32:52.057 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.051+0000 7f163003c700 1 --2- 172.21.15.27:0/4010545710 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f16280adf40 0x7f162806e4d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:52.057 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.051+0000 7f163003c700 1 --2- 172.21.15.27:0/4010545710 >> v2:172.21.15.162:3300/0 conn(0x7f16280cd5e0 0x7f16280cd9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:52.057 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.051+0000 7f163003c700 1 -- 172.21.15.27:0/4010545710 >> 172.21.15.27:0/4010545710 conn(0x7f162806b920 msgr2=0x7f16280cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:32:52.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.051+0000 7f163003c700 1 -- 172.21.15.27:0/4010545710 shutdown_connections 2023-07-05T23:32:52.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.051+0000 7f163003c700 1 -- 172.21.15.27:0/4010545710 wait complete. 2023-07-05T23:32:52.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.052+0000 7f163003c700 1 Processor -- start 2023-07-05T23:32:52.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.052+0000 7f163003c700 1 -- start start 2023-07-05T23:32:52.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.053+0000 7f163003c700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f162806e030 0x7f16280b2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:52.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.053+0000 7f163003c700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16280adf40 0x7f16280b5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:52.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.053+0000 7f163003c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f16280cd5e0 0x7f16280cf9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:52.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.053+0000 7f163003c700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16280b5750 con 0x7f16280cd5e0 2023-07-05T23:32:52.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.053+0000 7f163003c700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16280cb4d0 con 0x7f16280adf40 2023-07-05T23:32:52.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.053+0000 7f163003c700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16280cb7b0 con 0x7f162806e030 2023-07-05T23:32:52.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.053+0000 7f162e5d9700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f16280cd5e0 0x7f16280cf9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:52.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.053+0000 7f162e5d9700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f16280cd5e0 0x7f16280cf9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44622/0 (socket says 172.21.15.27:44622) 2023-07-05T23:32:52.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.053+0000 7f162e5d9700 1 -- 172.21.15.27:0/2395823662 learned_addr learned my addr 172.21.15.27:0/2395823662 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:32:52.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.053+0000 7f162ddd8700 1 --2- 172.21.15.27:0/2395823662 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f162806e030 0x7f16280b2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:52.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.053+0000 7f162d5d7700 1 --2- 172.21.15.27:0/2395823662 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16280adf40 0x7f16280b5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:52.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.053+0000 7f162e5d9700 1 -- 172.21.15.27:0/2395823662 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f162806e030 msgr2=0x7f16280b2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:52.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.053+0000 7f162e5d9700 1 --2- 172.21.15.27:0/2395823662 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f162806e030 0x7f16280b2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:52.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.053+0000 7f162e5d9700 1 -- 172.21.15.27:0/2395823662 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16280adf40 msgr2=0x7f16280b5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:52.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.053+0000 7f162e5d9700 1 --2- 172.21.15.27:0/2395823662 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16280adf40 0x7f16280b5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:52.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.053+0000 7f162e5d9700 1 -- 172.21.15.27:0/2395823662 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1620009a70 con 0x7f16280cd5e0 2023-07-05T23:32:52.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.053+0000 7f162e5d9700 1 --2- 172.21.15.27:0/2395823662 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f16280cd5e0 0x7f16280cf9d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f162806fca0 tx=0x7f1620004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:52.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.053+0000 7f161a7fc700 1 -- 172.21.15.27:0/2395823662 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1620012430 con 0x7f16280cd5e0 2023-07-05T23:32:52.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.053+0000 7f161a7fc700 1 -- 172.21.15.27:0/2395823662 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1620020070 con 0x7f16280cd5e0 2023-07-05T23:32:52.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.053+0000 7f163003c700 1 -- 172.21.15.27:0/2395823662 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16280cba90 con 0x7f16280cd5e0 2023-07-05T23:32:52.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.053+0000 7f161a7fc700 1 -- 172.21.15.27:0/2395823662 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1620004280 con 0x7f16280cd5e0 2023-07-05T23:32:52.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.054+0000 7f163003c700 1 -- 172.21.15.27:0/2395823662 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1628148910 con 0x7f16280cd5e0 2023-07-05T23:32:52.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.055+0000 7f163003c700 1 -- 172.21.15.27:0/2395823662 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f162804ea20 con 0x7f16280cd5e0 2023-07-05T23:32:52.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.055+0000 7f161a7fc700 1 -- 172.21.15.27:0/2395823662 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f16200043e0 con 0x7f16280cd5e0 2023-07-05T23:32:52.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.055+0000 7f161a7fc700 1 --2- 172.21.15.27:0/2395823662 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f160c06ace0 0x7f160c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:52.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.056+0000 7f161a7fc700 1 -- 172.21.15.27:0/2395823662 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f1620022070 con 0x7f16280cd5e0 2023-07-05T23:32:52.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.056+0000 7f162ddd8700 1 --2- 172.21.15.27:0/2395823662 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f160c06ace0 0x7f160c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:52.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.056+0000 7f162ddd8700 1 --2- 172.21.15.27:0/2395823662 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f160c06ace0 0x7f160c06d190 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1624006fd0 tx=0x7f1624008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:52.063 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.060+0000 7f161a7fc700 1 -- 172.21.15.27:0/2395823662 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f16200567f0 con 0x7f16280cd5e0 2023-07-05T23:32:52.258 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.256+0000 7f163003c700 1 -- 172.21.15.27:0/2395823662 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f16280b5990 con 0x7f16280cd5e0 2023-07-05T23:32:52.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.888+0000 7f161a7fc700 1 -- 172.21.15.27:0/2395823662 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v22) v1 ==== 171+0+0 (secure 0 0 0) 0x7f1620059e10 con 0x7f16280cd5e0 2023-07-05T23:32:52.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.894+0000 7f163003c700 1 -- 172.21.15.27:0/2395823662 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f160c06ace0 msgr2=0x7f160c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:52.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.894+0000 7f163003c700 1 --2- 172.21.15.27:0/2395823662 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f160c06ace0 0x7f160c06d190 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1624006fd0 tx=0x7f1624008040 comp rx=0 tx=0).stop 2023-07-05T23:32:52.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.894+0000 7f163003c700 1 -- 172.21.15.27:0/2395823662 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f16280cd5e0 msgr2=0x7f16280cf9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:52.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.894+0000 7f163003c700 1 --2- 172.21.15.27:0/2395823662 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f16280cd5e0 0x7f16280cf9d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f162806fca0 tx=0x7f1620004ad0 comp rx=0 tx=0).stop 2023-07-05T23:32:52.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.894+0000 7f163003c700 1 -- 172.21.15.27:0/2395823662 shutdown_connections 2023-07-05T23:32:52.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.894+0000 7f163003c700 1 --2- 172.21.15.27:0/2395823662 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f160c06ace0 0x7f160c06d190 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:52.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.894+0000 7f163003c700 1 --2- 172.21.15.27:0/2395823662 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f16280cd5e0 0x7f16280cf9d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:52.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.894+0000 7f163003c700 1 --2- 172.21.15.27:0/2395823662 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f162806e030 0x7f16280b2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:52.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.894+0000 7f163003c700 1 --2- 172.21.15.27:0/2395823662 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16280adf40 0x7f16280b5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:52.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.894+0000 7f163003c700 1 -- 172.21.15.27:0/2395823662 >> 172.21.15.27:0/2395823662 conn(0x7f162806b920 msgr2=0x7f1628069ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:32:52.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.898+0000 7f163003c700 1 -- 172.21.15.27:0/2395823662 shutdown_connections 2023-07-05T23:32:52.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:52.901+0000 7f163003c700 1 -- 172.21.15.27:0/2395823662 wait complete. 2023-07-05T23:32:52.908 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_data' created 2023-07-05T23:32:52.924 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-05T23:32:53.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.055+0000 7fdc2f63a700 1 Processor -- start 2023-07-05T23:32:53.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.055+0000 7fdc2f63a700 1 -- start start 2023-07-05T23:32:53.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.056+0000 7fdc2f63a700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fdc280cd5e0 0x7fdc280cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:53.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.056+0000 7fdc2f63a700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc2806e030 0x7fdc2806e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:53.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.056+0000 7fdc2f63a700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fdc2815cf70 0x7fdc2815d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:53.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.056+0000 7fdc2f63a700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc280ce2c0 con 0x7fdc280cd5e0 2023-07-05T23:32:53.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.056+0000 7fdc2f63a700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc2806f0e0 con 0x7fdc2815cf70 2023-07-05T23:32:53.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.056+0000 7fdc2f63a700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc280cdef0 con 0x7fdc2806e030 2023-07-05T23:32:53.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.056+0000 7fdc2d3d6700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fdc280cd5e0 0x7fdc280cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:53.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.056+0000 7fdc2d3d6700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fdc280cd5e0 0x7fdc280cd9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44626/0 (socket says 172.21.15.27:44626) 2023-07-05T23:32:53.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.056+0000 7fdc2d3d6700 1 -- 172.21.15.27:0/1999039368 learned_addr learned my addr 172.21.15.27:0/1999039368 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:32:53.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.056+0000 7fdc2cbd5700 1 --2- 172.21.15.27:0/1999039368 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc2806e030 0x7fdc2806e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:53.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.056+0000 7fdc2dbd7700 1 --2- 172.21.15.27:0/1999039368 >> v2:172.21.15.162:3300/0 conn(0x7fdc2815cf70 0x7fdc2815d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:53.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.056+0000 7fdc2d3d6700 1 -- 172.21.15.27:0/1999039368 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc2806e030 msgr2=0x7fdc2806e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:32:53.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.056+0000 7fdc2d3d6700 1 --2- 172.21.15.27:0/1999039368 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc2806e030 0x7fdc2806e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:53.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.056+0000 7fdc2d3d6700 1 -- 172.21.15.27:0/1999039368 >> v2:172.21.15.162:3300/0 conn(0x7fdc2815cf70 msgr2=0x7fdc2815d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:32:53.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.056+0000 7fdc2d3d6700 1 --2- 172.21.15.27:0/1999039368 >> v2:172.21.15.162:3300/0 conn(0x7fdc2815cf70 0x7fdc2815d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:53.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.056+0000 7fdc2d3d6700 1 -- 172.21.15.27:0/1999039368 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc2806eb20 con 0x7fdc280cd5e0 2023-07-05T23:32:53.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.056+0000 7fdc2d3d6700 1 --2- 172.21.15.27:0/1999039368 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc280cd5e0 0x7fdc280cd9b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdc28071930 tx=0x7fdc18009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab48b07fb557003d server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:53.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.056+0000 7fdc1ffff700 1 -- 172.21.15.27:0/1999039368 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc18005e30 con 0x7fdc280cd5e0 2023-07-05T23:32:53.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.056+0000 7fdc1ffff700 1 -- 172.21.15.27:0/1999039368 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc18004030 con 0x7fdc280cd5e0 2023-07-05T23:32:53.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.056+0000 7fdc1ffff700 1 -- 172.21.15.27:0/1999039368 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc180043e0 con 0x7fdc280cd5e0 2023-07-05T23:32:53.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.057+0000 7fdc2f63a700 1 -- 172.21.15.27:0/1999039368 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc280cd5e0 msgr2=0x7fdc280cd9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:53.070 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.057+0000 7fdc2f63a700 1 --2- 172.21.15.27:0/1999039368 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc280cd5e0 0x7fdc280cd9b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdc28071930 tx=0x7fdc18009bd0 comp rx=0 tx=0).stop 2023-07-05T23:32:53.070 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.057+0000 7fdc2f63a700 1 -- 172.21.15.27:0/1999039368 shutdown_connections 2023-07-05T23:32:53.070 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.057+0000 7fdc2f63a700 1 --2- 172.21.15.27:0/1999039368 >> v2:172.21.15.162:3300/0 conn(0x7fdc2815cf70 0x7fdc2815d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:53.070 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.057+0000 7fdc2f63a700 1 --2- 172.21.15.27:0/1999039368 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc280cd5e0 0x7fdc280cd9b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:53.070 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.057+0000 7fdc2f63a700 1 --2- 172.21.15.27:0/1999039368 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc2806e030 0x7fdc2806e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:53.070 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.057+0000 7fdc2f63a700 1 -- 172.21.15.27:0/1999039368 >> 172.21.15.27:0/1999039368 conn(0x7fdc2806b920 msgr2=0x7fdc280cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:32:53.071 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.057+0000 7fdc2f63a700 1 -- 172.21.15.27:0/1999039368 shutdown_connections 2023-07-05T23:32:53.071 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.057+0000 7fdc2f63a700 1 -- 172.21.15.27:0/1999039368 wait complete. 2023-07-05T23:32:53.071 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.058+0000 7fdc2f63a700 1 Processor -- start 2023-07-05T23:32:53.071 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.058+0000 7fdc2f63a700 1 -- start start 2023-07-05T23:32:53.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.059+0000 7fdc2f63a700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc2806e030 0x7fdc28154440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:53.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.059+0000 7fdc2f63a700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc280cd5e0 0x7fdc28155360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:53.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.059+0000 7fdc2f63a700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc2815cf70 0x7fdc2815aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:53.073 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.059+0000 7fdc2f63a700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc281ef3f0 con 0x7fdc2815cf70 2023-07-05T23:32:53.073 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.059+0000 7fdc2f63a700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc281564c0 con 0x7fdc2806e030 2023-07-05T23:32:53.073 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.059+0000 7fdc2f63a700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc28155c20 con 0x7fdc280cd5e0 2023-07-05T23:32:53.073 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.059+0000 7fdc2dbd7700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc2815cf70 0x7fdc2815aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:53.074 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.059+0000 7fdc2dbd7700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc2815cf70 0x7fdc2815aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44636/0 (socket says 172.21.15.27:44636) 2023-07-05T23:32:53.074 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.059+0000 7fdc2dbd7700 1 -- 172.21.15.27:0/439297125 learned_addr learned my addr 172.21.15.27:0/439297125 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:32:53.074 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.059+0000 7fdc2d3d6700 1 --2- 172.21.15.27:0/439297125 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc2806e030 0x7fdc28154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:53.074 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.059+0000 7fdc2cbd5700 1 --2- 172.21.15.27:0/439297125 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc280cd5e0 0x7fdc28155360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:53.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.060+0000 7fdc2dbd7700 1 -- 172.21.15.27:0/439297125 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc280cd5e0 msgr2=0x7fdc28155360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:53.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.060+0000 7fdc2dbd7700 1 --2- 172.21.15.27:0/439297125 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc280cd5e0 0x7fdc28155360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:53.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.060+0000 7fdc2dbd7700 1 -- 172.21.15.27:0/439297125 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc2806e030 msgr2=0x7fdc28154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:53.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.060+0000 7fdc2dbd7700 1 --2- 172.21.15.27:0/439297125 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc2806e030 0x7fdc28154440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:53.076 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.060+0000 7fdc2dbd7700 1 -- 172.21.15.27:0/439297125 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc18009500 con 0x7fdc2815cf70 2023-07-05T23:32:53.076 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.060+0000 7fdc2dbd7700 1 --2- 172.21.15.27:0/439297125 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc2815cf70 0x7fdc2815aca0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdc20007e40 tx=0x7fdc2000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:53.076 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.060+0000 7fdc1dffb700 1 -- 172.21.15.27:0/439297125 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc2000ed30 con 0x7fdc2815cf70 2023-07-05T23:32:53.076 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.060+0000 7fdc1dffb700 1 -- 172.21.15.27:0/439297125 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc20014420 con 0x7fdc2815cf70 2023-07-05T23:32:53.077 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.060+0000 7fdc2f63a700 1 -- 172.21.15.27:0/439297125 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc28155f00 con 0x7fdc2815cf70 2023-07-05T23:32:53.077 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.060+0000 7fdc1dffb700 1 -- 172.21.15.27:0/439297125 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc200147d0 con 0x7fdc2815cf70 2023-07-05T23:32:53.077 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.060+0000 7fdc2f63a700 1 -- 172.21.15.27:0/439297125 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc281569e0 con 0x7fdc2815cf70 2023-07-05T23:32:53.078 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.061+0000 7fdc2f63a700 1 -- 172.21.15.27:0/439297125 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc28156840 con 0x7fdc2815cf70 2023-07-05T23:32:53.078 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.062+0000 7fdc1dffb700 1 -- 172.21.15.27:0/439297125 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdc20014930 con 0x7fdc2815cf70 2023-07-05T23:32:53.078 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.062+0000 7fdc1dffb700 1 --2- 172.21.15.27:0/439297125 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fdc0c06ace0 0x7fdc0c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:53.078 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.062+0000 7fdc1dffb700 1 -- 172.21.15.27:0/439297125 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5962+0+0 (secure 0 0 0) 0x7fdc20089a50 con 0x7fdc2815cf70 2023-07-05T23:32:53.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.062+0000 7fdc2d3d6700 1 --2- 172.21.15.27:0/439297125 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fdc0c06ace0 0x7fdc0c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:53.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.063+0000 7fdc2d3d6700 1 --2- 172.21.15.27:0/439297125 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fdc0c06ace0 0x7fdc0c06d190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdc28071930 tx=0x7fdc18008070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:53.080 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.067+0000 7fdc1dffb700 1 -- 172.21.15.27:0/439297125 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdc28156840 con 0x7fdc2815cf70 2023-07-05T23:32:53.314 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.311+0000 7fdc2f63a700 1 -- 172.21.15.27:0/439297125 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fdc28156840 con 0x7fdc2815cf70 2023-07-05T23:32:53.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.318+0000 7fdc1dffb700 1 -- 172.21.15.27:0/439297125 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fdc28156840 con 0x7fdc2815cf70 2023-07-05T23:32:53.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.322+0000 7fdc2f63a700 1 -- 172.21.15.27:0/439297125 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fdc0c06ace0 msgr2=0x7fdc0c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:53.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.322+0000 7fdc2f63a700 1 --2- 172.21.15.27:0/439297125 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fdc0c06ace0 0x7fdc0c06d190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdc28071930 tx=0x7fdc18008070 comp rx=0 tx=0).stop 2023-07-05T23:32:53.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.322+0000 7fdc2f63a700 1 -- 172.21.15.27:0/439297125 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc2815cf70 msgr2=0x7fdc2815aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:53.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.322+0000 7fdc2f63a700 1 --2- 172.21.15.27:0/439297125 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc2815cf70 0x7fdc2815aca0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdc20007e40 tx=0x7fdc2000e3c0 comp rx=0 tx=0).stop 2023-07-05T23:32:53.331 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.328+0000 7fdc2f63a700 1 -- 172.21.15.27:0/439297125 shutdown_connections 2023-07-05T23:32:53.331 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.328+0000 7fdc2f63a700 1 --2- 172.21.15.27:0/439297125 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc2806e030 0x7fdc28154440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:53.332 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.328+0000 7fdc2f63a700 1 --2- 172.21.15.27:0/439297125 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fdc0c06ace0 0x7fdc0c06d190 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:53.332 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.328+0000 7fdc2f63a700 1 --2- 172.21.15.27:0/439297125 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc2815cf70 0x7fdc2815aca0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:53.332 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.328+0000 7fdc2f63a700 1 --2- 172.21.15.27:0/439297125 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc280cd5e0 0x7fdc28155360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:53.332 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.328+0000 7fdc2f63a700 1 -- 172.21.15.27:0/439297125 >> 172.21.15.27:0/439297125 conn(0x7fdc2806b920 msgr2=0x7fdc280adf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:32:53.332 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.328+0000 7fdc2f63a700 1 -- 172.21.15.27:0/439297125 shutdown_connections 2023-07-05T23:32:53.332 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.328+0000 7fdc2f63a700 1 -- 172.21.15.27:0/439297125 wait complete. 2023-07-05T23:32:53.333 INFO:teuthology.orchestra.run.smithi027.stderr:new fs with metadata pool 3 and data pool 4 2023-07-05T23:32:53.354 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-07-05T23:32:53.354 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-07-05T23:32:53.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.480+0000 7f7829dc7700 1 Processor -- start 2023-07-05T23:32:53.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.480+0000 7f7829dc7700 1 -- start start 2023-07-05T23:32:53.485 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.481+0000 7f7829dc7700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f78240ae8b0 0x7f782406e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:53.485 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.481+0000 7f7829dc7700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f78240acd10 0x7f782415e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:53.485 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.481+0000 7f7829dc7700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78240aee00 con 0x7f782415a430 2023-07-05T23:32:53.485 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.481+0000 7f7829dc7700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78240af330 con 0x7f78240ae8b0 2023-07-05T23:32:53.485 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.481+0000 7f7829dc7700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f782406e340 con 0x7f78240acd10 2023-07-05T23:32:53.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.481+0000 7f7822ffd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f78240ae8b0 0x7f782406e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:53.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.481+0000 7f7822ffd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f78240ae8b0 0x7f782406e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44652/0 (socket says 172.21.15.27:44652) 2023-07-05T23:32:53.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.481+0000 7f7822ffd700 1 -- 172.21.15.27:0/1558502895 learned_addr learned my addr 172.21.15.27:0/1558502895 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:32:53.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.482+0000 7f7823fff700 1 --2- 172.21.15.27:0/1558502895 >> v2:172.21.15.162:3300/0 conn(0x7f78240acd10 0x7f782415e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:53.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.482+0000 7f7822ffd700 1 -- 172.21.15.27:0/1558502895 >> v2:172.21.15.162:3300/0 conn(0x7f78240acd10 msgr2=0x7f782415e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:32:53.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.482+0000 7f7822ffd700 1 --2- 172.21.15.27:0/1558502895 >> v2:172.21.15.162:3300/0 conn(0x7f78240acd10 0x7f782415e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:53.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.482+0000 7f7822ffd700 1 -- 172.21.15.27:0/1558502895 >> v1:172.21.15.162:6789/0 conn(0x7f782415a430 legacy=0x7f78240ac600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:32:53.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.482+0000 7f7822ffd700 1 -- 172.21.15.27:0/1558502895 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78240af050 con 0x7f78240ae8b0 2023-07-05T23:32:53.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.482+0000 7f7823fff700 1 --2- 172.21.15.27:0/1558502895 >> v2:172.21.15.162:3300/0 conn(0x7f78240acd10 0x7f782415e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T23:32:53.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.482+0000 7f7822ffd700 1 --2- 172.21.15.27:0/1558502895 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f78240ae8b0 0x7f782406e7d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f78240c3250 tx=0x7f7814009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38e5c84587e83240 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:53.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.482+0000 7f78227fc700 1 -- 172.21.15.27:0/1558502895 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7814004230 con 0x7f78240ae8b0 2023-07-05T23:32:53.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.482+0000 7f78227fc700 1 -- 172.21.15.27:0/1558502895 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7814004390 con 0x7f78240ae8b0 2023-07-05T23:32:53.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.482+0000 7f78227fc700 1 -- 172.21.15.27:0/1558502895 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78140036a0 con 0x7f78240ae8b0 2023-07-05T23:32:53.489 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.482+0000 7f7829dc7700 1 -- 172.21.15.27:0/1558502895 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f78240ae8b0 msgr2=0x7f782406e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:53.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.482+0000 7f7829dc7700 1 --2- 172.21.15.27:0/1558502895 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f78240ae8b0 0x7f782406e7d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f78240c3250 tx=0x7f7814009bd0 comp rx=0 tx=0).stop 2023-07-05T23:32:53.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.483+0000 7f7829dc7700 1 -- 172.21.15.27:0/1558502895 shutdown_connections 2023-07-05T23:32:53.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.483+0000 7f7829dc7700 1 --2- 172.21.15.27:0/1558502895 >> v2:172.21.15.162:3300/0 conn(0x7f78240acd10 0x7f782415e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:53.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.483+0000 7f7829dc7700 1 --2- 172.21.15.27:0/1558502895 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f78240ae8b0 0x7f782406e7d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:53.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.483+0000 7f7829dc7700 1 -- 172.21.15.27:0/1558502895 >> 172.21.15.27:0/1558502895 conn(0x7f782406b920 msgr2=0x7f78240cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:32:53.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.483+0000 7f7829dc7700 1 -- 172.21.15.27:0/1558502895 shutdown_connections 2023-07-05T23:32:53.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.483+0000 7f7829dc7700 1 -- 172.21.15.27:0/1558502895 wait complete. 2023-07-05T23:32:53.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.484+0000 7f7829dc7700 1 Processor -- start 2023-07-05T23:32:53.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.484+0000 7f7829dc7700 1 -- start start 2023-07-05T23:32:53.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.485+0000 7f7829dc7700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f78240acd10 0x7f7824152f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:53.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.485+0000 7f7829dc7700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f78240ae8b0 0x7f78240c4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:53.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.485+0000 7f7829dc7700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f782415a430 0x7f78240c5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:53.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.485+0000 7f7829dc7700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78241f1720 con 0x7f78240acd10 2023-07-05T23:32:53.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.485+0000 7f7829dc7700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78241f1440 con 0x7f78240ae8b0 2023-07-05T23:32:53.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.485+0000 7f7829dc7700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78240af610 con 0x7f782415a430 2023-07-05T23:32:53.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.485+0000 7f78237fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f78240acd10 0x7f7824152f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:53.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.485+0000 7f78237fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f78240acd10 0x7f7824152f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44658/0 (socket says 172.21.15.27:44658) 2023-07-05T23:32:53.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.485+0000 7f78237fe700 1 -- 172.21.15.27:0/3831727612 learned_addr learned my addr 172.21.15.27:0/3831727612 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:32:53.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.485+0000 7f7823fff700 1 --2- 172.21.15.27:0/3831727612 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f782415a430 0x7f78240c5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:53.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.485+0000 7f7822ffd700 1 --2- 172.21.15.27:0/3831727612 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f78240ae8b0 0x7f78240c4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:53.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.485+0000 7f78237fe700 1 -- 172.21.15.27:0/3831727612 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f782415a430 msgr2=0x7f78240c5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:53.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.485+0000 7f78237fe700 1 --2- 172.21.15.27:0/3831727612 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f782415a430 0x7f78240c5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:53.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.485+0000 7f78237fe700 1 -- 172.21.15.27:0/3831727612 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f78240ae8b0 msgr2=0x7f78240c4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:53.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.485+0000 7f78237fe700 1 --2- 172.21.15.27:0/3831727612 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f78240ae8b0 0x7f78240c4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:53.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.485+0000 7f78237fe700 1 -- 172.21.15.27:0/3831727612 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7814009550 con 0x7f78240acd10 2023-07-05T23:32:53.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.485+0000 7f78237fe700 1 --2- 172.21.15.27:0/3831727612 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f78240acd10 0x7f7824152f50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f781800b450 tx=0x7f781800b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:53.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.485+0000 7f780bfff700 1 -- 172.21.15.27:0/3831727612 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7818004020 con 0x7f78240acd10 2023-07-05T23:32:53.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.485+0000 7f780bfff700 1 -- 172.21.15.27:0/3831727612 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7818004180 con 0x7f78240acd10 2023-07-05T23:32:53.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.485+0000 7f7829dc7700 1 -- 172.21.15.27:0/3831727612 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78240af8f0 con 0x7f78240acd10 2023-07-05T23:32:53.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.485+0000 7f780bfff700 1 -- 172.21.15.27:0/3831727612 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7818004530 con 0x7f78240acd10 2023-07-05T23:32:53.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.485+0000 7f7829dc7700 1 -- 172.21.15.27:0/3831727612 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7824153490 con 0x7f78240acd10 2023-07-05T23:32:53.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.486+0000 7f7829dc7700 1 -- 172.21.15.27:0/3831727612 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78240af470 con 0x7f78240acd10 2023-07-05T23:32:53.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.487+0000 7f780bfff700 1 -- 172.21.15.27:0/3831727612 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f78180036d0 con 0x7f78240acd10 2023-07-05T23:32:53.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.487+0000 7f780bfff700 1 --2- 172.21.15.27:0/3831727612 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f781006ace0 0x7f781006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:53.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.487+0000 7f780bfff700 1 -- 172.21.15.27:0/3831727612 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7818088d00 con 0x7f78240acd10 2023-07-05T23:32:53.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.487+0000 7f7822ffd700 1 --2- 172.21.15.27:0/3831727612 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f781006ace0 0x7f781006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:53.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.488+0000 7f7822ffd700 1 --2- 172.21.15.27:0/3831727612 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f781006ace0 0x7f781006d190 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7814009130 tx=0x7f7814008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:53.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.492+0000 7f780bfff700 1 -- 172.21.15.27:0/3831727612 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f78240af470 con 0x7f78240acd10 2023-07-05T23:32:53.702 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:53.699+0000 7f7829dc7700 1 -- 172.21.15.27:0/3831727612 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f78240af470 con 0x7f78240acd10 2023-07-05T23:32:54.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.320+0000 7f780bfff700 1 -- 172.21.15.27:0/3831727612 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v24) v1 ==== 157+0+0 (secure 0 0 0) 0x7f78240af470 con 0x7f78240acd10 2023-07-05T23:32:54.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.323+0000 7f7829dc7700 1 -- 172.21.15.27:0/3831727612 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f781006ace0 msgr2=0x7f781006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:54.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.323+0000 7f7829dc7700 1 --2- 172.21.15.27:0/3831727612 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f781006ace0 0x7f781006d190 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7814009130 tx=0x7f7814008030 comp rx=0 tx=0).stop 2023-07-05T23:32:54.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.323+0000 7f7829dc7700 1 -- 172.21.15.27:0/3831727612 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f78240acd10 msgr2=0x7f7824152f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:54.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.323+0000 7f7829dc7700 1 --2- 172.21.15.27:0/3831727612 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f78240acd10 0x7f7824152f50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f781800b450 tx=0x7f781800b810 comp rx=0 tx=0).stop 2023-07-05T23:32:54.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.323+0000 7f7829dc7700 1 -- 172.21.15.27:0/3831727612 shutdown_connections 2023-07-05T23:32:54.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.323+0000 7f7829dc7700 1 --2- 172.21.15.27:0/3831727612 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f781006ace0 0x7f781006d190 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:54.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.323+0000 7f7829dc7700 1 --2- 172.21.15.27:0/3831727612 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f782415a430 0x7f78240c5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:54.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.323+0000 7f7829dc7700 1 --2- 172.21.15.27:0/3831727612 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f78240acd10 0x7f7824152f50 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:54.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.323+0000 7f7829dc7700 1 --2- 172.21.15.27:0/3831727612 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f78240ae8b0 0x7f78240c4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:54.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.323+0000 7f7829dc7700 1 -- 172.21.15.27:0/3831727612 >> 172.21.15.27:0/3831727612 conn(0x7f782406b920 msgr2=0x7f78240b2b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:32:54.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.323+0000 7f7829dc7700 1 -- 172.21.15.27:0/3831727612 shutdown_connections 2023-07-05T23:32:54.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.323+0000 7f7829dc7700 1 -- 172.21.15.27:0/3831727612 wait complete. 2023-07-05T23:32:54.340 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-07-05T23:32:54.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.474+0000 7fb4f9923700 1 Processor -- start 2023-07-05T23:32:54.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.474+0000 7fb4f9923700 1 -- start start 2023-07-05T23:32:54.479 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.475+0000 7fb4f9923700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4f40cd5e0 0x7fb4f40cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:54.479 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.475+0000 7fb4f9923700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb4f40adf40 0x7fb4f406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:54.480 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.475+0000 7fb4f9923700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4f406f0e0 con 0x7fb4f406e030 2023-07-05T23:32:54.480 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.475+0000 7fb4f9923700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4f40ce2c0 con 0x7fb4f40adf40 2023-07-05T23:32:54.480 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.475+0000 7fb4f9923700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f40cdef0 con 0x7fb4f40cd5e0 2023-07-05T23:32:54.480 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.475+0000 7fb4f37fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb4f40adf40 0x7fb4f406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:54.480 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.475+0000 7fb4f37fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb4f40adf40 0x7fb4f406e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44670/0 (socket says 172.21.15.27:44670) 2023-07-05T23:32:54.480 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.475+0000 7fb4f37fe700 1 -- 172.21.15.27:0/2126306766 learned_addr learned my addr 172.21.15.27:0/2126306766 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:32:54.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.475+0000 7fb4f27fc700 1 --1- 172.21.15.27:0/2126306766 >> v1:172.21.15.27:6789/0 conn(0x7fb4f406e030 0x7fb4f415cf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:51832/0 (socket says 172.21.15.27:51832) 2023-07-05T23:32:54.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.475+0000 7fb4f2ffd700 1 --2- 172.21.15.27:0/2126306766 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4f40cd5e0 0x7fb4f40cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:54.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.476+0000 7fb4f37fe700 1 -- 172.21.15.27:0/2126306766 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4f40cd5e0 msgr2=0x7fb4f40cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:32:54.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.476+0000 7fb4f37fe700 1 --2- 172.21.15.27:0/2126306766 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4f40cd5e0 0x7fb4f40cd9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:54.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.476+0000 7fb4f37fe700 1 -- 172.21.15.27:0/2126306766 >> v1:172.21.15.27:6789/0 conn(0x7fb4f406e030 legacy=0x7fb4f415cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:54.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.476+0000 7fb4f37fe700 1 -- 172.21.15.27:0/2126306766 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f406eb20 con 0x7fb4f40adf40 2023-07-05T23:32:54.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.476+0000 7fb4f37fe700 1 --2- 172.21.15.27:0/2126306766 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb4f40adf40 0x7fb4f406e4a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec009e50 tx=0x7fb4ec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90162770fc989901 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:54.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.476+0000 7fb4f1ffb700 1 -- 172.21.15.27:0/2126306766 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4ec00e070 con 0x7fb4f40adf40 2023-07-05T23:32:54.482 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.476+0000 7fb4f1ffb700 1 -- 172.21.15.27:0/2126306766 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4ec00b910 con 0x7fb4f40adf40 2023-07-05T23:32:54.482 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.476+0000 7fb4f1ffb700 1 -- 172.21.15.27:0/2126306766 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4ec00bcc0 con 0x7fb4f40adf40 2023-07-05T23:32:54.482 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.476+0000 7fb4f9923700 1 -- 172.21.15.27:0/2126306766 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb4f40adf40 msgr2=0x7fb4f406e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:54.482 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.476+0000 7fb4f9923700 1 --2- 172.21.15.27:0/2126306766 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb4f40adf40 0x7fb4f406e4a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec009e50 tx=0x7fb4ec00b330 comp rx=0 tx=0).stop 2023-07-05T23:32:54.482 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.477+0000 7fb4f9923700 1 -- 172.21.15.27:0/2126306766 shutdown_connections 2023-07-05T23:32:54.482 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.477+0000 7fb4f9923700 1 --2- 172.21.15.27:0/2126306766 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb4f40adf40 0x7fb4f406e4a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:54.482 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.477+0000 7fb4f9923700 1 --2- 172.21.15.27:0/2126306766 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4f40cd5e0 0x7fb4f40cd9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:54.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.477+0000 7fb4f9923700 1 -- 172.21.15.27:0/2126306766 >> 172.21.15.27:0/2126306766 conn(0x7fb4f406b920 msgr2=0x7fb4f40cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:32:54.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.477+0000 7fb4f9923700 1 -- 172.21.15.27:0/2126306766 shutdown_connections 2023-07-05T23:32:54.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.477+0000 7fb4f9923700 1 -- 172.21.15.27:0/2126306766 wait complete. 2023-07-05T23:32:54.485 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.478+0000 7fb4f9923700 1 Processor -- start 2023-07-05T23:32:54.485 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.478+0000 7fb4f9923700 1 -- start start 2023-07-05T23:32:54.485 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.479+0000 7fb4f9923700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4f406e030 0x7fb4f4150890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:54.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.479+0000 7fb4f9923700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb4f40adf40 0x7fb4f4150dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:54.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.479+0000 7fb4f9923700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4f40cd5e0 0x7fb4f40b09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:54.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.479+0000 7fb4f9923700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f40b2420 con 0x7fb4f40adf40 2023-07-05T23:32:54.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.479+0000 7fb4f9923700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f41521d0 con 0x7fb4f40cd5e0 2023-07-05T23:32:54.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.479+0000 7fb4f9923700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f4151310 con 0x7fb4f406e030 2023-07-05T23:32:54.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.479+0000 7fb4f27fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb4f40adf40 0x7fb4f4150dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:54.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.479+0000 7fb4f27fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb4f40adf40 0x7fb4f4150dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44674/0 (socket says 172.21.15.27:44674) 2023-07-05T23:32:54.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.479+0000 7fb4f27fc700 1 -- 172.21.15.27:0/1449184866 learned_addr learned my addr 172.21.15.27:0/1449184866 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:32:54.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.479+0000 7fb4f2ffd700 1 --2- 172.21.15.27:0/1449184866 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4f406e030 0x7fb4f4150890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:54.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.479+0000 7fb4f27fc700 1 -- 172.21.15.27:0/1449184866 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4f406e030 msgr2=0x7fb4f4150890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:54.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.479+0000 7fb4f27fc700 1 --2- 172.21.15.27:0/1449184866 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4f406e030 0x7fb4f4150890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:54.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.479+0000 7fb4f27fc700 1 -- 172.21.15.27:0/1449184866 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4f40cd5e0 msgr2=0x7fb4f40b09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:54.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.479+0000 7fb4f27fc700 1 --2- 172.21.15.27:0/1449184866 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4f40cd5e0 0x7fb4f40b09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:54.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.479+0000 7fb4f27fc700 1 -- 172.21.15.27:0/1449184866 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4ec009b30 con 0x7fb4f40adf40 2023-07-05T23:32:54.488 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.479+0000 7fb4f27fc700 1 --2- 172.21.15.27:0/1449184866 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb4f40adf40 0x7fb4f4150dd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb4e400c500 tx=0x7fb4e400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:54.488 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.479+0000 7fb4dbfff700 1 -- 172.21.15.27:0/1449184866 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e4005cb0 con 0x7fb4f40adf40 2023-07-05T23:32:54.488 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.479+0000 7fb4dbfff700 1 -- 172.21.15.27:0/1449184866 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e4005e10 con 0x7fb4f40adf40 2023-07-05T23:32:54.488 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.479+0000 7fb4dbfff700 1 -- 172.21.15.27:0/1449184866 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e40072d0 con 0x7fb4f40adf40 2023-07-05T23:32:54.488 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.479+0000 7fb4f9923700 1 -- 172.21.15.27:0/1449184866 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4f41515c0 con 0x7fb4f40adf40 2023-07-05T23:32:54.488 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.479+0000 7fb4f9923700 1 -- 172.21.15.27:0/1449184866 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4f4151b80 con 0x7fb4f40adf40 2023-07-05T23:32:54.488 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.480+0000 7fb4f9923700 1 -- 172.21.15.27:0/1449184866 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4f404ea20 con 0x7fb4f40adf40 2023-07-05T23:32:54.488 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.481+0000 7fb4dbfff700 1 -- 172.21.15.27:0/1449184866 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb4e4007430 con 0x7fb4f40adf40 2023-07-05T23:32:54.489 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.481+0000 7fb4dbfff700 1 --2- 172.21.15.27:0/1449184866 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fb4e006ace0 0x7fb4e006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:54.489 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.481+0000 7fb4dbfff700 1 -- 172.21.15.27:0/1449184866 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6288+0+0 (secure 0 0 0) 0x7fb4e4088930 con 0x7fb4f40adf40 2023-07-05T23:32:54.489 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.481+0000 7fb4f2ffd700 1 --2- 172.21.15.27:0/1449184866 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fb4e006ace0 0x7fb4e006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:54.489 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.482+0000 7fb4f2ffd700 1 --2- 172.21.15.27:0/1449184866 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fb4e006ace0 0x7fb4e006d190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb4e8009a90 tx=0x7fb4e8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:54.489 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.486+0000 7fb4dbfff700 1 -- 172.21.15.27:0/1449184866 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb4e4053930 con 0x7fb4f40adf40 2023-07-05T23:32:54.690 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:54.687+0000 7fb4f9923700 1 -- 172.21.15.27:0/1449184866 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fb4f4152310 con 0x7fb4f40adf40 2023-07-05T23:32:56.331 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.328+0000 7fb4dbfff700 1 -- 172.21.15.27:0/1449184866 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v26) v1 ==== 228+0+0 (secure 0 0 0) 0x7fb4e4056f50 con 0x7fb4f40adf40 2023-07-05T23:32:56.337 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.333+0000 7fb4f9923700 1 -- 172.21.15.27:0/1449184866 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fb4e006ace0 msgr2=0x7fb4e006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:56.337 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.333+0000 7fb4f9923700 1 --2- 172.21.15.27:0/1449184866 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fb4e006ace0 0x7fb4e006d190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb4e8009a90 tx=0x7fb4e8008040 comp rx=0 tx=0).stop 2023-07-05T23:32:56.337 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.333+0000 7fb4f9923700 1 -- 172.21.15.27:0/1449184866 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb4f40adf40 msgr2=0x7fb4f4150dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:56.338 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.333+0000 7fb4f9923700 1 --2- 172.21.15.27:0/1449184866 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb4f40adf40 0x7fb4f4150dd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb4e400c500 tx=0x7fb4e400c8c0 comp rx=0 tx=0).stop 2023-07-05T23:32:56.339 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.334+0000 7fb4f9923700 1 -- 172.21.15.27:0/1449184866 shutdown_connections 2023-07-05T23:32:56.339 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.334+0000 7fb4f9923700 1 --2- 172.21.15.27:0/1449184866 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4f40cd5e0 0x7fb4f40b09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:56.340 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.334+0000 7fb4f9923700 1 --2- 172.21.15.27:0/1449184866 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fb4e006ace0 0x7fb4e006d190 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:56.340 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.334+0000 7fb4f9923700 1 --2- 172.21.15.27:0/1449184866 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4f406e030 0x7fb4f4150890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:56.340 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.334+0000 7fb4f9923700 1 --2- 172.21.15.27:0/1449184866 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb4f40adf40 0x7fb4f4150dd0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:56.340 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.334+0000 7fb4f9923700 1 -- 172.21.15.27:0/1449184866 >> 172.21.15.27:0/1449184866 conn(0x7fb4f406b920 msgr2=0x7fb4f41547b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:32:56.341 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.336+0000 7fb4f9923700 1 -- 172.21.15.27:0/1449184866 shutdown_connections 2023-07-05T23:32:56.341 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.336+0000 7fb4f9923700 1 -- 172.21.15.27:0/1449184866 wait complete. 2023-07-05T23:32:56.343 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_data_ec' created 2023-07-05T23:32:56.357 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-07-05T23:32:56.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.489+0000 7f09f6b8b700 1 Processor -- start 2023-07-05T23:32:56.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.489+0000 7f09f6b8b700 1 -- start start 2023-07-05T23:32:56.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.489+0000 7f09f6b8b700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f09f015a330 0x7f09f0070980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:56.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.489+0000 7f09f6b8b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f09f00afc40 0x7f09f015dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:56.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.489+0000 7f09f6b8b700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09f00caf70 con 0x7f09f00cd330 2023-07-05T23:32:56.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.489+0000 7f09f6b8b700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09f00cb210 con 0x7f09f00afc40 2023-07-05T23:32:56.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.490+0000 7f09f6b8b700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09f00ccc20 con 0x7f09f015a330 2023-07-05T23:32:56.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.490+0000 7f09f5128700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f09f00afc40 0x7f09f015dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:56.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.490+0000 7f09f5128700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f09f00afc40 0x7f09f015dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44684/0 (socket says 172.21.15.27:44684) 2023-07-05T23:32:56.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.490+0000 7f09f5128700 1 -- 172.21.15.27:0/2618913396 learned_addr learned my addr 172.21.15.27:0/2618913396 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:32:56.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.490+0000 7f09f4927700 1 --1- 172.21.15.27:0/2618913396 >> v1:172.21.15.27:6789/0 conn(0x7f09f00cd330 0x7f09f00cd700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:51846/0 (socket says 172.21.15.27:51846) 2023-07-05T23:32:56.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.490+0000 7f09effff700 1 --2- 172.21.15.27:0/2618913396 >> v2:172.21.15.162:3300/0 conn(0x7f09f015a330 0x7f09f0070980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:56.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.490+0000 7f09f5128700 1 -- 172.21.15.27:0/2618913396 >> v2:172.21.15.162:3300/0 conn(0x7f09f015a330 msgr2=0x7f09f0070980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:32:56.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.490+0000 7f09f5128700 1 --2- 172.21.15.27:0/2618913396 >> v2:172.21.15.162:3300/0 conn(0x7f09f015a330 0x7f09f0070980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:56.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.490+0000 7f09f5128700 1 -- 172.21.15.27:0/2618913396 >> v1:172.21.15.27:6789/0 conn(0x7f09f00cd330 legacy=0x7f09f00cd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:56.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.490+0000 7f09f5128700 1 -- 172.21.15.27:0/2618913396 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f00ccf00 con 0x7f09f00afc40 2023-07-05T23:32:56.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.490+0000 7f09effff700 1 --2- 172.21.15.27:0/2618913396 >> v2:172.21.15.162:3300/0 conn(0x7f09f015a330 0x7f09f0070980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T23:32:56.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.490+0000 7f09f5128700 1 --2- 172.21.15.27:0/2618913396 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09f00afc40 0x7f09f015dc50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f09f00cc360 tx=0x7f09e800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abb3b7be98fc55e1 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:56.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.490+0000 7f09ef7fe700 1 -- 172.21.15.27:0/2618913396 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e800e070 con 0x7f09f00afc40 2023-07-05T23:32:56.497 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.490+0000 7f09ef7fe700 1 -- 172.21.15.27:0/2618913396 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e800b9c0 con 0x7f09f00afc40 2023-07-05T23:32:56.497 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.490+0000 7f09ef7fe700 1 -- 172.21.15.27:0/2618913396 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e800bd70 con 0x7f09f00afc40 2023-07-05T23:32:56.497 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.491+0000 7f09f6b8b700 1 -- 172.21.15.27:0/2618913396 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09f00afc40 msgr2=0x7f09f015dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:56.498 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.491+0000 7f09f6b8b700 1 --2- 172.21.15.27:0/2618913396 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09f00afc40 0x7f09f015dc50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f09f00cc360 tx=0x7f09e800b330 comp rx=0 tx=0).stop 2023-07-05T23:32:56.498 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.491+0000 7f09f6b8b700 1 -- 172.21.15.27:0/2618913396 shutdown_connections 2023-07-05T23:32:56.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.491+0000 7f09f6b8b700 1 --2- 172.21.15.27:0/2618913396 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09f00afc40 0x7f09f015dc50 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:56.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.491+0000 7f09f6b8b700 1 --2- 172.21.15.27:0/2618913396 >> v2:172.21.15.162:3300/0 conn(0x7f09f015a330 0x7f09f0070980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:56.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.491+0000 7f09f6b8b700 1 -- 172.21.15.27:0/2618913396 >> 172.21.15.27:0/2618913396 conn(0x7f09f006e5c0 msgr2=0x7f09f006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:32:56.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.491+0000 7f09f6b8b700 1 -- 172.21.15.27:0/2618913396 shutdown_connections 2023-07-05T23:32:56.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.491+0000 7f09f6b8b700 1 -- 172.21.15.27:0/2618913396 wait complete. 2023-07-05T23:32:56.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.492+0000 7f09f6b8b700 1 Processor -- start 2023-07-05T23:32:56.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.493+0000 7f09f6b8b700 1 -- start start 2023-07-05T23:32:56.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.494+0000 7f09f6b8b700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09f00afc40 0x7f09f0155750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:56.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.494+0000 7f09f6b8b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09f00cd330 0x7f09f0155c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:56.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.494+0000 7f09f6b8b700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09f015a330 0x7f09f01eff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:56.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.494+0000 7f09f6b8b700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f0157200 con 0x7f09f00cd330 2023-07-05T23:32:56.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.494+0000 7f09f6b8b700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f015c670 con 0x7f09f00afc40 2023-07-05T23:32:56.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.494+0000 7f09f6b8b700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09f015b780 con 0x7f09f015a330 2023-07-05T23:32:56.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.494+0000 7f09effff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09f00cd330 0x7f09f0155c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:56.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.494+0000 7f09effff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09f00cd330 0x7f09f0155c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44688/0 (socket says 172.21.15.27:44688) 2023-07-05T23:32:56.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.494+0000 7f09effff700 1 -- 172.21.15.27:0/4024938406 learned_addr learned my addr 172.21.15.27:0/4024938406 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:32:56.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.494+0000 7f09f4927700 1 --2- 172.21.15.27:0/4024938406 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09f00afc40 0x7f09f0155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:56.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.494+0000 7f09f5128700 1 --2- 172.21.15.27:0/4024938406 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09f015a330 0x7f09f01eff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:56.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.494+0000 7f09effff700 1 -- 172.21.15.27:0/4024938406 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09f015a330 msgr2=0x7f09f01eff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:56.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.494+0000 7f09effff700 1 --2- 172.21.15.27:0/4024938406 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09f015a330 0x7f09f01eff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:56.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.494+0000 7f09effff700 1 -- 172.21.15.27:0/4024938406 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09f00afc40 msgr2=0x7f09f0155750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:56.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.494+0000 7f09effff700 1 --2- 172.21.15.27:0/4024938406 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09f00afc40 0x7f09f0155750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:56.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.494+0000 7f09effff700 1 -- 172.21.15.27:0/4024938406 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e8009b30 con 0x7f09f00cd330 2023-07-05T23:32:56.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.494+0000 7f09effff700 1 --2- 172.21.15.27:0/4024938406 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09f00cd330 0x7f09f0155c90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f09dc00c780 tx=0x7f09dc00cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:56.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.494+0000 7f09ed7fa700 1 -- 172.21.15.27:0/4024938406 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09dc011800 con 0x7f09f00cd330 2023-07-05T23:32:56.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.494+0000 7f09ed7fa700 1 -- 172.21.15.27:0/4024938406 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09dc011960 con 0x7f09f00cd330 2023-07-05T23:32:56.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.494+0000 7f09f6b8b700 1 -- 172.21.15.27:0/4024938406 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09f015ba60 con 0x7f09f00cd330 2023-07-05T23:32:56.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.494+0000 7f09ed7fa700 1 -- 172.21.15.27:0/4024938406 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09dc011d10 con 0x7f09f00cd330 2023-07-05T23:32:56.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.494+0000 7f09f6b8b700 1 -- 172.21.15.27:0/4024938406 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09f015c020 con 0x7f09f00cd330 2023-07-05T23:32:56.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.495+0000 7f09f6b8b700 1 -- 172.21.15.27:0/4024938406 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09f01579e0 con 0x7f09f00cd330 2023-07-05T23:32:56.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.496+0000 7f09ed7fa700 1 -- 172.21.15.27:0/4024938406 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f09dc018360 con 0x7f09f00cd330 2023-07-05T23:32:56.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.496+0000 7f09ed7fa700 1 --2- 172.21.15.27:0/4024938406 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f09d406ace0 0x7f09d406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:56.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.496+0000 7f09ed7fa700 1 -- 172.21.15.27:0/4024938406 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6781+0+0 (secure 0 0 0) 0x7f09dc0896d0 con 0x7f09f00cd330 2023-07-05T23:32:56.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.496+0000 7f09f4927700 1 --2- 172.21.15.27:0/4024938406 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f09d406ace0 0x7f09d406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:56.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.497+0000 7f09f4927700 1 --2- 172.21.15.27:0/4024938406 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f09d406ace0 0x7f09d406d190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f09e4000f60 tx=0x7f09e4007d10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:56.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.501+0000 7f09ed7fa700 1 -- 172.21.15.27:0/4024938406 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f09dc054540 con 0x7f09f00cd330 2023-07-05T23:32:56.700 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:56.698+0000 7f09f6b8b700 1 -- 172.21.15.27:0/4024938406 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f09f015c7e0 con 0x7f09f00cd330 2023-07-05T23:32:57.339 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.336+0000 7f09ed7fa700 1 -- 172.21.15.27:0/4024938406 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 5 allow_ec_overwrites to true v27) v1 ==== 169+0+0 (secure 0 0 0) 0x7f09dc057b60 con 0x7f09f00cd330 2023-07-05T23:32:57.351 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.348+0000 7f09f6b8b700 1 -- 172.21.15.27:0/4024938406 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f09d406ace0 msgr2=0x7f09d406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:57.351 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.348+0000 7f09f6b8b700 1 --2- 172.21.15.27:0/4024938406 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f09d406ace0 0x7f09d406d190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f09e4000f60 tx=0x7f09e4007d10 comp rx=0 tx=0).stop 2023-07-05T23:32:57.351 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.348+0000 7f09f6b8b700 1 -- 172.21.15.27:0/4024938406 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09f00cd330 msgr2=0x7f09f0155c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:57.352 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.348+0000 7f09f6b8b700 1 --2- 172.21.15.27:0/4024938406 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09f00cd330 0x7f09f0155c90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f09dc00c780 tx=0x7f09dc00cb40 comp rx=0 tx=0).stop 2023-07-05T23:32:57.352 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.348+0000 7f09f6b8b700 1 -- 172.21.15.27:0/4024938406 shutdown_connections 2023-07-05T23:32:57.352 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.348+0000 7f09f6b8b700 1 --2- 172.21.15.27:0/4024938406 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09f00afc40 0x7f09f0155750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:57.352 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.348+0000 7f09f6b8b700 1 --2- 172.21.15.27:0/4024938406 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f09d406ace0 0x7f09d406d190 secure :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f09e4000f60 tx=0x7f09e4007d10 comp rx=0 tx=0).stop 2023-07-05T23:32:57.352 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.348+0000 7f09f6b8b700 1 --2- 172.21.15.27:0/4024938406 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09f015a330 0x7f09f01eff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:57.353 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.348+0000 7f09f6b8b700 1 --2- 172.21.15.27:0/4024938406 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09f00cd330 0x7f09f0155c90 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:57.353 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.349+0000 7f09f6b8b700 1 -- 172.21.15.27:0/4024938406 >> 172.21.15.27:0/4024938406 conn(0x7f09f006e5c0 msgr2=0x7f09f00cea60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:32:57.357 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.354+0000 7f09f6b8b700 1 -- 172.21.15.27:0/4024938406 shutdown_connections 2023-07-05T23:32:57.357 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.354+0000 7f09f6b8b700 1 -- 172.21.15.27:0/4024938406 wait complete. 2023-07-05T23:32:57.360 INFO:teuthology.orchestra.run.smithi027.stderr:set pool 5 allow_ec_overwrites to true 2023-07-05T23:32:57.380 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-07-05T23:32:57.514 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.511+0000 7fdff368b700 1 Processor -- start 2023-07-05T23:32:57.514 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.512+0000 7fdff368b700 1 -- start start 2023-07-05T23:32:57.515 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.512+0000 7fdff368b700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fdfec0aecc0 0x7fdfec06a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:57.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.512+0000 7fdff368b700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdfec06e970 0x7fdfec0ac600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:57.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.512+0000 7fdff368b700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfec0ce620 con 0x7fdfec15fc60 2023-07-05T23:32:57.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.512+0000 7fdff368b700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfec160580 con 0x7fdfec0aecc0 2023-07-05T23:32:57.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.512+0000 7fdff368b700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfec160860 con 0x7fdfec06e970 2023-07-05T23:32:57.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.513+0000 7fdff0c26700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fdfec0aecc0 0x7fdfec06a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:57.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.513+0000 7fdff1c28700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdfec06e970 0x7fdfec0ac600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:57.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.513+0000 7fdff0c26700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fdfec0aecc0 0x7fdfec06a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.27:42634/0 (socket says 172.21.15.27:42634) 2023-07-05T23:32:57.517 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.513+0000 7fdff0c26700 1 -- 172.21.15.27:0/410950141 learned_addr learned my addr 172.21.15.27:0/410950141 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:32:57.518 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.513+0000 7fdff0c26700 1 -- 172.21.15.27:0/410950141 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdfec06e970 msgr2=0x7fdfec0ac600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:32:57.518 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.513+0000 7fdff0c26700 1 --2- 172.21.15.27:0/410950141 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdfec06e970 0x7fdfec0ac600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:57.518 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.513+0000 7fdff0c26700 1 -- 172.21.15.27:0/410950141 >> v1:172.21.15.162:6789/0 conn(0x7fdfec15fc60 legacy=0x7fdfec06e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:57.518 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.513+0000 7fdff0c26700 1 -- 172.21.15.27:0/410950141 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfec160b40 con 0x7fdfec0aecc0 2023-07-05T23:32:57.518 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.513+0000 7fdff1c28700 1 --2- 172.21.15.27:0/410950141 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdfec06e970 0x7fdfec0ac600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T23:32:57.518 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.513+0000 7fdff0c26700 1 --2- 172.21.15.27:0/410950141 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdfec0aecc0 0x7fdfec06a900 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdfe80098f0 tx=0x7fdfe8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c93e5b8f94e444e5 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:57.519 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.513+0000 7fdfe3fff700 1 -- 172.21.15.27:0/410950141 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe8011830 con 0x7fdfec0aecc0 2023-07-05T23:32:57.519 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.514+0000 7fdfe3fff700 1 -- 172.21.15.27:0/410950141 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfe8011990 con 0x7fdfec0aecc0 2023-07-05T23:32:57.519 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.514+0000 7fdfe3fff700 1 -- 172.21.15.27:0/410950141 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe8011d20 con 0x7fdfec0aecc0 2023-07-05T23:32:57.519 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.514+0000 7fdff368b700 1 -- 172.21.15.27:0/410950141 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdfec0aecc0 msgr2=0x7fdfec06a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:57.519 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.514+0000 7fdff368b700 1 --2- 172.21.15.27:0/410950141 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdfec0aecc0 0x7fdfec06a900 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdfe80098f0 tx=0x7fdfe8009c00 comp rx=0 tx=0).stop 2023-07-05T23:32:57.519 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.514+0000 7fdff368b700 1 -- 172.21.15.27:0/410950141 shutdown_connections 2023-07-05T23:32:57.519 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.514+0000 7fdff368b700 1 --2- 172.21.15.27:0/410950141 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdfec06e970 0x7fdfec0ac600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:57.520 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.514+0000 7fdff368b700 1 --2- 172.21.15.27:0/410950141 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdfec0aecc0 0x7fdfec06a900 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:57.520 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.514+0000 7fdff368b700 1 -- 172.21.15.27:0/410950141 >> 172.21.15.27:0/410950141 conn(0x7fdfec06b920 msgr2=0x7fdfec0cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:32:57.520 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.514+0000 7fdff368b700 1 -- 172.21.15.27:0/410950141 shutdown_connections 2023-07-05T23:32:57.520 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.514+0000 7fdff368b700 1 -- 172.21.15.27:0/410950141 wait complete. 2023-07-05T23:32:57.522 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.515+0000 7fdff368b700 1 Processor -- start 2023-07-05T23:32:57.522 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.515+0000 7fdff368b700 1 -- start start 2023-07-05T23:32:57.522 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.516+0000 7fdff368b700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdfec06e970 0x7fdfec0c5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:57.522 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.516+0000 7fdff368b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdfec0aecc0 0x7fdfec1e7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:57.522 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.516+0000 7fdff368b700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdfec15fc60 0x7fdfec1e7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:57.523 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.516+0000 7fdff368b700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfec1e7ed0 con 0x7fdfec0aecc0 2023-07-05T23:32:57.523 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.516+0000 7fdff368b700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfec0b4080 con 0x7fdfec06e970 2023-07-05T23:32:57.523 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.516+0000 7fdff368b700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfec0c3540 con 0x7fdfec15fc60 2023-07-05T23:32:57.523 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.516+0000 7fdff0c26700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdfec0aecc0 0x7fdfec1e7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:57.523 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.516+0000 7fdff0c26700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdfec0aecc0 0x7fdfec1e7450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44702/0 (socket says 172.21.15.27:44702) 2023-07-05T23:32:57.523 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.516+0000 7fdff0c26700 1 -- 172.21.15.27:0/2925558862 learned_addr learned my addr 172.21.15.27:0/2925558862 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:32:57.523 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.516+0000 7fdff1427700 1 --2- 172.21.15.27:0/2925558862 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdfec06e970 0x7fdfec0c5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:57.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.517+0000 7fdff1c28700 1 --2- 172.21.15.27:0/2925558862 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdfec15fc60 0x7fdfec1e7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:57.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.517+0000 7fdff0c26700 1 -- 172.21.15.27:0/2925558862 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdfec15fc60 msgr2=0x7fdfec1e7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:57.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.517+0000 7fdff0c26700 1 --2- 172.21.15.27:0/2925558862 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdfec15fc60 0x7fdfec1e7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:57.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.517+0000 7fdff0c26700 1 -- 172.21.15.27:0/2925558862 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdfec06e970 msgr2=0x7fdfec0c5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:57.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.517+0000 7fdff0c26700 1 --2- 172.21.15.27:0/2925558862 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdfec06e970 0x7fdfec0c5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:57.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.517+0000 7fdff0c26700 1 -- 172.21.15.27:0/2925558862 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfe4009a70 con 0x7fdfec0aecc0 2023-07-05T23:32:57.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.517+0000 7fdff1427700 1 --2- 172.21.15.27:0/2925558862 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdfec06e970 0x7fdfec0c5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T23:32:57.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.517+0000 7fdff0c26700 1 --2- 172.21.15.27:0/2925558862 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdfec0aecc0 0x7fdfec1e7450 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fdfe8000c00 tx=0x7fdfe8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:57.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.517+0000 7fdfe1ffb700 1 -- 172.21.15.27:0/2925558862 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe8004570 con 0x7fdfec0aecc0 2023-07-05T23:32:57.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.517+0000 7fdfe1ffb700 1 -- 172.21.15.27:0/2925558862 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfe801f070 con 0x7fdfec0aecc0 2023-07-05T23:32:57.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.517+0000 7fdff368b700 1 -- 172.21.15.27:0/2925558862 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfe8009550 con 0x7fdfec0aecc0 2023-07-05T23:32:57.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.517+0000 7fdfe1ffb700 1 -- 172.21.15.27:0/2925558862 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe80038c0 con 0x7fdfec0aecc0 2023-07-05T23:32:57.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.517+0000 7fdff368b700 1 -- 172.21.15.27:0/2925558862 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfec0c3b00 con 0x7fdfec0aecc0 2023-07-05T23:32:57.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.518+0000 7fdff368b700 1 -- 172.21.15.27:0/2925558862 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfec04ea20 con 0x7fdfec0aecc0 2023-07-05T23:32:57.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.519+0000 7fdfe1ffb700 1 -- 172.21.15.27:0/2925558862 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdfe8021030 con 0x7fdfec0aecc0 2023-07-05T23:32:57.526 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.519+0000 7fdfe1ffb700 1 --2- 172.21.15.27:0/2925558862 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fdfd006ace0 0x7fdfd006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:57.526 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.519+0000 7fdfe1ffb700 1 -- 172.21.15.27:0/2925558862 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6781+0+0 (secure 0 0 0) 0x7fdfe808abd0 con 0x7fdfec0aecc0 2023-07-05T23:32:57.526 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.519+0000 7fdff1427700 1 --2- 172.21.15.27:0/2925558862 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fdfd006ace0 0x7fdfd006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:57.526 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.520+0000 7fdff1427700 1 --2- 172.21.15.27:0/2925558862 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fdfd006ace0 0x7fdfd006d190 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc000fb0 tx=0x7fdfdc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:57.526 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.524+0000 7fdfe1ffb700 1 -- 172.21.15.27:0/2925558862 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdfe8055b60 con 0x7fdfec0aecc0 2023-07-05T23:32:57.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.767+0000 7fdff368b700 1 -- 172.21.15.27:0/2925558862 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7fdfec0b5990 con 0x7fdfec0aecc0 2023-07-05T23:32:57.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.775+0000 7fdfe1ffb700 1 -- 172.21.15.27:0/2925558862 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 5 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7fdfe80150b0 con 0x7fdfec0aecc0 2023-07-05T23:32:57.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.780+0000 7fdff368b700 1 -- 172.21.15.27:0/2925558862 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fdfd006ace0 msgr2=0x7fdfd006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:57.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.780+0000 7fdff368b700 1 --2- 172.21.15.27:0/2925558862 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fdfd006ace0 0x7fdfd006d190 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc000fb0 tx=0x7fdfdc009040 comp rx=0 tx=0).stop 2023-07-05T23:32:57.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.780+0000 7fdff368b700 1 -- 172.21.15.27:0/2925558862 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdfec0aecc0 msgr2=0x7fdfec1e7450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:57.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.780+0000 7fdff368b700 1 --2- 172.21.15.27:0/2925558862 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdfec0aecc0 0x7fdfec1e7450 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fdfe8000c00 tx=0x7fdfe8004750 comp rx=0 tx=0).stop 2023-07-05T23:32:57.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.780+0000 7fdff368b700 1 -- 172.21.15.27:0/2925558862 shutdown_connections 2023-07-05T23:32:57.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.780+0000 7fdff368b700 1 --2- 172.21.15.27:0/2925558862 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdfec06e970 0x7fdfec0c5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:57.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.780+0000 7fdff368b700 1 --2- 172.21.15.27:0/2925558862 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fdfd006ace0 0x7fdfd006d190 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:57.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.780+0000 7fdff368b700 1 --2- 172.21.15.27:0/2925558862 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdfec15fc60 0x7fdfec1e7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:57.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.780+0000 7fdff368b700 1 --2- 172.21.15.27:0/2925558862 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdfec0aecc0 0x7fdfec1e7450 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:57.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.780+0000 7fdff368b700 1 -- 172.21.15.27:0/2925558862 >> 172.21.15.27:0/2925558862 conn(0x7fdfec06b920 msgr2=0x7fdfec0b07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:32:57.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.780+0000 7fdff368b700 1 -- 172.21.15.27:0/2925558862 shutdown_connections 2023-07-05T23:32:57.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.780+0000 7fdff368b700 1 -- 172.21.15.27:0/2925558862 wait complete. 2023-07-05T23:32:57.786 INFO:teuthology.orchestra.run.smithi027.stderr:added data pool 5 to fsmap 2023-07-05T23:32:57.795 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-05T23:32:57.881 INFO:tasks.ceph.mds.a.smithi027.stderr:2023-07-05T23:32:57.877+0000 7fa2ecc71700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-05T23:32:57.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.917+0000 7ff31d409700 1 Processor -- start 2023-07-05T23:32:57.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.917+0000 7ff31d409700 1 -- start start 2023-07-05T23:32:57.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.918+0000 7ff31d409700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff3180aed30 0x7ff318160580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:57.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.918+0000 7ff31d409700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff3180cc1d0 0x7ff3180cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:57.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.918+0000 7ff31d409700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3180ccb50 con 0x7ff318156880 2023-07-05T23:32:57.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.918+0000 7ff31d409700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3180cee80 con 0x7ff3180cc1d0 2023-07-05T23:32:57.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.918+0000 7ff31d409700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3180cf100 con 0x7ff3180aed30 2023-07-05T23:32:57.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.918+0000 7ff3177fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff3180cc1d0 0x7ff3180cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:57.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.918+0000 7ff3177fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff3180cc1d0 0x7ff3180cc610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44712/0 (socket says 172.21.15.27:44712) 2023-07-05T23:32:57.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.918+0000 7ff316ffd700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7ff318156880 0x7ff318069ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:51874/0 (socket says 172.21.15.27:51874) 2023-07-05T23:32:57.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.918+0000 7ff3177fe700 1 -- 172.21.15.27:0/325414812 learned_addr learned my addr 172.21.15.27:0/325414812 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:32:57.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.919+0000 7ff3167fc700 1 --2- 172.21.15.27:0/325414812 >> v2:172.21.15.162:3300/0 conn(0x7ff3180aed30 0x7ff318160580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:57.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.919+0000 7ff3177fe700 1 -- 172.21.15.27:0/325414812 >> v2:172.21.15.162:3300/0 conn(0x7ff3180aed30 msgr2=0x7ff318160580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:32:57.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.919+0000 7ff3177fe700 1 --2- 172.21.15.27:0/325414812 >> v2:172.21.15.162:3300/0 conn(0x7ff3180aed30 0x7ff318160580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:57.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.919+0000 7ff3177fe700 1 -- 172.21.15.27:0/325414812 >> v1:172.21.15.27:6789/0 conn(0x7ff318156880 legacy=0x7ff318069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:57.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.919+0000 7ff315ffb700 1 -- 172.21.15.27:0/325414812 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2933912244 0 0) 0x7ff3180ccb50 con 0x7ff318156880 2023-07-05T23:32:57.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.919+0000 7ff3177fe700 1 -- 172.21.15.27:0/325414812 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3180cf3e0 con 0x7ff3180cc1d0 2023-07-05T23:32:57.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.919+0000 7ff3177fe700 1 --2- 172.21.15.27:0/325414812 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3180cc1d0 0x7ff3180cc610 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff31806ffc0 tx=0x7ff31000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=302c808cb2a70b2 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:57.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.919+0000 7ff315ffb700 1 -- 172.21.15.27:0/325414812 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31000e070 con 0x7ff3180cc1d0 2023-07-05T23:32:57.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.919+0000 7ff315ffb700 1 -- 172.21.15.27:0/325414812 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff31000b9c0 con 0x7ff3180cc1d0 2023-07-05T23:32:57.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.919+0000 7ff315ffb700 1 -- 172.21.15.27:0/325414812 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31000bd70 con 0x7ff3180cc1d0 2023-07-05T23:32:57.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.920+0000 7ff31d409700 1 -- 172.21.15.27:0/325414812 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3180cc1d0 msgr2=0x7ff3180cc610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:57.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.920+0000 7ff31d409700 1 --2- 172.21.15.27:0/325414812 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3180cc1d0 0x7ff3180cc610 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff31806ffc0 tx=0x7ff31000b330 comp rx=0 tx=0).stop 2023-07-05T23:32:57.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.920+0000 7ff31d409700 1 -- 172.21.15.27:0/325414812 shutdown_connections 2023-07-05T23:32:57.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.920+0000 7ff31d409700 1 --2- 172.21.15.27:0/325414812 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3180cc1d0 0x7ff3180cc610 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:57.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.920+0000 7ff31d409700 1 --2- 172.21.15.27:0/325414812 >> v2:172.21.15.162:3300/0 conn(0x7ff3180aed30 0x7ff318160580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:57.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.920+0000 7ff31d409700 1 -- 172.21.15.27:0/325414812 >> 172.21.15.27:0/325414812 conn(0x7ff31806d4a0 msgr2=0x7ff31806d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:32:57.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.920+0000 7ff31d409700 1 -- 172.21.15.27:0/325414812 shutdown_connections 2023-07-05T23:32:57.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.920+0000 7ff31d409700 1 -- 172.21.15.27:0/325414812 wait complete. 2023-07-05T23:32:57.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.921+0000 7ff31d409700 1 Processor -- start 2023-07-05T23:32:57.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.921+0000 7ff31d409700 1 -- start start 2023-07-05T23:32:57.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.922+0000 7ff31d409700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff3180aed30 0x7ff3180ab8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:57.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.922+0000 7ff31d409700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3180cc1d0 0x7ff318155300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:57.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.922+0000 7ff31d409700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff318156880 0x7ff3180c5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:57.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.922+0000 7ff31d409700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3180acb70 con 0x7ff3180cc1d0 2023-07-05T23:32:57.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.922+0000 7ff31d409700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3180abf60 con 0x7ff3180aed30 2023-07-05T23:32:57.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.922+0000 7ff31d409700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3180ac240 con 0x7ff318156880 2023-07-05T23:32:57.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.922+0000 7ff3167fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3180cc1d0 0x7ff318155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:57.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.922+0000 7ff3167fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3180cc1d0 0x7ff318155300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44716/0 (socket says 172.21.15.27:44716) 2023-07-05T23:32:57.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.922+0000 7ff3167fc700 1 -- 172.21.15.27:0/2293186702 learned_addr learned my addr 172.21.15.27:0/2293186702 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:32:57.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.922+0000 7ff316ffd700 1 --2- 172.21.15.27:0/2293186702 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff3180aed30 0x7ff3180ab8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:57.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.922+0000 7ff3177fe700 1 --2- 172.21.15.27:0/2293186702 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff318156880 0x7ff3180c5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:57.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.922+0000 7ff3167fc700 1 -- 172.21.15.27:0/2293186702 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff318156880 msgr2=0x7ff3180c5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:57.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.922+0000 7ff3167fc700 1 --2- 172.21.15.27:0/2293186702 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff318156880 0x7ff3180c5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:57.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.922+0000 7ff3167fc700 1 -- 172.21.15.27:0/2293186702 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff3180aed30 msgr2=0x7ff3180ab8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:57.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.922+0000 7ff3167fc700 1 --2- 172.21.15.27:0/2293186702 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff3180aed30 0x7ff3180ab8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:57.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.922+0000 7ff3167fc700 1 -- 172.21.15.27:0/2293186702 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff310009b30 con 0x7ff3180cc1d0 2023-07-05T23:32:57.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.922+0000 7ff3167fc700 1 --2- 172.21.15.27:0/2293186702 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3180cc1d0 0x7ff318155300 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff30000e810 tx=0x7ff30000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:57.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.922+0000 7ff30f7fe700 1 -- 172.21.15.27:0/2293186702 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff300013610 con 0x7ff3180cc1d0 2023-07-05T23:32:57.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.923+0000 7ff30f7fe700 1 -- 172.21.15.27:0/2293186702 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff300013770 con 0x7ff3180cc1d0 2023-07-05T23:32:57.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.923+0000 7ff31d409700 1 -- 172.21.15.27:0/2293186702 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3180ac520 con 0x7ff3180cc1d0 2023-07-05T23:32:57.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.923+0000 7ff30f7fe700 1 -- 172.21.15.27:0/2293186702 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff300013b20 con 0x7ff3180cc1d0 2023-07-05T23:32:57.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.923+0000 7ff31d409700 1 -- 172.21.15.27:0/2293186702 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff318155840 con 0x7ff3180cc1d0 2023-07-05T23:32:57.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.923+0000 7ff31d409700 1 -- 172.21.15.27:0/2293186702 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3180acce0 con 0x7ff3180cc1d0 2023-07-05T23:32:57.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.924+0000 7ff30f7fe700 1 -- 172.21.15.27:0/2293186702 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff300013c80 con 0x7ff3180cc1d0 2023-07-05T23:32:57.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.924+0000 7ff30f7fe700 1 --2- 172.21.15.27:0/2293186702 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7ff2f806ace0 0x7ff2f806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:57.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.925+0000 7ff30f7fe700 1 -- 172.21.15.27:0/2293186702 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff300089360 con 0x7ff3180cc1d0 2023-07-05T23:32:57.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.925+0000 7ff316ffd700 1 --2- 172.21.15.27:0/2293186702 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7ff2f806ace0 0x7ff2f806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:57.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.925+0000 7ff316ffd700 1 --2- 172.21.15.27:0/2293186702 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7ff2f806ace0 0x7ff2f806d190 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff308000f60 tx=0x7ff308007e70 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:57.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:57.929+0000 7ff30f7fe700 1 -- 172.21.15.27:0/2293186702 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff300057bc0 con 0x7ff3180cc1d0 2023-07-05T23:32:58.175 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.172+0000 7ff31d409700 1 -- 172.21.15.27:0/2293186702 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff318073910 con 0x7ff3180cc1d0 2023-07-05T23:32:58.176 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.173+0000 7ff30f7fe700 1 -- 172.21.15.27:0/2293186702 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4670 (secure 0 0 0) 0x7ff300057750 con 0x7ff3180cc1d0 2023-07-05T23:32:58.177 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:32:58.177 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/4263442347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":4263442347},{"type":"v1","addr":"172.21.15.162:6837","nonce":4263442347}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/2486008632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2486008632},{"type":"v1","addr":"172.21.15.162:6836","nonce":2486008632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/217781445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":217781445},{"type":"v1","addr":"172.21.15.27:6834","nonce":217781445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-05T23:32:53.313219+0000","modified":"2023-07-05T23:32:57.769151+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6835/3387103520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":3387103520},{"type":"v1","addr":"172.21.15.27:6835","nonce":3387103520}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-07-05T23:32:58.179 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.175+0000 7ff31d409700 1 -- 172.21.15.27:0/2293186702 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7ff2f806ace0 msgr2=0x7ff2f806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:58.179 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.175+0000 7ff31d409700 1 --2- 172.21.15.27:0/2293186702 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7ff2f806ace0 0x7ff2f806d190 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff308000f60 tx=0x7ff308007e70 comp rx=0 tx=0).stop 2023-07-05T23:32:58.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.175+0000 7ff31d409700 1 -- 172.21.15.27:0/2293186702 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3180cc1d0 msgr2=0x7ff318155300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:58.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.175+0000 7ff31d409700 1 --2- 172.21.15.27:0/2293186702 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3180cc1d0 0x7ff318155300 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff30000e810 tx=0x7ff30000eb20 comp rx=0 tx=0).stop 2023-07-05T23:32:58.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.175+0000 7ff31d409700 1 -- 172.21.15.27:0/2293186702 shutdown_connections 2023-07-05T23:32:58.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.175+0000 7ff31d409700 1 --2- 172.21.15.27:0/2293186702 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff3180aed30 0x7ff3180ab8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:58.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.175+0000 7ff31d409700 1 --2- 172.21.15.27:0/2293186702 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7ff2f806ace0 0x7ff2f806d190 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:58.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.175+0000 7ff31d409700 1 --2- 172.21.15.27:0/2293186702 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff318156880 0x7ff3180c5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:58.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.175+0000 7ff31d409700 1 --2- 172.21.15.27:0/2293186702 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3180cc1d0 0x7ff318155300 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:58.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.175+0000 7ff31d409700 1 -- 172.21.15.27:0/2293186702 >> 172.21.15.27:0/2293186702 conn(0x7ff31806d4a0 msgr2=0x7ff31815dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:32:58.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.175+0000 7ff31d409700 1 -- 172.21.15.27:0/2293186702 shutdown_connections 2023-07-05T23:32:58.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.175+0000 7ff31d409700 1 -- 172.21.15.27:0/2293186702 wait complete. 2023-07-05T23:32:58.182 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 7 2023-07-05T23:32:58.190 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-05T23:32:58.314 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.311+0000 7f00e6feb700 1 Processor -- start 2023-07-05T23:32:58.314 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.311+0000 7f00e6feb700 1 -- start start 2023-07-05T23:32:58.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.312+0000 7f00e6feb700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00e015d700 0x7f00e006e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:58.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.312+0000 7f00e6feb700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00e006f220 con 0x7f00e015cb60 2023-07-05T23:32:58.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.312+0000 7f00e6feb700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00e00c9e60 con 0x7f00e00caea0 2023-07-05T23:32:58.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.312+0000 7f00e6feb700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00e00ca0e0 con 0x7f00e015d700 2023-07-05T23:32:58.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.312+0000 7f00e4d87700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f00e015cb60 0x7f00e015cf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:51888/0 (socket says 172.21.15.27:51888) 2023-07-05T23:32:58.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.312+0000 7f00e4d87700 1 -- 172.21.15.27:0/3571182450 learned_addr learned my addr 172.21.15.27:0/3571182450 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-07-05T23:32:58.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.312+0000 7f00df7fe700 1 -- 172.21.15.27:0/3571182450 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2192462689 0 0) 0x7f00d4001110 con 0x7f00e015cb60 2023-07-05T23:32:58.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.312+0000 7f00df7fe700 1 -- 172.21.15.27:0/3571182450 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00d00035b0 con 0x7f00e015cb60 2023-07-05T23:32:58.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.312+0000 7f00dffff700 1 --2- 172.21.15.27:0/3571182450 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00e015d700 0x7f00e006e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:58.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.312+0000 7f00df7fe700 1 -- 172.21.15.27:0/3571182450 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1936602600 0 0) 0x7f00d00035b0 con 0x7f00e015cb60 2023-07-05T23:32:58.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.312+0000 7f00df7fe700 1 -- 172.21.15.27:0/3571182450 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00e015d700 msgr2=0x7f00e006e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:32:58.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.312+0000 7f00df7fe700 1 --2- 172.21.15.27:0/3571182450 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00e015d700 0x7f00e006e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:58.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.312+0000 7f00df7fe700 1 -- 172.21.15.27:0/3571182450 >> v1:172.21.15.162:6789/0 conn(0x7f00e00caea0 legacy=0x7f00e00ccb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:58.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.312+0000 7f00df7fe700 1 -- 172.21.15.27:0/3571182450 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e00ca3c0 con 0x7f00e015cb60 2023-07-05T23:32:58.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.313+0000 7f00df7fe700 1 -- 172.21.15.27:0/3571182450 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1246168953 0 0) 0x7f00d4001800 con 0x7f00e015cb60 2023-07-05T23:32:58.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.313+0000 7f00df7fe700 1 -- 172.21.15.27:0/3571182450 >> v1:172.21.15.27:6789/0 conn(0x7f00e015cb60 legacy=0x7f00e015cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:58.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.313+0000 7f00df7fe700 1 --2- 172.21.15.27:0/3571182450 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00d0003a30 0x7f00d0003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:58.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.313+0000 7f00df7fe700 1 --2- 172.21.15.27:0/3571182450 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00e015d700 0x7f00d0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:58.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.313+0000 7f00df7fe700 1 --2- 172.21.15.27:0/3571182450 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00d0004d90 0x7f00d0005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:58.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.313+0000 7f00df7fe700 1 -- 172.21.15.27:0/3571182450 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e00ca0e0 con 0x7f00d0003a30 2023-07-05T23:32:58.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.313+0000 7f00df7fe700 1 -- 172.21.15.27:0/3571182450 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d000bb50 con 0x7f00d0004d90 2023-07-05T23:32:58.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.313+0000 7f00df7fe700 1 -- 172.21.15.27:0/3571182450 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00d000df20 con 0x7f00e015d700 2023-07-05T23:32:58.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.313+0000 7f00e4d87700 1 --2- 172.21.15.27:0/3571182450 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00d0003a30 0x7f00d0003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:58.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.313+0000 7f00e5588700 1 --2- 172.21.15.27:0/3571182450 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00d0004d90 0x7f00d0005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:58.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.313+0000 7f00dffff700 1 --2- 172.21.15.27:0/3571182450 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00e015d700 0x7f00d0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:58.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.313+0000 7f00e4d87700 1 -- 172.21.15.27:0/3571182450 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00e015d700 msgr2=0x7f00d0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:32:58.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.313+0000 7f00e4d87700 1 --2- 172.21.15.27:0/3571182450 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00e015d700 0x7f00d0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:58.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.313+0000 7f00e4d87700 1 -- 172.21.15.27:0/3571182450 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00d0004d90 msgr2=0x7f00d0005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:32:58.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.313+0000 7f00e4d87700 1 --2- 172.21.15.27:0/3571182450 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00d0004d90 0x7f00d0005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:58.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.313+0000 7f00e4d87700 1 -- 172.21.15.27:0/3571182450 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d00035b0 con 0x7f00d0003a30 2023-07-05T23:32:58.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.313+0000 7f00e4d87700 1 --2- 172.21.15.27:0/3571182450 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00d0003a30 0x7f00d0003e40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f00d400c240 tx=0x7f00d0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87745bbf329798b2 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:58.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.313+0000 7f00df7fe700 1 -- 172.21.15.27:0/3571182450 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d4007db0 con 0x7f00d0003a30 2023-07-05T23:32:58.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.313+0000 7f00df7fe700 1 -- 172.21.15.27:0/3571182450 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00d400ce00 con 0x7f00d0003a30 2023-07-05T23:32:58.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.313+0000 7f00df7fe700 1 -- 172.21.15.27:0/3571182450 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d4005ba0 con 0x7f00d0003a30 2023-07-05T23:32:58.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.314+0000 7f00e6feb700 1 -- 172.21.15.27:0/3571182450 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00d0003a30 msgr2=0x7f00d0003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:58.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.314+0000 7f00e6feb700 1 --2- 172.21.15.27:0/3571182450 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00d0003a30 0x7f00d0003e40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f00d400c240 tx=0x7f00d0005880 comp rx=0 tx=0).stop 2023-07-05T23:32:58.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.314+0000 7f00e5588700 1 -- 172.21.15.27:0/3571182450 reap_dead start 2023-07-05T23:32:58.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.314+0000 7f00e6feb700 1 -- 172.21.15.27:0/3571182450 shutdown_connections 2023-07-05T23:32:58.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.314+0000 7f00e6feb700 1 -- 172.21.15.27:0/3571182450 >> 172.21.15.27:0/3571182450 conn(0x7f00e00b1740 msgr2=0x7f00e006cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:32:58.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.314+0000 7f00e6feb700 1 -- 172.21.15.27:0/3571182450 shutdown_connections 2023-07-05T23:32:58.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.314+0000 7f00e6feb700 1 -- 172.21.15.27:0/3571182450 wait complete. 2023-07-05T23:32:58.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.315+0000 7f00e6feb700 1 Processor -- start 2023-07-05T23:32:58.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.315+0000 7f00e6feb700 1 -- start start 2023-07-05T23:32:58.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.316+0000 7f00e6feb700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00d0003a30 0x7f00e0156c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:58.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.316+0000 7f00e6feb700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00e0159f50 0x7f00e0152560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:58.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.316+0000 7f00e6feb700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00e015b320 0x7f00e015b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:58.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.316+0000 7f00e6feb700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e015bcd0 con 0x7f00e015b320 2023-07-05T23:32:58.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.316+0000 7f00e6feb700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e00b34c0 con 0x7f00d0003a30 2023-07-05T23:32:58.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.316+0000 7f00e6feb700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00e015a710 con 0x7f00e0159f50 2023-07-05T23:32:58.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.316+0000 7f00e5588700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00e015b320 0x7f00e015b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:58.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.316+0000 7f00e5588700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00e015b320 0x7f00e015b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44738/0 (socket says 172.21.15.27:44738) 2023-07-05T23:32:58.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.316+0000 7f00e5588700 1 -- 172.21.15.27:0/940253377 learned_addr learned my addr 172.21.15.27:0/940253377 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:32:58.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.316+0000 7f00e4d87700 1 --2- 172.21.15.27:0/940253377 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00d0003a30 0x7f00e0156c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:58.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.316+0000 7f00dffff700 1 --2- 172.21.15.27:0/940253377 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00e0159f50 0x7f00e0152560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:58.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.316+0000 7f00e5588700 1 -- 172.21.15.27:0/940253377 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00e0159f50 msgr2=0x7f00e0152560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:58.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.316+0000 7f00e5588700 1 --2- 172.21.15.27:0/940253377 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00e0159f50 0x7f00e0152560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:58.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.316+0000 7f00e5588700 1 -- 172.21.15.27:0/940253377 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00d0003a30 msgr2=0x7f00e0156c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:58.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.316+0000 7f00e5588700 1 --2- 172.21.15.27:0/940253377 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00d0003a30 0x7f00e0156c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:58.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.316+0000 7f00e5588700 1 -- 172.21.15.27:0/940253377 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e00b2b90 con 0x7f00e015b320 2023-07-05T23:32:58.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.317+0000 7f00e5588700 1 --2- 172.21.15.27:0/940253377 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00e015b320 0x7f00e015b790 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f00e00b5100 tx=0x7f00d800d150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:58.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.317+0000 7f00dd7fa700 1 -- 172.21.15.27:0/940253377 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d8003c10 con 0x7f00e015b320 2023-07-05T23:32:58.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.317+0000 7f00dd7fa700 1 -- 172.21.15.27:0/940253377 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00d8003d90 con 0x7f00e015b320 2023-07-05T23:32:58.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.317+0000 7f00e6feb700 1 -- 172.21.15.27:0/940253377 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00e00b2e70 con 0x7f00e015b320 2023-07-05T23:32:58.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.317+0000 7f00dd7fa700 1 -- 172.21.15.27:0/940253377 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d8005310 con 0x7f00e015b320 2023-07-05T23:32:58.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.317+0000 7f00e6feb700 1 -- 172.21.15.27:0/940253377 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00e015a3c0 con 0x7f00e015b320 2023-07-05T23:32:58.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.318+0000 7f00e6feb700 1 -- 172.21.15.27:0/940253377 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00e00ca680 con 0x7f00e015b320 2023-07-05T23:32:58.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.319+0000 7f00dd7fa700 1 -- 172.21.15.27:0/940253377 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f00d8005470 con 0x7f00e015b320 2023-07-05T23:32:58.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.319+0000 7f00dd7fa700 1 --2- 172.21.15.27:0/940253377 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f00c406ace0 0x7f00c406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:58.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.319+0000 7f00dd7fa700 1 -- 172.21.15.27:0/940253377 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f00d808a110 con 0x7f00e015b320 2023-07-05T23:32:58.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.319+0000 7f00e4d87700 1 --2- 172.21.15.27:0/940253377 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f00c406ace0 0x7f00c406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:58.330 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.320+0000 7f00e4d87700 1 --2- 172.21.15.27:0/940253377 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f00c406ace0 0x7f00c406d190 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f00d4001ac0 tx=0x7f00d4007000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:58.330 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.323+0000 7f00dd7fa700 1 -- 172.21.15.27:0/940253377 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f00d8054fb0 con 0x7f00e015b320 2023-07-05T23:32:58.530 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.527+0000 7f00e6feb700 1 -- 172.21.15.27:0/940253377 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f00e00ca680 con 0x7f00e015b320 2023-07-05T23:32:58.531 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.528+0000 7f00dd7fa700 1 -- 172.21.15.27:0/940253377 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20120 (secure 0 0 0) 0x7f00e00ca680 con 0x7f00e015b320 2023-07-05T23:32:58.532 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:32:58.532 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":28,"fsid":"23eebe48-65f5-4d3c-8c2d-4aa171c055d5","created":"2023-07-05T23:32:27.989612+0000","modified":"2023-07-05T23:32:57.768949+0000","last_up_change":"2023-07-05T23:32:39.601570+0000","last_in_change":"2023-07-05T23:32:30.488261+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-05T23:32:41.624598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-05T23:32:46.481587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-05T23:32:51.025210+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-05T23:32:52.286964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-05T23:32:55.354212+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ac2071e4-394b-4385-b9ba-fad5265efc65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6814","nonce":3766536605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6818","nonce":3766536605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6823","nonce":3766536605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6821","nonce":3766536605}]},"public_addr":"172.21.15.27:6814/3766536605","cluster_addr":"172.21.15.27:6818/3766536605","heartbeat_back_addr":"172.21.15.27:6823/3766536605","heartbeat_front_addr":"172.21.15.27:6821/3766536605","state":["exists","up"]},{"osd":1,"uuid":"8c9b61a0-39d5-46bf-afd6-5add78453ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6801","nonce":1579117455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6803","nonce":1579117455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6807","nonce":1579117455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6805","nonce":1579117455}]},"public_addr":"172.21.15.27:6801/1579117455","cluster_addr":"172.21.15.27:6803/1579117455","heartbeat_back_addr":"172.21.15.27:6807/1579117455","heartbeat_front_addr":"172.21.15.27:6805/1579117455","state":["exists","up"]},{"osd":2,"uuid":"dcd032a2-06b1-4055-b798-b86c71a7107d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6825","nonce":807520271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6827","nonce":807520271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6831","nonce":807520271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6829","nonce":807520271}]},"public_addr":"172.21.15.27:6825/807520271","cluster_addr":"172.21.15.27:6827/807520271","heartbeat_back_addr":"172.21.15.27:6831/807520271","heartbeat_front_addr":"172.21.15.27:6829/807520271","state":["exists","up"]},{"osd":3,"uuid":"b0ffe0fc-47ba-4636-b5ea-6bab637642c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6809","nonce":2125656143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6811","nonce":2125656143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6817","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6819","nonce":2125656143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6813","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6815","nonce":2125656143}]},"public_addr":"172.21.15.27:6809/2125656143","cluster_addr":"172.21.15.27:6811/2125656143","heartbeat_back_addr":"172.21.15.27:6819/2125656143","heartbeat_front_addr":"172.21.15.27:6815/2125656143","state":["exists","up"]},{"osd":4,"uuid":"7fab4e5a-1246-4efe-9562-10c4a6c789ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6801","nonce":2111223016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6803","nonce":2111223016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6807","nonce":2111223016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6805","nonce":2111223016}]},"public_addr":"172.21.15.162:6801/2111223016","cluster_addr":"172.21.15.162:6803/2111223016","heartbeat_back_addr":"172.21.15.162:6807/2111223016","heartbeat_front_addr":"172.21.15.162:6805/2111223016","state":["exists","up"]},{"osd":5,"uuid":"110c4d9f-cef6-48ab-a818-5a81e72372af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6825","nonce":3102609008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6827","nonce":3102609008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6831","nonce":3102609008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6829","nonce":3102609008}]},"public_addr":"172.21.15.162:6825/3102609008","cluster_addr":"172.21.15.162:6827/3102609008","heartbeat_back_addr":"172.21.15.162:6831/3102609008","heartbeat_front_addr":"172.21.15.162:6829/3102609008","state":["exists","up"]},{"osd":6,"uuid":"16803bcc-2c92-4aed-954e-487938c9f24a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6809","nonce":2657688865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6811","nonce":2657688865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6815","nonce":2657688865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6813","nonce":2657688865}]},"public_addr":"172.21.15.162:6809/2657688865","cluster_addr":"172.21.15.162:6811/2657688865","heartbeat_back_addr":"172.21.15.162:6815/2657688865","heartbeat_front_addr":"172.21.15.162:6813/2657688865","state":["exists","up"]},{"osd":7,"uuid":"b7c35377-3cf2-4569-b6b9-72376eb463bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6817","nonce":2096609978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6819","nonce":2096609978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6823","nonce":2096609978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6821","nonce":2096609978}]},"public_addr":"172.21.15.162:6817/2096609978","cluster_addr":"172.21.15.162:6819/2096609978","heartbeat_back_addr":"172.21.15.162:6823/2096609978","heartbeat_front_addr":"172.21.15.162:6821/2096609978","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.735448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.645561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.759120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.682507+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.736228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.694664+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.716002+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.680485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-05T23:32:58.534 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.530+0000 7f00e6feb700 1 -- 172.21.15.27:0/940253377 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f00c406ace0 msgr2=0x7f00c406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:58.534 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.530+0000 7f00e6feb700 1 --2- 172.21.15.27:0/940253377 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f00c406ace0 0x7f00c406d190 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f00d4001ac0 tx=0x7f00d4007000 comp rx=0 tx=0).stop 2023-07-05T23:32:58.534 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.530+0000 7f00e6feb700 1 -- 172.21.15.27:0/940253377 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00e015b320 msgr2=0x7f00e015b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:58.534 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.530+0000 7f00e6feb700 1 --2- 172.21.15.27:0/940253377 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00e015b320 0x7f00e015b790 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f00e00b5100 tx=0x7f00d800d150 comp rx=0 tx=0).stop 2023-07-05T23:32:58.534 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.531+0000 7f00e6feb700 1 -- 172.21.15.27:0/940253377 shutdown_connections 2023-07-05T23:32:58.535 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.531+0000 7f00e6feb700 1 --2- 172.21.15.27:0/940253377 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00d0003a30 0x7f00e0156c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:58.535 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.531+0000 7f00e6feb700 1 --2- 172.21.15.27:0/940253377 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f00c406ace0 0x7f00c406d190 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:58.535 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.531+0000 7f00e6feb700 1 --2- 172.21.15.27:0/940253377 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00e015b320 0x7f00e015b790 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:58.535 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.531+0000 7f00e6feb700 1 --2- 172.21.15.27:0/940253377 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00e0159f50 0x7f00e0152560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:58.535 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.531+0000 7f00e6feb700 1 -- 172.21.15.27:0/940253377 >> 172.21.15.27:0/940253377 conn(0x7f00e00b1740 msgr2=0x7f00e006e780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:32:58.535 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.531+0000 7f00e6feb700 1 -- 172.21.15.27:0/940253377 shutdown_connections 2023-07-05T23:32:58.535 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.531+0000 7f00e6feb700 1 -- 172.21.15.27:0/940253377 wait complete. 2023-07-05T23:32:58.547 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-05T23:32:58.671 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.668+0000 7f28adbf5700 1 Processor -- start 2023-07-05T23:32:58.671 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.668+0000 7f28adbf5700 1 -- start start 2023-07-05T23:32:58.673 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.669+0000 7f28adbf5700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f28a815cb60 0x7f28a815cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:58.673 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.669+0000 7f28adbf5700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f28a815d700 0x7f28a806e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:58.673 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.669+0000 7f28adbf5700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28a806f220 con 0x7f28a80caea0 2023-07-05T23:32:58.673 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.669+0000 7f28adbf5700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28a80c9e60 con 0x7f28a815cb60 2023-07-05T23:32:58.673 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.669+0000 7f28adbf5700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28a815d470 con 0x7f28a815d700 2023-07-05T23:32:58.674 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.669+0000 7f28a77fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f28a815cb60 0x7f28a815cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:58.674 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.669+0000 7f28a77fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f28a815cb60 0x7f28a815cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44742/0 (socket says 172.21.15.27:44742) 2023-07-05T23:32:58.674 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.669+0000 7f28a77fe700 1 -- 172.21.15.27:0/3096147624 learned_addr learned my addr 172.21.15.27:0/3096147624 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:32:58.674 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.669+0000 7f28a6ffd700 1 --2- 172.21.15.27:0/3096147624 >> v2:172.21.15.162:3300/0 conn(0x7f28a815d700 0x7f28a806e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:58.674 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.670+0000 7f28a77fe700 1 -- 172.21.15.27:0/3096147624 >> v2:172.21.15.162:3300/0 conn(0x7f28a815d700 msgr2=0x7f28a806e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:32:58.674 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.670+0000 7f28a77fe700 1 --2- 172.21.15.27:0/3096147624 >> v2:172.21.15.162:3300/0 conn(0x7f28a815d700 0x7f28a806e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:58.674 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.670+0000 7f28a77fe700 1 -- 172.21.15.27:0/3096147624 >> v1:172.21.15.162:6789/0 conn(0x7f28a80caea0 legacy=0x7f28a80ccb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:58.674 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.670+0000 7f28a77fe700 1 -- 172.21.15.27:0/3096147624 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28a80ca0e0 con 0x7f28a815cb60 2023-07-05T23:32:58.675 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.670+0000 7f28a77fe700 1 --2- 172.21.15.27:0/3096147624 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f28a815cb60 0x7f28a815cf30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f28980098f0 tx=0x7f2898009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=201978404fe626b9 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:58.675 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.670+0000 7f28a67fc700 1 -- 172.21.15.27:0/3096147624 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2898011830 con 0x7f28a815cb60 2023-07-05T23:32:58.675 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.670+0000 7f28a67fc700 1 -- 172.21.15.27:0/3096147624 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2898011990 con 0x7f28a815cb60 2023-07-05T23:32:58.675 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.670+0000 7f28a67fc700 1 -- 172.21.15.27:0/3096147624 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2898011d20 con 0x7f28a815cb60 2023-07-05T23:32:58.678 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.671+0000 7f28adbf5700 1 -- 172.21.15.27:0/3096147624 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f28a815cb60 msgr2=0x7f28a815cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:58.679 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.671+0000 7f28adbf5700 1 --2- 172.21.15.27:0/3096147624 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f28a815cb60 0x7f28a815cf30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f28980098f0 tx=0x7f2898009c00 comp rx=0 tx=0).stop 2023-07-05T23:32:58.679 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.671+0000 7f28adbf5700 1 -- 172.21.15.27:0/3096147624 shutdown_connections 2023-07-05T23:32:58.679 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.671+0000 7f28adbf5700 1 --2- 172.21.15.27:0/3096147624 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f28a815cb60 0x7f28a815cf30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:58.679 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.671+0000 7f28adbf5700 1 --2- 172.21.15.27:0/3096147624 >> v2:172.21.15.162:3300/0 conn(0x7f28a815d700 0x7f28a806e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:58.679 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.671+0000 7f28adbf5700 1 -- 172.21.15.27:0/3096147624 >> 172.21.15.27:0/3096147624 conn(0x7f28a80b1740 msgr2=0x7f28a806cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:32:58.679 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.671+0000 7f28adbf5700 1 -- 172.21.15.27:0/3096147624 shutdown_connections 2023-07-05T23:32:58.680 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.671+0000 7f28adbf5700 1 -- 172.21.15.27:0/3096147624 wait complete. 2023-07-05T23:32:58.680 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.672+0000 7f28adbf5700 1 Processor -- start 2023-07-05T23:32:58.680 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.672+0000 7f28adbf5700 1 -- start start 2023-07-05T23:32:58.680 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.673+0000 7f28adbf5700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28a80caea0 0x7f28a8148200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:58.680 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.673+0000 7f28adbf5700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f28a815cb60 0x7f28a8070ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:58.680 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.673+0000 7f28adbf5700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f28a815d700 0x7f28a80713e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:58.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.673+0000 7f28adbf5700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a8152a60 con 0x7f28a815d700 2023-07-05T23:32:58.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.673+0000 7f28adbf5700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a8152d20 con 0x7f28a80caea0 2023-07-05T23:32:58.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.673+0000 7f28adbf5700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28a80c75f0 con 0x7f28a815cb60 2023-07-05T23:32:58.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.673+0000 7f28a7fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f28a815d700 0x7f28a80713e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:58.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.673+0000 7f28a7fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f28a815d700 0x7f28a80713e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44752/0 (socket says 172.21.15.27:44752) 2023-07-05T23:32:58.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.673+0000 7f28a7fff700 1 -- 172.21.15.27:0/896428571 learned_addr learned my addr 172.21.15.27:0/896428571 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:32:58.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.673+0000 7f28a6ffd700 1 --2- 172.21.15.27:0/896428571 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f28a815cb60 0x7f28a8070ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:58.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.673+0000 7f28a77fe700 1 --2- 172.21.15.27:0/896428571 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28a80caea0 0x7f28a8148200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:58.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.673+0000 7f28a7fff700 1 -- 172.21.15.27:0/896428571 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f28a815cb60 msgr2=0x7f28a8070ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:58.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.673+0000 7f28a7fff700 1 --2- 172.21.15.27:0/896428571 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f28a815cb60 0x7f28a8070ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:58.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.673+0000 7f28a7fff700 1 -- 172.21.15.27:0/896428571 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28a80caea0 msgr2=0x7f28a8148200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:58.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.673+0000 7f28a7fff700 1 --2- 172.21.15.27:0/896428571 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28a80caea0 0x7f28a8148200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:58.683 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.673+0000 7f28a7fff700 1 -- 172.21.15.27:0/896428571 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2898009550 con 0x7f28a815d700 2023-07-05T23:32:58.683 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.673+0000 7f28a7fff700 1 --2- 172.21.15.27:0/896428571 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f28a815d700 0x7f28a80713e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f28a000cb50 tx=0x7f28a000ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:58.683 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.673+0000 7f289ffff700 1 -- 172.21.15.27:0/896428571 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a0003c00 con 0x7f28a815d700 2023-07-05T23:32:58.683 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.673+0000 7f289ffff700 1 -- 172.21.15.27:0/896428571 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28a0003d60 con 0x7f28a815d700 2023-07-05T23:32:58.683 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.673+0000 7f28adbf5700 1 -- 172.21.15.27:0/896428571 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28a8148740 con 0x7f28a815d700 2023-07-05T23:32:58.683 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.673+0000 7f289ffff700 1 -- 172.21.15.27:0/896428571 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a000aa20 con 0x7f28a815d700 2023-07-05T23:32:58.683 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.674+0000 7f28adbf5700 1 -- 172.21.15.27:0/896428571 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28a80c7030 con 0x7f28a815d700 2023-07-05T23:32:58.684 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.674+0000 7f28adbf5700 1 -- 172.21.15.27:0/896428571 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28a8073910 con 0x7f28a815d700 2023-07-05T23:32:58.684 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.675+0000 7f289ffff700 1 -- 172.21.15.27:0/896428571 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f28a000ab80 con 0x7f28a815d700 2023-07-05T23:32:58.684 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.675+0000 7f289ffff700 1 --2- 172.21.15.27:0/896428571 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f288806ace0 0x7f288806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:58.684 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.675+0000 7f289ffff700 1 -- 172.21.15.27:0/896428571 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f28a0089670 con 0x7f28a815d700 2023-07-05T23:32:58.685 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.676+0000 7f28a77fe700 1 --2- 172.21.15.27:0/896428571 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f288806ace0 0x7f288806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:58.685 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.676+0000 7f28a77fe700 1 --2- 172.21.15.27:0/896428571 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f288806ace0 0x7f288806d190 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2898014040 tx=0x7f2898008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:58.685 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.680+0000 7f289ffff700 1 -- 172.21.15.27:0/896428571 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f28a0054320 con 0x7f28a815d700 2023-07-05T23:32:58.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.878+0000 7f28adbf5700 1 -- 172.21.15.27:0/896428571 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f28a806f220 con 0x7f28a815d700 2023-07-05T23:32:58.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.879+0000 7f289ffff700 1 -- 172.21.15.27:0/896428571 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20120 (secure 0 0 0) 0x7f28a806f220 con 0x7f28a815d700 2023-07-05T23:32:58.883 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:32:58.883 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":28,"fsid":"23eebe48-65f5-4d3c-8c2d-4aa171c055d5","created":"2023-07-05T23:32:27.989612+0000","modified":"2023-07-05T23:32:57.768949+0000","last_up_change":"2023-07-05T23:32:39.601570+0000","last_in_change":"2023-07-05T23:32:30.488261+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-05T23:32:41.624598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-05T23:32:46.481587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-05T23:32:51.025210+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-05T23:32:52.286964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-05T23:32:55.354212+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ac2071e4-394b-4385-b9ba-fad5265efc65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6814","nonce":3766536605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6818","nonce":3766536605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6823","nonce":3766536605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6821","nonce":3766536605}]},"public_addr":"172.21.15.27:6814/3766536605","cluster_addr":"172.21.15.27:6818/3766536605","heartbeat_back_addr":"172.21.15.27:6823/3766536605","heartbeat_front_addr":"172.21.15.27:6821/3766536605","state":["exists","up"]},{"osd":1,"uuid":"8c9b61a0-39d5-46bf-afd6-5add78453ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6801","nonce":1579117455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6803","nonce":1579117455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6807","nonce":1579117455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6805","nonce":1579117455}]},"public_addr":"172.21.15.27:6801/1579117455","cluster_addr":"172.21.15.27:6803/1579117455","heartbeat_back_addr":"172.21.15.27:6807/1579117455","heartbeat_front_addr":"172.21.15.27:6805/1579117455","state":["exists","up"]},{"osd":2,"uuid":"dcd032a2-06b1-4055-b798-b86c71a7107d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6825","nonce":807520271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6827","nonce":807520271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6831","nonce":807520271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6829","nonce":807520271}]},"public_addr":"172.21.15.27:6825/807520271","cluster_addr":"172.21.15.27:6827/807520271","heartbeat_back_addr":"172.21.15.27:6831/807520271","heartbeat_front_addr":"172.21.15.27:6829/807520271","state":["exists","up"]},{"osd":3,"uuid":"b0ffe0fc-47ba-4636-b5ea-6bab637642c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6809","nonce":2125656143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6811","nonce":2125656143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6817","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6819","nonce":2125656143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6813","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6815","nonce":2125656143}]},"public_addr":"172.21.15.27:6809/2125656143","cluster_addr":"172.21.15.27:6811/2125656143","heartbeat_back_addr":"172.21.15.27:6819/2125656143","heartbeat_front_addr":"172.21.15.27:6815/2125656143","state":["exists","up"]},{"osd":4,"uuid":"7fab4e5a-1246-4efe-9562-10c4a6c789ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6801","nonce":2111223016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6803","nonce":2111223016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6807","nonce":2111223016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6805","nonce":2111223016}]},"public_addr":"172.21.15.162:6801/2111223016","cluster_addr":"172.21.15.162:6803/2111223016","heartbeat_back_addr":"172.21.15.162:6807/2111223016","heartbeat_front_addr":"172.21.15.162:6805/2111223016","state":["exists","up"]},{"osd":5,"uuid":"110c4d9f-cef6-48ab-a818-5a81e72372af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6825","nonce":3102609008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6827","nonce":3102609008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6831","nonce":3102609008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6829","nonce":3102609008}]},"public_addr":"172.21.15.162:6825/3102609008","cluster_addr":"172.21.15.162:6827/3102609008","heartbeat_back_addr":"172.21.15.162:6831/3102609008","heartbeat_front_addr":"172.21.15.162:6829/3102609008","state":["exists","up"]},{"osd":6,"uuid":"16803bcc-2c92-4aed-954e-487938c9f24a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6809","nonce":2657688865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6811","nonce":2657688865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6815","nonce":2657688865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6813","nonce":2657688865}]},"public_addr":"172.21.15.162:6809/2657688865","cluster_addr":"172.21.15.162:6811/2657688865","heartbeat_back_addr":"172.21.15.162:6815/2657688865","heartbeat_front_addr":"172.21.15.162:6813/2657688865","state":["exists","up"]},{"osd":7,"uuid":"b7c35377-3cf2-4569-b6b9-72376eb463bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6817","nonce":2096609978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6819","nonce":2096609978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6823","nonce":2096609978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6821","nonce":2096609978}]},"public_addr":"172.21.15.162:6817/2096609978","cluster_addr":"172.21.15.162:6819/2096609978","heartbeat_back_addr":"172.21.15.162:6823/2096609978","heartbeat_front_addr":"172.21.15.162:6821/2096609978","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.735448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.645561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.759120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.682507+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.736228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.694664+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.716002+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.680485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-05T23:32:58.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.881+0000 7f28adbf5700 1 -- 172.21.15.27:0/896428571 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f288806ace0 msgr2=0x7f288806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:58.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.881+0000 7f28adbf5700 1 --2- 172.21.15.27:0/896428571 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f288806ace0 0x7f288806d190 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2898014040 tx=0x7f2898008030 comp rx=0 tx=0).stop 2023-07-05T23:32:58.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.881+0000 7f28adbf5700 1 -- 172.21.15.27:0/896428571 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f28a815d700 msgr2=0x7f28a80713e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:58.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.881+0000 7f28adbf5700 1 --2- 172.21.15.27:0/896428571 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f28a815d700 0x7f28a80713e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f28a000cb50 tx=0x7f28a000ce60 comp rx=0 tx=0).stop 2023-07-05T23:32:58.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.881+0000 7f28adbf5700 1 -- 172.21.15.27:0/896428571 shutdown_connections 2023-07-05T23:32:58.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.881+0000 7f28adbf5700 1 --2- 172.21.15.27:0/896428571 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28a80caea0 0x7f28a8148200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:58.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.881+0000 7f28adbf5700 1 --2- 172.21.15.27:0/896428571 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f288806ace0 0x7f288806d190 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:58.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.881+0000 7f28adbf5700 1 --2- 172.21.15.27:0/896428571 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f28a815d700 0x7f28a80713e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:58.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.881+0000 7f28adbf5700 1 --2- 172.21.15.27:0/896428571 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f28a815cb60 0x7f28a8070ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:58.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.881+0000 7f28adbf5700 1 -- 172.21.15.27:0/896428571 >> 172.21.15.27:0/896428571 conn(0x7f28a80b1740 msgr2=0x7f28a815b810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:32:58.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.882+0000 7f28adbf5700 1 -- 172.21.15.27:0/896428571 shutdown_connections 2023-07-05T23:32:58.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:58.882+0000 7f28adbf5700 1 -- 172.21.15.27:0/896428571 wait complete. 2023-07-05T23:32:58.912 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-05T23:32:59.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.035+0000 7f17b6f8b700 1 Processor -- start 2023-07-05T23:32:59.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.035+0000 7f17b6f8b700 1 -- start start 2023-07-05T23:32:59.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.036+0000 7f17b6f8b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f17b00cddd0 0x7f17b015a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:59.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.036+0000 7f17b6f8b700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f17b00ae6c0 0x7f17b00aec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:59.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.036+0000 7f17b6f8b700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17b015d6a0 con 0x7f17b00ce1a0 2023-07-05T23:32:59.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.036+0000 7f17b6f8b700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17b00cdc80 con 0x7f17b00cddd0 2023-07-05T23:32:59.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.036+0000 7f17b6f8b700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17b0159700 con 0x7f17b00ae6c0 2023-07-05T23:32:59.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.036+0000 7f17b4d27700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f17b00cddd0 0x7f17b015a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:59.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.036+0000 7f17b4d27700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f17b00cddd0 0x7f17b015a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44756/0 (socket says 172.21.15.27:44756) 2023-07-05T23:32:59.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.036+0000 7f17b4d27700 1 -- 172.21.15.27:0/2699480702 learned_addr learned my addr 172.21.15.27:0/2699480702 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:32:59.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.036+0000 7f17b5528700 1 --1- 172.21.15.27:0/2699480702 >> v1:172.21.15.27:6789/0 conn(0x7f17b00ce1a0 0x7f17b00714a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:51926/0 (socket says 172.21.15.27:51926) 2023-07-05T23:32:59.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.036+0000 7f17b4d27700 1 -- 172.21.15.27:0/2699480702 >> v2:172.21.15.162:3300/0 conn(0x7f17b00ae6c0 msgr2=0x7f17b00aec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:32:59.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.036+0000 7f17b4d27700 1 --2- 172.21.15.27:0/2699480702 >> v2:172.21.15.162:3300/0 conn(0x7f17b00ae6c0 0x7f17b00aec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:59.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.036+0000 7f17b4d27700 1 -- 172.21.15.27:0/2699480702 >> v1:172.21.15.27:6789/0 conn(0x7f17b00ce1a0 legacy=0x7f17b00714a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:59.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.036+0000 7f17b4d27700 1 -- 172.21.15.27:0/2699480702 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b01599e0 con 0x7f17b00cddd0 2023-07-05T23:32:59.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.036+0000 7f17b4d27700 1 --2- 172.21.15.27:0/2699480702 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f17b00cddd0 0x7f17b015a1e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f17b006c0d0 tx=0x7f17a4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a9bca418988aa70 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:59.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.036+0000 7f17af7fe700 1 -- 172.21.15.27:0/2699480702 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a400b870 con 0x7f17b00cddd0 2023-07-05T23:32:59.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.036+0000 7f17af7fe700 1 -- 172.21.15.27:0/2699480702 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17a400b9d0 con 0x7f17b00cddd0 2023-07-05T23:32:59.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.036+0000 7f17af7fe700 1 -- 172.21.15.27:0/2699480702 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a400bd60 con 0x7f17b00cddd0 2023-07-05T23:32:59.043 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.037+0000 7f17b6f8b700 1 -- 172.21.15.27:0/2699480702 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f17b00cddd0 msgr2=0x7f17b015a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:59.044 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.037+0000 7f17b6f8b700 1 --2- 172.21.15.27:0/2699480702 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f17b00cddd0 0x7f17b015a1e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f17b006c0d0 tx=0x7f17a4009bd0 comp rx=0 tx=0).stop 2023-07-05T23:32:59.044 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.037+0000 7f17b6f8b700 1 -- 172.21.15.27:0/2699480702 shutdown_connections 2023-07-05T23:32:59.044 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.037+0000 7f17b6f8b700 1 --2- 172.21.15.27:0/2699480702 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f17b00cddd0 0x7f17b015a1e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:59.044 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.037+0000 7f17b6f8b700 1 --2- 172.21.15.27:0/2699480702 >> v2:172.21.15.162:3300/0 conn(0x7f17b00ae6c0 0x7f17b00aec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:59.044 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.037+0000 7f17b6f8b700 1 -- 172.21.15.27:0/2699480702 >> 172.21.15.27:0/2699480702 conn(0x7f17b006d4a0 msgr2=0x7f17b006d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:32:59.044 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.037+0000 7f17b6f8b700 1 -- 172.21.15.27:0/2699480702 shutdown_connections 2023-07-05T23:32:59.045 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.037+0000 7f17b6f8b700 1 -- 172.21.15.27:0/2699480702 wait complete. 2023-07-05T23:32:59.045 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.038+0000 7f17b6f8b700 1 Processor -- start 2023-07-05T23:32:59.045 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.038+0000 7f17b6f8b700 1 -- start start 2023-07-05T23:32:59.045 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.039+0000 7f17b6f8b700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f17b00ae6c0 0x7f17b014dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:59.045 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.039+0000 7f17b6f8b700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f17b00cddd0 0x7f17b00b42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:59.045 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.039+0000 7f17b6f8b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f17b00ce1a0 0x7f17b00b4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:59.045 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.039+0000 7f17b6f8b700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b00b2e40 con 0x7f17b00ce1a0 2023-07-05T23:32:59.045 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.039+0000 7f17b6f8b700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b00b2b60 con 0x7f17b00cddd0 2023-07-05T23:32:59.046 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.039+0000 7f17b6f8b700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17b00ca7e0 con 0x7f17b00ae6c0 2023-07-05T23:32:59.048 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.039+0000 7f17b5528700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f17b00ce1a0 0x7f17b00b4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:59.048 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.039+0000 7f17b5528700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f17b00ce1a0 0x7f17b00b4830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44766/0 (socket says 172.21.15.27:44766) 2023-07-05T23:32:59.048 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.039+0000 7f17b5528700 1 -- 172.21.15.27:0/654439676 learned_addr learned my addr 172.21.15.27:0/654439676 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:32:59.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.039+0000 7f17b4d27700 1 --2- 172.21.15.27:0/654439676 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f17b00ae6c0 0x7f17b014dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:59.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.039+0000 7f17affff700 1 --2- 172.21.15.27:0/654439676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f17b00cddd0 0x7f17b00b42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:59.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.039+0000 7f17b5528700 1 -- 172.21.15.27:0/654439676 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f17b00ae6c0 msgr2=0x7f17b014dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:59.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.039+0000 7f17b5528700 1 --2- 172.21.15.27:0/654439676 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f17b00ae6c0 0x7f17b014dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:59.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.039+0000 7f17b5528700 1 -- 172.21.15.27:0/654439676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f17b00cddd0 msgr2=0x7f17b00b42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:59.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.039+0000 7f17b5528700 1 --2- 172.21.15.27:0/654439676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f17b00cddd0 0x7f17b00b42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:59.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.039+0000 7f17b5528700 1 -- 172.21.15.27:0/654439676 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a4009550 con 0x7f17b00ce1a0 2023-07-05T23:32:59.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.039+0000 7f17b4d27700 1 --2- 172.21.15.27:0/654439676 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f17b00ae6c0 0x7f17b014dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T23:32:59.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.039+0000 7f17affff700 1 --2- 172.21.15.27:0/654439676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f17b00cddd0 0x7f17b00b42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T23:32:59.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.040+0000 7f17b5528700 1 --2- 172.21.15.27:0/654439676 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f17b00ce1a0 0x7f17b00b4830 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f17a800cbd0 tx=0x7f17a800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:59.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.040+0000 7f17ad7fa700 1 -- 172.21.15.27:0/654439676 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a800abb0 con 0x7f17b00ce1a0 2023-07-05T23:32:59.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.040+0000 7f17ad7fa700 1 -- 172.21.15.27:0/654439676 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17a800ad10 con 0x7f17b00ce1a0 2023-07-05T23:32:59.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.040+0000 7f17b6f8b700 1 -- 172.21.15.27:0/654439676 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17b00caac0 con 0x7f17b00ce1a0 2023-07-05T23:32:59.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.040+0000 7f17ad7fa700 1 -- 172.21.15.27:0/654439676 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a8007270 con 0x7f17b00ce1a0 2023-07-05T23:32:59.051 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.040+0000 7f17b6f8b700 1 -- 172.21.15.27:0/654439676 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17b014e160 con 0x7f17b00ce1a0 2023-07-05T23:32:59.051 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.041+0000 7f17b6f8b700 1 -- 172.21.15.27:0/654439676 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17b00ca640 con 0x7f17b00ce1a0 2023-07-05T23:32:59.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.041+0000 7f17ad7fa700 1 -- 172.21.15.27:0/654439676 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f17a80073d0 con 0x7f17b00ce1a0 2023-07-05T23:32:59.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.042+0000 7f17ad7fa700 1 --2- 172.21.15.27:0/654439676 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f179406ace0 0x7f179406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:59.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.042+0000 7f17ad7fa700 1 -- 172.21.15.27:0/654439676 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f17a8089570 con 0x7f17b00ce1a0 2023-07-05T23:32:59.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.042+0000 7f17b4d27700 1 --2- 172.21.15.27:0/654439676 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f179406ace0 0x7f179406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:59.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.042+0000 7f17b4d27700 1 --2- 172.21.15.27:0/654439676 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f179406ace0 0x7f179406d190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f17a4009130 tx=0x7f17a4008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:59.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.046+0000 7f17ad7fa700 1 -- 172.21.15.27:0/654439676 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f17b00ca640 con 0x7f17b00ce1a0 2023-07-05T23:32:59.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.289+0000 7f17b6f8b700 1 -- 172.21.15.27:0/654439676 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f17b00cafe0 con 0x7f17b00ce1a0 2023-07-05T23:32:59.293 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.290+0000 7f17ad7fa700 1 -- 172.21.15.27:0/654439676 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4670 (secure 0 0 0) 0x7f17b00cafe0 con 0x7f17b00ce1a0 2023-07-05T23:32:59.293 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:32:59.294 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/4263442347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":4263442347},{"type":"v1","addr":"172.21.15.162:6837","nonce":4263442347}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/2486008632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2486008632},{"type":"v1","addr":"172.21.15.162:6836","nonce":2486008632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/217781445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":217781445},{"type":"v1","addr":"172.21.15.27:6834","nonce":217781445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-05T23:32:53.313219+0000","modified":"2023-07-05T23:32:57.769151+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6835/3387103520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":3387103520},{"type":"v1","addr":"172.21.15.27:6835","nonce":3387103520}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-07-05T23:32:59.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.292+0000 7f17b6f8b700 1 -- 172.21.15.27:0/654439676 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f179406ace0 msgr2=0x7f179406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:59.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.292+0000 7f17b6f8b700 1 --2- 172.21.15.27:0/654439676 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f179406ace0 0x7f179406d190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f17a4009130 tx=0x7f17a4008030 comp rx=0 tx=0).stop 2023-07-05T23:32:59.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.292+0000 7f17b6f8b700 1 -- 172.21.15.27:0/654439676 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f17b00ce1a0 msgr2=0x7f17b00b4830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:59.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.292+0000 7f17b6f8b700 1 --2- 172.21.15.27:0/654439676 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f17b00ce1a0 0x7f17b00b4830 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f17a800cbd0 tx=0x7f17a800cf90 comp rx=0 tx=0).stop 2023-07-05T23:32:59.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.292+0000 7f17b6f8b700 1 -- 172.21.15.27:0/654439676 shutdown_connections 2023-07-05T23:32:59.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.292+0000 7f17b6f8b700 1 --2- 172.21.15.27:0/654439676 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f179406ace0 0x7f179406d190 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:59.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.292+0000 7f17b6f8b700 1 --2- 172.21.15.27:0/654439676 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f17b00ce1a0 0x7f17b00b4830 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:59.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.292+0000 7f17b6f8b700 1 --2- 172.21.15.27:0/654439676 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f17b00ae6c0 0x7f17b014dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:59.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.292+0000 7f17b6f8b700 1 --2- 172.21.15.27:0/654439676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f17b00cddd0 0x7f17b00b42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:59.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.292+0000 7f17b6f8b700 1 -- 172.21.15.27:0/654439676 >> 172.21.15.27:0/654439676 conn(0x7f17b006d4a0 msgr2=0x7f17b006b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:32:59.298 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.292+0000 7f17b6f8b700 1 -- 172.21.15.27:0/654439676 shutdown_connections 2023-07-05T23:32:59.298 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.292+0000 7f17b6f8b700 1 -- 172.21.15.27:0/654439676 wait complete. 2023-07-05T23:32:59.298 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 7 2023-07-05T23:32:59.307 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-05T23:32:59.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.430+0000 7fc276b72700 1 Processor -- start 2023-07-05T23:32:59.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.430+0000 7fc276b72700 1 -- start start 2023-07-05T23:32:59.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.431+0000 7fc276b72700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc2700cddd0 0x7fc27015a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:59.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.431+0000 7fc276b72700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc2700aec10 0x7fc2700714a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:59.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.431+0000 7fc276b72700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2700af090 con 0x7fc2700ae6c0 2023-07-05T23:32:59.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.431+0000 7fc276b72700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2700cdc80 con 0x7fc2700cddd0 2023-07-05T23:32:59.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.431+0000 7fc276b72700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc27015d6a0 con 0x7fc2700aec10 2023-07-05T23:32:59.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.431+0000 7fc27490e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc2700cddd0 0x7fc27015a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:59.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.431+0000 7fc27490e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc2700cddd0 0x7fc27015a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44770/0 (socket says 172.21.15.27:44770) 2023-07-05T23:32:59.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.431+0000 7fc27490e700 1 -- 172.21.15.27:0/3489083528 learned_addr learned my addr 172.21.15.27:0/3489083528 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:32:59.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.431+0000 7fc26ffff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fc2700ae6c0 0x7fc2700ce1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:51936/0 (socket says 172.21.15.27:51936) 2023-07-05T23:32:59.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.431+0000 7fc27510f700 1 --2- 172.21.15.27:0/3489083528 >> v2:172.21.15.162:3300/0 conn(0x7fc2700aec10 0x7fc2700714a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:59.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.431+0000 7fc27490e700 1 -- 172.21.15.27:0/3489083528 >> v2:172.21.15.162:3300/0 conn(0x7fc2700aec10 msgr2=0x7fc2700714a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:32:59.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.431+0000 7fc27490e700 1 --2- 172.21.15.27:0/3489083528 >> v2:172.21.15.162:3300/0 conn(0x7fc2700aec10 0x7fc2700714a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:59.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.431+0000 7fc27490e700 1 -- 172.21.15.27:0/3489083528 >> v1:172.21.15.27:6789/0 conn(0x7fc2700ae6c0 legacy=0x7fc2700ce1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:59.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.432+0000 7fc26f7fe700 1 -- 172.21.15.27:0/3489083528 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3541381412 0 0) 0x7fc2700af090 con 0x7fc2700ae6c0 2023-07-05T23:32:59.437 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.432+0000 7fc27490e700 1 -- 172.21.15.27:0/3489083528 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc270159700 con 0x7fc2700cddd0 2023-07-05T23:32:59.437 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.432+0000 7fc27490e700 1 --2- 172.21.15.27:0/3489083528 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc2700cddd0 0x7fc27015a1e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc2700c3290 tx=0x7fc26400be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6d0d0883314e9ac server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:59.437 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.432+0000 7fc26f7fe700 1 -- 172.21.15.27:0/3489083528 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26400dd30 con 0x7fc2700cddd0 2023-07-05T23:32:59.437 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.432+0000 7fc26f7fe700 1 -- 172.21.15.27:0/3489083528 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc26400de90 con 0x7fc2700cddd0 2023-07-05T23:32:59.437 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.432+0000 7fc26f7fe700 1 -- 172.21.15.27:0/3489083528 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc264010690 con 0x7fc2700cddd0 2023-07-05T23:32:59.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.432+0000 7fc276b72700 1 -- 172.21.15.27:0/3489083528 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc2700cddd0 msgr2=0x7fc27015a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:59.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.432+0000 7fc276b72700 1 --2- 172.21.15.27:0/3489083528 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc2700cddd0 0x7fc27015a1e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc2700c3290 tx=0x7fc26400be70 comp rx=0 tx=0).stop 2023-07-05T23:32:59.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.432+0000 7fc276b72700 1 -- 172.21.15.27:0/3489083528 shutdown_connections 2023-07-05T23:32:59.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.432+0000 7fc276b72700 1 --2- 172.21.15.27:0/3489083528 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc2700cddd0 0x7fc27015a1e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:59.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.432+0000 7fc276b72700 1 --2- 172.21.15.27:0/3489083528 >> v2:172.21.15.162:3300/0 conn(0x7fc2700aec10 0x7fc2700714a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:59.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.432+0000 7fc276b72700 1 -- 172.21.15.27:0/3489083528 >> 172.21.15.27:0/3489083528 conn(0x7fc27006d4a0 msgr2=0x7fc27006d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:32:59.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.432+0000 7fc276b72700 1 -- 172.21.15.27:0/3489083528 shutdown_connections 2023-07-05T23:32:59.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.432+0000 7fc276b72700 1 -- 172.21.15.27:0/3489083528 wait complete. 2023-07-05T23:32:59.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.434+0000 7fc276b72700 1 Processor -- start 2023-07-05T23:32:59.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.434+0000 7fc276b72700 1 -- start start 2023-07-05T23:32:59.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.434+0000 7fc276b72700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2700ae6c0 0x7fc2701f2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:59.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.435+0000 7fc276b72700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2700aec10 0x7fc270154ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:59.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.435+0000 7fc276b72700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc2700cddd0 0x7fc2701f55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:59.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.435+0000 7fc276b72700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2701f60a0 con 0x7fc2700cddd0 2023-07-05T23:32:59.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.435+0000 7fc276b72700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2701f6380 con 0x7fc2700ae6c0 2023-07-05T23:32:59.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.435+0000 7fc276b72700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2701f2320 con 0x7fc2700aec10 2023-07-05T23:32:59.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.435+0000 7fc27510f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc2700cddd0 0x7fc2701f55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:59.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.435+0000 7fc27510f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc2700cddd0 0x7fc2701f55e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44780/0 (socket says 172.21.15.27:44780) 2023-07-05T23:32:59.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.435+0000 7fc27510f700 1 -- 172.21.15.27:0/2159817526 learned_addr learned my addr 172.21.15.27:0/2159817526 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:32:59.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.435+0000 7fc26ffff700 1 --2- 172.21.15.27:0/2159817526 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2700aec10 0x7fc270154ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:59.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.435+0000 7fc27490e700 1 --2- 172.21.15.27:0/2159817526 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2700ae6c0 0x7fc2701f2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:59.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.435+0000 7fc27510f700 1 -- 172.21.15.27:0/2159817526 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2700aec10 msgr2=0x7fc270154ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:59.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.435+0000 7fc27510f700 1 --2- 172.21.15.27:0/2159817526 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2700aec10 0x7fc270154ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:59.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.435+0000 7fc27510f700 1 -- 172.21.15.27:0/2159817526 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2700ae6c0 msgr2=0x7fc2701f2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:59.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.435+0000 7fc27510f700 1 --2- 172.21.15.27:0/2159817526 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2700ae6c0 0x7fc2701f2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:59.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.435+0000 7fc27510f700 1 -- 172.21.15.27:0/2159817526 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc26400b7f0 con 0x7fc2700cddd0 2023-07-05T23:32:59.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.435+0000 7fc27490e700 1 --2- 172.21.15.27:0/2159817526 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2700ae6c0 0x7fc2701f2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T23:32:59.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.435+0000 7fc27510f700 1 --2- 172.21.15.27:0/2159817526 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc2700cddd0 0x7fc2701f55e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc26800cc30 tx=0x7fc26800cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:59.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.435+0000 7fc26d7fa700 1 -- 172.21.15.27:0/2159817526 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26800ab00 con 0x7fc2700cddd0 2023-07-05T23:32:59.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.435+0000 7fc26d7fa700 1 -- 172.21.15.27:0/2159817526 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc26800ac60 con 0x7fc2700cddd0 2023-07-05T23:32:59.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.435+0000 7fc276b72700 1 -- 172.21.15.27:0/2159817526 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2701f2600 con 0x7fc2700cddd0 2023-07-05T23:32:59.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.435+0000 7fc26d7fa700 1 -- 172.21.15.27:0/2159817526 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc268003a20 con 0x7fc2700cddd0 2023-07-05T23:32:59.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.435+0000 7fc276b72700 1 -- 172.21.15.27:0/2159817526 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2701f1ff0 con 0x7fc2700cddd0 2023-07-05T23:32:59.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.436+0000 7fc276b72700 1 -- 172.21.15.27:0/2159817526 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2701f2970 con 0x7fc2700cddd0 2023-07-05T23:32:59.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.437+0000 7fc26d7fa700 1 -- 172.21.15.27:0/2159817526 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc26800f3f0 con 0x7fc2700cddd0 2023-07-05T23:32:59.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.437+0000 7fc26d7fa700 1 --2- 172.21.15.27:0/2159817526 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fc25406ad10 0x7fc25406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:32:59.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.437+0000 7fc26d7fa700 1 -- 172.21.15.27:0/2159817526 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc2680897d0 con 0x7fc2700cddd0 2023-07-05T23:32:59.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.437+0000 7fc27490e700 1 --2- 172.21.15.27:0/2159817526 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fc25406ad10 0x7fc25406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:32:59.447 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.438+0000 7fc27490e700 1 --2- 172.21.15.27:0/2159817526 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fc25406ad10 0x7fc25406d1c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc26400b6f0 tx=0x7fc264012000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:32:59.447 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.442+0000 7fc26d7fa700 1 -- 172.21.15.27:0/2159817526 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc268054620 con 0x7fc2700cddd0 2023-07-05T23:32:59.642 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.639+0000 7fc276b72700 1 -- 172.21.15.27:0/2159817526 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc27006f120 con 0x7fc2700cddd0 2023-07-05T23:32:59.643 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.640+0000 7fc26d7fa700 1 -- 172.21.15.27:0/2159817526 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20120 (secure 0 0 0) 0x7fc26801d090 con 0x7fc2700cddd0 2023-07-05T23:32:59.644 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:32:59.644 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":28,"fsid":"23eebe48-65f5-4d3c-8c2d-4aa171c055d5","created":"2023-07-05T23:32:27.989612+0000","modified":"2023-07-05T23:32:57.768949+0000","last_up_change":"2023-07-05T23:32:39.601570+0000","last_in_change":"2023-07-05T23:32:30.488261+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-05T23:32:41.624598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-05T23:32:46.481587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-05T23:32:51.025210+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-05T23:32:52.286964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-05T23:32:55.354212+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ac2071e4-394b-4385-b9ba-fad5265efc65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6814","nonce":3766536605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6818","nonce":3766536605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6823","nonce":3766536605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6821","nonce":3766536605}]},"public_addr":"172.21.15.27:6814/3766536605","cluster_addr":"172.21.15.27:6818/3766536605","heartbeat_back_addr":"172.21.15.27:6823/3766536605","heartbeat_front_addr":"172.21.15.27:6821/3766536605","state":["exists","up"]},{"osd":1,"uuid":"8c9b61a0-39d5-46bf-afd6-5add78453ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6801","nonce":1579117455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6803","nonce":1579117455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6807","nonce":1579117455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6805","nonce":1579117455}]},"public_addr":"172.21.15.27:6801/1579117455","cluster_addr":"172.21.15.27:6803/1579117455","heartbeat_back_addr":"172.21.15.27:6807/1579117455","heartbeat_front_addr":"172.21.15.27:6805/1579117455","state":["exists","up"]},{"osd":2,"uuid":"dcd032a2-06b1-4055-b798-b86c71a7107d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6825","nonce":807520271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6827","nonce":807520271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6831","nonce":807520271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6829","nonce":807520271}]},"public_addr":"172.21.15.27:6825/807520271","cluster_addr":"172.21.15.27:6827/807520271","heartbeat_back_addr":"172.21.15.27:6831/807520271","heartbeat_front_addr":"172.21.15.27:6829/807520271","state":["exists","up"]},{"osd":3,"uuid":"b0ffe0fc-47ba-4636-b5ea-6bab637642c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6809","nonce":2125656143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6811","nonce":2125656143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6817","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6819","nonce":2125656143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6813","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6815","nonce":2125656143}]},"public_addr":"172.21.15.27:6809/2125656143","cluster_addr":"172.21.15.27:6811/2125656143","heartbeat_back_addr":"172.21.15.27:6819/2125656143","heartbeat_front_addr":"172.21.15.27:6815/2125656143","state":["exists","up"]},{"osd":4,"uuid":"7fab4e5a-1246-4efe-9562-10c4a6c789ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6801","nonce":2111223016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6803","nonce":2111223016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6807","nonce":2111223016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6805","nonce":2111223016}]},"public_addr":"172.21.15.162:6801/2111223016","cluster_addr":"172.21.15.162:6803/2111223016","heartbeat_back_addr":"172.21.15.162:6807/2111223016","heartbeat_front_addr":"172.21.15.162:6805/2111223016","state":["exists","up"]},{"osd":5,"uuid":"110c4d9f-cef6-48ab-a818-5a81e72372af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6825","nonce":3102609008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6827","nonce":3102609008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6831","nonce":3102609008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6829","nonce":3102609008}]},"public_addr":"172.21.15.162:6825/3102609008","cluster_addr":"172.21.15.162:6827/3102609008","heartbeat_back_addr":"172.21.15.162:6831/3102609008","heartbeat_front_addr":"172.21.15.162:6829/3102609008","state":["exists","up"]},{"osd":6,"uuid":"16803bcc-2c92-4aed-954e-487938c9f24a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6809","nonce":2657688865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6811","nonce":2657688865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6815","nonce":2657688865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6813","nonce":2657688865}]},"public_addr":"172.21.15.162:6809/2657688865","cluster_addr":"172.21.15.162:6811/2657688865","heartbeat_back_addr":"172.21.15.162:6815/2657688865","heartbeat_front_addr":"172.21.15.162:6813/2657688865","state":["exists","up"]},{"osd":7,"uuid":"b7c35377-3cf2-4569-b6b9-72376eb463bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6817","nonce":2096609978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6819","nonce":2096609978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6823","nonce":2096609978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6821","nonce":2096609978}]},"public_addr":"172.21.15.162:6817/2096609978","cluster_addr":"172.21.15.162:6819/2096609978","heartbeat_back_addr":"172.21.15.162:6823/2096609978","heartbeat_front_addr":"172.21.15.162:6821/2096609978","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.735448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.645561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.759120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.682507+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.736228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.694664+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.716002+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.680485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-05T23:32:59.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.643+0000 7fc276b72700 1 -- 172.21.15.27:0/2159817526 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fc25406ad10 msgr2=0x7fc25406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:59.646 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.643+0000 7fc276b72700 1 --2- 172.21.15.27:0/2159817526 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fc25406ad10 0x7fc25406d1c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc26400b6f0 tx=0x7fc264012000 comp rx=0 tx=0).stop 2023-07-05T23:32:59.646 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.643+0000 7fc276b72700 1 -- 172.21.15.27:0/2159817526 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc2700cddd0 msgr2=0x7fc2701f55e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:32:59.646 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.643+0000 7fc276b72700 1 --2- 172.21.15.27:0/2159817526 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc2700cddd0 0x7fc2701f55e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc26800cc30 tx=0x7fc26800cf40 comp rx=0 tx=0).stop 2023-07-05T23:32:59.646 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.643+0000 7fc276b72700 1 -- 172.21.15.27:0/2159817526 shutdown_connections 2023-07-05T23:32:59.646 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.643+0000 7fc276b72700 1 --2- 172.21.15.27:0/2159817526 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2700ae6c0 0x7fc2701f2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:59.646 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.643+0000 7fc276b72700 1 --2- 172.21.15.27:0/2159817526 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fc25406ad10 0x7fc25406d1c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:59.647 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.643+0000 7fc276b72700 1 --2- 172.21.15.27:0/2159817526 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc2700cddd0 0x7fc2701f55e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:59.647 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.643+0000 7fc276b72700 1 --2- 172.21.15.27:0/2159817526 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2700aec10 0x7fc270154ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:32:59.647 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.643+0000 7fc276b72700 1 -- 172.21.15.27:0/2159817526 >> 172.21.15.27:0/2159817526 conn(0x7fc27006d4a0 msgr2=0x7fc27015c870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:32:59.648 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.643+0000 7fc276b72700 1 -- 172.21.15.27:0/2159817526 shutdown_connections 2023-07-05T23:32:59.649 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:32:59.643+0000 7fc276b72700 1 -- 172.21.15.27:0/2159817526 wait complete. 2023-07-05T23:33:00.061 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-05T23:32:53.313219+0000', 'modified': '2023-07-05T23:32:57.769151+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4293}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4293': {'gid': 4293, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.27:6835/3387103520', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.27:6833', 'nonce': 3387103520}, {'type': 'v1', 'addr': '172.21.15.27:6835', 'nonce': 3387103520}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-07-05T23:33:00.061 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-05T23:33:00.062 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-07-05T23:33:00.189 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.186+0000 7f42808e7700 1 Processor -- start 2023-07-05T23:33:00.189 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.186+0000 7f42808e7700 1 -- start start 2023-07-05T23:33:00.193 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.187+0000 7f42808e7700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f427c156880 0x7f427c069ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:00.193 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.187+0000 7f42808e7700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f427c0aed30 0x7f427c160580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:00.194 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.187+0000 7f42808e7700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f427c0cee80 con 0x7f427c0cc1d0 2023-07-05T23:33:00.194 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.187+0000 7f42808e7700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f427c0cf100 con 0x7f427c156880 2023-07-05T23:33:00.195 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.187+0000 7f42808e7700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f427c0cf3e0 con 0x7f427c0aed30 2023-07-05T23:33:00.195 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.187+0000 7f4279d9b700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f427c0aed30 0x7f427c160580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:00.195 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.187+0000 7f427a59c700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f427c156880 0x7f427c069ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:00.195 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.187+0000 7f4279d9b700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f427c0aed30 0x7f427c160580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.27:44822/0 (socket says 172.21.15.27:44822) 2023-07-05T23:33:00.196 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.187+0000 7f4279d9b700 1 -- 172.21.15.27:0/3002280804 learned_addr learned my addr 172.21.15.27:0/3002280804 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:00.196 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.187+0000 7f427ad9d700 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f427c0cc1d0 0x7f427c15cb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.27:32922/0 (socket says 172.21.15.27:32922) 2023-07-05T23:33:00.196 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.188+0000 7f427a59c700 1 -- 172.21.15.27:0/3002280804 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f427c0aed30 msgr2=0x7f427c160580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:00.196 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.188+0000 7f427a59c700 1 --2- 172.21.15.27:0/3002280804 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f427c0aed30 0x7f427c160580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:00.196 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.188+0000 7f427a59c700 1 -- 172.21.15.27:0/3002280804 >> v1:172.21.15.162:6789/0 conn(0x7f427c0cc1d0 legacy=0x7f427c15cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:00.196 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.188+0000 7f427959a700 1 -- 172.21.15.27:0/3002280804 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 445300965 0 0) 0x7f427c0cee80 con 0x7f427c0cc1d0 2023-07-05T23:33:00.196 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.188+0000 7f427a59c700 1 -- 172.21.15.27:0/3002280804 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f427c0cd390 con 0x7f427c156880 2023-07-05T23:33:00.197 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.188+0000 7f427a59c700 1 --2- 172.21.15.27:0/3002280804 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f427c156880 0x7f427c069ef0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f426c009840 tx=0x7f426c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=845f78d79e71881e server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:00.197 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.188+0000 7f427959a700 1 -- 172.21.15.27:0/3002280804 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426c011830 con 0x7f427c156880 2023-07-05T23:33:00.197 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.188+0000 7f427959a700 1 -- 172.21.15.27:0/3002280804 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f426c011990 con 0x7f427c156880 2023-07-05T23:33:00.197 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.188+0000 7f427959a700 1 -- 172.21.15.27:0/3002280804 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426c011d20 con 0x7f427c156880 2023-07-05T23:33:00.197 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.189+0000 7f42808e7700 1 -- 172.21.15.27:0/3002280804 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f427c156880 msgr2=0x7f427c069ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:00.197 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.189+0000 7f42808e7700 1 --2- 172.21.15.27:0/3002280804 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f427c156880 0x7f427c069ef0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f426c009840 tx=0x7f426c009b50 comp rx=0 tx=0).stop 2023-07-05T23:33:00.197 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.189+0000 7f42808e7700 1 -- 172.21.15.27:0/3002280804 shutdown_connections 2023-07-05T23:33:00.197 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.189+0000 7f42808e7700 1 --2- 172.21.15.27:0/3002280804 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f427c156880 0x7f427c069ef0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:00.198 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.189+0000 7f42808e7700 1 --2- 172.21.15.27:0/3002280804 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f427c0aed30 0x7f427c160580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:00.198 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.189+0000 7f42808e7700 1 -- 172.21.15.27:0/3002280804 >> 172.21.15.27:0/3002280804 conn(0x7f427c06d4a0 msgr2=0x7f427c06d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:00.198 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.189+0000 7f42808e7700 1 -- 172.21.15.27:0/3002280804 shutdown_connections 2023-07-05T23:33:00.198 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.189+0000 7f42808e7700 1 -- 172.21.15.27:0/3002280804 wait complete. 2023-07-05T23:33:00.198 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.190+0000 7f42808e7700 1 Processor -- start 2023-07-05T23:33:00.198 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.190+0000 7f42808e7700 1 -- start start 2023-07-05T23:33:00.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.191+0000 7f42808e7700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f427c0aed30 0x7f427c0c3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:00.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.191+0000 7f42808e7700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f427c0cc1d0 0x7f427c0c5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:00.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.191+0000 7f42808e7700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f427c156880 0x7f427c0acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:00.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.191+0000 7f42808e7700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f427c1555f0 con 0x7f427c0aed30 2023-07-05T23:33:00.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.191+0000 7f42808e7700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f427c1f1b30 con 0x7f427c0cc1d0 2023-07-05T23:33:00.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.191+0000 7f42808e7700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f427c0c6290 con 0x7f427c156880 2023-07-05T23:33:00.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.191+0000 7f427a59c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f427c0aed30 0x7f427c0c3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:00.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.191+0000 7f427a59c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f427c0aed30 0x7f427c0c3d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44790/0 (socket says 172.21.15.27:44790) 2023-07-05T23:33:00.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.191+0000 7f427a59c700 1 -- 172.21.15.27:0/2060655387 learned_addr learned my addr 172.21.15.27:0/2060655387 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:00.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.191+0000 7f4279d9b700 1 --2- 172.21.15.27:0/2060655387 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f427c0cc1d0 0x7f427c0c5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:00.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.191+0000 7f427ad9d700 1 --2- 172.21.15.27:0/2060655387 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f427c156880 0x7f427c0acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:00.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.191+0000 7f427a59c700 1 -- 172.21.15.27:0/2060655387 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f427c156880 msgr2=0x7f427c0acdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:00.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.191+0000 7f427a59c700 1 --2- 172.21.15.27:0/2060655387 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f427c156880 0x7f427c0acdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:00.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.191+0000 7f427a59c700 1 -- 172.21.15.27:0/2060655387 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f427c0cc1d0 msgr2=0x7f427c0c5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:00.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.191+0000 7f427a59c700 1 --2- 172.21.15.27:0/2060655387 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f427c0cc1d0 0x7f427c0c5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:00.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.191+0000 7f427a59c700 1 -- 172.21.15.27:0/2060655387 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f426c0094a0 con 0x7f427c0aed30 2023-07-05T23:33:00.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.192+0000 7f427a59c700 1 --2- 172.21.15.27:0/2060655387 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f427c0aed30 0x7f427c0c3d00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f426c009fd0 tx=0x7f426c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:00.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.192+0000 7f426affd700 1 -- 172.21.15.27:0/2060655387 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426c0045d0 con 0x7f427c0aed30 2023-07-05T23:33:00.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.192+0000 7f426affd700 1 -- 172.21.15.27:0/2060655387 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f426c01e070 con 0x7f427c0aed30 2023-07-05T23:33:00.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.192+0000 7f42808e7700 1 -- 172.21.15.27:0/2060655387 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f427c0cb6c0 con 0x7f427c0aed30 2023-07-05T23:33:00.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.192+0000 7f426affd700 1 -- 172.21.15.27:0/2060655387 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426c0038e0 con 0x7f427c0aed30 2023-07-05T23:33:00.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.192+0000 7f42808e7700 1 -- 172.21.15.27:0/2060655387 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f427c0c4650 con 0x7f427c0aed30 2023-07-05T23:33:00.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.193+0000 7f426affd700 1 -- 172.21.15.27:0/2060655387 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f426c003a40 con 0x7f427c0aed30 2023-07-05T23:33:00.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.194+0000 7f426affd700 1 --2- 172.21.15.27:0/2060655387 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f425c06ace0 0x7f425c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:00.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.194+0000 7f426affd700 1 -- 172.21.15.27:0/2060655387 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f426c08a6a0 con 0x7f427c0aed30 2023-07-05T23:33:00.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.194+0000 7f4279d9b700 1 --2- 172.21.15.27:0/2060655387 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f425c06ace0 0x7f425c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:00.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.194+0000 7f4279d9b700 1 --2- 172.21.15.27:0/2060655387 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f425c06ace0 0x7f425c06d190 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4270009bd0 tx=0x7f42700092c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:00.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.196+0000 7f428ca6cb80 1 Processor -- start 2023-07-05T23:33:00.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.196+0000 7f428ca6cb80 1 -- start start 2023-07-05T23:33:00.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.197+0000 7f428ca6cb80 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5558012e0f50 0x5558012e1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:00.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.197+0000 7f428ca6cb80 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x555801308d80 0x555801307820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:00.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.197+0000 7f428ca6cb80 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5558012de740 0x55580130b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:00.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.197+0000 7f428ca6cb80 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558011e5c60 con 0x5558012de740 2023-07-05T23:33:00.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.197+0000 7f428ca6cb80 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558012389f0 con 0x5558012e0f50 2023-07-05T23:33:00.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.197+0000 7f428ca6cb80 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x555801231e80 con 0x555801308d80 2023-07-05T23:33:00.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.197+0000 7f427ad9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5558012de740 0x55580130b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:00.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.197+0000 7f427ad9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5558012de740 0x55580130b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44802/0 (socket says 172.21.15.27:44802) 2023-07-05T23:33:00.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.197+0000 7f427ad9d700 1 -- 172.21.15.27:0/3549107297 learned_addr learned my addr 172.21.15.27:0/3549107297 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:00.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.197+0000 7f427a59c700 1 --2- 172.21.15.27:0/3549107297 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5558012e0f50 0x5558012e1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:00.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.197+0000 7f4279d9b700 1 --2- 172.21.15.27:0/3549107297 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x555801308d80 0x555801307820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:00.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.198+0000 7f427ad9d700 1 -- 172.21.15.27:0/3549107297 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x555801308d80 msgr2=0x555801307820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:00.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.198+0000 7f427ad9d700 1 --2- 172.21.15.27:0/3549107297 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x555801308d80 0x555801307820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:00.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.198+0000 7f427ad9d700 1 -- 172.21.15.27:0/3549107297 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5558012e0f50 msgr2=0x5558012e1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:00.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.198+0000 7f427ad9d700 1 --2- 172.21.15.27:0/3549107297 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5558012e0f50 0x5558012e1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:00.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.198+0000 7f427ad9d700 1 -- 172.21.15.27:0/3549107297 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5558010b35e0 con 0x5558012de740 2023-07-05T23:33:00.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.198+0000 7f427a59c700 1 --2- 172.21.15.27:0/3549107297 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5558012e0f50 0x5558012e1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T23:33:00.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.198+0000 7f427ad9d700 1 --2- 172.21.15.27:0/3549107297 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5558012de740 0x55580130b440 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4274002160 tx=0x7f4274007330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=484210a831a01947 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:00.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.198+0000 7f425bfff700 1 -- 172.21.15.27:0/3549107297 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4274014480 con 0x5558012de740 2023-07-05T23:33:00.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.198+0000 7f425bfff700 1 -- 172.21.15.27:0/3549107297 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4274014600 con 0x5558012de740 2023-07-05T23:33:00.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.198+0000 7f425bfff700 1 -- 172.21.15.27:0/3549107297 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42740149b0 con 0x5558012de740 2023-07-05T23:33:00.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.198+0000 7f428ca6cb80 1 -- 172.21.15.27:0/3549107297 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5558012de740 msgr2=0x55580130b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:00.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.198+0000 7f428ca6cb80 1 --2- 172.21.15.27:0/3549107297 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5558012de740 0x55580130b440 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4274002160 tx=0x7f4274007330 comp rx=0 tx=0).stop 2023-07-05T23:33:00.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.199+0000 7f428ca6cb80 1 -- 172.21.15.27:0/3549107297 shutdown_connections 2023-07-05T23:33:00.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.199+0000 7f428ca6cb80 1 --2- 172.21.15.27:0/3549107297 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5558012e0f50 0x5558012e1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:00.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.199+0000 7f428ca6cb80 1 --2- 172.21.15.27:0/3549107297 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5558012de740 0x55580130b440 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:00.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.199+0000 7f428ca6cb80 1 --2- 172.21.15.27:0/3549107297 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x555801308d80 0x555801307820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:00.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.199+0000 7f428ca6cb80 1 -- 172.21.15.27:0/3549107297 >> 172.21.15.27:0/3549107297 conn(0x5558012d5fc0 msgr2=0x5558013261a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:00.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.199+0000 7f428ca6cb80 1 -- 172.21.15.27:0/3549107297 shutdown_connections 2023-07-05T23:33:00.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.199+0000 7f428ca6cb80 1 -- 172.21.15.27:0/3549107297 wait complete. 2023-07-05T23:33:00.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.199+0000 7f428ca6cb80 1 -- start start 2023-07-05T23:33:00.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.199+0000 7f428ca6cb80 1 Processor -- start 2023-07-05T23:33:00.214 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.200+0000 7f428ca6cb80 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5558012de740 0x555801329e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:00.215 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.200+0000 7f428ca6cb80 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5558012e0f50 0x555801322760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:00.215 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.200+0000 7f428ca6cb80 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555801308d80 0x555801322ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:00.215 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.200+0000 7f428ca6cb80 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558011d1a70 con 0x5558012de740 2023-07-05T23:33:00.215 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.200+0000 7f428ca6cb80 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558011d1770 con 0x555801308d80 2023-07-05T23:33:00.215 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.200+0000 7f428ca6cb80 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x5558010b58d0 con 0x5558012e0f50 2023-07-05T23:33:00.215 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.200+0000 7f428ca6cb80 10 client.0 _ll_register_callbacks cb 0x5558011d7210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-05T23:33:00.215 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.200+0000 7f427a59c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5558012de740 0x555801329e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:00.216 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.200+0000 7f427a59c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5558012de740 0x555801329e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44804/0 (socket says 172.21.15.27:44804) 2023-07-05T23:33:00.216 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.200+0000 7f427a59c700 1 -- 172.21.15.27:0/2931725845 learned_addr learned my addr 172.21.15.27:0/2931725845 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:00.216 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.201+0000 7f4279d9b700 1 --2- 172.21.15.27:0/2931725845 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5558012e0f50 0x555801322760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:00.216 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.201+0000 7f427ad9d700 1 --2- 172.21.15.27:0/2931725845 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555801308d80 0x555801322ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:00.216 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.201+0000 7f427a59c700 1 -- 172.21.15.27:0/2931725845 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5558012e0f50 msgr2=0x555801322760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:00.216 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.201+0000 7f427a59c700 1 --2- 172.21.15.27:0/2931725845 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5558012e0f50 0x555801322760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:00.216 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.201+0000 7f427a59c700 1 -- 172.21.15.27:0/2931725845 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555801308d80 msgr2=0x555801322ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:00.217 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.201+0000 7f427a59c700 1 --2- 172.21.15.27:0/2931725845 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555801308d80 0x555801322ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:00.217 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.201+0000 7f427a59c700 1 -- 172.21.15.27:0/2931725845 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f427c0c4650 con 0x5558012de740 2023-07-05T23:33:00.217 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.201+0000 7f427a59c700 1 --2- 172.21.15.27:0/2931725845 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5558012de740 0x555801329e60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f426c059140 tx=0x7f426c05d2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5a39a0a3920ae0b server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:00.217 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.201+0000 7f42597fa700 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2023-07-05T23:33:00.217 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.201+0000 7f42597fa700 1 -- 172.21.15.27:0/2931725845 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426c0588a0 con 0x5558012de740 2023-07-05T23:33:00.217 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.201+0000 7f42597fa700 1 -- 172.21.15.27:0/2931725845 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f426c061070 con 0x5558012de740 2023-07-05T23:33:00.217 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.201+0000 7f428ca6cb80 1 -- 172.21.15.27:0/2931725845 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5558012d3780 con 0x5558012de740 2023-07-05T23:33:00.217 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.201+0000 7f42597fa700 1 -- 172.21.15.27:0/2931725845 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f426c061250 con 0x5558012de740 2023-07-05T23:33:00.218 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.201+0000 7f428ca6cb80 10 client.4446 fetch_fsmap learned FSMap version 7 2023-07-05T23:33:00.218 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.201+0000 7f428ca6cb80 1 -- 172.21.15.27:0/2931725845 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x7f427400f040 con 0x5558012de740 2023-07-05T23:33:00.218 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.201+0000 7f42597fa700 1 -- 172.21.15.27:0/2931725845 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5558012d3780 con 0x5558012de740 2023-07-05T23:33:00.218 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.201+0000 7f42597fa700 1 -- 172.21.15.27:0/2931725845 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 7) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f426c088ba0 con 0x5558012de740 2023-07-05T23:33:00.218 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.201+0000 7f428ca6cb80 10 client.4446 fetch_fsmap finished waiting for FSMap version 7 2023-07-05T23:33:00.218 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.201+0000 7f428ca6cb80 10 client.4446 resolve_mds: resolved name 'a' to daemon mds.a 2023-07-05T23:33:00.218 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.201+0000 7f428ca6cb80 20 client.4446 populate_metadata read hostname 'smithi027' 2023-07-05T23:33:00.218 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.201+0000 7f428ca6cb80 1 --2- 172.21.15.27:0/2931725845 >> [v2:172.21.15.27:6833/3387103520,v1:172.21.15.27:6835/3387103520] conn(0x555801320e00 0x555801325260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:00.219 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.201+0000 7f428ca6cb80 4 client.4446 mds_command: new command op to 4293 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-05T23:33:00.219 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.201+0000 7f428ca6cb80 1 -- 172.21.15.27:0/2931725845 --> [v2:172.21.15.27:6833/3387103520,v1:172.21.15.27:6835/3387103520] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55580122ae60 con 0x555801320e00 2023-07-05T23:33:00.219 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.202+0000 7f4279d9b700 1 --2- 172.21.15.27:0/2931725845 >> [v2:172.21.15.27:6833/3387103520,v1:172.21.15.27:6835/3387103520] conn(0x555801320e00 0x555801325260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:00.219 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.202+0000 7f42597fa700 10 client.4446 ms_handle_connect on v2:172.21.15.27:6833/3387103520 2023-07-05T23:33:00.219 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.202+0000 7f4279d9b700 1 --2- 172.21.15.27:0/2931725845 >> [v2:172.21.15.27:6833/3387103520,v1:172.21.15.27:6835/3387103520] conn(0x555801320e00 0x555801325260 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa5ae15bbf99b2e1 server_cookie=74d62b55de1748f3 in_seq=0 out_seq=0 2023-07-05T23:33:00.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.202+0000 7f42597fa700 1 -- 172.21.15.27:0/2931725845 <== mds.0 v2:172.21.15.27:6833/3387103520 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55580122ae60 con 0x555801320e00 2023-07-05T23:33:00.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.202+0000 7f42597fa700 10 client.4446 handle_command_reply: tid=0 2023-07-05T23:33:00.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.202+0000 7f428ca6cb80 1 client.4446 shutdown 2023-07-05T23:33:00.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.203+0000 7f428ca6cb80 1 -- 172.21.15.27:0/2931725845 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5558012de740 msgr2=0x555801329e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:00.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.203+0000 7f428ca6cb80 1 --2- 172.21.15.27:0/2931725845 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5558012de740 0x555801329e60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f426c059140 tx=0x7f426c05d2f0 comp rx=0 tx=0).stop 2023-07-05T23:33:00.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.203+0000 7f428ca6cb80 1 -- 172.21.15.27:0/2931725845 shutdown_connections 2023-07-05T23:33:00.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.203+0000 7f428ca6cb80 1 --2- 172.21.15.27:0/2931725845 >> [v2:172.21.15.27:6833/3387103520,v1:172.21.15.27:6835/3387103520] conn(0x555801320e00 0x555801325260 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:00.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.203+0000 7f428ca6cb80 1 --2- 172.21.15.27:0/2931725845 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555801308d80 0x555801322ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:00.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.203+0000 7f428ca6cb80 1 --2- 172.21.15.27:0/2931725845 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5558012de740 0x555801329e60 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:00.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.203+0000 7f42597fa700 0 client.4446 ms_handle_reset on v2:172.21.15.27:6833/3387103520 2023-07-05T23:33:00.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.203+0000 7f428ca6cb80 1 --2- 172.21.15.27:0/2931725845 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5558012e0f50 0x555801322760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:00.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.203+0000 7f428ca6cb80 1 -- 172.21.15.27:0/2931725845 >> 172.21.15.27:0/2931725845 conn(0x5558012d5fc0 msgr2=0x555801326bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:00.222 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.203+0000 7f428ca6cb80 1 -- 172.21.15.27:0/2931725845 shutdown_connections 2023-07-05T23:33:00.222 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.203+0000 7f428ca6cb80 1 -- 172.21.15.27:0/2931725845 wait complete. 2023-07-05T23:33:00.222 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.203+0000 7f428ca6cb80 20 client.4446 trim_cache size 0 max 16384 2023-07-05T23:33:00.223 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.221+0000 7f428ca6cb80 1 Processor -- start 2023-07-05T23:33:00.224 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.221+0000 7f428ca6cb80 1 -- start start 2023-07-05T23:33:00.224 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.221+0000 7f428ca6cb80 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5558012de740 0x555801347fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:00.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.221+0000 7f428ca6cb80 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5558012e0f50 0x555801302490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:00.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.221+0000 7f428ca6cb80 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555801308d80 0x55580131ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:00.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.221+0000 7f428ca6cb80 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558013484e0 con 0x555801308d80 2023-07-05T23:33:00.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.221+0000 7f428ca6cb80 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x555801323c70 con 0x5558012de740 2023-07-05T23:33:00.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.221+0000 7f428ca6cb80 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x5558012e0a20 con 0x5558012e0f50 2023-07-05T23:33:00.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.222+0000 7f427ad9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555801308d80 0x55580131ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:00.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.222+0000 7f427ad9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555801308d80 0x55580131ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44816/0 (socket says 172.21.15.27:44816) 2023-07-05T23:33:00.226 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.222+0000 7f427ad9d700 1 -- 172.21.15.27:0/879381221 learned_addr learned my addr 172.21.15.27:0/879381221 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:00.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.222+0000 7f4279d9b700 1 --2- 172.21.15.27:0/879381221 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5558012e0f50 0x555801302490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:00.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.222+0000 7f427a59c700 1 --2- 172.21.15.27:0/879381221 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5558012de740 0x555801347fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:00.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.222+0000 7f427ad9d700 1 -- 172.21.15.27:0/879381221 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5558012e0f50 msgr2=0x555801302490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:00.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.222+0000 7f427ad9d700 1 --2- 172.21.15.27:0/879381221 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5558012e0f50 0x555801302490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:00.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.222+0000 7f427ad9d700 1 -- 172.21.15.27:0/879381221 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5558012de740 msgr2=0x555801347fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:00.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.222+0000 7f427ad9d700 1 --2- 172.21.15.27:0/879381221 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5558012de740 0x555801347fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:00.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.222+0000 7f427ad9d700 1 -- 172.21.15.27:0/879381221 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55580105fd90 con 0x555801308d80 2023-07-05T23:33:00.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.222+0000 7f427ad9d700 1 --2- 172.21.15.27:0/879381221 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555801308d80 0x55580131ed40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f42740012e0 tx=0x7f427400c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c19c1b0958f8c2af server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:00.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.222+0000 7f4268ff9700 1 -- 172.21.15.27:0/879381221 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4274014480 con 0x555801308d80 2023-07-05T23:33:00.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.222+0000 7f4268ff9700 1 -- 172.21.15.27:0/879381221 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f427400b040 con 0x555801308d80 2023-07-05T23:33:00.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.222+0000 7f4268ff9700 1 -- 172.21.15.27:0/879381221 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42740149b0 con 0x555801308d80 2023-07-05T23:33:00.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.223+0000 7f428ca6cb80 1 -- 172.21.15.27:0/879381221 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555801308d80 msgr2=0x55580131ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:00.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.223+0000 7f428ca6cb80 1 --2- 172.21.15.27:0/879381221 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555801308d80 0x55580131ed40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f42740012e0 tx=0x7f427400c000 comp rx=0 tx=0).stop 2023-07-05T23:33:00.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.223+0000 7f428ca6cb80 1 -- 172.21.15.27:0/879381221 shutdown_connections 2023-07-05T23:33:00.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.223+0000 7f428ca6cb80 1 --2- 172.21.15.27:0/879381221 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5558012de740 0x555801347fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:00.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.223+0000 7f428ca6cb80 1 --2- 172.21.15.27:0/879381221 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555801308d80 0x55580131ed40 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:00.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.223+0000 7f428ca6cb80 1 --2- 172.21.15.27:0/879381221 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5558012e0f50 0x555801302490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:00.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.223+0000 7f428ca6cb80 1 -- 172.21.15.27:0/879381221 >> 172.21.15.27:0/879381221 conn(0x5558012d5fc0 msgr2=0x555801326ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:00.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.223+0000 7f428ca6cb80 1 -- 172.21.15.27:0/879381221 shutdown_connections 2023-07-05T23:33:00.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.223+0000 7f428ca6cb80 1 -- 172.21.15.27:0/879381221 wait complete. 2023-07-05T23:33:00.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.223+0000 7f428ca6cb80 1 -- start start 2023-07-05T23:33:00.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.223+0000 7f428ca6cb80 1 Processor -- start 2023-07-05T23:33:00.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.224+0000 7f428ca6cb80 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5558012de740 0x5558012df450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:00.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.224+0000 7f428ca6cb80 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5558012e0f50 0x555801323170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:00.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.224+0000 7f428ca6cb80 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x555801308d80 0x55580131f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:00.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.224+0000 7f428ca6cb80 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558012da030 con 0x5558012de740 2023-07-05T23:33:00.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.224+0000 7f428ca6cb80 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x555801386670 con 0x5558012e0f50 2023-07-05T23:33:00.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.224+0000 7f428ca6cb80 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x5558012da2a0 con 0x555801308d80 2023-07-05T23:33:00.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.224+0000 7f428ca6cb80 10 client.0 _ll_register_callbacks cb 0x5558011d7210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-05T23:33:00.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.224+0000 7f427a59c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5558012de740 0x5558012df450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:00.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.224+0000 7f427a59c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5558012de740 0x5558012df450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44818/0 (socket says 172.21.15.27:44818) 2023-07-05T23:33:00.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.224+0000 7f427a59c700 1 -- 172.21.15.27:0/2038831965 learned_addr learned my addr 172.21.15.27:0/2038831965 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:00.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.224+0000 7f427ad9d700 1 --2- 172.21.15.27:0/2038831965 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x555801308d80 0x55580131f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:00.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.224+0000 7f4279d9b700 1 --2- 172.21.15.27:0/2038831965 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5558012e0f50 0x555801323170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:00.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.225+0000 7f427a59c700 1 -- 172.21.15.27:0/2038831965 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x555801308d80 msgr2=0x55580131f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:00.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.225+0000 7f427a59c700 1 --2- 172.21.15.27:0/2038831965 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x555801308d80 0x55580131f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:00.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.225+0000 7f427a59c700 1 -- 172.21.15.27:0/2038831965 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5558012e0f50 msgr2=0x555801323170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:00.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.225+0000 7f427a59c700 1 --2- 172.21.15.27:0/2038831965 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5558012e0f50 0x555801323170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:00.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.225+0000 7f427a59c700 1 -- 172.21.15.27:0/2038831965 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5558010b35e0 con 0x5558012de740 2023-07-05T23:33:00.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.225+0000 7f4279d9b700 1 --2- 172.21.15.27:0/2038831965 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5558012e0f50 0x555801323170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T23:33:00.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.225+0000 7f427a59c700 1 --2- 172.21.15.27:0/2038831965 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5558012de740 0x5558012df450 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f426c060fd0 tx=0x7f426c0886e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d31d38227a2f4a83 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:00.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.225+0000 7f42597fa700 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2023-07-05T23:33:00.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.225+0000 7f42597fa700 1 -- 172.21.15.27:0/2038831965 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426c058f80 con 0x5558012de740 2023-07-05T23:33:00.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.225+0000 7f42597fa700 1 -- 172.21.15.27:0/2038831965 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f426c088ba0 con 0x5558012de740 2023-07-05T23:33:00.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.225+0000 7f428ca6cb80 1 -- 172.21.15.27:0/2038831965 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4274014600 con 0x5558012de740 2023-07-05T23:33:00.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.225+0000 7f42597fa700 1 -- 172.21.15.27:0/2038831965 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f426c0586a0 con 0x5558012de740 2023-07-05T23:33:00.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.225+0000 7f428ca6cb80 10 client.4452 fetch_fsmap learned FSMap version 7 2023-07-05T23:33:00.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.225+0000 7f428ca6cb80 1 -- 172.21.15.27:0/2038831965 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x555801048c10 con 0x5558012de740 2023-07-05T23:33:00.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.225+0000 7f42597fa700 1 -- 172.21.15.27:0/2038831965 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4274014600 con 0x5558012de740 2023-07-05T23:33:00.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.225+0000 7f42597fa700 1 -- 172.21.15.27:0/2038831965 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 7) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f426c088270 con 0x5558012de740 2023-07-05T23:33:00.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.225+0000 7f428ca6cb80 10 client.4452 fetch_fsmap finished waiting for FSMap version 7 2023-07-05T23:33:00.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.225+0000 7f428ca6cb80 10 client.4452 resolve_mds: resolved name 'a' to daemon mds.a 2023-07-05T23:33:00.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.225+0000 7f428ca6cb80 20 client.4452 populate_metadata read hostname 'smithi027' 2023-07-05T23:33:00.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.225+0000 7f428ca6cb80 1 --2- 172.21.15.27:0/2038831965 >> [v2:172.21.15.27:6833/3387103520,v1:172.21.15.27:6835/3387103520] conn(0x555801320210 0x55580131f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:00.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.225+0000 7f428ca6cb80 4 client.4452 mds_command: new command op to 4293 tid=0[{"prefix": "status"}] 2023-07-05T23:33:00.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.225+0000 7f428ca6cb80 1 -- 172.21.15.27:0/2038831965 --> [v2:172.21.15.27:6833/3387103520,v1:172.21.15.27:6835/3387103520] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5558011ed000 con 0x555801320210 2023-07-05T23:33:00.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.225+0000 7f4279d9b700 1 --2- 172.21.15.27:0/2038831965 >> [v2:172.21.15.27:6833/3387103520,v1:172.21.15.27:6835/3387103520] conn(0x555801320210 0x55580131f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:00.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.226+0000 7f42597fa700 10 client.4452 ms_handle_connect on v2:172.21.15.27:6833/3387103520 2023-07-05T23:33:00.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.226+0000 7f4279d9b700 1 --2- 172.21.15.27:0/2038831965 >> [v2:172.21.15.27:6833/3387103520,v1:172.21.15.27:6835/3387103520] conn(0x555801320210 0x55580131f6e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e27250ee7478e935 server_cookie=7335fc7bedd02e44 in_seq=0 out_seq=0 2023-07-05T23:33:00.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.226+0000 7f42597fa700 1 -- 172.21.15.27:0/2038831965 <== mds.0 v2:172.21.15.27:6833/3387103520 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x5558011ed000 con 0x555801320210 2023-07-05T23:33:00.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.226+0000 7f42597fa700 10 client.4452 handle_command_reply: tid=0 2023-07-05T23:33:00.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.226+0000 7f428ca6cb80 1 client.4452 shutdown 2023-07-05T23:33:00.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.226+0000 7f428ca6cb80 1 -- 172.21.15.27:0/2038831965 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5558012de740 msgr2=0x5558012df450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:00.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.226+0000 7f428ca6cb80 1 --2- 172.21.15.27:0/2038831965 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5558012de740 0x5558012df450 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f426c060fd0 tx=0x7f426c0886e0 comp rx=0 tx=0).stop 2023-07-05T23:33:00.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.226+0000 7f428ca6cb80 1 -- 172.21.15.27:0/2038831965 shutdown_connections 2023-07-05T23:33:00.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.226+0000 7f428ca6cb80 1 --2- 172.21.15.27:0/2038831965 >> [v2:172.21.15.27:6833/3387103520,v1:172.21.15.27:6835/3387103520] conn(0x555801320210 0x55580131f6e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:00.239 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.226+0000 7f428ca6cb80 1 --2- 172.21.15.27:0/2038831965 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x555801308d80 0x55580131f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:00.239 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.226+0000 7f428ca6cb80 1 --2- 172.21.15.27:0/2038831965 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5558012de740 0x5558012df450 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:00.239 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.226+0000 7f428ca6cb80 1 --2- 172.21.15.27:0/2038831965 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5558012e0f50 0x555801323170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:00.239 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.226+0000 7f42597fa700 0 client.4452 ms_handle_reset on v2:172.21.15.27:6833/3387103520 2023-07-05T23:33:00.239 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.226+0000 7f428ca6cb80 1 -- 172.21.15.27:0/2038831965 >> 172.21.15.27:0/2038831965 conn(0x5558012d5fc0 msgr2=0x5558012db8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:00.239 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.226+0000 7f428ca6cb80 1 -- 172.21.15.27:0/2038831965 shutdown_connections 2023-07-05T23:33:00.239 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.226+0000 7f428ca6cb80 1 -- 172.21.15.27:0/2038831965 wait complete. 2023-07-05T23:33:00.239 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.226+0000 7f428ca6cb80 20 client.4452 trim_cache size 0 max 16384 2023-07-05T23:33:00.240 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2023-07-05T23:33:00.240 INFO:teuthology.orchestra.run.smithi027.stdout: "cluster_fsid": "23eebe48-65f5-4d3c-8c2d-4aa171c055d5", 2023-07-05T23:33:00.240 INFO:teuthology.orchestra.run.smithi027.stdout: "whoami": 0, 2023-07-05T23:33:00.240 INFO:teuthology.orchestra.run.smithi027.stdout: "id": 4293, 2023-07-05T23:33:00.240 INFO:teuthology.orchestra.run.smithi027.stdout: "want_state": "up:active", 2023-07-05T23:33:00.241 INFO:teuthology.orchestra.run.smithi027.stdout: "state": "up:active", 2023-07-05T23:33:00.241 INFO:teuthology.orchestra.run.smithi027.stdout: "fs_name": "cephfs", 2023-07-05T23:33:00.241 INFO:teuthology.orchestra.run.smithi027.stdout: "rank_uptime": 6.9116399660000001, 2023-07-05T23:33:00.241 INFO:teuthology.orchestra.run.smithi027.stdout: "mdsmap_epoch": 7, 2023-07-05T23:33:00.241 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_epoch": 28, 2023-07-05T23:33:00.241 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_epoch_barrier": 27, 2023-07-05T23:33:00.241 INFO:teuthology.orchestra.run.smithi027.stdout: "uptime": 12.357172397999999 2023-07-05T23:33:00.242 INFO:teuthology.orchestra.run.smithi027.stdout:} 2023-07-05T23:33:00.243 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.227+0000 7f42808e7700 1 -- 172.21.15.27:0/2060655387 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f425c06ace0 msgr2=0x7f425c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:00.243 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.227+0000 7f42808e7700 1 --2- 172.21.15.27:0/2060655387 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f425c06ace0 0x7f425c06d190 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4270009bd0 tx=0x7f42700092c0 comp rx=0 tx=0).stop 2023-07-05T23:33:00.243 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.227+0000 7f42808e7700 1 -- 172.21.15.27:0/2060655387 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f427c0aed30 msgr2=0x7f427c0c3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:00.243 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.227+0000 7f42808e7700 1 --2- 172.21.15.27:0/2060655387 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f427c0aed30 0x7f427c0c3d00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f426c009fd0 tx=0x7f426c004750 comp rx=0 tx=0).stop 2023-07-05T23:33:00.243 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.227+0000 7f42808e7700 1 -- 172.21.15.27:0/2060655387 shutdown_connections 2023-07-05T23:33:00.243 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.227+0000 7f42808e7700 1 --2- 172.21.15.27:0/2060655387 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f425c06ace0 0x7f425c06d190 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:00.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.227+0000 7f42808e7700 1 --2- 172.21.15.27:0/2060655387 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f427c156880 0x7f427c0acdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:00.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.227+0000 7f42808e7700 1 --2- 172.21.15.27:0/2060655387 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f427c0aed30 0x7f427c0c3d00 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:00.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.227+0000 7f42808e7700 1 --2- 172.21.15.27:0/2060655387 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f427c0cc1d0 0x7f427c0c5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:00.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.227+0000 7f42808e7700 1 -- 172.21.15.27:0/2060655387 >> 172.21.15.27:0/2060655387 conn(0x7f427c06d4a0 msgr2=0x7f427c15f010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:00.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.227+0000 7f42808e7700 1 -- 172.21.15.27:0/2060655387 shutdown_connections 2023-07-05T23:33:00.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.227+0000 7f42808e7700 1 -- 172.21.15.27:0/2060655387 wait complete. 2023-07-05T23:33:00.245 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-05T23:33:00.245 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-07-05T23:33:00.246 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-05T23:33:00.371 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.368+0000 7fb52cb4f700 1 Processor -- start 2023-07-05T23:33:00.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.368+0000 7fb52cb4f700 1 -- start start 2023-07-05T23:33:00.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.369+0000 7fb52cb4f700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb52815a1e0 0x7fb5280aec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:00.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.369+0000 7fb52cb4f700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb52815d6a0 con 0x7fb5280ae6c0 2023-07-05T23:33:00.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.369+0000 7fb52cb4f700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb528159700 con 0x7fb5280cddd0 2023-07-05T23:33:00.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.369+0000 7fb52cb4f700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5280cdc80 con 0x7fb52815a1e0 2023-07-05T23:33:00.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.369+0000 7fb525d9b700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fb5280ae6c0 0x7fb5280714a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:51994/0 (socket says 172.21.15.27:51994) 2023-07-05T23:33:00.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.369+0000 7fb525d9b700 1 -- 172.21.15.27:0/1716209101 learned_addr learned my addr 172.21.15.27:0/1716209101 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-07-05T23:33:00.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.369+0000 7fb52559a700 1 -- 172.21.15.27:0/1716209101 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 333912606 0 0) 0x7fb52815d6a0 con 0x7fb5280ae6c0 2023-07-05T23:33:00.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.369+0000 7fb526d9d700 1 --2- 172.21.15.27:0/1716209101 >> v2:172.21.15.162:3300/0 conn(0x7fb52815a1e0 0x7fb5280aec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:00.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.369+0000 7fb52559a700 1 -- 172.21.15.27:0/1716209101 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5100035b0 con 0x7fb5280ae6c0 2023-07-05T23:33:00.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.370+0000 7fb52559a700 1 -- 172.21.15.27:0/1716209101 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 210765966 0 0) 0x7fb5100035b0 con 0x7fb5280ae6c0 2023-07-05T23:33:00.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.370+0000 7fb52559a700 1 -- 172.21.15.27:0/1716209101 >> v2:172.21.15.162:3300/0 conn(0x7fb52815a1e0 msgr2=0x7fb5280aec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:00.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.370+0000 7fb52559a700 1 --2- 172.21.15.27:0/1716209101 >> v2:172.21.15.162:3300/0 conn(0x7fb52815a1e0 0x7fb5280aec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:00.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.370+0000 7fb52559a700 1 -- 172.21.15.27:0/1716209101 >> v1:172.21.15.162:6789/0 conn(0x7fb5280cddd0 legacy=0x7fb5280ce1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:00.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.370+0000 7fb52559a700 1 -- 172.21.15.27:0/1716209101 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5281599e0 con 0x7fb5280ae6c0 2023-07-05T23:33:00.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.370+0000 7fb52559a700 1 -- 172.21.15.27:0/1716209101 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1246168953 0 0) 0x7fb518001670 con 0x7fb5280ae6c0 2023-07-05T23:33:00.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.370+0000 7fb52559a700 1 -- 172.21.15.27:0/1716209101 >> v1:172.21.15.27:6789/0 conn(0x7fb5280ae6c0 legacy=0x7fb5280714a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:00.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.370+0000 7fb52559a700 1 --2- 172.21.15.27:0/1716209101 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb510003a00 0x7fb510003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:00.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.370+0000 7fb52559a700 1 --2- 172.21.15.27:0/1716209101 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb510004850 0x7fb510004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:00.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.370+0000 7fb52559a700 1 --2- 172.21.15.27:0/1716209101 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb510005200 0x7fb51000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:00.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.370+0000 7fb52559a700 1 -- 172.21.15.27:0/1716209101 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb51000c0e0 con 0x7fb510005200 2023-07-05T23:33:00.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.370+0000 7fb52559a700 1 -- 172.21.15.27:0/1716209101 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb51000c250 con 0x7fb510003a00 2023-07-05T23:33:00.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.370+0000 7fb52559a700 1 -- 172.21.15.27:0/1716209101 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb51000c410 con 0x7fb510004850 2023-07-05T23:33:00.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.370+0000 7fb526d9d700 1 --2- 172.21.15.27:0/1716209101 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb510005200 0x7fb51000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:00.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.370+0000 7fb52659c700 1 --2- 172.21.15.27:0/1716209101 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb510003a00 0x7fb510003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:00.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.370+0000 7fb525d9b700 1 --2- 172.21.15.27:0/1716209101 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb510004850 0x7fb510004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:00.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.370+0000 7fb526d9d700 1 -- 172.21.15.27:0/1716209101 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb510004850 msgr2=0x7fb510004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:00.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.370+0000 7fb526d9d700 1 --2- 172.21.15.27:0/1716209101 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb510004850 0x7fb510004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:00.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.370+0000 7fb526d9d700 1 -- 172.21.15.27:0/1716209101 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb510003a00 msgr2=0x7fb510003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:00.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.370+0000 7fb526d9d700 1 --2- 172.21.15.27:0/1716209101 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb510003a00 0x7fb510003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:00.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.370+0000 7fb526d9d700 1 -- 172.21.15.27:0/1716209101 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5100035b0 con 0x7fb510005200 2023-07-05T23:33:00.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.370+0000 7fb526d9d700 1 -- 172.21.15.27:0/1716209101 reap_dead start 2023-07-05T23:33:00.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.370+0000 7fb526d9d700 1 --2- 172.21.15.27:0/1716209101 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb510005200 0x7fb51000ba10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb520009fc0 tx=0x7fb510005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49f30d5ec01a8b44 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:00.387 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.371+0000 7fb52559a700 1 -- 172.21.15.27:0/1716209101 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb520003a20 con 0x7fb510005200 2023-07-05T23:33:00.387 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.371+0000 7fb52559a700 1 -- 172.21.15.27:0/1716209101 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb52000f040 con 0x7fb510005200 2023-07-05T23:33:00.387 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.371+0000 7fb52559a700 1 -- 172.21.15.27:0/1716209101 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb520003da0 con 0x7fb510005200 2023-07-05T23:33:00.387 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.371+0000 7fb52cb4f700 1 -- 172.21.15.27:0/1716209101 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb510005200 msgr2=0x7fb51000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:00.388 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.371+0000 7fb52cb4f700 1 --2- 172.21.15.27:0/1716209101 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb510005200 0x7fb51000ba10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb520009fc0 tx=0x7fb510005880 comp rx=0 tx=0).stop 2023-07-05T23:33:00.388 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.371+0000 7fb52cb4f700 1 -- 172.21.15.27:0/1716209101 shutdown_connections 2023-07-05T23:33:00.388 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.371+0000 7fb52cb4f700 1 --2- 172.21.15.27:0/1716209101 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb510005200 0x7fb51000ba10 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:00.389 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.371+0000 7fb52cb4f700 1 -- 172.21.15.27:0/1716209101 >> 172.21.15.27:0/1716209101 conn(0x7fb52806d4a0 msgr2=0x7fb52806d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:00.389 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.371+0000 7fb52cb4f700 1 -- 172.21.15.27:0/1716209101 shutdown_connections 2023-07-05T23:33:00.389 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.371+0000 7fb52cb4f700 1 -- 172.21.15.27:0/1716209101 wait complete. 2023-07-05T23:33:00.389 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.373+0000 7fb52cb4f700 1 Processor -- start 2023-07-05T23:33:00.389 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.373+0000 7fb52cb4f700 1 -- start start 2023-07-05T23:33:00.390 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.373+0000 7fb52cb4f700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb510005200 0x7fb5280ade00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:00.390 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.373+0000 7fb52cb4f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb528153000 0x7fb52814bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:00.390 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.373+0000 7fb52cb4f700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb528153450 0x7fb52814bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:00.391 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.373+0000 7fb52cb4f700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb52814da90 con 0x7fb528153000 2023-07-05T23:33:00.392 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.373+0000 7fb52cb4f700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5280af6e0 con 0x7fb528153450 2023-07-05T23:33:00.392 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.373+0000 7fb52cb4f700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb52814c530 con 0x7fb510005200 2023-07-05T23:33:00.392 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.374+0000 7fb525d9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb528153000 0x7fb52814bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:00.392 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.374+0000 7fb525d9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb528153000 0x7fb52814bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44840/0 (socket says 172.21.15.27:44840) 2023-07-05T23:33:00.392 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.374+0000 7fb525d9b700 1 -- 172.21.15.27:0/293515517 learned_addr learned my addr 172.21.15.27:0/293515517 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:00.392 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.374+0000 7fb526d9d700 1 --2- 172.21.15.27:0/293515517 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb528153450 0x7fb52814bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:00.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.374+0000 7fb52659c700 1 --2- 172.21.15.27:0/293515517 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb510005200 0x7fb5280ade00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:00.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.374+0000 7fb525d9b700 1 -- 172.21.15.27:0/293515517 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb510005200 msgr2=0x7fb5280ade00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:00.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.374+0000 7fb525d9b700 1 --2- 172.21.15.27:0/293515517 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb510005200 0x7fb5280ade00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:00.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.374+0000 7fb525d9b700 1 -- 172.21.15.27:0/293515517 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb528153450 msgr2=0x7fb52814bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:00.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.374+0000 7fb525d9b700 1 --2- 172.21.15.27:0/293515517 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb528153450 0x7fb52814bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:00.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.374+0000 7fb525d9b700 1 -- 172.21.15.27:0/293515517 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb52814d4d0 con 0x7fb528153000 2023-07-05T23:33:00.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.374+0000 7fb526d9d700 1 --2- 172.21.15.27:0/293515517 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb528153450 0x7fb52814bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T23:33:00.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.374+0000 7fb525d9b700 1 --2- 172.21.15.27:0/293515517 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb528153000 0x7fb52814bab0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb5180072f0 tx=0x7fb518007600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:00.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.374+0000 7fb516ffd700 1 -- 172.21.15.27:0/293515517 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51800f640 con 0x7fb528153000 2023-07-05T23:33:00.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.374+0000 7fb516ffd700 1 -- 172.21.15.27:0/293515517 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb51800f7e0 con 0x7fb528153000 2023-07-05T23:33:00.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.374+0000 7fb516ffd700 1 -- 172.21.15.27:0/293515517 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51800fb90 con 0x7fb528153000 2023-07-05T23:33:00.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.374+0000 7fb52cb4f700 1 -- 172.21.15.27:0/293515517 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb52814d7b0 con 0x7fb528153000 2023-07-05T23:33:00.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.374+0000 7fb52cb4f700 1 -- 172.21.15.27:0/293515517 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5280ab8d0 con 0x7fb528153000 2023-07-05T23:33:00.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.375+0000 7fb52cb4f700 1 -- 172.21.15.27:0/293515517 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5280c9d10 con 0x7fb528153000 2023-07-05T23:33:00.395 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.376+0000 7fb516ffd700 1 -- 172.21.15.27:0/293515517 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb51800fcf0 con 0x7fb528153000 2023-07-05T23:33:00.395 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.376+0000 7fb516ffd700 1 --2- 172.21.15.27:0/293515517 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fb50806ace0 0x7fb50806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:00.395 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.376+0000 7fb516ffd700 1 -- 172.21.15.27:0/293515517 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb518089710 con 0x7fb528153000 2023-07-05T23:33:00.395 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.376+0000 7fb52659c700 1 --2- 172.21.15.27:0/293515517 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fb50806ace0 0x7fb50806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:00.395 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.377+0000 7fb52659c700 1 --2- 172.21.15.27:0/293515517 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fb50806ace0 0x7fb50806d190 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb51c007fd0 tx=0x7fb51c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:00.396 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.380+0000 7fb516ffd700 1 -- 172.21.15.27:0/293515517 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb518054440 con 0x7fb528153000 2023-07-05T23:33:00.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.622+0000 7fb52cb4f700 1 -- 172.21.15.27:0/293515517 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb52806f500 con 0x7fb528153000 2023-07-05T23:33:00.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.622+0000 7fb516ffd700 1 -- 172.21.15.27:0/293515517 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7fb518057a60 con 0x7fb528153000 2023-07-05T23:33:00.625 INFO:teuthology.orchestra.run.smithi027.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-07-05T23:33:00.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.624+0000 7fb52cb4f700 1 -- 172.21.15.27:0/293515517 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fb50806ace0 msgr2=0x7fb50806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:00.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.624+0000 7fb52cb4f700 1 --2- 172.21.15.27:0/293515517 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fb50806ace0 0x7fb50806d190 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb51c007fd0 tx=0x7fb51c009040 comp rx=0 tx=0).stop 2023-07-05T23:33:00.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.624+0000 7fb52cb4f700 1 -- 172.21.15.27:0/293515517 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb528153000 msgr2=0x7fb52814bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:00.628 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.624+0000 7fb52cb4f700 1 --2- 172.21.15.27:0/293515517 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb528153000 0x7fb52814bab0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb5180072f0 tx=0x7fb518007600 comp rx=0 tx=0).stop 2023-07-05T23:33:00.628 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.624+0000 7fb52cb4f700 1 -- 172.21.15.27:0/293515517 shutdown_connections 2023-07-05T23:33:00.628 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.624+0000 7fb52cb4f700 1 --2- 172.21.15.27:0/293515517 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb528153450 0x7fb52814bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:00.628 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.624+0000 7fb52cb4f700 1 --2- 172.21.15.27:0/293515517 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fb50806ace0 0x7fb50806d190 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:00.628 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.624+0000 7fb52cb4f700 1 --2- 172.21.15.27:0/293515517 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb510005200 0x7fb5280ade00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:00.628 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.624+0000 7fb52cb4f700 1 --2- 172.21.15.27:0/293515517 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb528153000 0x7fb52814bab0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:00.628 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.624+0000 7fb52cb4f700 1 -- 172.21.15.27:0/293515517 >> 172.21.15.27:0/293515517 conn(0x7fb52806d4a0 msgr2=0x7fb52806a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:00.629 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.624+0000 7fb52cb4f700 1 -- 172.21.15.27:0/293515517 shutdown_connections 2023-07-05T23:33:00.629 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:00.624+0000 7fb52cb4f700 1 -- 172.21.15.27:0/293515517 wait complete. 2023-07-05T23:33:00.639 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-05T23:33:00.639 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-05T23:33:00.640 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi027.front.sepia.ceph.com 2023-07-05T23:33:00.640 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-07-05T23:33:00.640 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-07-05T23:33:00.641 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-05T23:33:00.641 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-05T23:33:00.641 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-05T23:33:00.641 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-07-05T23:33:00.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:00.642 DEBUG:teuthology.orchestra.run.smithi027:> ip addr 2023-07-05T23:33:00.659 INFO:teuthology.orchestra.run.smithi027.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-05T23:33:00.660 INFO:teuthology.orchestra.run.smithi027.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-05T23:33:00.660 INFO:teuthology.orchestra.run.smithi027.stdout: inet 127.0.0.1/8 scope host lo 2023-07-05T23:33:00.661 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-07-05T23:33:00.661 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 ::1/128 scope host 2023-07-05T23:33:00.661 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-07-05T23:33:00.661 INFO:teuthology.orchestra.run.smithi027.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-05T23:33:00.662 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 0c:c4:7a:6b:fe:c8 brd ff:ff:ff:ff:ff:ff 2023-07-05T23:33:00.663 INFO:teuthology.orchestra.run.smithi027.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-05T23:33:00.663 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether ac:1f:6b:f8:39:5a brd ff:ff:ff:ff:ff:ff 2023-07-05T23:33:00.663 INFO:teuthology.orchestra.run.smithi027.stdout: inet 172.21.15.27/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-07-05T23:33:00.663 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft 42402sec preferred_lft 42402sec 2023-07-05T23:33:00.663 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::ae1f:6bff:fef8:395a/64 scope link 2023-07-05T23:33:00.663 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-07-05T23:33:00.663 INFO:teuthology.orchestra.run.smithi027.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-05T23:33:00.663 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 0c:c4:7a:6b:fe:c9 brd ff:ff:ff:ff:ff:ff 2023-07-05T23:33:00.664 INFO:teuthology.orchestra.run.smithi027.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-05T23:33:00.664 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether ac:1f:6b:f8:39:5b brd ff:ff:ff:ff:ff:ff 2023-07-05T23:33:00.665 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-07-05T23:33:00.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:00.666 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec bash -c ' 2023-07-05T23:33:00.666 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2023-07-05T23:33:00.666 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link add name ceph-brx type bridge 2023-07-05T23:33:00.667 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip addr flush dev ceph-brx 2023-07-05T23:33:00.667 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link set ceph-brx up 2023-07-05T23:33:00.667 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-07-05T23:33:00.667 DEBUG:teuthology.orchestra.run.smithi027:> ') 2023-07-05T23:33:00.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:00.825 DEBUG:teuthology.orchestra.run.smithi027:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-05T23:33:00.854 INFO:teuthology.orchestra.run.smithi027.stdout:1 2023-07-05T23:33:00.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:00.856 DEBUG:teuthology.orchestra.run.smithi027:> route 2023-07-05T23:33:01.067 INFO:teuthology.orchestra.run.smithi027.stdout:Kernel IP routing table 2023-07-05T23:33:01.068 INFO:teuthology.orchestra.run.smithi027.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-05T23:33:01.068 INFO:teuthology.orchestra.run.smithi027.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-07-05T23:33:01.068 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-07-05T23:33:01.068 INFO:teuthology.orchestra.run.smithi027.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-05T23:33:01.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:01.069 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec bash -c ' 2023-07-05T23:33:01.069 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2023-07-05T23:33:01.070 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-05T23:33:01.070 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-05T23:33:01.070 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-05T23:33:01.070 DEBUG:teuthology.orchestra.run.smithi027:> ') 2023-07-05T23:33:01.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:01.588 DEBUG:teuthology.orchestra.run.smithi027:> ip netns list 2023-07-05T23:33:01.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:01.606 DEBUG:teuthology.orchestra.run.smithi027:> ip netns list-id 2023-07-05T23:33:01.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:01.663 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec bash -c ' 2023-07-05T23:33:01.664 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2023-07-05T23:33:01.664 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-07-05T23:33:01.664 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-07-05T23:33:01.666 DEBUG:teuthology.orchestra.run.smithi027:> ') 2023-07-05T23:33:01.761 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-07-05T23:33:01.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:01.762 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec bash -c ' 2023-07-05T23:33:01.762 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2023-07-05T23:33:01.762 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-07-05T23:33:01.763 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-07-05T23:33:01.763 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-07-05T23:33:01.763 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-07-05T23:33:01.763 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-07-05T23:33:01.764 DEBUG:teuthology.orchestra.run.smithi027:> ') 2023-07-05T23:33:01.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:01.964 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec bash -c ' 2023-07-05T23:33:01.964 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2023-07-05T23:33:01.964 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link set brx.0 up 2023-07-05T23:33:01.964 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link set dev brx.0 master ceph-brx 2023-07-05T23:33:01.965 DEBUG:teuthology.orchestra.run.smithi027:> ') 2023-07-05T23:33:02.068 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-07-05T23:33:02.069 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-05T23:33:02.069 DEBUG:teuthology.orchestra.run.smithi027:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-07-05T23:33:02.089 INFO:teuthology.orchestra.run.smithi027.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-07-05T23:33:02.090 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-05T23:33:02.090 DEBUG:teuthology.orchestra.run.smithi027:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-07-05T23:33:02.146 DEBUG:teuthology.orchestra.run.smithi027:> sudo modprobe fuse 2023-07-05T23:33:02.214 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-05T23:33:02.214 DEBUG:teuthology.orchestra.run.smithi027:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-05T23:33:02.280 INFO:teuthology.orchestra.run.smithi027.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-05T23:33:02.281 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-05T23:33:02.282 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:02.282 DEBUG:teuthology.orchestra.run.smithi027:> ls /sys/fs/fuse/connections 2023-07-05T23:33:02.340 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-07-05T23:33:02.340 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-07-05T23:33:02.382 DEBUG:teuthology.orchestra.run.smithi027:> sudo modprobe fuse 2023-07-05T23:33:02.410 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-05T23:33:02.411 DEBUG:teuthology.orchestra.run.smithi027:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-05T23:33:02.478 INFO:teuthology.orchestra.run.smithi027.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-05T23:33:02.479 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-05T23:33:02.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:02.480 DEBUG:teuthology.orchestra.run.smithi027:> ls /sys/fs/fuse/connections 2023-07-05T23:33:02.507 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi027.stderr:2023-07-05T23:33:02.504+0000 7f96c4d305c0 -1 init, newargv = 0x560cc9cd9220 newargc=15 2023-07-05T23:33:02.508 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi027.stderr:ceph-fuse[109259]: starting ceph client 2023-07-05T23:33:02.513 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi027.stderr:ceph-fuse[109259]: starting fuse 2023-07-05T23:33:02.525 INFO:teuthology.orchestra.run.smithi027.stdout:47 2023-07-05T23:33:02.526 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2023-07-05T23:33:02.527 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-07-05T23:33:02.527 DEBUG:teuthology.orchestra.run.smithi027:> import glob 2023-07-05T23:33:02.528 DEBUG:teuthology.orchestra.run.smithi027:> import re 2023-07-05T23:33:02.528 DEBUG:teuthology.orchestra.run.smithi027:> import os 2023-07-05T23:33:02.528 DEBUG:teuthology.orchestra.run.smithi027:> import subprocess 2023-07-05T23:33:02.528 DEBUG:teuthology.orchestra.run.smithi027:> 2023-07-05T23:33:02.529 DEBUG:teuthology.orchestra.run.smithi027:> def _find_admin_socket(client_name): 2023-07-05T23:33:02.529 DEBUG:teuthology.orchestra.run.smithi027:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-07-05T23:33:02.529 DEBUG:teuthology.orchestra.run.smithi027:> files = glob.glob(asok_path) 2023-07-05T23:33:02.529 DEBUG:teuthology.orchestra.run.smithi027:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-07-05T23:33:02.530 DEBUG:teuthology.orchestra.run.smithi027:> 2023-07-05T23:33:02.530 DEBUG:teuthology.orchestra.run.smithi027:> # Given a non-glob path, it better be there 2023-07-05T23:33:02.531 DEBUG:teuthology.orchestra.run.smithi027:> if "*" not in asok_path: 2023-07-05T23:33:02.531 DEBUG:teuthology.orchestra.run.smithi027:> assert(len(files) == 1) 2023-07-05T23:33:02.531 DEBUG:teuthology.orchestra.run.smithi027:> return files[0] 2023-07-05T23:33:02.531 DEBUG:teuthology.orchestra.run.smithi027:> 2023-07-05T23:33:02.532 DEBUG:teuthology.orchestra.run.smithi027:> for f in files: 2023-07-05T23:33:02.532 DEBUG:teuthology.orchestra.run.smithi027:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-07-05T23:33:02.532 DEBUG:teuthology.orchestra.run.smithi027:> if os.path.exists("/proc/{0}".format(pid)): 2023-07-05T23:33:02.532 DEBUG:teuthology.orchestra.run.smithi027:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-07-05T23:33:02.533 DEBUG:teuthology.orchestra.run.smithi027:> contents = proc_f.read() 2023-07-05T23:33:02.533 DEBUG:teuthology.orchestra.run.smithi027:> if mountpoint in contents: 2023-07-05T23:33:02.534 DEBUG:teuthology.orchestra.run.smithi027:> return f 2023-07-05T23:33:02.534 DEBUG:teuthology.orchestra.run.smithi027:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-07-05T23:33:02.534 DEBUG:teuthology.orchestra.run.smithi027:> 2023-07-05T23:33:02.534 DEBUG:teuthology.orchestra.run.smithi027:> print(_find_admin_socket("client.admin")) 2023-07-05T23:33:02.535 DEBUG:teuthology.orchestra.run.smithi027:> ' 2023-07-05T23:33:02.651 INFO:teuthology.orchestra.run.smithi027.stdout:/var/run/ceph/ceph-client.admin.109259.asok 2023-07-05T23:33:02.833 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.109259.asok 2023-07-05T23:33:02.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:02.834 DEBUG:teuthology.orchestra.run.smithi027:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.109259.asok status 2023-07-05T23:33:02.994 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2023-07-05T23:33:02.994 INFO:teuthology.orchestra.run.smithi027.stdout: "metadata": { 2023-07-05T23:33:02.995 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph_sha1": "0a781ef0807ae9473fb1306ef07036226ca4f1a6", 2023-07-05T23:33:02.995 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph_version": "ceph version 18.0.0-4488-g0a781ef0 (0a781ef0807ae9473fb1306ef07036226ca4f1a6) reef (dev)", 2023-07-05T23:33:02.995 INFO:teuthology.orchestra.run.smithi027.stdout: "entity_id": "admin", 2023-07-05T23:33:02.995 INFO:teuthology.orchestra.run.smithi027.stdout: "hostname": "smithi027", 2023-07-05T23:33:02.995 INFO:teuthology.orchestra.run.smithi027.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-07-05T23:33:02.995 INFO:teuthology.orchestra.run.smithi027.stdout: "pid": "109259", 2023-07-05T23:33:02.995 INFO:teuthology.orchestra.run.smithi027.stdout: "root": "/" 2023-07-05T23:33:02.996 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-07-05T23:33:02.996 INFO:teuthology.orchestra.run.smithi027.stdout: "dentry_count": 0, 2023-07-05T23:33:02.996 INFO:teuthology.orchestra.run.smithi027.stdout: "dentry_pinned_count": 0, 2023-07-05T23:33:02.996 INFO:teuthology.orchestra.run.smithi027.stdout: "id": 4461, 2023-07-05T23:33:02.996 INFO:teuthology.orchestra.run.smithi027.stdout: "inst": { 2023-07-05T23:33:02.996 INFO:teuthology.orchestra.run.smithi027.stdout: "name": { 2023-07-05T23:33:02.996 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "client", 2023-07-05T23:33:02.997 INFO:teuthology.orchestra.run.smithi027.stdout: "num": 4461 2023-07-05T23:33:02.997 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-07-05T23:33:02.997 INFO:teuthology.orchestra.run.smithi027.stdout: "addr": { 2023-07-05T23:33:02.997 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "v1", 2023-07-05T23:33:02.997 INFO:teuthology.orchestra.run.smithi027.stdout: "addr": "192.168.0.1:0", 2023-07-05T23:33:02.997 INFO:teuthology.orchestra.run.smithi027.stdout: "nonce": 1580966282 2023-07-05T23:33:02.997 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-07-05T23:33:02.998 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-07-05T23:33:02.998 INFO:teuthology.orchestra.run.smithi027.stdout: "addr": { 2023-07-05T23:33:02.998 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "v1", 2023-07-05T23:33:02.998 INFO:teuthology.orchestra.run.smithi027.stdout: "addr": "192.168.0.1:0", 2023-07-05T23:33:02.998 INFO:teuthology.orchestra.run.smithi027.stdout: "nonce": 1580966282 2023-07-05T23:33:02.998 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-07-05T23:33:02.998 INFO:teuthology.orchestra.run.smithi027.stdout: "inst_str": "client.4461 192.168.0.1:0/1580966282", 2023-07-05T23:33:02.998 INFO:teuthology.orchestra.run.smithi027.stdout: "addr_str": "192.168.0.1:0/1580966282", 2023-07-05T23:33:02.999 INFO:teuthology.orchestra.run.smithi027.stdout: "inode_count": 1, 2023-07-05T23:33:02.999 INFO:teuthology.orchestra.run.smithi027.stdout: "mds_epoch": 7, 2023-07-05T23:33:02.999 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_epoch": 28, 2023-07-05T23:33:02.999 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_epoch_barrier": 0, 2023-07-05T23:33:02.999 INFO:teuthology.orchestra.run.smithi027.stdout: "blocklisted": false, 2023-07-05T23:33:02.999 INFO:teuthology.orchestra.run.smithi027.stdout: "fs_name": "cephfs" 2023-07-05T23:33:03.000 INFO:teuthology.orchestra.run.smithi027.stdout:} 2023-07-05T23:33:03.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:03.005 DEBUG:teuthology.orchestra.run.smithi027:> stat --file-system '--printf=%T 2023-07-05T23:33:03.005 DEBUG:teuthology.orchestra.run.smithi027:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-07-05T23:33:03.022 INFO:teuthology.orchestra.run.smithi027.stdout:fuseblk 2023-07-05T23:33:03.023 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-07-05T23:33:03.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:03.023 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-07-05T23:33:03.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:03.091 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-07-05T23:33:03.190 INFO:teuthology.orchestra.run.smithi027.stdout:# file: . 2023-07-05T23:33:03.191 INFO:teuthology.orchestra.run.smithi027.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-07-05T23:33:03.191 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:33:03.191 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-07-05T23:33:03.192 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-05T23:33:03.209 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-05T23:33:03.374 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.371+0000 7f4cb9b65700 1 Processor -- start 2023-07-05T23:33:03.374 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.371+0000 7f4cb9b65700 1 -- start start 2023-07-05T23:33:03.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.372+0000 7f4cb9b65700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4cb40cc1d0 0x7f4cb40cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:03.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.372+0000 7f4cb9b65700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cb40ccb50 con 0x7f4cb4156880 2023-07-05T23:33:03.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.372+0000 7f4cb9b65700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cb40cee80 con 0x7f4cb40aed30 2023-07-05T23:33:03.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.372+0000 7f4cb9b65700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cb40cf100 con 0x7f4cb40cc1d0 2023-07-05T23:33:03.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.372+0000 7f4cb3fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4cb40cc1d0 0x7f4cb40cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:03.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.372+0000 7f4cb37fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f4cb4156880 0x7f4cb4069ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:52024/0 (socket says 172.21.15.27:52024) 2023-07-05T23:33:03.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.372+0000 7f4cb37fe700 1 -- 172.21.15.27:0/1810381094 learned_addr learned my addr 172.21.15.27:0/1810381094 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-07-05T23:33:03.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.373+0000 7f4cb3fff700 1 -- 172.21.15.27:0/1810381094 >> v1:172.21.15.162:6789/0 conn(0x7f4cb40aed30 legacy=0x7f4cb4160580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:03.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.373+0000 7f4cb3fff700 1 -- 172.21.15.27:0/1810381094 >> v1:172.21.15.27:6789/0 conn(0x7f4cb4156880 legacy=0x7f4cb4069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:03.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.373+0000 7f4cb3fff700 1 -- 172.21.15.27:0/1810381094 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cb40cf3e0 con 0x7f4cb40cc1d0 2023-07-05T23:33:03.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.373+0000 7f4cb27fc700 1 -- 172.21.15.27:0/1810381094 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3471303237 0 0) 0x7f4cb40ccb50 con 0x7f4cb4156880 2023-07-05T23:33:03.379 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.373+0000 7f4cb3fff700 1 --2- 172.21.15.27:0/1810381094 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4cb40cc1d0 0x7f4cb40cc610 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4cac009d90 tx=0x7f4cac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c23a2d81ea3a3aa server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:03.379 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.373+0000 7f4cb27fc700 1 -- 172.21.15.27:0/1810381094 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cac00e070 con 0x7f4cb40cc1d0 2023-07-05T23:33:03.379 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.373+0000 7f4cb27fc700 1 -- 172.21.15.27:0/1810381094 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cac00bbd0 con 0x7f4cb40cc1d0 2023-07-05T23:33:03.379 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.373+0000 7f4cb27fc700 1 -- 172.21.15.27:0/1810381094 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cac012430 con 0x7f4cb40cc1d0 2023-07-05T23:33:03.379 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.373+0000 7f4cb9b65700 1 -- 172.21.15.27:0/1810381094 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4cb40cc1d0 msgr2=0x7f4cb40cc610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:03.379 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.373+0000 7f4cb9b65700 1 --2- 172.21.15.27:0/1810381094 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4cb40cc1d0 0x7f4cb40cc610 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4cac009d90 tx=0x7f4cac00b330 comp rx=0 tx=0).stop 2023-07-05T23:33:03.379 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.373+0000 7f4cb9b65700 1 -- 172.21.15.27:0/1810381094 shutdown_connections 2023-07-05T23:33:03.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.373+0000 7f4cb9b65700 1 --2- 172.21.15.27:0/1810381094 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4cb40cc1d0 0x7f4cb40cc610 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:03.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.373+0000 7f4cb9b65700 1 -- 172.21.15.27:0/1810381094 >> 172.21.15.27:0/1810381094 conn(0x7f4cb406d4a0 msgr2=0x7f4cb406d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:03.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.373+0000 7f4cb9b65700 1 -- 172.21.15.27:0/1810381094 shutdown_connections 2023-07-05T23:33:03.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.373+0000 7f4cb9b65700 1 -- 172.21.15.27:0/1810381094 wait complete. 2023-07-05T23:33:03.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.375+0000 7f4cb9b65700 1 Processor -- start 2023-07-05T23:33:03.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.375+0000 7f4cb9b65700 1 -- start start 2023-07-05T23:33:03.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.376+0000 7f4cb9b65700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4cb40aed30 0x7f4cb40c32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:03.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.376+0000 7f4cb9b65700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4cb40cc1d0 0x7f4cb414f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:03.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.376+0000 7f4cb9b65700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4cb4156880 0x7f4cb40cf960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:03.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.376+0000 7f4cb9b65700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb40c5e60 con 0x7f4cb40cc1d0 2023-07-05T23:33:03.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.376+0000 7f4cb9b65700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb40c6280 con 0x7f4cb4156880 2023-07-05T23:33:03.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.376+0000 7f4cb9b65700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb40c51e0 con 0x7f4cb40aed30 2023-07-05T23:33:03.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.376+0000 7f4cb2ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4cb40cc1d0 0x7f4cb414f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:03.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.376+0000 7f4cb2ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4cb40cc1d0 0x7f4cb414f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44864/0 (socket says 172.21.15.27:44864) 2023-07-05T23:33:03.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.376+0000 7f4cb2ffd700 1 -- 172.21.15.27:0/631434935 learned_addr learned my addr 172.21.15.27:0/631434935 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:03.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.376+0000 7f4cb3fff700 1 --2- 172.21.15.27:0/631434935 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4cb4156880 0x7f4cb40cf960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:03.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.376+0000 7f4cb37fe700 1 --2- 172.21.15.27:0/631434935 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4cb40aed30 0x7f4cb40c32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:03.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.377+0000 7f4cb2ffd700 1 -- 172.21.15.27:0/631434935 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4cb40aed30 msgr2=0x7f4cb40c32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:03.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.377+0000 7f4cb2ffd700 1 --2- 172.21.15.27:0/631434935 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4cb40aed30 0x7f4cb40c32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:03.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.377+0000 7f4cb2ffd700 1 -- 172.21.15.27:0/631434935 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4cb4156880 msgr2=0x7f4cb40cf960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:03.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.377+0000 7f4cb2ffd700 1 --2- 172.21.15.27:0/631434935 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4cb4156880 0x7f4cb40cf960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:03.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.377+0000 7f4cb2ffd700 1 -- 172.21.15.27:0/631434935 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cac009a70 con 0x7f4cb40cc1d0 2023-07-05T23:33:03.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.377+0000 7f4cb37fe700 1 --2- 172.21.15.27:0/631434935 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4cb40aed30 0x7f4cb40c32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T23:33:03.387 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.377+0000 7f4cb3fff700 1 --2- 172.21.15.27:0/631434935 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4cb4156880 0x7f4cb40cf960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T23:33:03.388 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.377+0000 7f4cb2ffd700 1 --2- 172.21.15.27:0/631434935 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4cb40cc1d0 0x7f4cb414f880 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c00c4e0 tx=0x7f4c9c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:03.388 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.377+0000 7f4cabfff700 1 -- 172.21.15.27:0/631434935 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9c0052d0 con 0x7f4cb40cc1d0 2023-07-05T23:33:03.388 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.377+0000 7f4cabfff700 1 -- 172.21.15.27:0/631434935 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c9c005430 con 0x7f4cb40cc1d0 2023-07-05T23:33:03.388 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.377+0000 7f4cb9b65700 1 -- 172.21.15.27:0/631434935 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cb40c54c0 con 0x7f4cb40cc1d0 2023-07-05T23:33:03.388 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.377+0000 7f4cabfff700 1 -- 172.21.15.27:0/631434935 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9c0038c0 con 0x7f4cb40cc1d0 2023-07-05T23:33:03.389 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.377+0000 7f4cb9b65700 1 -- 172.21.15.27:0/631434935 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cb40c5a80 con 0x7f4cb40cc1d0 2023-07-05T23:33:03.389 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.378+0000 7f4cb9b65700 1 -- 172.21.15.27:0/631434935 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cb40c5fa0 con 0x7f4cb40cc1d0 2023-07-05T23:33:03.389 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.378+0000 7f4cabfff700 1 -- 172.21.15.27:0/631434935 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4c9c003a20 con 0x7f4cb40cc1d0 2023-07-05T23:33:03.389 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.379+0000 7f4cabfff700 1 --2- 172.21.15.27:0/631434935 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f4c9406ace0 0x7f4c9406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:03.389 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.379+0000 7f4cabfff700 1 -- 172.21.15.27:0/631434935 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4c9c088c00 con 0x7f4cb40cc1d0 2023-07-05T23:33:03.389 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.379+0000 7f4cb37fe700 1 --2- 172.21.15.27:0/631434935 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f4c9406ace0 0x7f4c9406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:03.389 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.380+0000 7f4cb37fe700 1 --2- 172.21.15.27:0/631434935 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f4c9406ace0 0x7f4c9406d190 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4ca4000f60 tx=0x7f4ca4007e50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:03.390 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.383+0000 7f4cabfff700 1 -- 172.21.15.27:0/631434935 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4cb40c5fa0 con 0x7f4cb40cc1d0 2023-07-05T23:33:03.585 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.582+0000 7f4cb9b65700 1 -- 172.21.15.27:0/631434935 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4cb40c5fa0 con 0x7f4cb40cc1d0 2023-07-05T23:33:03.586 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.583+0000 7f4cabfff700 1 -- 172.21.15.27:0/631434935 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20120 (secure 0 0 0) 0x7f4cb40c5fa0 con 0x7f4cb40cc1d0 2023-07-05T23:33:03.587 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:33:03.587 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":28,"fsid":"23eebe48-65f5-4d3c-8c2d-4aa171c055d5","created":"2023-07-05T23:32:27.989612+0000","modified":"2023-07-05T23:32:57.768949+0000","last_up_change":"2023-07-05T23:32:39.601570+0000","last_in_change":"2023-07-05T23:32:30.488261+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-05T23:32:41.624598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-05T23:32:46.481587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-05T23:32:51.025210+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-05T23:32:52.286964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-05T23:32:55.354212+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ac2071e4-394b-4385-b9ba-fad5265efc65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6814","nonce":3766536605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6818","nonce":3766536605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6823","nonce":3766536605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6821","nonce":3766536605}]},"public_addr":"172.21.15.27:6814/3766536605","cluster_addr":"172.21.15.27:6818/3766536605","heartbeat_back_addr":"172.21.15.27:6823/3766536605","heartbeat_front_addr":"172.21.15.27:6821/3766536605","state":["exists","up"]},{"osd":1,"uuid":"8c9b61a0-39d5-46bf-afd6-5add78453ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6801","nonce":1579117455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6803","nonce":1579117455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6807","nonce":1579117455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6805","nonce":1579117455}]},"public_addr":"172.21.15.27:6801/1579117455","cluster_addr":"172.21.15.27:6803/1579117455","heartbeat_back_addr":"172.21.15.27:6807/1579117455","heartbeat_front_addr":"172.21.15.27:6805/1579117455","state":["exists","up"]},{"osd":2,"uuid":"dcd032a2-06b1-4055-b798-b86c71a7107d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6825","nonce":807520271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6827","nonce":807520271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6831","nonce":807520271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6829","nonce":807520271}]},"public_addr":"172.21.15.27:6825/807520271","cluster_addr":"172.21.15.27:6827/807520271","heartbeat_back_addr":"172.21.15.27:6831/807520271","heartbeat_front_addr":"172.21.15.27:6829/807520271","state":["exists","up"]},{"osd":3,"uuid":"b0ffe0fc-47ba-4636-b5ea-6bab637642c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6809","nonce":2125656143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6811","nonce":2125656143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6817","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6819","nonce":2125656143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6813","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6815","nonce":2125656143}]},"public_addr":"172.21.15.27:6809/2125656143","cluster_addr":"172.21.15.27:6811/2125656143","heartbeat_back_addr":"172.21.15.27:6819/2125656143","heartbeat_front_addr":"172.21.15.27:6815/2125656143","state":["exists","up"]},{"osd":4,"uuid":"7fab4e5a-1246-4efe-9562-10c4a6c789ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6801","nonce":2111223016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6803","nonce":2111223016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6807","nonce":2111223016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6805","nonce":2111223016}]},"public_addr":"172.21.15.162:6801/2111223016","cluster_addr":"172.21.15.162:6803/2111223016","heartbeat_back_addr":"172.21.15.162:6807/2111223016","heartbeat_front_addr":"172.21.15.162:6805/2111223016","state":["exists","up"]},{"osd":5,"uuid":"110c4d9f-cef6-48ab-a818-5a81e72372af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6825","nonce":3102609008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6827","nonce":3102609008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6831","nonce":3102609008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6829","nonce":3102609008}]},"public_addr":"172.21.15.162:6825/3102609008","cluster_addr":"172.21.15.162:6827/3102609008","heartbeat_back_addr":"172.21.15.162:6831/3102609008","heartbeat_front_addr":"172.21.15.162:6829/3102609008","state":["exists","up"]},{"osd":6,"uuid":"16803bcc-2c92-4aed-954e-487938c9f24a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6809","nonce":2657688865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6811","nonce":2657688865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6815","nonce":2657688865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6813","nonce":2657688865}]},"public_addr":"172.21.15.162:6809/2657688865","cluster_addr":"172.21.15.162:6811/2657688865","heartbeat_back_addr":"172.21.15.162:6815/2657688865","heartbeat_front_addr":"172.21.15.162:6813/2657688865","state":["exists","up"]},{"osd":7,"uuid":"b7c35377-3cf2-4569-b6b9-72376eb463bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6817","nonce":2096609978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6819","nonce":2096609978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6823","nonce":2096609978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6821","nonce":2096609978}]},"public_addr":"172.21.15.162:6817/2096609978","cluster_addr":"172.21.15.162:6819/2096609978","heartbeat_back_addr":"172.21.15.162:6823/2096609978","heartbeat_front_addr":"172.21.15.162:6821/2096609978","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.735448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.645561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.759120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.682507+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.736228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.694664+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.716002+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.680485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-05T23:33:03.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.585+0000 7f4cb9b65700 1 -- 172.21.15.27:0/631434935 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f4c9406ace0 msgr2=0x7f4c9406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:03.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.585+0000 7f4cb9b65700 1 --2- 172.21.15.27:0/631434935 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f4c9406ace0 0x7f4c9406d190 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4ca4000f60 tx=0x7f4ca4007e50 comp rx=0 tx=0).stop 2023-07-05T23:33:03.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.585+0000 7f4cb9b65700 1 -- 172.21.15.27:0/631434935 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4cb40cc1d0 msgr2=0x7f4cb414f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:03.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.585+0000 7f4cb9b65700 1 --2- 172.21.15.27:0/631434935 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4cb40cc1d0 0x7f4cb414f880 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c00c4e0 tx=0x7f4c9c00c8a0 comp rx=0 tx=0).stop 2023-07-05T23:33:03.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.585+0000 7f4cb9b65700 1 -- 172.21.15.27:0/631434935 shutdown_connections 2023-07-05T23:33:03.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.585+0000 7f4cb9b65700 1 --2- 172.21.15.27:0/631434935 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4cb4156880 0x7f4cb40cf960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:03.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.585+0000 7f4cb9b65700 1 --2- 172.21.15.27:0/631434935 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f4c9406ace0 0x7f4c9406d190 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:03.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.585+0000 7f4cb9b65700 1 --2- 172.21.15.27:0/631434935 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4cb40aed30 0x7f4cb40c32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:03.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.585+0000 7f4cb9b65700 1 --2- 172.21.15.27:0/631434935 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4cb40cc1d0 0x7f4cb414f880 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:03.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.585+0000 7f4cb9b65700 1 -- 172.21.15.27:0/631434935 >> 172.21.15.27:0/631434935 conn(0x7f4cb406d4a0 msgr2=0x7f4cb406b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:03.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.585+0000 7f4cb9b65700 1 -- 172.21.15.27:0/631434935 shutdown_connections 2023-07-05T23:33:03.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.585+0000 7f4cb9b65700 1 -- 172.21.15.27:0/631434935 wait complete. 2023-07-05T23:33:03.600 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-05T23:32:41.624598+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-05T23:32:46.481587+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-05T23:32:51.025210+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-05T23:32:52.286964+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-05T23:32:55.354212+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-05T23:33:03.601 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-05T23:33:03.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.726+0000 7f2a4e4ef700 1 Processor -- start 2023-07-05T23:33:03.729 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.726+0000 7f2a4e4ef700 1 -- start start 2023-07-05T23:33:03.730 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.726+0000 7f2a4e4ef700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2a48070dc0 0x7f2a48065b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:03.730 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.726+0000 7f2a4e4ef700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a4806d3e0 0x7f2a4806a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:03.730 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.726+0000 7f2a4e4ef700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a4815c450 con 0x7f2a4815cbc0 2023-07-05T23:33:03.731 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.726+0000 7f2a4e4ef700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a4806b8f0 con 0x7f2a48070dc0 2023-07-05T23:33:03.731 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.726+0000 7f2a4e4ef700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a48159640 con 0x7f2a4806d3e0 2023-07-05T23:33:03.731 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.727+0000 7f2a47fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2a48070dc0 0x7f2a48065b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:03.731 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.727+0000 7f2a477fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f2a4815cbc0 0x7f2a4806ccd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:52036/0 (socket says 172.21.15.27:52036) 2023-07-05T23:33:03.731 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.727+0000 7f2a47fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2a48070dc0 0x7f2a48065b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44870/0 (socket says 172.21.15.27:44870) 2023-07-05T23:33:03.731 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.727+0000 7f2a477fe700 1 -- 172.21.15.27:0/3459234969 learned_addr learned my addr 172.21.15.27:0/3459234969 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-07-05T23:33:03.731 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.727+0000 7f2a4ca8c700 1 --2- 172.21.15.27:0/3459234969 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a4806d3e0 0x7f2a4806a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:03.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.727+0000 7f2a47fff700 1 -- 172.21.15.27:0/3459234969 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a4806d3e0 msgr2=0x7f2a4806a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:03.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.727+0000 7f2a47fff700 1 --2- 172.21.15.27:0/3459234969 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a4806d3e0 0x7f2a4806a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:03.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.727+0000 7f2a47fff700 1 -- 172.21.15.27:0/3459234969 >> v1:172.21.15.27:6789/0 conn(0x7f2a4815cbc0 legacy=0x7f2a4806ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:03.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.727+0000 7f2a47fff700 1 -- 172.21.15.27:0/3459234969 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a48159920 con 0x7f2a48070dc0 2023-07-05T23:33:03.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.727+0000 7f2a46ffd700 1 -- 172.21.15.27:0/3459234969 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 399393109 0 0) 0x7f2a4815c450 con 0x7f2a4815cbc0 2023-07-05T23:33:03.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.727+0000 7f2a47fff700 1 --2- 172.21.15.27:0/3459234969 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a48070dc0 0x7f2a48065b90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2a38009840 tx=0x7f2a38009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=622df27e64603f5f server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:03.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.727+0000 7f2a46ffd700 1 -- 172.21.15.27:0/3459234969 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a38011830 con 0x7f2a48070dc0 2023-07-05T23:33:03.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.727+0000 7f2a46ffd700 1 -- 172.21.15.27:0/3459234969 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a38011990 con 0x7f2a48070dc0 2023-07-05T23:33:03.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.727+0000 7f2a46ffd700 1 -- 172.21.15.27:0/3459234969 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a38011d20 con 0x7f2a48070dc0 2023-07-05T23:33:03.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.728+0000 7f2a4e4ef700 1 -- 172.21.15.27:0/3459234969 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a48070dc0 msgr2=0x7f2a48065b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:03.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.728+0000 7f2a4e4ef700 1 --2- 172.21.15.27:0/3459234969 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a48070dc0 0x7f2a48065b90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2a38009840 tx=0x7f2a38009b50 comp rx=0 tx=0).stop 2023-07-05T23:33:03.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.728+0000 7f2a4e4ef700 1 -- 172.21.15.27:0/3459234969 shutdown_connections 2023-07-05T23:33:03.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.728+0000 7f2a4e4ef700 1 --2- 172.21.15.27:0/3459234969 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a4806d3e0 0x7f2a4806a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:03.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.728+0000 7f2a4e4ef700 1 --2- 172.21.15.27:0/3459234969 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a48070dc0 0x7f2a48065b90 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:03.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.728+0000 7f2a4e4ef700 1 -- 172.21.15.27:0/3459234969 >> 172.21.15.27:0/3459234969 conn(0x7f2a480b1990 msgr2=0x7f2a480cf1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:03.736 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.728+0000 7f2a4e4ef700 1 -- 172.21.15.27:0/3459234969 shutdown_connections 2023-07-05T23:33:03.736 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.728+0000 7f2a4e4ef700 1 -- 172.21.15.27:0/3459234969 wait complete. 2023-07-05T23:33:03.736 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.729+0000 7f2a4e4ef700 1 Processor -- start 2023-07-05T23:33:03.736 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.729+0000 7f2a4e4ef700 1 -- start start 2023-07-05T23:33:03.736 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.730+0000 7f2a4e4ef700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a4806d3e0 0x7f2a480b4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:03.737 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.730+0000 7f2a4e4ef700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a48070dc0 0x7f2a4814cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:03.737 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.730+0000 7f2a4e4ef700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a4815cbc0 0x7f2a480b39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:03.737 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.730+0000 7f2a4e4ef700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4814d4e0 con 0x7f2a4815cbc0 2023-07-05T23:33:03.737 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.730+0000 7f2a4e4ef700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a480c6c80 con 0x7f2a4806d3e0 2023-07-05T23:33:03.737 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.730+0000 7f2a4e4ef700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a480b4cf0 con 0x7f2a48070dc0 2023-07-05T23:33:03.737 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.730+0000 7f2a4ca8c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a4815cbc0 0x7f2a480b39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:03.737 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.730+0000 7f2a4ca8c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a4815cbc0 0x7f2a480b39f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44880/0 (socket says 172.21.15.27:44880) 2023-07-05T23:33:03.737 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.730+0000 7f2a4ca8c700 1 -- 172.21.15.27:0/2996596811 learned_addr learned my addr 172.21.15.27:0/2996596811 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:03.738 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.730+0000 7f2a477fe700 1 --2- 172.21.15.27:0/2996596811 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a48070dc0 0x7f2a4814cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:03.738 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.730+0000 7f2a47fff700 1 --2- 172.21.15.27:0/2996596811 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a4806d3e0 0x7f2a480b4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:03.738 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.731+0000 7f2a4ca8c700 1 -- 172.21.15.27:0/2996596811 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a48070dc0 msgr2=0x7f2a4814cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:03.738 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.731+0000 7f2a4ca8c700 1 --2- 172.21.15.27:0/2996596811 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a48070dc0 0x7f2a4814cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:03.738 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.731+0000 7f2a4ca8c700 1 -- 172.21.15.27:0/2996596811 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a4806d3e0 msgr2=0x7f2a480b4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:03.738 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.731+0000 7f2a4ca8c700 1 --2- 172.21.15.27:0/2996596811 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a4806d3e0 0x7f2a480b4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:03.738 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.731+0000 7f2a4ca8c700 1 -- 172.21.15.27:0/2996596811 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a380094a0 con 0x7f2a4815cbc0 2023-07-05T23:33:03.739 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.731+0000 7f2a4ca8c700 1 --2- 172.21.15.27:0/2996596811 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a4815cbc0 0x7f2a480b39f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2a4000ef90 tx=0x7f2a4000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:03.739 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.731+0000 7f2a44ff9700 1 -- 172.21.15.27:0/2996596811 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4000cc90 con 0x7f2a4815cbc0 2023-07-05T23:33:03.739 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.731+0000 7f2a44ff9700 1 -- 172.21.15.27:0/2996596811 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a4000f040 con 0x7f2a4815cbc0 2023-07-05T23:33:03.739 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.731+0000 7f2a4e4ef700 1 -- 172.21.15.27:0/2996596811 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a480c6ed0 con 0x7f2a4815cbc0 2023-07-05T23:33:03.739 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.731+0000 7f2a44ff9700 1 -- 172.21.15.27:0/2996596811 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a40014480 con 0x7f2a4815cbc0 2023-07-05T23:33:03.739 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.731+0000 7f2a4e4ef700 1 -- 172.21.15.27:0/2996596811 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a480c7490 con 0x7f2a4815cbc0 2023-07-05T23:33:03.739 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.732+0000 7f2a4e4ef700 1 -- 172.21.15.27:0/2996596811 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a4804ea20 con 0x7f2a4815cbc0 2023-07-05T23:33:03.740 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.733+0000 7f2a44ff9700 1 -- 172.21.15.27:0/2996596811 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2a400145e0 con 0x7f2a4815cbc0 2023-07-05T23:33:03.740 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.733+0000 7f2a44ff9700 1 --2- 172.21.15.27:0/2996596811 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f2a3406ace0 0x7f2a3406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:03.741 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.733+0000 7f2a44ff9700 1 -- 172.21.15.27:0/2996596811 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2a4008a8c0 con 0x7f2a4815cbc0 2023-07-05T23:33:03.741 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.734+0000 7f2a47fff700 1 --2- 172.21.15.27:0/2996596811 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f2a3406ace0 0x7f2a3406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:03.741 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.734+0000 7f2a47fff700 1 --2- 172.21.15.27:0/2996596811 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f2a3406ace0 0x7f2a3406d190 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2a380090b0 tx=0x7f2a38008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:03.741 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.737+0000 7f2a44ff9700 1 -- 172.21.15.27:0/2996596811 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2a40055680 con 0x7f2a4815cbc0 2023-07-05T23:33:03.943 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.940+0000 7f2a4e4ef700 1 -- 172.21.15.27:0/2996596811 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2a480b5060 con 0x7f2a4815cbc0 2023-07-05T23:33:03.943 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.940+0000 7f2a44ff9700 1 -- 172.21.15.27:0/2996596811 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2a40009ca0 con 0x7f2a4815cbc0 2023-07-05T23:33:03.944 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2023-07-05T23:33:03.945 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.942+0000 7f2a4e4ef700 1 -- 172.21.15.27:0/2996596811 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f2a3406ace0 msgr2=0x7f2a3406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:03.945 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.942+0000 7f2a4e4ef700 1 --2- 172.21.15.27:0/2996596811 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f2a3406ace0 0x7f2a3406d190 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2a380090b0 tx=0x7f2a38008030 comp rx=0 tx=0).stop 2023-07-05T23:33:03.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.942+0000 7f2a4e4ef700 1 -- 172.21.15.27:0/2996596811 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a4815cbc0 msgr2=0x7f2a480b39f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:03.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.942+0000 7f2a4e4ef700 1 --2- 172.21.15.27:0/2996596811 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a4815cbc0 0x7f2a480b39f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2a4000ef90 tx=0x7f2a4000c3a0 comp rx=0 tx=0).stop 2023-07-05T23:33:03.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.942+0000 7f2a4e4ef700 1 -- 172.21.15.27:0/2996596811 shutdown_connections 2023-07-05T23:33:03.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.942+0000 7f2a4e4ef700 1 --2- 172.21.15.27:0/2996596811 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a4806d3e0 0x7f2a480b4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:03.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.942+0000 7f2a4e4ef700 1 --2- 172.21.15.27:0/2996596811 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f2a3406ace0 0x7f2a3406d190 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:03.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.942+0000 7f2a4e4ef700 1 --2- 172.21.15.27:0/2996596811 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a4815cbc0 0x7f2a480b39f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:03.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.942+0000 7f2a4e4ef700 1 --2- 172.21.15.27:0/2996596811 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a48070dc0 0x7f2a4814cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:03.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.942+0000 7f2a4e4ef700 1 -- 172.21.15.27:0/2996596811 >> 172.21.15.27:0/2996596811 conn(0x7f2a480b1990 msgr2=0x7f2a4815b920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:03.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.943+0000 7f2a4e4ef700 1 -- 172.21.15.27:0/2996596811 shutdown_connections 2023-07-05T23:33:03.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:03.943+0000 7f2a4e4ef700 1 -- 172.21.15.27:0/2996596811 wait complete. 2023-07-05T23:33:03.957 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-05T23:33:04.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.082+0000 7f8b8f7f8700 1 Processor -- start 2023-07-05T23:33:04.085 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.082+0000 7f8b8f7f8700 1 -- start start 2023-07-05T23:33:04.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.083+0000 7f8b8f7f8700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f8b8815fc60 0x7f8b8806a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:04.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.083+0000 7f8b8f7f8700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8b8806e970 0x7f8b880ac600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:04.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.083+0000 7f8b8f7f8700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b880ce620 con 0x7f8b880aecc0 2023-07-05T23:33:04.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.083+0000 7f8b8f7f8700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b88160580 con 0x7f8b8815fc60 2023-07-05T23:33:04.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.083+0000 7f8b8f7f8700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b88160860 con 0x7f8b8806e970 2023-07-05T23:33:04.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.083+0000 7f8b8d594700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f8b8815fc60 0x7f8b8806a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:04.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.083+0000 7f8b8cd93700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f8b880aecc0 0x7f8b8806e260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:52054/0 (socket says 172.21.15.27:52054) 2023-07-05T23:33:04.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.083+0000 7f8b8cd93700 1 -- 172.21.15.27:0/837019446 learned_addr learned my addr 172.21.15.27:0/837019446 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-07-05T23:33:04.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.083+0000 7f8b8d594700 1 -- 172.21.15.27:0/837019446 >> v2:172.21.15.162:3300/0 conn(0x7f8b8806e970 msgr2=0x7f8b880ac600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:04.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.083+0000 7f8b8dd95700 1 --2- 172.21.15.27:0/837019446 >> v2:172.21.15.162:3300/0 conn(0x7f8b8806e970 0x7f8b880ac600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:04.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.083+0000 7f8b7bfff700 1 -- 172.21.15.27:0/837019446 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3107461201 0 0) 0x7f8b880ce620 con 0x7f8b880aecc0 2023-07-05T23:33:04.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.083+0000 7f8b8d594700 1 --2- 172.21.15.27:0/837019446 >> v2:172.21.15.162:3300/0 conn(0x7f8b8806e970 0x7f8b880ac600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:04.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.083+0000 7f8b8d594700 1 -- 172.21.15.27:0/837019446 >> v1:172.21.15.27:6789/0 conn(0x7f8b880aecc0 legacy=0x7f8b8806e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:04.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.083+0000 7f8b8d594700 1 -- 172.21.15.27:0/837019446 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b88160b40 con 0x7f8b8815fc60 2023-07-05T23:33:04.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.083+0000 7f8b8dd95700 1 --2- 172.21.15.27:0/837019446 >> v2:172.21.15.162:3300/0 conn(0x7f8b8806e970 0x7f8b880ac600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T23:33:04.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.083+0000 7f8b8d594700 1 --2- 172.21.15.27:0/837019446 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8b8815fc60 0x7f8b8806a900 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8b8806c030 tx=0x7f8b84009b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=223849bb3200a774 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:04.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.083+0000 7f8b7bfff700 1 -- 172.21.15.27:0/837019446 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b84005e30 con 0x7f8b8815fc60 2023-07-05T23:33:04.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.083+0000 7f8b7bfff700 1 -- 172.21.15.27:0/837019446 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b84006030 con 0x7f8b8815fc60 2023-07-05T23:33:04.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.083+0000 7f8b7bfff700 1 -- 172.21.15.27:0/837019446 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b840063c0 con 0x7f8b8815fc60 2023-07-05T23:33:04.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.084+0000 7f8b8f7f8700 1 -- 172.21.15.27:0/837019446 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8b8815fc60 msgr2=0x7f8b8806a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:04.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.084+0000 7f8b8f7f8700 1 --2- 172.21.15.27:0/837019446 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8b8815fc60 0x7f8b8806a900 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8b8806c030 tx=0x7f8b84009b00 comp rx=0 tx=0).stop 2023-07-05T23:33:04.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.084+0000 7f8b8f7f8700 1 -- 172.21.15.27:0/837019446 shutdown_connections 2023-07-05T23:33:04.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.084+0000 7f8b8f7f8700 1 --2- 172.21.15.27:0/837019446 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8b8815fc60 0x7f8b8806a900 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:04.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.084+0000 7f8b8f7f8700 1 --2- 172.21.15.27:0/837019446 >> v2:172.21.15.162:3300/0 conn(0x7f8b8806e970 0x7f8b880ac600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:04.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.084+0000 7f8b8f7f8700 1 -- 172.21.15.27:0/837019446 >> 172.21.15.27:0/837019446 conn(0x7f8b8806b920 msgr2=0x7f8b880cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:04.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.084+0000 7f8b8f7f8700 1 -- 172.21.15.27:0/837019446 shutdown_connections 2023-07-05T23:33:04.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.084+0000 7f8b8f7f8700 1 -- 172.21.15.27:0/837019446 wait complete. 2023-07-05T23:33:04.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.085+0000 7f8b8f7f8700 1 Processor -- start 2023-07-05T23:33:04.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.085+0000 7f8b8f7f8700 1 -- start start 2023-07-05T23:33:04.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.086+0000 7f8b8f7f8700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8b8806e970 0x7f8b880ae120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:04.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.086+0000 7f8b8f7f8700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b880aecc0 0x7f8b88155fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:04.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.086+0000 7f8b8f7f8700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b8815fc60 0x7f8b88156500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:04.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.086+0000 7f8b8f7f8700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b880cbdc0 con 0x7f8b8806e970 2023-07-05T23:33:04.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.086+0000 7f8b8f7f8700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b880cba90 con 0x7f8b8815fc60 2023-07-05T23:33:04.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.086+0000 7f8b8f7f8700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b880cafc0 con 0x7f8b880aecc0 2023-07-05T23:33:04.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.086+0000 7f8b8d594700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8b8806e970 0x7f8b880ae120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:04.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.086+0000 7f8b8d594700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8b8806e970 0x7f8b880ae120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44894/0 (socket says 172.21.15.27:44894) 2023-07-05T23:33:04.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.086+0000 7f8b8d594700 1 -- 172.21.15.27:0/3135321728 learned_addr learned my addr 172.21.15.27:0/3135321728 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:04.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.086+0000 7f8b8dd95700 1 --2- 172.21.15.27:0/3135321728 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b8815fc60 0x7f8b88156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:04.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.086+0000 7f8b8cd93700 1 --2- 172.21.15.27:0/3135321728 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b880aecc0 0x7f8b88155fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:04.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.086+0000 7f8b8d594700 1 -- 172.21.15.27:0/3135321728 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b880aecc0 msgr2=0x7f8b88155fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:04.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.086+0000 7f8b8d594700 1 --2- 172.21.15.27:0/3135321728 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b880aecc0 0x7f8b88155fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:04.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.086+0000 7f8b8d594700 1 -- 172.21.15.27:0/3135321728 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b8815fc60 msgr2=0x7f8b88156500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:04.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.086+0000 7f8b8d594700 1 --2- 172.21.15.27:0/3135321728 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b8815fc60 0x7f8b88156500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:04.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.086+0000 7f8b8d594700 1 -- 172.21.15.27:0/3135321728 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b84009430 con 0x7f8b8806e970 2023-07-05T23:33:04.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.086+0000 7f8b8d594700 1 --2- 172.21.15.27:0/3135321728 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8b8806e970 0x7f8b880ae120 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8b84000c00 tx=0x7f8b84004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:04.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.087+0000 7f8b79ffb700 1 -- 172.21.15.27:0/3135321728 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b84004240 con 0x7f8b8806e970 2023-07-05T23:33:04.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.087+0000 7f8b79ffb700 1 -- 172.21.15.27:0/3135321728 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b840043a0 con 0x7f8b8806e970 2023-07-05T23:33:04.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.087+0000 7f8b8f7f8700 1 -- 172.21.15.27:0/3135321728 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b880cb2a0 con 0x7f8b8806e970 2023-07-05T23:33:04.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.087+0000 7f8b79ffb700 1 -- 172.21.15.27:0/3135321728 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b840036a0 con 0x7f8b8806e970 2023-07-05T23:33:04.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.087+0000 7f8b8f7f8700 1 -- 172.21.15.27:0/3135321728 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b88157220 con 0x7f8b8806e970 2023-07-05T23:33:04.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.088+0000 7f8b8f7f8700 1 -- 172.21.15.27:0/3135321728 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b8804ea20 con 0x7f8b8806e970 2023-07-05T23:33:04.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.088+0000 7f8b79ffb700 1 -- 172.21.15.27:0/3135321728 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8b84022070 con 0x7f8b8806e970 2023-07-05T23:33:04.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.088+0000 7f8b79ffb700 1 --2- 172.21.15.27:0/3135321728 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f8b6c06ace0 0x7f8b6c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:04.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.089+0000 7f8b79ffb700 1 -- 172.21.15.27:0/3135321728 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8b8408b170 con 0x7f8b8806e970 2023-07-05T23:33:04.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.089+0000 7f8b8cd93700 1 --2- 172.21.15.27:0/3135321728 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f8b6c06ace0 0x7f8b6c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:04.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.089+0000 7f8b8cd93700 1 --2- 172.21.15.27:0/3135321728 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f8b6c06ace0 0x7f8b6c06d190 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8b881f5890 tx=0x7f8b7c007be0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:04.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.093+0000 7f8b79ffb700 1 -- 172.21.15.27:0/3135321728 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8b84055fc0 con 0x7f8b8806e970 2023-07-05T23:33:04.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.287+0000 7f8b8f7f8700 1 -- 172.21.15.27:0/3135321728 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8b880b0190 con 0x7f8b8806e970 2023-07-05T23:33:04.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.288+0000 7f8b79ffb700 1 -- 172.21.15.27:0/3135321728 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8b840595e0 con 0x7f8b8806e970 2023-07-05T23:33:04.291 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 8 2023-07-05T23:33:04.293 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.290+0000 7f8b8f7f8700 1 -- 172.21.15.27:0/3135321728 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f8b6c06ace0 msgr2=0x7f8b6c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:04.293 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.290+0000 7f8b8f7f8700 1 --2- 172.21.15.27:0/3135321728 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f8b6c06ace0 0x7f8b6c06d190 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8b881f5890 tx=0x7f8b7c007be0 comp rx=0 tx=0).stop 2023-07-05T23:33:04.294 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.290+0000 7f8b8f7f8700 1 -- 172.21.15.27:0/3135321728 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8b8806e970 msgr2=0x7f8b880ae120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:04.294 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.290+0000 7f8b8f7f8700 1 --2- 172.21.15.27:0/3135321728 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8b8806e970 0x7f8b880ae120 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8b84000c00 tx=0x7f8b84004750 comp rx=0 tx=0).stop 2023-07-05T23:33:04.294 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.290+0000 7f8b8f7f8700 1 -- 172.21.15.27:0/3135321728 shutdown_connections 2023-07-05T23:33:04.294 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.290+0000 7f8b8f7f8700 1 --2- 172.21.15.27:0/3135321728 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b8815fc60 0x7f8b88156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:04.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.290+0000 7f8b8f7f8700 1 --2- 172.21.15.27:0/3135321728 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f8b6c06ace0 0x7f8b6c06d190 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:04.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.290+0000 7f8b8f7f8700 1 --2- 172.21.15.27:0/3135321728 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8b8806e970 0x7f8b880ae120 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:04.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.290+0000 7f8b8f7f8700 1 --2- 172.21.15.27:0/3135321728 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b880aecc0 0x7f8b88155fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:04.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.290+0000 7f8b8f7f8700 1 -- 172.21.15.27:0/3135321728 >> 172.21.15.27:0/3135321728 conn(0x7f8b8806b920 msgr2=0x7f8b880cf5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:04.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.290+0000 7f8b8f7f8700 1 -- 172.21.15.27:0/3135321728 shutdown_connections 2023-07-05T23:33:04.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.290+0000 7f8b8f7f8700 1 -- 172.21.15.27:0/3135321728 wait complete. 2023-07-05T23:33:04.305 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-05T23:33:04.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.430+0000 7f1f39cd3700 1 Processor -- start 2023-07-05T23:33:04.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.430+0000 7f1f39cd3700 1 -- start start 2023-07-05T23:33:04.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.431+0000 7f1f39cd3700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f1f3415fc60 0x7f1f3406a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:04.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.431+0000 7f1f39cd3700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f1f340aecc0 0x7f1f340ac600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:04.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.431+0000 7f1f39cd3700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f340ce620 con 0x7f1f3406e260 2023-07-05T23:33:04.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.431+0000 7f1f39cd3700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f34160580 con 0x7f1f340aecc0 2023-07-05T23:33:04.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.431+0000 7f1f39cd3700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f34160860 con 0x7f1f3415fc60 2023-07-05T23:33:04.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.431+0000 7f1f32ffd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f1f340aecc0 0x7f1f340ac600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:04.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.431+0000 7f1f33fff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f1f3406e260 0x7f1f3406e680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:52072/0 (socket says 172.21.15.27:52072) 2023-07-05T23:33:04.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.431+0000 7f1f33fff700 1 -- 172.21.15.27:0/658554672 learned_addr learned my addr 172.21.15.27:0/658554672 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-07-05T23:33:04.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.431+0000 7f1f337fe700 1 --2- 172.21.15.27:0/658554672 >> v2:172.21.15.162:3300/0 conn(0x7f1f3415fc60 0x7f1f3406a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:04.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.431+0000 7f1f32ffd700 1 -- 172.21.15.27:0/658554672 >> v2:172.21.15.162:3300/0 conn(0x7f1f3415fc60 msgr2=0x7f1f3406a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:04.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.431+0000 7f1f32ffd700 1 --2- 172.21.15.27:0/658554672 >> v2:172.21.15.162:3300/0 conn(0x7f1f3415fc60 0x7f1f3406a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:04.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.431+0000 7f1f32ffd700 1 -- 172.21.15.27:0/658554672 >> v1:172.21.15.27:6789/0 conn(0x7f1f3406e260 legacy=0x7f1f3406e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:04.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.431+0000 7f1f32ffd700 1 -- 172.21.15.27:0/658554672 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f34160b40 con 0x7f1f340aecc0 2023-07-05T23:33:04.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.432+0000 7f1f32ffd700 1 --2- 172.21.15.27:0/658554672 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1f340aecc0 0x7f1f340ac600 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1f34066830 tx=0x7f1f24009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb427e1127bf396d server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:04.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.432+0000 7f1f327fc700 1 -- 172.21.15.27:0/658554672 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f24011830 con 0x7f1f340aecc0 2023-07-05T23:33:04.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.432+0000 7f1f327fc700 1 -- 172.21.15.27:0/658554672 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f24011990 con 0x7f1f340aecc0 2023-07-05T23:33:04.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.432+0000 7f1f327fc700 1 -- 172.21.15.27:0/658554672 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f24011d20 con 0x7f1f340aecc0 2023-07-05T23:33:04.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.432+0000 7f1f39cd3700 1 -- 172.21.15.27:0/658554672 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1f340aecc0 msgr2=0x7f1f340ac600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:04.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.432+0000 7f1f39cd3700 1 --2- 172.21.15.27:0/658554672 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1f340aecc0 0x7f1f340ac600 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1f34066830 tx=0x7f1f24009b20 comp rx=0 tx=0).stop 2023-07-05T23:33:04.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.432+0000 7f1f39cd3700 1 -- 172.21.15.27:0/658554672 shutdown_connections 2023-07-05T23:33:04.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.432+0000 7f1f39cd3700 1 --2- 172.21.15.27:0/658554672 >> v2:172.21.15.162:3300/0 conn(0x7f1f3415fc60 0x7f1f3406a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:04.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.432+0000 7f1f39cd3700 1 --2- 172.21.15.27:0/658554672 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1f340aecc0 0x7f1f340ac600 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:04.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.432+0000 7f1f39cd3700 1 -- 172.21.15.27:0/658554672 >> 172.21.15.27:0/658554672 conn(0x7f1f3406b920 msgr2=0x7f1f340cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:04.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.432+0000 7f1f39cd3700 1 -- 172.21.15.27:0/658554672 shutdown_connections 2023-07-05T23:33:04.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.432+0000 7f1f39cd3700 1 -- 172.21.15.27:0/658554672 wait complete. 2023-07-05T23:33:04.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.434+0000 7f1f39cd3700 1 Processor -- start 2023-07-05T23:33:04.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.434+0000 7f1f39cd3700 1 -- start start 2023-07-05T23:33:04.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.434+0000 7f1f39cd3700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1f3406e260 0x7f1f34146fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:04.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.434+0000 7f1f39cd3700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1f340aecc0 0x7f1f340c8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:04.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.434+0000 7f1f39cd3700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1f3415fc60 0x7f1f340b3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:04.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.434+0000 7f1f39cd3700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f340b2940 con 0x7f1f3415fc60 2023-07-05T23:33:04.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.434+0000 7f1f39cd3700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f340c4c00 con 0x7f1f3406e260 2023-07-05T23:33:04.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.434+0000 7f1f39cd3700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f340c45f0 con 0x7f1f340aecc0 2023-07-05T23:33:04.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.435+0000 7f1f33fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1f3415fc60 0x7f1f340b3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:04.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.435+0000 7f1f33fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1f3415fc60 0x7f1f340b3d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44912/0 (socket says 172.21.15.27:44912) 2023-07-05T23:33:04.447 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.435+0000 7f1f33fff700 1 -- 172.21.15.27:0/2832867081 learned_addr learned my addr 172.21.15.27:0/2832867081 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:04.447 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.435+0000 7f1f32ffd700 1 --2- 172.21.15.27:0/2832867081 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1f340aecc0 0x7f1f340c8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:04.447 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.435+0000 7f1f337fe700 1 --2- 172.21.15.27:0/2832867081 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1f3406e260 0x7f1f34146fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:04.447 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.435+0000 7f1f33fff700 1 -- 172.21.15.27:0/2832867081 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1f340aecc0 msgr2=0x7f1f340c8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:04.447 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.435+0000 7f1f33fff700 1 --2- 172.21.15.27:0/2832867081 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1f340aecc0 0x7f1f340c8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:04.447 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.435+0000 7f1f33fff700 1 -- 172.21.15.27:0/2832867081 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1f3406e260 msgr2=0x7f1f34146fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:04.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.435+0000 7f1f33fff700 1 --2- 172.21.15.27:0/2832867081 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1f3406e260 0x7f1f34146fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:04.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.435+0000 7f1f33fff700 1 -- 172.21.15.27:0/2832867081 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f240094a0 con 0x7f1f3415fc60 2023-07-05T23:33:04.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.435+0000 7f1f33fff700 1 --2- 172.21.15.27:0/2832867081 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1f3415fc60 0x7f1f340b3d10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c00cbc0 tx=0x7f1f2c00cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:04.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.435+0000 7f1f2bfff700 1 -- 172.21.15.27:0/2832867081 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c00ab50 con 0x7f1f3415fc60 2023-07-05T23:33:04.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.435+0000 7f1f2bfff700 1 -- 172.21.15.27:0/2832867081 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f2c00acb0 con 0x7f1f3415fc60 2023-07-05T23:33:04.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.435+0000 7f1f39cd3700 1 -- 172.21.15.27:0/2832867081 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f340c9640 con 0x7f1f3415fc60 2023-07-05T23:33:04.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.435+0000 7f1f2bfff700 1 -- 172.21.15.27:0/2832867081 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c012600 con 0x7f1f3415fc60 2023-07-05T23:33:04.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.435+0000 7f1f39cd3700 1 -- 172.21.15.27:0/2832867081 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f340c9920 con 0x7f1f3415fc60 2023-07-05T23:33:04.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.436+0000 7f1f39cd3700 1 -- 172.21.15.27:0/2832867081 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f3404ea20 con 0x7f1f3415fc60 2023-07-05T23:33:04.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.437+0000 7f1f2bfff700 1 -- 172.21.15.27:0/2832867081 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1f2c01b3b0 con 0x7f1f3415fc60 2023-07-05T23:33:04.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.437+0000 7f1f2bfff700 1 --2- 172.21.15.27:0/2832867081 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f1f1406ace0 0x7f1f1406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:04.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.437+0000 7f1f2bfff700 1 -- 172.21.15.27:0/2832867081 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1f2c089420 con 0x7f1f3415fc60 2023-07-05T23:33:04.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.437+0000 7f1f337fe700 1 --2- 172.21.15.27:0/2832867081 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f1f1406ace0 0x7f1f1406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:04.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.438+0000 7f1f337fe700 1 --2- 172.21.15.27:0/2832867081 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f1f1406ace0 0x7f1f1406d190 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c006fd0 tx=0x7f1f1c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:04.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.441+0000 7f1f2bfff700 1 -- 172.21.15.27:0/2832867081 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1f2c054290 con 0x7f1f3415fc60 2023-07-05T23:33:04.642 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.639+0000 7f1f39cd3700 1 -- 172.21.15.27:0/2832867081 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1f340c4d40 con 0x7f1f3415fc60 2023-07-05T23:33:04.643 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.639+0000 7f1f2bfff700 1 -- 172.21.15.27:0/2832867081 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1f2c0578b0 con 0x7f1f3415fc60 2023-07-05T23:33:04.644 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 32 2023-07-05T23:33:04.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.641+0000 7f1f39cd3700 1 -- 172.21.15.27:0/2832867081 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f1f1406ace0 msgr2=0x7f1f1406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:04.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.641+0000 7f1f39cd3700 1 --2- 172.21.15.27:0/2832867081 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f1f1406ace0 0x7f1f1406d190 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c006fd0 tx=0x7f1f1c008040 comp rx=0 tx=0).stop 2023-07-05T23:33:04.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.641+0000 7f1f39cd3700 1 -- 172.21.15.27:0/2832867081 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1f3415fc60 msgr2=0x7f1f340b3d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:04.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.641+0000 7f1f39cd3700 1 --2- 172.21.15.27:0/2832867081 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1f3415fc60 0x7f1f340b3d10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c00cbc0 tx=0x7f1f2c00cf80 comp rx=0 tx=0).stop 2023-07-05T23:33:04.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.642+0000 7f1f39cd3700 1 -- 172.21.15.27:0/2832867081 shutdown_connections 2023-07-05T23:33:04.646 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.642+0000 7f1f39cd3700 1 --2- 172.21.15.27:0/2832867081 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1f3406e260 0x7f1f34146fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:04.646 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.642+0000 7f1f39cd3700 1 --2- 172.21.15.27:0/2832867081 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f1f1406ace0 0x7f1f1406d190 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:04.646 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.642+0000 7f1f39cd3700 1 --2- 172.21.15.27:0/2832867081 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1f3415fc60 0x7f1f340b3d10 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:04.647 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.642+0000 7f1f39cd3700 1 --2- 172.21.15.27:0/2832867081 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1f340aecc0 0x7f1f340c8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:04.647 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.642+0000 7f1f39cd3700 1 -- 172.21.15.27:0/2832867081 >> 172.21.15.27:0/2832867081 conn(0x7f1f3406b920 msgr2=0x7f1f340b0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:04.647 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.642+0000 7f1f39cd3700 1 -- 172.21.15.27:0/2832867081 shutdown_connections 2023-07-05T23:33:04.647 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.642+0000 7f1f39cd3700 1 -- 172.21.15.27:0/2832867081 wait complete. 2023-07-05T23:33:04.657 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-05T23:33:04.787 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.784+0000 7fe29bb69700 1 Processor -- start 2023-07-05T23:33:04.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.784+0000 7fe29bb69700 1 -- start start 2023-07-05T23:33:04.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.785+0000 7fe29bb69700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe29415a120 0x7fe2940c3310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:04.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.785+0000 7fe29bb69700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe2940b1950 0x7fe29406b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:04.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.785+0000 7fe29bb69700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe29406ae10 con 0x7fe2940cc950 2023-07-05T23:33:04.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.785+0000 7fe29bb69700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe29415a4f0 con 0x7fe2940b1950 2023-07-05T23:33:04.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.785+0000 7fe29bb69700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2940cbb80 con 0x7fe29415a120 2023-07-05T23:33:04.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.785+0000 7fe299104700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fe2940cc950 0x7fe2940b1240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:52082/0 (socket says 172.21.15.27:52082) 2023-07-05T23:33:04.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.785+0000 7fe299104700 1 -- 172.21.15.27:0/184044552 learned_addr learned my addr 172.21.15.27:0/184044552 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-07-05T23:33:04.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.785+0000 7fe29a106700 1 --2- 172.21.15.27:0/184044552 >> v2:172.21.15.162:3300/0 conn(0x7fe2940b1950 0x7fe29406b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:04.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.786+0000 7fe298903700 1 -- 172.21.15.27:0/184044552 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3430512553 0 0) 0x7fe29406ae10 con 0x7fe2940cc950 2023-07-05T23:33:04.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.786+0000 7fe299905700 1 --2- 172.21.15.27:0/184044552 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe29415a120 0x7fe2940c3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:04.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.786+0000 7fe298903700 1 -- 172.21.15.27:0/184044552 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2800035b0 con 0x7fe2940cc950 2023-07-05T23:33:04.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.786+0000 7fe298903700 1 -- 172.21.15.27:0/184044552 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1989131136 0 0) 0x7fe2800035b0 con 0x7fe2940cc950 2023-07-05T23:33:04.800 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.786+0000 7fe298903700 1 -- 172.21.15.27:0/184044552 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe29415a120 msgr2=0x7fe2940c3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:04.800 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.786+0000 7fe298903700 1 --2- 172.21.15.27:0/184044552 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe29415a120 0x7fe2940c3310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:04.800 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.786+0000 7fe298903700 1 -- 172.21.15.27:0/184044552 >> v2:172.21.15.162:3300/0 conn(0x7fe2940b1950 msgr2=0x7fe29406b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:04.800 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.786+0000 7fe298903700 1 --2- 172.21.15.27:0/184044552 >> v2:172.21.15.162:3300/0 conn(0x7fe2940b1950 0x7fe29406b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:04.800 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.786+0000 7fe298903700 1 -- 172.21.15.27:0/184044552 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2940cbe60 con 0x7fe2940cc950 2023-07-05T23:33:04.800 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.786+0000 7fe298903700 1 -- 172.21.15.27:0/184044552 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1246168953 0 0) 0x7fe290001670 con 0x7fe2940cc950 2023-07-05T23:33:04.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.786+0000 7fe298903700 1 -- 172.21.15.27:0/184044552 >> v1:172.21.15.27:6789/0 conn(0x7fe2940cc950 legacy=0x7fe2940b1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:04.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.786+0000 7fe298903700 1 --2- 172.21.15.27:0/184044552 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe29415a120 0x7fe280003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:04.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.786+0000 7fe298903700 1 --2- 172.21.15.27:0/184044552 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe280003f80 0x7fe280004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:04.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.786+0000 7fe298903700 1 --2- 172.21.15.27:0/184044552 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe280004d90 0x7fe280005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:04.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.786+0000 7fe298903700 1 -- 172.21.15.27:0/184044552 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe29415a4f0 con 0x7fe280003f80 2023-07-05T23:33:04.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.786+0000 7fe298903700 1 -- 172.21.15.27:0/184044552 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2940cbb80 con 0x7fe280004d90 2023-07-05T23:33:04.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.786+0000 7fe298903700 1 -- 172.21.15.27:0/184044552 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe28000ba10 con 0x7fe29415a120 2023-07-05T23:33:04.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.786+0000 7fe299104700 1 --2- 172.21.15.27:0/184044552 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe280003f80 0x7fe280004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:04.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.786+0000 7fe299905700 1 --2- 172.21.15.27:0/184044552 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe29415a120 0x7fe280003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:04.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.786+0000 7fe29a106700 1 --2- 172.21.15.27:0/184044552 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe280004d90 0x7fe280005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:04.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.786+0000 7fe299104700 1 -- 172.21.15.27:0/184044552 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe29415a120 msgr2=0x7fe280003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:04.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.786+0000 7fe299104700 1 --2- 172.21.15.27:0/184044552 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe29415a120 0x7fe280003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:04.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.786+0000 7fe299104700 1 -- 172.21.15.27:0/184044552 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe280004d90 msgr2=0x7fe280005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:04.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.786+0000 7fe299104700 1 --2- 172.21.15.27:0/184044552 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe280004d90 0x7fe280005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:04.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.786+0000 7fe299104700 1 -- 172.21.15.27:0/184044552 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2800035b0 con 0x7fe280003f80 2023-07-05T23:33:04.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.786+0000 7fe29a106700 1 --2- 172.21.15.27:0/184044552 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe280004d90 0x7fe280005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T23:33:04.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.786+0000 7fe299104700 1 --2- 172.21.15.27:0/184044552 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe280003f80 0x7fe280004850 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe29000c2f0 tx=0x7fe280005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0c2cfe568b59d68 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:04.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.787+0000 7fe298903700 1 -- 172.21.15.27:0/184044552 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe290007c40 con 0x7fe280003f80 2023-07-05T23:33:04.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.787+0000 7fe298903700 1 -- 172.21.15.27:0/184044552 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe29000ce30 con 0x7fe280003f80 2023-07-05T23:33:04.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.787+0000 7fe298903700 1 -- 172.21.15.27:0/184044552 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe290005ba0 con 0x7fe280003f80 2023-07-05T23:33:04.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.787+0000 7fe29bb69700 1 -- 172.21.15.27:0/184044552 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe280003f80 msgr2=0x7fe280004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:04.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.787+0000 7fe29bb69700 1 --2- 172.21.15.27:0/184044552 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe280003f80 0x7fe280004850 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe29000c2f0 tx=0x7fe280005880 comp rx=0 tx=0).stop 2023-07-05T23:33:04.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.787+0000 7fe29a106700 1 -- 172.21.15.27:0/184044552 reap_dead start 2023-07-05T23:33:04.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.787+0000 7fe29bb69700 1 -- 172.21.15.27:0/184044552 shutdown_connections 2023-07-05T23:33:04.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.787+0000 7fe29bb69700 1 -- 172.21.15.27:0/184044552 >> 172.21.15.27:0/184044552 conn(0x7fe29406e0a0 msgr2=0x7fe2940cc240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:04.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.787+0000 7fe29bb69700 1 -- 172.21.15.27:0/184044552 shutdown_connections 2023-07-05T23:33:04.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.787+0000 7fe29bb69700 1 -- 172.21.15.27:0/184044552 wait complete. 2023-07-05T23:33:04.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.788+0000 7fe29bb69700 1 Processor -- start 2023-07-05T23:33:04.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.789+0000 7fe29bb69700 1 -- start start 2023-07-05T23:33:04.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.789+0000 7fe29bb69700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe280003f80 0x7fe2940cd390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:04.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.789+0000 7fe29bb69700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2940abda0 0x7fe29414cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:04.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.789+0000 7fe29bb69700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2940cedc0 0x7fe2940ad990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:04.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.789+0000 7fe29bb69700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2940cd970 con 0x7fe2940cedc0 2023-07-05T23:33:04.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.789+0000 7fe29bb69700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2940cdc50 con 0x7fe2940abda0 2023-07-05T23:33:04.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.789+0000 7fe29bb69700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2940cdf30 con 0x7fe280003f80 2023-07-05T23:33:04.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.789+0000 7fe29a106700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2940cedc0 0x7fe2940ad990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:04.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.789+0000 7fe29a106700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2940cedc0 0x7fe2940ad990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44932/0 (socket says 172.21.15.27:44932) 2023-07-05T23:33:04.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.789+0000 7fe29a106700 1 -- 172.21.15.27:0/1075867634 learned_addr learned my addr 172.21.15.27:0/1075867634 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:04.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.790+0000 7fe299905700 1 --2- 172.21.15.27:0/1075867634 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe280003f80 0x7fe2940cd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:04.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.790+0000 7fe299104700 1 --2- 172.21.15.27:0/1075867634 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2940abda0 0x7fe29414cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:04.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.790+0000 7fe29a106700 1 -- 172.21.15.27:0/1075867634 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe280003f80 msgr2=0x7fe2940cd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:04.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.790+0000 7fe29a106700 1 --2- 172.21.15.27:0/1075867634 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe280003f80 0x7fe2940cd390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:04.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.790+0000 7fe29a106700 1 -- 172.21.15.27:0/1075867634 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2940abda0 msgr2=0x7fe29414cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:04.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.790+0000 7fe29a106700 1 --2- 172.21.15.27:0/1075867634 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2940abda0 0x7fe29414cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:04.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.790+0000 7fe29a106700 1 -- 172.21.15.27:0/1075867634 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2940ce210 con 0x7fe2940cedc0 2023-07-05T23:33:04.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.790+0000 7fe29a106700 1 --2- 172.21.15.27:0/1075867634 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2940cedc0 0x7fe2940ad990 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe2940cb6f0 tx=0x7fe28c007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:04.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.790+0000 7fe28a7fc700 1 -- 172.21.15.27:0/1075867634 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28c00e030 con 0x7fe2940cedc0 2023-07-05T23:33:04.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.790+0000 7fe28a7fc700 1 -- 172.21.15.27:0/1075867634 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe28c011930 con 0x7fe2940cedc0 2023-07-05T23:33:04.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.790+0000 7fe29bb69700 1 -- 172.21.15.27:0/1075867634 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe29415ba90 con 0x7fe2940cedc0 2023-07-05T23:33:04.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.790+0000 7fe28a7fc700 1 -- 172.21.15.27:0/1075867634 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28c011ce0 con 0x7fe2940cedc0 2023-07-05T23:33:04.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.790+0000 7fe29bb69700 1 -- 172.21.15.27:0/1075867634 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2940aded0 con 0x7fe2940cedc0 2023-07-05T23:33:04.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.791+0000 7fe29bb69700 1 -- 172.21.15.27:0/1075867634 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2940ce3a0 con 0x7fe2940cedc0 2023-07-05T23:33:04.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.791+0000 7fe28a7fc700 1 -- 172.21.15.27:0/1075867634 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe28c016470 con 0x7fe2940cedc0 2023-07-05T23:33:04.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.792+0000 7fe28a7fc700 1 --2- 172.21.15.27:0/1075867634 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fe27806ace0 0x7fe27806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:04.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.792+0000 7fe28a7fc700 1 -- 172.21.15.27:0/1075867634 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe28c00f070 con 0x7fe2940cedc0 2023-07-05T23:33:04.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.792+0000 7fe299905700 1 --2- 172.21.15.27:0/1075867634 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fe27806ace0 0x7fe27806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:04.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.793+0000 7fe299905700 1 --2- 172.21.15.27:0/1075867634 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fe27806ace0 0x7fe27806d190 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe2940ceba0 tx=0x7fe284009210 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:04.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.796+0000 7fe28a7fc700 1 -- 172.21.15.27:0/1075867634 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe28c054a40 con 0x7fe2940cedc0 2023-07-05T23:33:04.995 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.993+0000 7fe29bb69700 1 -- 172.21.15.27:0/1075867634 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe29404ea20 con 0x7fe2940cedc0 2023-07-05T23:33:04.996 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.993+0000 7fe28a7fc700 1 -- 172.21.15.27:0/1075867634 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe28c089e60 con 0x7fe2940cedc0 2023-07-05T23:33:04.996 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2023-07-05T23:33:04.998 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.995+0000 7fe29bb69700 1 -- 172.21.15.27:0/1075867634 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fe27806ace0 msgr2=0x7fe27806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:04.999 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.995+0000 7fe29bb69700 1 --2- 172.21.15.27:0/1075867634 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fe27806ace0 0x7fe27806d190 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe2940ceba0 tx=0x7fe284009210 comp rx=0 tx=0).stop 2023-07-05T23:33:04.999 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.995+0000 7fe29bb69700 1 -- 172.21.15.27:0/1075867634 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2940cedc0 msgr2=0x7fe2940ad990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:04.999 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.995+0000 7fe29bb69700 1 --2- 172.21.15.27:0/1075867634 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2940cedc0 0x7fe2940ad990 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe2940cb6f0 tx=0x7fe28c007f60 comp rx=0 tx=0).stop 2023-07-05T23:33:04.999 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.995+0000 7fe29bb69700 1 -- 172.21.15.27:0/1075867634 shutdown_connections 2023-07-05T23:33:04.999 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.995+0000 7fe29bb69700 1 --2- 172.21.15.27:0/1075867634 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fe27806ace0 0x7fe27806d190 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:04.999 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.995+0000 7fe29bb69700 1 --2- 172.21.15.27:0/1075867634 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2940cedc0 0x7fe2940ad990 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:04.999 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.995+0000 7fe29bb69700 1 --2- 172.21.15.27:0/1075867634 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe280003f80 0x7fe2940cd390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:05.000 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.995+0000 7fe29bb69700 1 --2- 172.21.15.27:0/1075867634 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2940abda0 0x7fe29414cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:05.000 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.995+0000 7fe29bb69700 1 -- 172.21.15.27:0/1075867634 >> 172.21.15.27:0/1075867634 conn(0x7fe29406e0a0 msgr2=0x7fe2940af220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:05.000 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.995+0000 7fe29bb69700 1 -- 172.21.15.27:0/1075867634 shutdown_connections 2023-07-05T23:33:05.000 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:04.995+0000 7fe29bb69700 1 -- 172.21.15.27:0/1075867634 wait complete. 2023-07-05T23:33:05.011 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-05T23:33:05.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.136+0000 7f7f006ed700 1 Processor -- start 2023-07-05T23:33:05.140 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.136+0000 7f7f006ed700 1 -- start start 2023-07-05T23:33:05.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.137+0000 7f7f006ed700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f7ef815a330 0x7f7ef8070980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:05.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.137+0000 7f7f006ed700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef80caf70 con 0x7f7ef80afc40 2023-07-05T23:33:05.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.137+0000 7f7f006ed700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef80cb210 con 0x7f7ef80cd330 2023-07-05T23:33:05.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.137+0000 7f7f006ed700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef815e360 con 0x7f7ef815a330 2023-07-05T23:33:05.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.137+0000 7f7efdc88700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f7ef815a330 0x7f7ef8070980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:05.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.137+0000 7f7efec8a700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f7ef80afc40 0x7f7ef815dc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:52106/0 (socket says 172.21.15.27:52106) 2023-07-05T23:33:05.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.137+0000 7f7efec8a700 1 -- 172.21.15.27:0/2296370441 learned_addr learned my addr 172.21.15.27:0/2296370441 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-07-05T23:33:05.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.137+0000 7f7efdc88700 1 -- 172.21.15.27:0/2296370441 >> v1:172.21.15.162:6789/0 conn(0x7f7ef80cd330 legacy=0x7f7ef80cd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:05.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.137+0000 7f7efdc88700 1 -- 172.21.15.27:0/2296370441 >> v1:172.21.15.27:6789/0 conn(0x7f7ef80afc40 legacy=0x7f7ef815dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:05.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.137+0000 7f7efdc88700 1 -- 172.21.15.27:0/2296370441 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef80ccc20 con 0x7f7ef815a330 2023-07-05T23:33:05.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.137+0000 7f7efd487700 1 -- 172.21.15.27:0/2296370441 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1337601480 0 0) 0x7f7ef80caf70 con 0x7f7ef80afc40 2023-07-05T23:33:05.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.138+0000 7f7efdc88700 1 --2- 172.21.15.27:0/2296370441 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ef815a330 0x7f7ef8070980 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7ef4009840 tx=0x7f7ef4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8697b7f90b01ee94 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:05.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.138+0000 7f7efd487700 1 -- 172.21.15.27:0/2296370441 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef4011830 con 0x7f7ef815a330 2023-07-05T23:33:05.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.138+0000 7f7efd487700 1 -- 172.21.15.27:0/2296370441 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ef4011990 con 0x7f7ef815a330 2023-07-05T23:33:05.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.138+0000 7f7efd487700 1 -- 172.21.15.27:0/2296370441 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef4011d20 con 0x7f7ef815a330 2023-07-05T23:33:05.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.138+0000 7f7f006ed700 1 -- 172.21.15.27:0/2296370441 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ef815a330 msgr2=0x7f7ef8070980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:05.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.138+0000 7f7f006ed700 1 --2- 172.21.15.27:0/2296370441 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ef815a330 0x7f7ef8070980 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7ef4009840 tx=0x7f7ef4009b50 comp rx=0 tx=0).stop 2023-07-05T23:33:05.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.138+0000 7f7f006ed700 1 -- 172.21.15.27:0/2296370441 shutdown_connections 2023-07-05T23:33:05.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.138+0000 7f7f006ed700 1 --2- 172.21.15.27:0/2296370441 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ef815a330 0x7f7ef8070980 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:05.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.138+0000 7f7f006ed700 1 -- 172.21.15.27:0/2296370441 >> 172.21.15.27:0/2296370441 conn(0x7f7ef806e5c0 msgr2=0x7f7ef806e990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:05.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.138+0000 7f7f006ed700 1 -- 172.21.15.27:0/2296370441 shutdown_connections 2023-07-05T23:33:05.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.138+0000 7f7f006ed700 1 -- 172.21.15.27:0/2296370441 wait complete. 2023-07-05T23:33:05.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.140+0000 7f7f006ed700 1 Processor -- start 2023-07-05T23:33:05.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.140+0000 7f7f006ed700 1 -- start start 2023-07-05T23:33:05.150 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.140+0000 7f7f006ed700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7ef80afc40 0x7f7ef80c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:05.151 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.140+0000 7f7f006ed700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ef80cd330 0x7f7ef80b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:05.151 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.140+0000 7f7f006ed700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ef815a330 0x7f7ef8151e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:05.151 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.140+0000 7f7f006ed700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef80b4160 con 0x7f7ef815a330 2023-07-05T23:33:05.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.140+0000 7f7f006ed700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef80ca5c0 con 0x7f7ef80cd330 2023-07-05T23:33:05.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.140+0000 7f7f006ed700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef80b4340 con 0x7f7ef80afc40 2023-07-05T23:33:05.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.141+0000 7f7efec8a700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ef815a330 0x7f7ef8151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:05.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.141+0000 7f7efec8a700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ef815a330 0x7f7ef8151e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44946/0 (socket says 172.21.15.27:44946) 2023-07-05T23:33:05.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.141+0000 7f7efec8a700 1 -- 172.21.15.27:0/3091828626 learned_addr learned my addr 172.21.15.27:0/3091828626 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:05.154 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.141+0000 7f7efe489700 1 --2- 172.21.15.27:0/3091828626 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7ef80afc40 0x7f7ef80c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:05.154 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.141+0000 7f7efdc88700 1 --2- 172.21.15.27:0/3091828626 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ef80cd330 0x7f7ef80b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:05.154 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.141+0000 7f7efec8a700 1 -- 172.21.15.27:0/3091828626 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7ef80afc40 msgr2=0x7f7ef80c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:05.154 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.141+0000 7f7efec8a700 1 --2- 172.21.15.27:0/3091828626 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7ef80afc40 0x7f7ef80c9fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:05.155 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.141+0000 7f7efec8a700 1 -- 172.21.15.27:0/3091828626 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ef80cd330 msgr2=0x7f7ef80b4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:05.155 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.141+0000 7f7efec8a700 1 --2- 172.21.15.27:0/3091828626 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ef80cd330 0x7f7ef80b4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:05.155 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.141+0000 7f7efec8a700 1 -- 172.21.15.27:0/3091828626 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef40094a0 con 0x7f7ef815a330 2023-07-05T23:33:05.155 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.141+0000 7f7efec8a700 1 --2- 172.21.15.27:0/3091828626 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ef815a330 0x7f7ef8151e60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7ef0002230 tx=0x7f7ef000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:05.156 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.141+0000 7f7eeeffd700 1 -- 172.21.15.27:0/3091828626 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef000ac20 con 0x7f7ef815a330 2023-07-05T23:33:05.156 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.141+0000 7f7eeeffd700 1 -- 172.21.15.27:0/3091828626 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ef000ada0 con 0x7f7ef815a330 2023-07-05T23:33:05.156 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.141+0000 7f7f006ed700 1 -- 172.21.15.27:0/3091828626 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ef80b4620 con 0x7f7ef815a330 2023-07-05T23:33:05.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.141+0000 7f7eeeffd700 1 -- 172.21.15.27:0/3091828626 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef0007310 con 0x7f7ef815a330 2023-07-05T23:33:05.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.141+0000 7f7f006ed700 1 -- 172.21.15.27:0/3091828626 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ef81523a0 con 0x7f7ef815a330 2023-07-05T23:33:05.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.142+0000 7f7f006ed700 1 -- 172.21.15.27:0/3091828626 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ef804ea20 con 0x7f7ef815a330 2023-07-05T23:33:05.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.143+0000 7f7eeeffd700 1 -- 172.21.15.27:0/3091828626 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7ef0007470 con 0x7f7ef815a330 2023-07-05T23:33:05.158 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.143+0000 7f7eeeffd700 1 --2- 172.21.15.27:0/3091828626 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f7edc06ace0 0x7f7edc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:05.158 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.143+0000 7f7eeeffd700 1 -- 172.21.15.27:0/3091828626 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7ef0089690 con 0x7f7ef815a330 2023-07-05T23:33:05.158 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.143+0000 7f7efe489700 1 --2- 172.21.15.27:0/3091828626 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f7edc06ace0 0x7f7edc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:05.158 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.144+0000 7f7efe489700 1 --2- 172.21.15.27:0/3091828626 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f7edc06ace0 0x7f7edc06d190 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7ee8000f60 tx=0x7f7ee8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:05.159 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.147+0000 7f7eeeffd700 1 -- 172.21.15.27:0/3091828626 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7ef0054450 con 0x7f7ef815a330 2023-07-05T23:33:05.349 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.346+0000 7f7f006ed700 1 -- 172.21.15.27:0/3091828626 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f7ef80b68a0 con 0x7f7ef815a330 2023-07-05T23:33:05.349 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.346+0000 7f7eeeffd700 1 -- 172.21.15.27:0/3091828626 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f7ef0018020 con 0x7f7ef815a330 2023-07-05T23:33:05.350 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 32 2023-07-05T23:33:05.352 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.348+0000 7f7f006ed700 1 -- 172.21.15.27:0/3091828626 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f7edc06ace0 msgr2=0x7f7edc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:05.352 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.348+0000 7f7f006ed700 1 --2- 172.21.15.27:0/3091828626 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f7edc06ace0 0x7f7edc06d190 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7ee8000f60 tx=0x7f7ee8009040 comp rx=0 tx=0).stop 2023-07-05T23:33:05.352 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.348+0000 7f7f006ed700 1 -- 172.21.15.27:0/3091828626 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ef815a330 msgr2=0x7f7ef8151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:05.352 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.348+0000 7f7f006ed700 1 --2- 172.21.15.27:0/3091828626 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ef815a330 0x7f7ef8151e60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7ef0002230 tx=0x7f7ef000a060 comp rx=0 tx=0).stop 2023-07-05T23:33:05.352 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.348+0000 7f7f006ed700 1 -- 172.21.15.27:0/3091828626 shutdown_connections 2023-07-05T23:33:05.353 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.348+0000 7f7f006ed700 1 --2- 172.21.15.27:0/3091828626 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f7edc06ace0 0x7f7edc06d190 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:05.353 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.348+0000 7f7f006ed700 1 --2- 172.21.15.27:0/3091828626 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ef815a330 0x7f7ef8151e60 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:05.353 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.348+0000 7f7f006ed700 1 --2- 172.21.15.27:0/3091828626 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7ef80afc40 0x7f7ef80c9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:05.353 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.348+0000 7f7f006ed700 1 --2- 172.21.15.27:0/3091828626 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ef80cd330 0x7f7ef80b4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:05.353 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.348+0000 7f7f006ed700 1 -- 172.21.15.27:0/3091828626 >> 172.21.15.27:0/3091828626 conn(0x7f7ef806e5c0 msgr2=0x7f7ef80cebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:05.354 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.348+0000 7f7f006ed700 1 -- 172.21.15.27:0/3091828626 shutdown_connections 2023-07-05T23:33:05.354 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.348+0000 7f7f006ed700 1 -- 172.21.15.27:0/3091828626 wait complete. 2023-07-05T23:33:05.365 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-05T23:33:05.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.488+0000 7f45d9406700 1 Processor -- start 2023-07-05T23:33:05.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.488+0000 7f45d9406700 1 -- start start 2023-07-05T23:33:05.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.489+0000 7f45d9406700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f45d406a9d0 0x7f45d40b2e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:05.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.489+0000 7f45d9406700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45d40cc9e0 con 0x7f45d406bab0 2023-07-05T23:33:05.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.489+0000 7f45d9406700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45d40b5780 con 0x7f45d4069ef0 2023-07-05T23:33:05.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.489+0000 7f45d9406700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45d40c9f40 con 0x7f45d406a9d0 2023-07-05T23:33:05.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.489+0000 7f45d27fc700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f45d406bab0 0x7f45d40b2710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:52130/0 (socket says 172.21.15.27:52130) 2023-07-05T23:33:05.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.489+0000 7f45d27fc700 1 -- 172.21.15.27:0/319378025 learned_addr learned my addr 172.21.15.27:0/319378025 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-07-05T23:33:05.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.489+0000 7f45d37fe700 1 --2- 172.21.15.27:0/319378025 >> v2:172.21.15.162:3300/0 conn(0x7f45d406a9d0 0x7f45d40b2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:05.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.489+0000 7f45d1ffb700 1 -- 172.21.15.27:0/319378025 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3874269393 0 0) 0x7f45d40cc9e0 con 0x7f45d406bab0 2023-07-05T23:33:05.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.489+0000 7f45d1ffb700 1 -- 172.21.15.27:0/319378025 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45bc0035b0 con 0x7f45d406bab0 2023-07-05T23:33:05.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.489+0000 7f45d1ffb700 1 -- 172.21.15.27:0/319378025 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4103477979 0 0) 0x7f45bc0035b0 con 0x7f45d406bab0 2023-07-05T23:33:05.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.489+0000 7f45d1ffb700 1 -- 172.21.15.27:0/319378025 >> v2:172.21.15.162:3300/0 conn(0x7f45d406a9d0 msgr2=0x7f45d40b2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:05.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.489+0000 7f45d1ffb700 1 --2- 172.21.15.27:0/319378025 >> v2:172.21.15.162:3300/0 conn(0x7f45d406a9d0 0x7f45d40b2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:05.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.489+0000 7f45d1ffb700 1 -- 172.21.15.27:0/319378025 >> v1:172.21.15.162:6789/0 conn(0x7f45d4069ef0 legacy=0x7f45d406a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:05.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.489+0000 7f45d1ffb700 1 -- 172.21.15.27:0/319378025 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d40cc390 con 0x7f45d406bab0 2023-07-05T23:33:05.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.489+0000 7f45d1ffb700 1 -- 172.21.15.27:0/319378025 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1246168953 0 0) 0x7f45c4001670 con 0x7f45d406bab0 2023-07-05T23:33:05.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.489+0000 7f45d1ffb700 1 -- 172.21.15.27:0/319378025 >> v1:172.21.15.27:6789/0 conn(0x7f45d406bab0 legacy=0x7f45d40b2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:05.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.489+0000 7f45d1ffb700 1 --2- 172.21.15.27:0/319378025 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f45bc003a00 0x7f45bc003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:05.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.490+0000 7f45d1ffb700 1 --2- 172.21.15.27:0/319378025 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45bc004850 0x7f45bc004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:05.497 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.490+0000 7f45d1ffb700 1 --2- 172.21.15.27:0/319378025 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45bc005200 0x7f45bc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:05.497 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.490+0000 7f45d1ffb700 1 -- 172.21.15.27:0/319378025 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d40c9f40 con 0x7f45bc004850 2023-07-05T23:33:05.497 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.490+0000 7f45d1ffb700 1 -- 172.21.15.27:0/319378025 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45bc00c110 con 0x7f45bc003a00 2023-07-05T23:33:05.497 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.490+0000 7f45d1ffb700 1 -- 172.21.15.27:0/319378025 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45bc00c2d0 con 0x7f45bc005200 2023-07-05T23:33:05.497 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.490+0000 7f45d37fe700 1 --2- 172.21.15.27:0/319378025 >> v2:172.21.15.162:3300/0 conn(0x7f45d406a9d0 0x7f45d40b2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T23:33:05.497 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.490+0000 7f45d27fc700 1 --2- 172.21.15.27:0/319378025 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45bc004850 0x7f45bc004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:05.498 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.490+0000 7f45d2ffd700 1 --2- 172.21.15.27:0/319378025 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f45bc003a00 0x7f45bc003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:05.498 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.490+0000 7f45d37fe700 1 --2- 172.21.15.27:0/319378025 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45bc005200 0x7f45bc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:05.498 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.490+0000 7f45d27fc700 1 -- 172.21.15.27:0/319378025 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45bc005200 msgr2=0x7f45bc00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:05.498 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.490+0000 7f45d27fc700 1 --2- 172.21.15.27:0/319378025 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45bc005200 0x7f45bc00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:05.498 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.490+0000 7f45d27fc700 1 -- 172.21.15.27:0/319378025 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f45bc003a00 msgr2=0x7f45bc003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:05.498 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.490+0000 7f45d27fc700 1 --2- 172.21.15.27:0/319378025 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f45bc003a00 0x7f45bc003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:05.498 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.490+0000 7f45d37fe700 1 -- 172.21.15.27:0/319378025 reap_dead start 2023-07-05T23:33:05.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.490+0000 7f45d27fc700 1 -- 172.21.15.27:0/319378025 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45bc0035b0 con 0x7f45bc004850 2023-07-05T23:33:05.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.490+0000 7f45d27fc700 1 --2- 172.21.15.27:0/319378025 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45bc004850 0x7f45bc004cc0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f45c400c240 tx=0x7f45bc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12d162b21607f268 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:05.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.490+0000 7f45d1ffb700 1 -- 172.21.15.27:0/319378025 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c4007c10 con 0x7f45bc004850 2023-07-05T23:33:05.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.490+0000 7f45d1ffb700 1 -- 172.21.15.27:0/319378025 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45c400cd80 con 0x7f45bc004850 2023-07-05T23:33:05.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.490+0000 7f45d1ffb700 1 -- 172.21.15.27:0/319378025 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c4005ba0 con 0x7f45bc004850 2023-07-05T23:33:05.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.491+0000 7f45d9406700 1 -- 172.21.15.27:0/319378025 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45bc004850 msgr2=0x7f45bc004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:05.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.491+0000 7f45d9406700 1 --2- 172.21.15.27:0/319378025 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45bc004850 0x7f45bc004cc0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f45c400c240 tx=0x7f45bc005880 comp rx=0 tx=0).stop 2023-07-05T23:33:05.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.491+0000 7f45d9406700 1 -- 172.21.15.27:0/319378025 shutdown_connections 2023-07-05T23:33:05.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.491+0000 7f45d9406700 1 --2- 172.21.15.27:0/319378025 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45bc004850 0x7f45bc004cc0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:05.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.491+0000 7f45d9406700 1 -- 172.21.15.27:0/319378025 >> 172.21.15.27:0/319378025 conn(0x7f45d406d4a0 msgr2=0x7f45d406d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:05.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.491+0000 7f45d9406700 1 -- 172.21.15.27:0/319378025 shutdown_connections 2023-07-05T23:33:05.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.491+0000 7f45d9406700 1 -- 172.21.15.27:0/319378025 wait complete. 2023-07-05T23:33:05.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.492+0000 7f45d9406700 1 Processor -- start 2023-07-05T23:33:05.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.492+0000 7f45d9406700 1 -- start start 2023-07-05T23:33:05.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.493+0000 7f45d9406700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45bc004850 0x7f45d41f1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:05.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.493+0000 7f45d9406700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45d415b690 0x7f45d415cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:05.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.493+0000 7f45d9406700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f45d40ced60 0x7f45d40c3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:05.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.493+0000 7f45d9406700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d415bb90 con 0x7f45d415b690 2023-07-05T23:33:05.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.493+0000 7f45d9406700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d415be70 con 0x7f45d40ced60 2023-07-05T23:33:05.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.493+0000 7f45d9406700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45d415c150 con 0x7f45bc004850 2023-07-05T23:33:05.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.493+0000 7f45d27fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45d415b690 0x7f45d415cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:05.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.493+0000 7f45d27fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45d415b690 0x7f45d415cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44976/0 (socket says 172.21.15.27:44976) 2023-07-05T23:33:05.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.493+0000 7f45d27fc700 1 -- 172.21.15.27:0/2036902087 learned_addr learned my addr 172.21.15.27:0/2036902087 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:05.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.493+0000 7f45d2ffd700 1 --2- 172.21.15.27:0/2036902087 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45bc004850 0x7f45d41f1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:05.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.493+0000 7f45d37fe700 1 --2- 172.21.15.27:0/2036902087 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f45d40ced60 0x7f45d40c3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:05.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.493+0000 7f45d27fc700 1 -- 172.21.15.27:0/2036902087 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45bc004850 msgr2=0x7f45d41f1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:05.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.493+0000 7f45d27fc700 1 --2- 172.21.15.27:0/2036902087 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45bc004850 0x7f45d41f1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:05.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.493+0000 7f45d27fc700 1 -- 172.21.15.27:0/2036902087 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f45d40ced60 msgr2=0x7f45d40c3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:05.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.493+0000 7f45d27fc700 1 --2- 172.21.15.27:0/2036902087 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f45d40ced60 0x7f45d40c3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:05.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.493+0000 7f45d27fc700 1 -- 172.21.15.27:0/2036902087 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d415c430 con 0x7f45d415b690 2023-07-05T23:33:05.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.494+0000 7f45d27fc700 1 --2- 172.21.15.27:0/2036902087 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45d415b690 0x7f45d415cc30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f45c400c830 tx=0x7f45c4001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:05.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.494+0000 7f45bb7fe700 1 -- 172.21.15.27:0/2036902087 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c4001630 con 0x7f45d415b690 2023-07-05T23:33:05.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.494+0000 7f45bb7fe700 1 -- 172.21.15.27:0/2036902087 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45c40070d0 con 0x7f45d415b690 2023-07-05T23:33:05.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.494+0000 7f45d9406700 1 -- 172.21.15.27:0/2036902087 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45d415c710 con 0x7f45d415b690 2023-07-05T23:33:05.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.494+0000 7f45bb7fe700 1 -- 172.21.15.27:0/2036902087 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c4007440 con 0x7f45d415b690 2023-07-05T23:33:05.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.494+0000 7f45d9406700 1 -- 172.21.15.27:0/2036902087 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45d40c5fa0 con 0x7f45d415b690 2023-07-05T23:33:05.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.495+0000 7f45d9406700 1 -- 172.21.15.27:0/2036902087 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45d415bfb0 con 0x7f45d415b690 2023-07-05T23:33:05.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.495+0000 7f45bb7fe700 1 -- 172.21.15.27:0/2036902087 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f45c40075a0 con 0x7f45d415b690 2023-07-05T23:33:05.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.496+0000 7f45bb7fe700 1 --2- 172.21.15.27:0/2036902087 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f45c006ace0 0x7f45c006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:05.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.496+0000 7f45bb7fe700 1 -- 172.21.15.27:0/2036902087 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f45c408ab40 con 0x7f45d415b690 2023-07-05T23:33:05.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.496+0000 7f45d2ffd700 1 --2- 172.21.15.27:0/2036902087 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f45c006ace0 0x7f45c006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:05.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.496+0000 7f45d2ffd700 1 --2- 172.21.15.27:0/2036902087 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f45c006ace0 0x7f45c006d190 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f45d40c9800 tx=0x7f45c8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:05.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.500+0000 7f45bb7fe700 1 -- 172.21.15.27:0/2036902087 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f45d415bfb0 con 0x7f45d415b690 2023-07-05T23:33:05.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.714+0000 7f45d9406700 1 -- 172.21.15.27:0/2036902087 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f45d415bfb0 con 0x7f45d415b690 2023-07-05T23:33:05.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.714+0000 7f45bb7fe700 1 -- 172.21.15.27:0/2036902087 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f45d415bfb0 con 0x7f45d415b690 2023-07-05T23:33:05.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.716+0000 7f45d9406700 1 -- 172.21.15.27:0/2036902087 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f45c006ace0 msgr2=0x7f45c006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:05.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.716+0000 7f45d9406700 1 --2- 172.21.15.27:0/2036902087 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f45c006ace0 0x7f45c006d190 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f45d40c9800 tx=0x7f45c8009040 comp rx=0 tx=0).stop 2023-07-05T23:33:05.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.716+0000 7f45d9406700 1 -- 172.21.15.27:0/2036902087 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45d415b690 msgr2=0x7f45d415cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:05.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.716+0000 7f45d9406700 1 --2- 172.21.15.27:0/2036902087 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45d415b690 0x7f45d415cc30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f45c400c830 tx=0x7f45c4001a00 comp rx=0 tx=0).stop 2023-07-05T23:33:05.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.716+0000 7f45d9406700 1 -- 172.21.15.27:0/2036902087 shutdown_connections 2023-07-05T23:33:05.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.716+0000 7f45d9406700 1 --2- 172.21.15.27:0/2036902087 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f45d40ced60 0x7f45d40c3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:05.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.716+0000 7f45d9406700 1 --2- 172.21.15.27:0/2036902087 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f45c006ace0 0x7f45c006d190 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:05.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.716+0000 7f45d9406700 1 --2- 172.21.15.27:0/2036902087 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45bc004850 0x7f45d41f1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:05.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.716+0000 7f45d9406700 1 --2- 172.21.15.27:0/2036902087 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45d415b690 0x7f45d415cc30 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:05.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.716+0000 7f45d9406700 1 -- 172.21.15.27:0/2036902087 >> 172.21.15.27:0/2036902087 conn(0x7f45d406d4a0 msgr2=0x7f45d4159db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:05.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.716+0000 7f45d9406700 1 -- 172.21.15.27:0/2036902087 shutdown_connections 2023-07-05T23:33:05.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.716+0000 7f45d9406700 1 -- 172.21.15.27:0/2036902087 wait complete. 2023-07-05T23:33:05.722 INFO:teuthology.orchestra.run.smithi027.stderr:listed 0 entries 2023-07-05T23:33:05.731 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-07-05T23:33:05.732 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-05T23:33:05.749 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-05T23:33:05.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.911+0000 7f3d53cdc700 1 Processor -- start 2023-07-05T23:33:05.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.911+0000 7f3d53cdc700 1 -- start start 2023-07-05T23:33:05.916 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.912+0000 7f3d53cdc700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f3d4c069ef0 0x7f3d4c070ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:05.916 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.912+0000 7f3d53cdc700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3d4c0c95e0 0x7f3d4c071020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:05.916 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.912+0000 7f3d53cdc700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d4c0cb580 con 0x7f3d4c157a90 2023-07-05T23:33:05.916 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.912+0000 7f3d53cdc700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d4c06db80 con 0x7f3d4c069ef0 2023-07-05T23:33:05.916 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.912+0000 7f3d53cdc700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d4c0cafb0 con 0x7f3d4c0c95e0 2023-07-05T23:33:05.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.912+0000 7f3d51277700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f3d4c069ef0 0x7f3d4c070ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:05.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.912+0000 7f3d51a78700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f3d4c157a90 0x7f3d4c15e5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:52148/0 (socket says 172.21.15.27:52148) 2023-07-05T23:33:05.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.912+0000 7f3d51a78700 1 -- 172.21.15.27:0/432571436 learned_addr learned my addr 172.21.15.27:0/432571436 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-07-05T23:33:05.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.913+0000 7f3d52279700 1 --2- 172.21.15.27:0/432571436 >> v2:172.21.15.162:3300/0 conn(0x7f3d4c0c95e0 0x7f3d4c071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:05.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.913+0000 7f3d51277700 1 -- 172.21.15.27:0/432571436 >> v2:172.21.15.162:3300/0 conn(0x7f3d4c0c95e0 msgr2=0x7f3d4c071020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:05.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.913+0000 7f3d51277700 1 --2- 172.21.15.27:0/432571436 >> v2:172.21.15.162:3300/0 conn(0x7f3d4c0c95e0 0x7f3d4c071020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:05.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.913+0000 7f3d51277700 1 -- 172.21.15.27:0/432571436 >> v1:172.21.15.27:6789/0 conn(0x7f3d4c157a90 legacy=0x7f3d4c15e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:05.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.913+0000 7f3d50a76700 1 -- 172.21.15.27:0/432571436 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4284808184 0 0) 0x7f3d4c0cb580 con 0x7f3d4c157a90 2023-07-05T23:33:05.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.913+0000 7f3d51277700 1 -- 172.21.15.27:0/432571436 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d4c0cb250 con 0x7f3d4c069ef0 2023-07-05T23:33:05.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.913+0000 7f3d52279700 1 --2- 172.21.15.27:0/432571436 >> v2:172.21.15.162:3300/0 conn(0x7f3d4c0c95e0 0x7f3d4c071020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T23:33:05.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.913+0000 7f3d51277700 1 --2- 172.21.15.27:0/432571436 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d4c069ef0 0x7f3d4c070ae0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c15daf0 tx=0x7f3d40009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa0334ea4903c538 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:05.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.913+0000 7f3d50a76700 1 -- 172.21.15.27:0/432571436 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d40011830 con 0x7f3d4c069ef0 2023-07-05T23:33:05.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.913+0000 7f3d50a76700 1 -- 172.21.15.27:0/432571436 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d40011990 con 0x7f3d4c069ef0 2023-07-05T23:33:05.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.913+0000 7f3d50a76700 1 -- 172.21.15.27:0/432571436 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d40011d20 con 0x7f3d4c069ef0 2023-07-05T23:33:05.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.914+0000 7f3d53cdc700 1 -- 172.21.15.27:0/432571436 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d4c069ef0 msgr2=0x7f3d4c070ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:05.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.914+0000 7f3d53cdc700 1 --2- 172.21.15.27:0/432571436 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d4c069ef0 0x7f3d4c070ae0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c15daf0 tx=0x7f3d40009b20 comp rx=0 tx=0).stop 2023-07-05T23:33:05.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.914+0000 7f3d53cdc700 1 -- 172.21.15.27:0/432571436 shutdown_connections 2023-07-05T23:33:05.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.914+0000 7f3d53cdc700 1 --2- 172.21.15.27:0/432571436 >> v2:172.21.15.162:3300/0 conn(0x7f3d4c0c95e0 0x7f3d4c071020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:05.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.914+0000 7f3d53cdc700 1 --2- 172.21.15.27:0/432571436 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d4c069ef0 0x7f3d4c070ae0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:05.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.914+0000 7f3d53cdc700 1 -- 172.21.15.27:0/432571436 >> 172.21.15.27:0/432571436 conn(0x7f3d4c0b1740 msgr2=0x7f3d4c06cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:05.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.914+0000 7f3d53cdc700 1 -- 172.21.15.27:0/432571436 shutdown_connections 2023-07-05T23:33:05.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.914+0000 7f3d53cdc700 1 -- 172.21.15.27:0/432571436 wait complete. 2023-07-05T23:33:05.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.915+0000 7f3d53cdc700 1 Processor -- start 2023-07-05T23:33:05.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.915+0000 7f3d53cdc700 1 -- start start 2023-07-05T23:33:05.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.916+0000 7f3d53cdc700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d4c069ef0 0x7f3d4c14efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:05.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.916+0000 7f3d53cdc700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d4c0c95e0 0x7f3d4c1f2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:05.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.916+0000 7f3d53cdc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d4c157a90 0x7f3d4c1f3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:05.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.916+0000 7f3d53cdc700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4c0b2cb0 con 0x7f3d4c157a90 2023-07-05T23:33:05.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.916+0000 7f3d53cdc700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4c0c2ac0 con 0x7f3d4c0c95e0 2023-07-05T23:33:05.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.916+0000 7f3d53cdc700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4c0c2da0 con 0x7f3d4c069ef0 2023-07-05T23:33:05.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.916+0000 7f3d52279700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d4c157a90 0x7f3d4c1f3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:05.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.916+0000 7f3d52279700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d4c157a90 0x7f3d4c1f3420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44992/0 (socket says 172.21.15.27:44992) 2023-07-05T23:33:05.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.916+0000 7f3d52279700 1 -- 172.21.15.27:0/962671850 learned_addr learned my addr 172.21.15.27:0/962671850 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:05.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.916+0000 7f3d51a78700 1 --2- 172.21.15.27:0/962671850 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d4c069ef0 0x7f3d4c14efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:05.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.916+0000 7f3d51277700 1 --2- 172.21.15.27:0/962671850 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d4c0c95e0 0x7f3d4c1f2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:05.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.916+0000 7f3d52279700 1 -- 172.21.15.27:0/962671850 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d4c069ef0 msgr2=0x7f3d4c14efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:05.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.916+0000 7f3d52279700 1 --2- 172.21.15.27:0/962671850 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d4c069ef0 0x7f3d4c14efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:05.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.916+0000 7f3d52279700 1 -- 172.21.15.27:0/962671850 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d4c0c95e0 msgr2=0x7f3d4c1f2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:05.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.916+0000 7f3d52279700 1 --2- 172.21.15.27:0/962671850 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d4c0c95e0 0x7f3d4c1f2ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:05.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.916+0000 7f3d52279700 1 -- 172.21.15.27:0/962671850 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d400094a0 con 0x7f3d4c157a90 2023-07-05T23:33:05.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.916+0000 7f3d52279700 1 --2- 172.21.15.27:0/962671850 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d4c157a90 0x7f3d4c1f3420 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3d4400cf20 tx=0x7f3d4400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:05.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.916+0000 7f3d3e7fc700 1 -- 172.21.15.27:0/962671850 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4400ae80 con 0x7f3d4c157a90 2023-07-05T23:33:05.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.916+0000 7f3d3e7fc700 1 -- 172.21.15.27:0/962671850 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d44015440 con 0x7f3d4c157a90 2023-07-05T23:33:05.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.916+0000 7f3d3e7fc700 1 -- 172.21.15.27:0/962671850 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d440157d0 con 0x7f3d4c157a90 2023-07-05T23:33:05.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.916+0000 7f3d53cdc700 1 -- 172.21.15.27:0/962671850 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d4c0c5a00 con 0x7f3d4c157a90 2023-07-05T23:33:05.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.916+0000 7f3d53cdc700 1 -- 172.21.15.27:0/962671850 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d4c0b40d0 con 0x7f3d4c157a90 2023-07-05T23:33:05.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.917+0000 7f3d53cdc700 1 -- 172.21.15.27:0/962671850 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d4c067930 con 0x7f3d4c157a90 2023-07-05T23:33:05.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.918+0000 7f3d3e7fc700 1 -- 172.21.15.27:0/962671850 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3d4400d430 con 0x7f3d4c157a90 2023-07-05T23:33:05.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.918+0000 7f3d3e7fc700 1 --2- 172.21.15.27:0/962671850 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f3d3006ace0 0x7f3d3006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:05.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.918+0000 7f3d3e7fc700 1 -- 172.21.15.27:0/962671850 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3d44089cf0 con 0x7f3d4c157a90 2023-07-05T23:33:05.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.918+0000 7f3d51a78700 1 --2- 172.21.15.27:0/962671850 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f3d3006ace0 0x7f3d3006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:05.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.919+0000 7f3d51a78700 1 --2- 172.21.15.27:0/962671850 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f3d3006ace0 0x7f3d3006d190 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3d48000f60 tx=0x7f3d48009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:05.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:05.923+0000 7f3d3e7fc700 1 -- 172.21.15.27:0/962671850 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3d4408e070 con 0x7f3d4c157a90 2023-07-05T23:33:06.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.121+0000 7f3d53cdc700 1 -- 172.21.15.27:0/962671850 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3d4c073910 con 0x7f3d4c157a90 2023-07-05T23:33:06.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.122+0000 7f3d3e7fc700 1 -- 172.21.15.27:0/962671850 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20120 (secure 0 0 0) 0x7f3d4401a090 con 0x7f3d4c157a90 2023-07-05T23:33:06.125 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:33:06.126 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":28,"fsid":"23eebe48-65f5-4d3c-8c2d-4aa171c055d5","created":"2023-07-05T23:32:27.989612+0000","modified":"2023-07-05T23:32:57.768949+0000","last_up_change":"2023-07-05T23:32:39.601570+0000","last_in_change":"2023-07-05T23:32:30.488261+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-05T23:32:41.624598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-05T23:32:46.481587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-05T23:32:51.025210+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-05T23:32:52.286964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-05T23:32:55.354212+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ac2071e4-394b-4385-b9ba-fad5265efc65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6814","nonce":3766536605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6818","nonce":3766536605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6823","nonce":3766536605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6821","nonce":3766536605}]},"public_addr":"172.21.15.27:6814/3766536605","cluster_addr":"172.21.15.27:6818/3766536605","heartbeat_back_addr":"172.21.15.27:6823/3766536605","heartbeat_front_addr":"172.21.15.27:6821/3766536605","state":["exists","up"]},{"osd":1,"uuid":"8c9b61a0-39d5-46bf-afd6-5add78453ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6801","nonce":1579117455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6803","nonce":1579117455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6807","nonce":1579117455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6805","nonce":1579117455}]},"public_addr":"172.21.15.27:6801/1579117455","cluster_addr":"172.21.15.27:6803/1579117455","heartbeat_back_addr":"172.21.15.27:6807/1579117455","heartbeat_front_addr":"172.21.15.27:6805/1579117455","state":["exists","up"]},{"osd":2,"uuid":"dcd032a2-06b1-4055-b798-b86c71a7107d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6825","nonce":807520271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6827","nonce":807520271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6831","nonce":807520271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6829","nonce":807520271}]},"public_addr":"172.21.15.27:6825/807520271","cluster_addr":"172.21.15.27:6827/807520271","heartbeat_back_addr":"172.21.15.27:6831/807520271","heartbeat_front_addr":"172.21.15.27:6829/807520271","state":["exists","up"]},{"osd":3,"uuid":"b0ffe0fc-47ba-4636-b5ea-6bab637642c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6809","nonce":2125656143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6811","nonce":2125656143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6817","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6819","nonce":2125656143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6813","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6815","nonce":2125656143}]},"public_addr":"172.21.15.27:6809/2125656143","cluster_addr":"172.21.15.27:6811/2125656143","heartbeat_back_addr":"172.21.15.27:6819/2125656143","heartbeat_front_addr":"172.21.15.27:6815/2125656143","state":["exists","up"]},{"osd":4,"uuid":"7fab4e5a-1246-4efe-9562-10c4a6c789ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6801","nonce":2111223016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6803","nonce":2111223016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6807","nonce":2111223016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6805","nonce":2111223016}]},"public_addr":"172.21.15.162:6801/2111223016","cluster_addr":"172.21.15.162:6803/2111223016","heartbeat_back_addr":"172.21.15.162:6807/2111223016","heartbeat_front_addr":"172.21.15.162:6805/2111223016","state":["exists","up"]},{"osd":5,"uuid":"110c4d9f-cef6-48ab-a818-5a81e72372af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6825","nonce":3102609008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6827","nonce":3102609008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6831","nonce":3102609008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6829","nonce":3102609008}]},"public_addr":"172.21.15.162:6825/3102609008","cluster_addr":"172.21.15.162:6827/3102609008","heartbeat_back_addr":"172.21.15.162:6831/3102609008","heartbeat_front_addr":"172.21.15.162:6829/3102609008","state":["exists","up"]},{"osd":6,"uuid":"16803bcc-2c92-4aed-954e-487938c9f24a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6809","nonce":2657688865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6811","nonce":2657688865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6815","nonce":2657688865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6813","nonce":2657688865}]},"public_addr":"172.21.15.162:6809/2657688865","cluster_addr":"172.21.15.162:6811/2657688865","heartbeat_back_addr":"172.21.15.162:6815/2657688865","heartbeat_front_addr":"172.21.15.162:6813/2657688865","state":["exists","up"]},{"osd":7,"uuid":"b7c35377-3cf2-4569-b6b9-72376eb463bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6817","nonce":2096609978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6819","nonce":2096609978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6823","nonce":2096609978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6821","nonce":2096609978}]},"public_addr":"172.21.15.162:6817/2096609978","cluster_addr":"172.21.15.162:6819/2096609978","heartbeat_back_addr":"172.21.15.162:6823/2096609978","heartbeat_front_addr":"172.21.15.162:6821/2096609978","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.735448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.645561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.759120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.682507+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.736228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.694664+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.716002+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.680485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-05T23:33:06.127 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.124+0000 7f3d53cdc700 1 -- 172.21.15.27:0/962671850 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f3d3006ace0 msgr2=0x7f3d3006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:06.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.124+0000 7f3d53cdc700 1 --2- 172.21.15.27:0/962671850 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f3d3006ace0 0x7f3d3006d190 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3d48000f60 tx=0x7f3d48009040 comp rx=0 tx=0).stop 2023-07-05T23:33:06.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.124+0000 7f3d53cdc700 1 -- 172.21.15.27:0/962671850 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d4c157a90 msgr2=0x7f3d4c1f3420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:06.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.124+0000 7f3d53cdc700 1 --2- 172.21.15.27:0/962671850 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d4c157a90 0x7f3d4c1f3420 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3d4400cf20 tx=0x7f3d4400a340 comp rx=0 tx=0).stop 2023-07-05T23:33:06.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.124+0000 7f3d53cdc700 1 -- 172.21.15.27:0/962671850 shutdown_connections 2023-07-05T23:33:06.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.124+0000 7f3d53cdc700 1 --2- 172.21.15.27:0/962671850 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f3d3006ace0 0x7f3d3006d190 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:06.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.124+0000 7f3d53cdc700 1 --2- 172.21.15.27:0/962671850 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d4c157a90 0x7f3d4c1f3420 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:06.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.124+0000 7f3d53cdc700 1 --2- 172.21.15.27:0/962671850 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d4c069ef0 0x7f3d4c14efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:06.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.124+0000 7f3d53cdc700 1 --2- 172.21.15.27:0/962671850 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d4c0c95e0 0x7f3d4c1f2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:06.133 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.124+0000 7f3d53cdc700 1 -- 172.21.15.27:0/962671850 >> 172.21.15.27:0/962671850 conn(0x7f3d4c0b1740 msgr2=0x7f3d4c06df10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:06.133 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.124+0000 7f3d53cdc700 1 -- 172.21.15.27:0/962671850 shutdown_connections 2023-07-05T23:33:06.134 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.125+0000 7f3d53cdc700 1 -- 172.21.15.27:0/962671850 wait complete. 2023-07-05T23:33:06.140 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-05T23:32:41.624598+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-05T23:32:46.481587+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-05T23:32:51.025210+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-05T23:32:52.286964+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-05T23:32:55.354212+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-05T23:33:06.142 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-05T23:33:06.270 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.267+0000 7fb69a3b1700 1 Processor -- start 2023-07-05T23:33:06.271 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.268+0000 7fb69a3b1700 1 -- start start 2023-07-05T23:33:06.273 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.268+0000 7fb69a3b1700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb6940cd5e0 0x7fb6940cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:06.274 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.268+0000 7fb69a3b1700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb69406e030 0x7fb69406e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:06.274 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.268+0000 7fb69a3b1700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb69406f0e0 con 0x7fb69415cf70 2023-07-05T23:33:06.274 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.268+0000 7fb69a3b1700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6940ce2c0 con 0x7fb69406e030 2023-07-05T23:33:06.274 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.268+0000 7fb69a3b1700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6940cdef0 con 0x7fb6940cd5e0 2023-07-05T23:33:06.274 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.268+0000 7fb6937fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb69406e030 0x7fb69406e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:06.274 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.269+0000 7fb69894e700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fb69415cf70 0x7fb69415d390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:52166/0 (socket says 172.21.15.27:52166) 2023-07-05T23:33:06.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.269+0000 7fb69894e700 1 -- 172.21.15.27:0/3522946067 learned_addr learned my addr 172.21.15.27:0/3522946067 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-07-05T23:33:06.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.269+0000 7fb693fff700 1 --2- 172.21.15.27:0/3522946067 >> v2:172.21.15.162:3300/0 conn(0x7fb6940cd5e0 0x7fb6940cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:06.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.269+0000 7fb6937fe700 1 -- 172.21.15.27:0/3522946067 >> v2:172.21.15.162:3300/0 conn(0x7fb6940cd5e0 msgr2=0x7fb6940cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:06.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.269+0000 7fb6937fe700 1 --2- 172.21.15.27:0/3522946067 >> v2:172.21.15.162:3300/0 conn(0x7fb6940cd5e0 0x7fb6940cd9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:06.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.269+0000 7fb6937fe700 1 -- 172.21.15.27:0/3522946067 >> v1:172.21.15.27:6789/0 conn(0x7fb69415cf70 legacy=0x7fb69415d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:06.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.269+0000 7fb6937fe700 1 -- 172.21.15.27:0/3522946067 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb69406eb20 con 0x7fb69406e030 2023-07-05T23:33:06.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.269+0000 7fb692ffd700 1 -- 172.21.15.27:0/3522946067 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4150374546 0 0) 0x7fb69406f0e0 con 0x7fb69415cf70 2023-07-05T23:33:06.276 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.269+0000 7fb6937fe700 1 --2- 172.21.15.27:0/3522946067 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb69406e030 0x7fb69406e4d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb694071470 tx=0x7fb688009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a6811b8c32aadf server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:06.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.269+0000 7fb692ffd700 1 -- 172.21.15.27:0/3522946067 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb688011830 con 0x7fb69406e030 2023-07-05T23:33:06.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.269+0000 7fb692ffd700 1 -- 172.21.15.27:0/3522946067 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb688011990 con 0x7fb69406e030 2023-07-05T23:33:06.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.269+0000 7fb692ffd700 1 -- 172.21.15.27:0/3522946067 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb688011d20 con 0x7fb69406e030 2023-07-05T23:33:06.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.270+0000 7fb69a3b1700 1 -- 172.21.15.27:0/3522946067 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb69406e030 msgr2=0x7fb69406e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:06.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.270+0000 7fb69a3b1700 1 --2- 172.21.15.27:0/3522946067 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb69406e030 0x7fb69406e4d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb694071470 tx=0x7fb688009b20 comp rx=0 tx=0).stop 2023-07-05T23:33:06.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.270+0000 7fb69a3b1700 1 -- 172.21.15.27:0/3522946067 shutdown_connections 2023-07-05T23:33:06.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.270+0000 7fb69a3b1700 1 --2- 172.21.15.27:0/3522946067 >> v2:172.21.15.162:3300/0 conn(0x7fb6940cd5e0 0x7fb6940cd9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:06.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.270+0000 7fb69a3b1700 1 --2- 172.21.15.27:0/3522946067 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb69406e030 0x7fb69406e4d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:06.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.270+0000 7fb69a3b1700 1 -- 172.21.15.27:0/3522946067 >> 172.21.15.27:0/3522946067 conn(0x7fb69406b920 msgr2=0x7fb6940cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:06.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.270+0000 7fb69a3b1700 1 -- 172.21.15.27:0/3522946067 shutdown_connections 2023-07-05T23:33:06.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.270+0000 7fb69a3b1700 1 -- 172.21.15.27:0/3522946067 wait complete. 2023-07-05T23:33:06.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.271+0000 7fb69a3b1700 1 Processor -- start 2023-07-05T23:33:06.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.271+0000 7fb69a3b1700 1 -- start start 2023-07-05T23:33:06.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.272+0000 7fb69a3b1700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb69406e030 0x7fb694146b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:06.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.272+0000 7fb69a3b1700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb6940cd5e0 0x7fb6940ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:06.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.272+0000 7fb69a3b1700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb69415cf70 0x7fb694069ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:06.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.272+0000 7fb69a3b1700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6940cbf30 con 0x7fb69415cf70 2023-07-05T23:33:06.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.272+0000 7fb69a3b1700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6940cb2b0 con 0x7fb69406e030 2023-07-05T23:33:06.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.272+0000 7fb69a3b1700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6940cb590 con 0x7fb6940cd5e0 2023-07-05T23:33:06.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.272+0000 7fb69894e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb69415cf70 0x7fb694069ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:06.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.272+0000 7fb69894e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb69415cf70 0x7fb694069ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45006/0 (socket says 172.21.15.27:45006) 2023-07-05T23:33:06.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.272+0000 7fb69894e700 1 -- 172.21.15.27:0/1641631321 learned_addr learned my addr 172.21.15.27:0/1641631321 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:06.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.272+0000 7fb693fff700 1 --2- 172.21.15.27:0/1641631321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb69406e030 0x7fb694146b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:06.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.272+0000 7fb6937fe700 1 --2- 172.21.15.27:0/1641631321 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb6940cd5e0 0x7fb6940ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:06.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.272+0000 7fb69894e700 1 -- 172.21.15.27:0/1641631321 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb6940cd5e0 msgr2=0x7fb6940ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:06.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.272+0000 7fb69894e700 1 --2- 172.21.15.27:0/1641631321 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb6940cd5e0 0x7fb6940ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:06.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.272+0000 7fb69894e700 1 -- 172.21.15.27:0/1641631321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb69406e030 msgr2=0x7fb694146b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:06.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.272+0000 7fb69894e700 1 --2- 172.21.15.27:0/1641631321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb69406e030 0x7fb694146b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:06.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.272+0000 7fb69894e700 1 -- 172.21.15.27:0/1641631321 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6880094a0 con 0x7fb69415cf70 2023-07-05T23:33:06.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.272+0000 7fb69894e700 1 --2- 172.21.15.27:0/1641631321 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb69415cf70 0x7fb694069ef0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb68c00cba0 tx=0x7fb68c00ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:06.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.273+0000 7fb690ff9700 1 -- 172.21.15.27:0/1641631321 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68c00aaa0 con 0x7fb69415cf70 2023-07-05T23:33:06.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.273+0000 7fb690ff9700 1 -- 172.21.15.27:0/1641631321 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb68c00ac20 con 0x7fb69415cf70 2023-07-05T23:33:06.284 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.273+0000 7fb69a3b1700 1 -- 172.21.15.27:0/1641631321 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6940cb870 con 0x7fb69415cf70 2023-07-05T23:33:06.284 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.273+0000 7fb690ff9700 1 -- 172.21.15.27:0/1641631321 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68c0070d0 con 0x7fb69415cf70 2023-07-05T23:33:06.284 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.273+0000 7fb69a3b1700 1 -- 172.21.15.27:0/1641631321 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6941470c0 con 0x7fb69415cf70 2023-07-05T23:33:06.284 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.274+0000 7fb69a3b1700 1 -- 172.21.15.27:0/1641631321 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6940c49a0 con 0x7fb69415cf70 2023-07-05T23:33:06.284 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.274+0000 7fb690ff9700 1 -- 172.21.15.27:0/1641631321 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb68c007230 con 0x7fb69415cf70 2023-07-05T23:33:06.285 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.274+0000 7fb690ff9700 1 --2- 172.21.15.27:0/1641631321 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fb68006ace0 0x7fb68006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:06.285 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.275+0000 7fb690ff9700 1 -- 172.21.15.27:0/1641631321 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb68c089420 con 0x7fb69415cf70 2023-07-05T23:33:06.285 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.275+0000 7fb693fff700 1 --2- 172.21.15.27:0/1641631321 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fb68006ace0 0x7fb68006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:06.285 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.275+0000 7fb693fff700 1 --2- 172.21.15.27:0/1641631321 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fb68006ace0 0x7fb68006d190 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb684009bc0 tx=0x7fb6840091c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:06.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.279+0000 7fb690ff9700 1 -- 172.21.15.27:0/1641631321 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb68c054270 con 0x7fb69415cf70 2023-07-05T23:33:06.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.474+0000 7fb69a3b1700 1 -- 172.21.15.27:0/1641631321 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb69404ea20 con 0x7fb69415cf70 2023-07-05T23:33:06.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.474+0000 7fb690ff9700 1 -- 172.21.15.27:0/1641631321 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb68c057890 con 0x7fb69415cf70 2023-07-05T23:33:06.478 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2023-07-05T23:33:06.480 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.476+0000 7fb69a3b1700 1 -- 172.21.15.27:0/1641631321 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fb68006ace0 msgr2=0x7fb68006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:06.480 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.476+0000 7fb69a3b1700 1 --2- 172.21.15.27:0/1641631321 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fb68006ace0 0x7fb68006d190 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb684009bc0 tx=0x7fb6840091c0 comp rx=0 tx=0).stop 2023-07-05T23:33:06.480 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.476+0000 7fb69a3b1700 1 -- 172.21.15.27:0/1641631321 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb69415cf70 msgr2=0x7fb694069ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:06.480 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.476+0000 7fb69a3b1700 1 --2- 172.21.15.27:0/1641631321 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb69415cf70 0x7fb694069ef0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb68c00cba0 tx=0x7fb68c00ceb0 comp rx=0 tx=0).stop 2023-07-05T23:33:06.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.476+0000 7fb69a3b1700 1 -- 172.21.15.27:0/1641631321 shutdown_connections 2023-07-05T23:33:06.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.476+0000 7fb69a3b1700 1 --2- 172.21.15.27:0/1641631321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb69406e030 0x7fb694146b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:06.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.476+0000 7fb69a3b1700 1 --2- 172.21.15.27:0/1641631321 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fb68006ace0 0x7fb68006d190 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:06.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.476+0000 7fb69a3b1700 1 --2- 172.21.15.27:0/1641631321 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb69415cf70 0x7fb694069ef0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:06.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.476+0000 7fb69a3b1700 1 --2- 172.21.15.27:0/1641631321 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb6940cd5e0 0x7fb6940ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:06.482 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.476+0000 7fb69a3b1700 1 -- 172.21.15.27:0/1641631321 >> 172.21.15.27:0/1641631321 conn(0x7fb69406b920 msgr2=0x7fb694158270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:06.482 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.477+0000 7fb69a3b1700 1 -- 172.21.15.27:0/1641631321 shutdown_connections 2023-07-05T23:33:06.482 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.477+0000 7fb69a3b1700 1 -- 172.21.15.27:0/1641631321 wait complete. 2023-07-05T23:33:06.492 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-05T23:33:06.619 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.616+0000 7f3f5c79c700 1 Processor -- start 2023-07-05T23:33:06.619 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.616+0000 7f3f5c79c700 1 -- start start 2023-07-05T23:33:06.620 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.617+0000 7f3f5c79c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f3f540cb0f0 0x7f3f540cb560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:06.620 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.617+0000 7f3f5c79c700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f540cac60 con 0x7f3f54070dc0 2023-07-05T23:33:06.621 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.617+0000 7f3f5c79c700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f540ca370 con 0x7f3f54069ef0 2023-07-05T23:33:06.621 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.617+0000 7f3f5c79c700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f5415dca0 con 0x7f3f540cb0f0 2023-07-05T23:33:06.621 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.617+0000 7f3f59d37700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f3f540cb0f0 0x7f3f540cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:06.621 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.617+0000 7f3f59d37700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f3f540cb0f0 0x7f3f540cb560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45012/0 (socket says 172.21.15.27:45012) 2023-07-05T23:33:06.621 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.617+0000 7f3f5a538700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f3f54070dc0 0x7f3f54071190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:52176/0 (socket says 172.21.15.27:52176) 2023-07-05T23:33:06.621 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.617+0000 7f3f59d37700 1 -- 172.21.15.27:0/359272802 learned_addr learned my addr 172.21.15.27:0/359272802 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:06.622 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.618+0000 7f3f59d37700 1 -- 172.21.15.27:0/359272802 >> v1:172.21.15.162:6789/0 conn(0x7f3f54069ef0 legacy=0x7f3f5415cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:06.622 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.618+0000 7f3f59d37700 1 -- 172.21.15.27:0/359272802 >> v1:172.21.15.27:6789/0 conn(0x7f3f54070dc0 legacy=0x7f3f54071190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:06.622 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.618+0000 7f3f59d37700 1 -- 172.21.15.27:0/359272802 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f5415d9c0 con 0x7f3f540cb0f0 2023-07-05T23:33:06.622 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.618+0000 7f3f59d37700 1 --2- 172.21.15.27:0/359272802 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3f540cb0f0 0x7f3f540cb560 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3f500098f0 tx=0x7f3f50009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19326536925c80c0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:06.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.618+0000 7f3f59536700 1 -- 172.21.15.27:0/359272802 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f50004230 con 0x7f3f540cb0f0 2023-07-05T23:33:06.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.618+0000 7f3f59536700 1 -- 172.21.15.27:0/359272802 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f50004390 con 0x7f3f540cb0f0 2023-07-05T23:33:06.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.618+0000 7f3f59536700 1 -- 172.21.15.27:0/359272802 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f500036a0 con 0x7f3f540cb0f0 2023-07-05T23:33:06.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.618+0000 7f3f5c79c700 1 -- 172.21.15.27:0/359272802 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3f540cb0f0 msgr2=0x7f3f540cb560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:06.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.618+0000 7f3f5c79c700 1 --2- 172.21.15.27:0/359272802 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3f540cb0f0 0x7f3f540cb560 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3f500098f0 tx=0x7f3f50009c00 comp rx=0 tx=0).stop 2023-07-05T23:33:06.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.619+0000 7f3f5c79c700 1 -- 172.21.15.27:0/359272802 shutdown_connections 2023-07-05T23:33:06.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.619+0000 7f3f5c79c700 1 --2- 172.21.15.27:0/359272802 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3f540cb0f0 0x7f3f540cb560 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:06.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.619+0000 7f3f5c79c700 1 -- 172.21.15.27:0/359272802 >> 172.21.15.27:0/359272802 conn(0x7f3f540b1990 msgr2=0x7f3f540cf1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:06.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.619+0000 7f3f5c79c700 1 -- 172.21.15.27:0/359272802 shutdown_connections 2023-07-05T23:33:06.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.619+0000 7f3f5c79c700 1 -- 172.21.15.27:0/359272802 wait complete. 2023-07-05T23:33:06.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.620+0000 7f3f5c79c700 1 Processor -- start 2023-07-05T23:33:06.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.620+0000 7f3f5c79c700 1 -- start start 2023-07-05T23:33:06.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.620+0000 7f3f5c79c700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f54069ef0 0x7f3f5414c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:06.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.620+0000 7f3f5c79c700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3f54070dc0 0x7f3f54155e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:06.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.620+0000 7f3f5c79c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3f540cb0f0 0x7f3f540c72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:06.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.620+0000 7f3f5c79c700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f541f05f0 con 0x7f3f540cb0f0 2023-07-05T23:33:06.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.620+0000 7f3f5c79c700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f54156810 con 0x7f3f54069ef0 2023-07-05T23:33:06.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.620+0000 7f3f5c79c700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f54159f20 con 0x7f3f54070dc0 2023-07-05T23:33:06.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.621+0000 7f3f5ad39700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3f540cb0f0 0x7f3f540c72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:06.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.621+0000 7f3f5ad39700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3f540cb0f0 0x7f3f540c72c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45020/0 (socket says 172.21.15.27:45020) 2023-07-05T23:33:06.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.621+0000 7f3f5ad39700 1 -- 172.21.15.27:0/1717797373 learned_addr learned my addr 172.21.15.27:0/1717797373 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:06.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.621+0000 7f3f59d37700 1 --2- 172.21.15.27:0/1717797373 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3f54070dc0 0x7f3f54155e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:06.628 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.621+0000 7f3f5a538700 1 --2- 172.21.15.27:0/1717797373 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f54069ef0 0x7f3f5414c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:06.628 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.621+0000 7f3f5ad39700 1 -- 172.21.15.27:0/1717797373 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3f54070dc0 msgr2=0x7f3f54155e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:06.628 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.621+0000 7f3f5ad39700 1 --2- 172.21.15.27:0/1717797373 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3f54070dc0 0x7f3f54155e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:06.628 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.621+0000 7f3f5ad39700 1 -- 172.21.15.27:0/1717797373 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f54069ef0 msgr2=0x7f3f5414c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:06.628 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.621+0000 7f3f5ad39700 1 --2- 172.21.15.27:0/1717797373 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f54069ef0 0x7f3f5414c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:06.628 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.621+0000 7f3f5ad39700 1 -- 172.21.15.27:0/1717797373 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f50009550 con 0x7f3f540cb0f0 2023-07-05T23:33:06.628 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.621+0000 7f3f59d37700 1 --2- 172.21.15.27:0/1717797373 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3f54070dc0 0x7f3f54155e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T23:33:06.629 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.621+0000 7f3f5a538700 1 --2- 172.21.15.27:0/1717797373 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f54069ef0 0x7f3f5414c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T23:33:06.629 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.621+0000 7f3f5ad39700 1 --2- 172.21.15.27:0/1717797373 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3f540cb0f0 0x7f3f540c72c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c00b970 tx=0x7f3f4c00bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:06.629 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.621+0000 7f3f4affd700 1 -- 172.21.15.27:0/1717797373 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4c00c9b0 con 0x7f3f540cb0f0 2023-07-05T23:33:06.629 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.621+0000 7f3f4affd700 1 -- 172.21.15.27:0/1717797373 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f4c00cb10 con 0x7f3f540cb0f0 2023-07-05T23:33:06.629 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.621+0000 7f3f4affd700 1 -- 172.21.15.27:0/1717797373 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4c014440 con 0x7f3f540cb0f0 2023-07-05T23:33:06.629 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.621+0000 7f3f5c79c700 1 -- 172.21.15.27:0/1717797373 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f5415a200 con 0x7f3f540cb0f0 2023-07-05T23:33:06.629 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.621+0000 7f3f5c79c700 1 -- 172.21.15.27:0/1717797373 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f54156a60 con 0x7f3f540cb0f0 2023-07-05T23:33:06.630 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.622+0000 7f3f5c79c700 1 -- 172.21.15.27:0/1717797373 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f54156c80 con 0x7f3f540cb0f0 2023-07-05T23:33:06.630 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.623+0000 7f3f4affd700 1 -- 172.21.15.27:0/1717797373 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3f4c01d3b0 con 0x7f3f540cb0f0 2023-07-05T23:33:06.631 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.623+0000 7f3f4affd700 1 --2- 172.21.15.27:0/1717797373 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f3f3806ace0 0x7f3f3806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:06.631 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.623+0000 7f3f4affd700 1 -- 172.21.15.27:0/1717797373 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3f4c0893d0 con 0x7f3f540cb0f0 2023-07-05T23:33:06.631 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.624+0000 7f3f5a538700 1 --2- 172.21.15.27:0/1717797373 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f3f3806ace0 0x7f3f3806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:06.631 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.624+0000 7f3f5a538700 1 --2- 172.21.15.27:0/1717797373 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f3f3806ace0 0x7f3f3806d190 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3f44000f60 tx=0x7f3f44007df0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:06.631 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.628+0000 7f3f4affd700 1 -- 172.21.15.27:0/1717797373 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3f4c054180 con 0x7f3f540cb0f0 2023-07-05T23:33:06.828 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.824+0000 7f3f5c79c700 1 -- 172.21.15.27:0/1717797373 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3f5415a720 con 0x7f3f540cb0f0 2023-07-05T23:33:06.828 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.825+0000 7f3f4affd700 1 -- 172.21.15.27:0/1717797373 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3f4c0577a0 con 0x7f3f540cb0f0 2023-07-05T23:33:06.829 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 8 2023-07-05T23:33:06.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.827+0000 7f3f5c79c700 1 -- 172.21.15.27:0/1717797373 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f3f3806ace0 msgr2=0x7f3f3806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:06.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.827+0000 7f3f5c79c700 1 --2- 172.21.15.27:0/1717797373 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f3f3806ace0 0x7f3f3806d190 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3f44000f60 tx=0x7f3f44007df0 comp rx=0 tx=0).stop 2023-07-05T23:33:06.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.827+0000 7f3f5c79c700 1 -- 172.21.15.27:0/1717797373 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3f540cb0f0 msgr2=0x7f3f540c72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:06.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.827+0000 7f3f5c79c700 1 --2- 172.21.15.27:0/1717797373 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3f540cb0f0 0x7f3f540c72c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c00b970 tx=0x7f3f4c00bd30 comp rx=0 tx=0).stop 2023-07-05T23:33:06.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.827+0000 7f3f5c79c700 1 -- 172.21.15.27:0/1717797373 shutdown_connections 2023-07-05T23:33:06.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.827+0000 7f3f5c79c700 1 --2- 172.21.15.27:0/1717797373 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f54069ef0 0x7f3f5414c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:06.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.827+0000 7f3f5c79c700 1 --2- 172.21.15.27:0/1717797373 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f3f3806ace0 0x7f3f3806d190 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:06.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.827+0000 7f3f5c79c700 1 --2- 172.21.15.27:0/1717797373 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3f540cb0f0 0x7f3f540c72c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:06.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.827+0000 7f3f5c79c700 1 --2- 172.21.15.27:0/1717797373 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3f54070dc0 0x7f3f54155e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:06.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.827+0000 7f3f5c79c700 1 -- 172.21.15.27:0/1717797373 >> 172.21.15.27:0/1717797373 conn(0x7f3f540b1990 msgr2=0x7f3f54158660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:06.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.827+0000 7f3f5c79c700 1 -- 172.21.15.27:0/1717797373 shutdown_connections 2023-07-05T23:33:06.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.827+0000 7f3f5c79c700 1 -- 172.21.15.27:0/1717797373 wait complete. 2023-07-05T23:33:06.842 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-05T23:33:06.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.966+0000 7fc65aedc700 1 Processor -- start 2023-07-05T23:33:06.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.966+0000 7fc65aedc700 1 -- start start 2023-07-05T23:33:06.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.967+0000 7fc65aedc700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc6540cfd80 0x7fc65415b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:06.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.967+0000 7fc65aedc700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc654069ef0 0x7fc65406a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:06.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.967+0000 7fc65aedc700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6540cb380 con 0x7fc65406ccd0 2023-07-05T23:33:06.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.967+0000 7fc65aedc700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc65415b7a0 con 0x7fc6540cfd80 2023-07-05T23:33:06.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.967+0000 7fc65aedc700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6540c97f0 con 0x7fc654069ef0 2023-07-05T23:33:06.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.967+0000 7fc653fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc6540cfd80 0x7fc65415b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:06.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.967+0000 7fc653fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc6540cfd80 0x7fc65415b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45026/0 (socket says 172.21.15.27:45026) 2023-07-05T23:33:06.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.967+0000 7fc653fff700 1 -- 172.21.15.27:0/3104214801 learned_addr learned my addr 172.21.15.27:0/3104214801 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:06.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.967+0000 7fc659479700 1 --2- 172.21.15.27:0/3104214801 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc654069ef0 0x7fc65406a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:06.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.968+0000 7fc653fff700 1 -- 172.21.15.27:0/3104214801 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc654069ef0 msgr2=0x7fc65406a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:06.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.968+0000 7fc653fff700 1 --2- 172.21.15.27:0/3104214801 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc654069ef0 0x7fc65406a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:06.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.968+0000 7fc653fff700 1 -- 172.21.15.27:0/3104214801 >> v1:172.21.15.162:6789/0 conn(0x7fc65406ccd0 legacy=0x7fc65406d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:06.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.968+0000 7fc653fff700 1 -- 172.21.15.27:0/3104214801 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6540cb620 con 0x7fc6540cfd80 2023-07-05T23:33:06.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.968+0000 7fc653fff700 1 --2- 172.21.15.27:0/3104214801 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6540cfd80 0x7fc65415b1c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc6400098f0 tx=0x7fc640009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a90c80cfc38a2512 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:06.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.968+0000 7fc6537fe700 1 -- 172.21.15.27:0/3104214801 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64000b8a0 con 0x7fc6540cfd80 2023-07-05T23:33:06.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.968+0000 7fc6537fe700 1 -- 172.21.15.27:0/3104214801 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc64000ba00 con 0x7fc6540cfd80 2023-07-05T23:33:06.977 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.968+0000 7fc6537fe700 1 -- 172.21.15.27:0/3104214801 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64000bd90 con 0x7fc6540cfd80 2023-07-05T23:33:06.979 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.968+0000 7fc65aedc700 1 -- 172.21.15.27:0/3104214801 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6540cfd80 msgr2=0x7fc65415b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:06.979 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.968+0000 7fc65aedc700 1 --2- 172.21.15.27:0/3104214801 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6540cfd80 0x7fc65415b1c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc6400098f0 tx=0x7fc640009c00 comp rx=0 tx=0).stop 2023-07-05T23:33:06.980 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.968+0000 7fc65aedc700 1 -- 172.21.15.27:0/3104214801 shutdown_connections 2023-07-05T23:33:06.980 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.968+0000 7fc65aedc700 1 --2- 172.21.15.27:0/3104214801 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc654069ef0 0x7fc65406a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:06.980 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.968+0000 7fc65aedc700 1 --2- 172.21.15.27:0/3104214801 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6540cfd80 0x7fc65415b1c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:06.980 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.968+0000 7fc65aedc700 1 -- 172.21.15.27:0/3104214801 >> 172.21.15.27:0/3104214801 conn(0x7fc6540b1990 msgr2=0x7fc6540cf1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:06.980 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.969+0000 7fc65aedc700 1 -- 172.21.15.27:0/3104214801 shutdown_connections 2023-07-05T23:33:06.980 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.969+0000 7fc65aedc700 1 -- 172.21.15.27:0/3104214801 wait complete. 2023-07-05T23:33:06.981 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.970+0000 7fc65aedc700 1 Processor -- start 2023-07-05T23:33:06.981 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.970+0000 7fc65aedc700 1 -- start start 2023-07-05T23:33:06.981 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.971+0000 7fc65aedc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc654069ef0 0x7fc6541569e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:06.981 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.971+0000 7fc65aedc700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc65406ccd0 0x7fc6540aff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:06.981 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.971+0000 7fc65aedc700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc6540cfd80 0x7fc654155190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:06.981 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.971+0000 7fc65aedc700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc65415c6a0 con 0x7fc654069ef0 2023-07-05T23:33:06.981 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.971+0000 7fc65aedc700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6540c7d20 con 0x7fc65406ccd0 2023-07-05T23:33:06.982 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.971+0000 7fc65aedc700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc65415bd70 con 0x7fc6540cfd80 2023-07-05T23:33:06.982 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.971+0000 7fc658c78700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc654069ef0 0x7fc6541569e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:06.982 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.971+0000 7fc658c78700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc654069ef0 0x7fc6541569e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45030/0 (socket says 172.21.15.27:45030) 2023-07-05T23:33:06.982 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.971+0000 7fc658c78700 1 -- 172.21.15.27:0/3827912800 learned_addr learned my addr 172.21.15.27:0/3827912800 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:06.982 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.971+0000 7fc659479700 1 --2- 172.21.15.27:0/3827912800 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc6540cfd80 0x7fc654155190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:06.982 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.971+0000 7fc653fff700 1 --2- 172.21.15.27:0/3827912800 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc65406ccd0 0x7fc6540aff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:06.982 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.971+0000 7fc658c78700 1 -- 172.21.15.27:0/3827912800 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc6540cfd80 msgr2=0x7fc654155190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:06.982 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.971+0000 7fc658c78700 1 --2- 172.21.15.27:0/3827912800 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc6540cfd80 0x7fc654155190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:06.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.971+0000 7fc658c78700 1 -- 172.21.15.27:0/3827912800 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc65406ccd0 msgr2=0x7fc6540aff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:06.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.971+0000 7fc658c78700 1 --2- 172.21.15.27:0/3827912800 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc65406ccd0 0x7fc6540aff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:06.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.971+0000 7fc658c78700 1 -- 172.21.15.27:0/3827912800 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc640009550 con 0x7fc654069ef0 2023-07-05T23:33:06.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.971+0000 7fc653fff700 1 --2- 172.21.15.27:0/3827912800 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc65406ccd0 0x7fc6540aff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T23:33:06.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.971+0000 7fc658c78700 1 --2- 172.21.15.27:0/3827912800 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc654069ef0 0x7fc6541569e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc64800c4e0 tx=0x7fc64800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:06.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.971+0000 7fc6517fa700 1 -- 172.21.15.27:0/3827912800 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6480052d0 con 0x7fc654069ef0 2023-07-05T23:33:06.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.971+0000 7fc6517fa700 1 -- 172.21.15.27:0/3827912800 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc648005430 con 0x7fc654069ef0 2023-07-05T23:33:06.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.971+0000 7fc65aedc700 1 -- 172.21.15.27:0/3827912800 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc65415c050 con 0x7fc654069ef0 2023-07-05T23:33:06.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.971+0000 7fc6517fa700 1 -- 172.21.15.27:0/3827912800 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6480038c0 con 0x7fc654069ef0 2023-07-05T23:33:06.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.971+0000 7fc65aedc700 1 -- 172.21.15.27:0/3827912800 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc654156f20 con 0x7fc654069ef0 2023-07-05T23:33:06.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.972+0000 7fc65aedc700 1 -- 172.21.15.27:0/3827912800 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6541570b0 con 0x7fc654069ef0 2023-07-05T23:33:06.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.973+0000 7fc6517fa700 1 -- 172.21.15.27:0/3827912800 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc648003a20 con 0x7fc654069ef0 2023-07-05T23:33:06.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.973+0000 7fc6517fa700 1 --2- 172.21.15.27:0/3827912800 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fc63806ace0 0x7fc63806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:06.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.973+0000 7fc6517fa700 1 -- 172.21.15.27:0/3827912800 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc648088c90 con 0x7fc654069ef0 2023-07-05T23:33:06.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.973+0000 7fc653fff700 1 --2- 172.21.15.27:0/3827912800 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fc63806ace0 0x7fc63806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:06.985 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.974+0000 7fc653fff700 1 --2- 172.21.15.27:0/3827912800 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fc63806ace0 0x7fc63806d190 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc6540b2510 tx=0x7fc640008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:06.985 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:06.978+0000 7fc6517fa700 1 -- 172.21.15.27:0/3827912800 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc648053a50 con 0x7fc654069ef0 2023-07-05T23:33:07.177 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.173+0000 7fc65aedc700 1 -- 172.21.15.27:0/3827912800 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc65404ea20 con 0x7fc654069ef0 2023-07-05T23:33:07.177 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.174+0000 7fc6517fa700 1 -- 172.21.15.27:0/3827912800 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc648057070 con 0x7fc654069ef0 2023-07-05T23:33:07.178 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 32 2023-07-05T23:33:07.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.176+0000 7fc65aedc700 1 -- 172.21.15.27:0/3827912800 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fc63806ace0 msgr2=0x7fc63806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:07.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.176+0000 7fc65aedc700 1 --2- 172.21.15.27:0/3827912800 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fc63806ace0 0x7fc63806d190 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc6540b2510 tx=0x7fc640008030 comp rx=0 tx=0).stop 2023-07-05T23:33:07.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.176+0000 7fc65aedc700 1 -- 172.21.15.27:0/3827912800 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc654069ef0 msgr2=0x7fc6541569e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:07.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.176+0000 7fc65aedc700 1 --2- 172.21.15.27:0/3827912800 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc654069ef0 0x7fc6541569e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc64800c4e0 tx=0x7fc64800c8a0 comp rx=0 tx=0).stop 2023-07-05T23:33:07.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.176+0000 7fc65aedc700 1 -- 172.21.15.27:0/3827912800 shutdown_connections 2023-07-05T23:33:07.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.176+0000 7fc65aedc700 1 --2- 172.21.15.27:0/3827912800 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fc63806ace0 0x7fc63806d190 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:07.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.176+0000 7fc65aedc700 1 --2- 172.21.15.27:0/3827912800 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc6540cfd80 0x7fc654155190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:07.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.176+0000 7fc65aedc700 1 --2- 172.21.15.27:0/3827912800 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc654069ef0 0x7fc6541569e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:07.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.176+0000 7fc65aedc700 1 --2- 172.21.15.27:0/3827912800 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc65406ccd0 0x7fc6540aff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:07.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.176+0000 7fc65aedc700 1 -- 172.21.15.27:0/3827912800 >> 172.21.15.27:0/3827912800 conn(0x7fc6540b1990 msgr2=0x7fc65406d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:07.183 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.176+0000 7fc65aedc700 1 -- 172.21.15.27:0/3827912800 shutdown_connections 2023-07-05T23:33:07.183 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.176+0000 7fc65aedc700 1 -- 172.21.15.27:0/3827912800 wait complete. 2023-07-05T23:33:07.191 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-05T23:33:07.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.316+0000 7f8aa0817700 1 Processor -- start 2023-07-05T23:33:07.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.316+0000 7f8aa0817700 1 -- start start 2023-07-05T23:33:07.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.317+0000 7f8aa0817700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8a9c0cd5e0 0x7f8a9c0cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:07.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.317+0000 7f8aa0817700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a9c06f0e0 con 0x7f8a9c06e030 2023-07-05T23:33:07.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.317+0000 7f8aa0817700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a9c15dd90 con 0x7f8a9c0adf40 2023-07-05T23:33:07.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.317+0000 7f8aa0817700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a9c0ce2c0 con 0x7f8a9c0cd5e0 2023-07-05T23:33:07.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.317+0000 7f8a99d9b700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f8a9c06e030 0x7f8a9c15cf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:52208/0 (socket says 172.21.15.27:52208) 2023-07-05T23:33:07.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.317+0000 7f8a99d9b700 1 -- 172.21.15.27:0/117951905 learned_addr learned my addr 172.21.15.27:0/117951905 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-07-05T23:33:07.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.317+0000 7f8a9a59c700 1 --2- 172.21.15.27:0/117951905 >> v2:172.21.15.162:3300/0 conn(0x7f8a9c0cd5e0 0x7f8a9c0cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:07.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.317+0000 7f8a9959a700 1 -- 172.21.15.27:0/117951905 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 484714769 0 0) 0x7f8a9c06f0e0 con 0x7f8a9c06e030 2023-07-05T23:33:07.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.317+0000 7f8a9959a700 1 -- 172.21.15.27:0/117951905 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a840035b0 con 0x7f8a9c06e030 2023-07-05T23:33:07.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.317+0000 7f8a9a59c700 1 -- 172.21.15.27:0/117951905 >> v1:172.21.15.162:6789/0 conn(0x7f8a9c0adf40 legacy=0x7f8a9c15d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:07.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.317+0000 7f8a9a59c700 1 -- 172.21.15.27:0/117951905 >> v1:172.21.15.27:6789/0 conn(0x7f8a9c06e030 legacy=0x7f8a9c15cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:07.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.317+0000 7f8a9a59c700 1 -- 172.21.15.27:0/117951905 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a9c0cdef0 con 0x7f8a9c0cd5e0 2023-07-05T23:33:07.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.317+0000 7f8a9959a700 1 -- 172.21.15.27:0/117951905 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2918260393 0 0) 0x7f8a9c15dd90 con 0x7f8a9c0adf40 2023-07-05T23:33:07.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.317+0000 7f8a9a59c700 1 --2- 172.21.15.27:0/117951905 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a9c0cd5e0 0x7f8a9c0cd9b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c009820 tx=0x7f8a8c009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=784b74dd629ee42a server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:07.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.318+0000 7f8a9959a700 1 -- 172.21.15.27:0/117951905 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a90001670 con 0x7f8a9c0cd5e0 2023-07-05T23:33:07.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.318+0000 7f8a9959a700 1 -- 172.21.15.27:0/117951905 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a8c005c30 con 0x7f8a9c0cd5e0 2023-07-05T23:33:07.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.318+0000 7f8a9959a700 1 -- 172.21.15.27:0/117951905 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a8c006030 con 0x7f8a9c0cd5e0 2023-07-05T23:33:07.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.318+0000 7f8aa0817700 1 -- 172.21.15.27:0/117951905 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a9c0cd5e0 msgr2=0x7f8a9c0cd9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:07.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.318+0000 7f8aa0817700 1 --2- 172.21.15.27:0/117951905 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a9c0cd5e0 0x7f8a9c0cd9b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c009820 tx=0x7f8a8c009b30 comp rx=0 tx=0).stop 2023-07-05T23:33:07.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.318+0000 7f8aa0817700 1 -- 172.21.15.27:0/117951905 shutdown_connections 2023-07-05T23:33:07.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.318+0000 7f8aa0817700 1 --2- 172.21.15.27:0/117951905 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a9c0cd5e0 0x7f8a9c0cd9b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:07.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.318+0000 7f8aa0817700 1 -- 172.21.15.27:0/117951905 >> 172.21.15.27:0/117951905 conn(0x7f8a9c06b920 msgr2=0x7f8a9c0cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:07.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.318+0000 7f8aa0817700 1 -- 172.21.15.27:0/117951905 shutdown_connections 2023-07-05T23:33:07.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.318+0000 7f8aa0817700 1 -- 172.21.15.27:0/117951905 wait complete. 2023-07-05T23:33:07.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.320+0000 7f8aa0817700 1 Processor -- start 2023-07-05T23:33:07.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.320+0000 7f8aa0817700 1 -- start start 2023-07-05T23:33:07.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.320+0000 7f8aa0817700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a9c06e030 0x7f8a9c158340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:07.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.320+0000 7f8aa0817700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a9c0adf40 0x7f8a9c0cffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:07.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.320+0000 7f8aa0817700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a9c0cd5e0 0x7f8a9c153ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:07.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.320+0000 7f8aa0817700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9c0c6310 con 0x7f8a9c06e030 2023-07-05T23:33:07.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.320+0000 7f8aa0817700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9c0c5690 con 0x7f8a9c0cd5e0 2023-07-05T23:33:07.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.320+0000 7f8aa0817700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9c0c5970 con 0x7f8a9c0adf40 2023-07-05T23:33:07.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.321+0000 7f8a9a59c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a9c06e030 0x7f8a9c158340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:07.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.321+0000 7f8a9a59c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a9c06e030 0x7f8a9c158340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45044/0 (socket says 172.21.15.27:45044) 2023-07-05T23:33:07.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.321+0000 7f8a9a59c700 1 -- 172.21.15.27:0/2677225470 learned_addr learned my addr 172.21.15.27:0/2677225470 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:07.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.321+0000 7f8a9ad9d700 1 --2- 172.21.15.27:0/2677225470 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a9c0cd5e0 0x7f8a9c153ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:07.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.321+0000 7f8a99d9b700 1 --2- 172.21.15.27:0/2677225470 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a9c0adf40 0x7f8a9c0cffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:07.330 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.321+0000 7f8a9a59c700 1 -- 172.21.15.27:0/2677225470 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a9c0adf40 msgr2=0x7f8a9c0cffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:07.330 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.321+0000 7f8a9a59c700 1 --2- 172.21.15.27:0/2677225470 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a9c0adf40 0x7f8a9c0cffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:07.330 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.321+0000 7f8a9a59c700 1 -- 172.21.15.27:0/2677225470 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a9c0cd5e0 msgr2=0x7f8a9c153ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:07.330 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.321+0000 7f8a9a59c700 1 --2- 172.21.15.27:0/2677225470 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a9c0cd5e0 0x7f8a9c153ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:07.330 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.321+0000 7f8a9a59c700 1 -- 172.21.15.27:0/2677225470 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a8c009430 con 0x7f8a9c06e030 2023-07-05T23:33:07.330 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.321+0000 7f8a9ad9d700 1 --2- 172.21.15.27:0/2677225470 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a9c0cd5e0 0x7f8a9c153ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T23:33:07.331 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.321+0000 7f8a99d9b700 1 --2- 172.21.15.27:0/2677225470 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a9c0adf40 0x7f8a9c0cffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T23:33:07.331 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.321+0000 7f8a9a59c700 1 --2- 172.21.15.27:0/2677225470 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a9c06e030 0x7f8a9c158340 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c000c00 tx=0x7f8a8c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:07.331 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.321+0000 7f8a8affd700 1 -- 172.21.15.27:0/2677225470 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a8c003c70 con 0x7f8a9c06e030 2023-07-05T23:33:07.331 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.321+0000 7f8a8affd700 1 -- 172.21.15.27:0/2677225470 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a8c003dd0 con 0x7f8a9c06e030 2023-07-05T23:33:07.331 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.321+0000 7f8aa0817700 1 -- 172.21.15.27:0/2677225470 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a9c0c5c50 con 0x7f8a9c06e030 2023-07-05T23:33:07.332 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.321+0000 7f8a8affd700 1 -- 172.21.15.27:0/2677225470 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a8c0126c0 con 0x7f8a9c06e030 2023-07-05T23:33:07.332 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.321+0000 7f8aa0817700 1 -- 172.21.15.27:0/2677225470 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a9c158880 con 0x7f8a9c06e030 2023-07-05T23:33:07.332 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.322+0000 7f8aa0817700 1 -- 172.21.15.27:0/2677225470 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a9c158a10 con 0x7f8a9c06e030 2023-07-05T23:33:07.332 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.323+0000 7f8a8affd700 1 -- 172.21.15.27:0/2677225470 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8a8c012820 con 0x7f8a9c06e030 2023-07-05T23:33:07.333 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.323+0000 7f8a8affd700 1 --2- 172.21.15.27:0/2677225470 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f8a7c06ace0 0x7f8a7c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:07.333 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.323+0000 7f8a8affd700 1 -- 172.21.15.27:0/2677225470 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8a8c08b090 con 0x7f8a9c06e030 2023-07-05T23:33:07.333 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.323+0000 7f8a99d9b700 1 --2- 172.21.15.27:0/2677225470 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f8a7c06ace0 0x7f8a7c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:07.333 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.324+0000 7f8a99d9b700 1 --2- 172.21.15.27:0/2677225470 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f8a7c06ace0 0x7f8a7c06d190 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8a90007a90 tx=0x7f8a90009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:07.333 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.327+0000 7f8a8affd700 1 -- 172.21.15.27:0/2677225470 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8a8c055dc0 con 0x7f8a9c06e030 2023-07-05T23:33:07.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.522+0000 7f8aa0817700 1 -- 172.21.15.27:0/2677225470 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8a9c1405d0 con 0x7f8a9c06e030 2023-07-05T23:33:07.526 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.523+0000 7f8a8affd700 1 -- 172.21.15.27:0/2677225470 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8a8c0593e0 con 0x7f8a9c06e030 2023-07-05T23:33:07.526 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2023-07-05T23:33:07.528 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.525+0000 7f8aa0817700 1 -- 172.21.15.27:0/2677225470 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f8a7c06ace0 msgr2=0x7f8a7c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:07.528 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.525+0000 7f8aa0817700 1 --2- 172.21.15.27:0/2677225470 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f8a7c06ace0 0x7f8a7c06d190 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8a90007a90 tx=0x7f8a90009040 comp rx=0 tx=0).stop 2023-07-05T23:33:07.529 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.525+0000 7f8aa0817700 1 -- 172.21.15.27:0/2677225470 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a9c06e030 msgr2=0x7f8a9c158340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:07.529 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.525+0000 7f8aa0817700 1 --2- 172.21.15.27:0/2677225470 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a9c06e030 0x7f8a9c158340 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c000c00 tx=0x7f8a8c004750 comp rx=0 tx=0).stop 2023-07-05T23:33:07.529 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.525+0000 7f8aa0817700 1 -- 172.21.15.27:0/2677225470 shutdown_connections 2023-07-05T23:33:07.529 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.525+0000 7f8aa0817700 1 --2- 172.21.15.27:0/2677225470 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a9c0cd5e0 0x7f8a9c153ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:07.529 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.525+0000 7f8aa0817700 1 --2- 172.21.15.27:0/2677225470 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f8a7c06ace0 0x7f8a7c06d190 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:07.529 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.525+0000 7f8aa0817700 1 --2- 172.21.15.27:0/2677225470 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a9c06e030 0x7f8a9c158340 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:07.530 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.525+0000 7f8aa0817700 1 --2- 172.21.15.27:0/2677225470 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a9c0adf40 0x7f8a9c0cffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:07.531 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.525+0000 7f8aa0817700 1 -- 172.21.15.27:0/2677225470 >> 172.21.15.27:0/2677225470 conn(0x7f8a9c06b920 msgr2=0x7f8a9c0acf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:07.531 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.525+0000 7f8aa0817700 1 -- 172.21.15.27:0/2677225470 shutdown_connections 2023-07-05T23:33:07.531 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.525+0000 7f8aa0817700 1 -- 172.21.15.27:0/2677225470 wait complete. 2023-07-05T23:33:07.540 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-05T23:33:07.668 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.665+0000 7f07a7bfa700 1 Processor -- start 2023-07-05T23:33:07.669 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.665+0000 7f07a7bfa700 1 -- start start 2023-07-05T23:33:07.671 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.666+0000 7f07a7bfa700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f07a00cb0f0 0x7f07a00cb560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:07.671 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.666+0000 7f07a7bfa700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07a00cac60 con 0x7f07a0069ef0 2023-07-05T23:33:07.671 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.666+0000 7f07a7bfa700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07a00ca370 con 0x7f07a0070dc0 2023-07-05T23:33:07.672 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.666+0000 7f07a7bfa700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07a015dca0 con 0x7f07a00cb0f0 2023-07-05T23:33:07.672 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.666+0000 7f07a5195700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f07a00cb0f0 0x7f07a00cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:07.672 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.666+0000 7f07a6197700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f07a0069ef0 0x7f07a015cc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:52222/0 (socket says 172.21.15.27:52222) 2023-07-05T23:33:07.672 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.666+0000 7f07a6197700 1 -- 172.21.15.27:0/1385864137 learned_addr learned my addr 172.21.15.27:0/1385864137 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-07-05T23:33:07.672 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.667+0000 7f07a5195700 1 -- 172.21.15.27:0/1385864137 >> v1:172.21.15.162:6789/0 conn(0x7f07a0070dc0 legacy=0x7f07a0071190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:07.672 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.667+0000 7f07a5195700 1 -- 172.21.15.27:0/1385864137 >> v1:172.21.15.27:6789/0 conn(0x7f07a0069ef0 legacy=0x7f07a015cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:07.673 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.667+0000 7f07a5195700 1 -- 172.21.15.27:0/1385864137 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a015d9c0 con 0x7f07a00cb0f0 2023-07-05T23:33:07.673 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.667+0000 7f07a5195700 1 --2- 172.21.15.27:0/1385864137 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f07a00cb0f0 0x7f07a00cb560 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0790009840 tx=0x7f0790009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a36d97125204bda server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:07.673 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.667+0000 7f07a4994700 1 -- 172.21.15.27:0/1385864137 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0790004230 con 0x7f07a00cb0f0 2023-07-05T23:33:07.673 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.667+0000 7f07a4994700 1 -- 172.21.15.27:0/1385864137 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0790004390 con 0x7f07a00cb0f0 2023-07-05T23:33:07.673 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.667+0000 7f07a4994700 1 -- 172.21.15.27:0/1385864137 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07900036a0 con 0x7f07a00cb0f0 2023-07-05T23:33:07.674 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.668+0000 7f07a7bfa700 1 -- 172.21.15.27:0/1385864137 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f07a00cb0f0 msgr2=0x7f07a00cb560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:07.674 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.668+0000 7f07a7bfa700 1 --2- 172.21.15.27:0/1385864137 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f07a00cb0f0 0x7f07a00cb560 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0790009840 tx=0x7f0790009b50 comp rx=0 tx=0).stop 2023-07-05T23:33:07.674 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.668+0000 7f07a7bfa700 1 -- 172.21.15.27:0/1385864137 shutdown_connections 2023-07-05T23:33:07.674 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.668+0000 7f07a7bfa700 1 --2- 172.21.15.27:0/1385864137 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f07a00cb0f0 0x7f07a00cb560 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:07.674 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.668+0000 7f07a7bfa700 1 -- 172.21.15.27:0/1385864137 >> 172.21.15.27:0/1385864137 conn(0x7f07a00b1990 msgr2=0x7f07a00cf1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:07.674 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.668+0000 7f07a7bfa700 1 -- 172.21.15.27:0/1385864137 shutdown_connections 2023-07-05T23:33:07.675 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.668+0000 7f07a7bfa700 1 -- 172.21.15.27:0/1385864137 wait complete. 2023-07-05T23:33:07.679 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.669+0000 7f07a7bfa700 1 Processor -- start 2023-07-05T23:33:07.679 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.669+0000 7f07a7bfa700 1 -- start start 2023-07-05T23:33:07.679 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.670+0000 7f07a7bfa700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f07a0069ef0 0x7f07a01e2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:07.680 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.670+0000 7f07a7bfa700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f07a0070dc0 0x7f07a01486d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:07.680 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.670+0000 7f07a7bfa700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07a00cb0f0 0x7f07a00c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:07.680 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.670+0000 7f07a7bfa700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a0148c10 con 0x7f07a0070dc0 2023-07-05T23:33:07.680 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.670+0000 7f07a7bfa700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a01e3ce0 con 0x7f07a00cb0f0 2023-07-05T23:33:07.680 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.670+0000 7f07a7bfa700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07a00c91d0 con 0x7f07a0069ef0 2023-07-05T23:33:07.680 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.670+0000 7f07a5195700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f07a0070dc0 0x7f07a01486d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:07.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.670+0000 7f07a5195700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f07a0070dc0 0x7f07a01486d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45060/0 (socket says 172.21.15.27:45060) 2023-07-05T23:33:07.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.670+0000 7f07a5195700 1 -- 172.21.15.27:0/906982931 learned_addr learned my addr 172.21.15.27:0/906982931 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:07.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.670+0000 7f07a6197700 1 --2- 172.21.15.27:0/906982931 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07a00cb0f0 0x7f07a00c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:07.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.670+0000 7f07a5996700 1 --2- 172.21.15.27:0/906982931 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f07a0069ef0 0x7f07a01e2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:07.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.670+0000 7f07a5195700 1 -- 172.21.15.27:0/906982931 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f07a0069ef0 msgr2=0x7f07a01e2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:07.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.670+0000 7f07a5195700 1 --2- 172.21.15.27:0/906982931 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f07a0069ef0 0x7f07a01e2af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:07.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.670+0000 7f07a5195700 1 -- 172.21.15.27:0/906982931 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07a00cb0f0 msgr2=0x7f07a00c8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:07.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.670+0000 7f07a5195700 1 --2- 172.21.15.27:0/906982931 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07a00cb0f0 0x7f07a00c8c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:07.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.670+0000 7f07a5195700 1 -- 172.21.15.27:0/906982931 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07900094a0 con 0x7f07a0070dc0 2023-07-05T23:33:07.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.670+0000 7f07a5996700 1 --2- 172.21.15.27:0/906982931 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f07a0069ef0 0x7f07a01e2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T23:33:07.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.670+0000 7f07a5195700 1 --2- 172.21.15.27:0/906982931 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f07a0070dc0 0x7f07a01486d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f07900090b0 tx=0x7f07900047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:07.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.670+0000 7f07967fc700 1 -- 172.21.15.27:0/906982931 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0790011630 con 0x7f07a0070dc0 2023-07-05T23:33:07.683 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.670+0000 7f07967fc700 1 -- 172.21.15.27:0/906982931 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0790011790 con 0x7f07a0070dc0 2023-07-05T23:33:07.683 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.670+0000 7f07a7bfa700 1 -- 172.21.15.27:0/906982931 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07a01e4170 con 0x7f07a0070dc0 2023-07-05T23:33:07.683 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.670+0000 7f07967fc700 1 -- 172.21.15.27:0/906982931 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0790011b40 con 0x7f07a0070dc0 2023-07-05T23:33:07.683 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.670+0000 7f07a7bfa700 1 -- 172.21.15.27:0/906982931 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07a01e33b0 con 0x7f07a0070dc0 2023-07-05T23:33:07.683 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.671+0000 7f07a7bfa700 1 -- 172.21.15.27:0/906982931 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07a00ca5f0 con 0x7f07a0070dc0 2023-07-05T23:33:07.683 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.672+0000 7f07967fc700 1 -- 172.21.15.27:0/906982931 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0790011ca0 con 0x7f07a0070dc0 2023-07-05T23:33:07.683 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.672+0000 7f07967fc700 1 --2- 172.21.15.27:0/906982931 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f078406ace0 0x7f078406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:07.684 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.672+0000 7f07967fc700 1 -- 172.21.15.27:0/906982931 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f079008af80 con 0x7f07a0070dc0 2023-07-05T23:33:07.684 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.672+0000 7f07a5996700 1 --2- 172.21.15.27:0/906982931 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f078406ace0 0x7f078406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:07.684 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.673+0000 7f07a5996700 1 --2- 172.21.15.27:0/906982931 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f078406ace0 0x7f078406d190 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f079c009930 tx=0x7f079c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:07.685 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.677+0000 7f07967fc700 1 -- 172.21.15.27:0/906982931 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f07900bd310 con 0x7f07a0070dc0 2023-07-05T23:33:07.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.874+0000 7f07a7bfa700 1 -- 172.21.15.27:0/906982931 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f07a004ea20 con 0x7f07a0070dc0 2023-07-05T23:33:07.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.874+0000 7f07967fc700 1 -- 172.21.15.27:0/906982931 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f07a00ca5f0 con 0x7f07a0070dc0 2023-07-05T23:33:07.878 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 32 2023-07-05T23:33:07.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.876+0000 7f07a7bfa700 1 -- 172.21.15.27:0/906982931 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f078406ace0 msgr2=0x7f078406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:07.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.876+0000 7f07a7bfa700 1 --2- 172.21.15.27:0/906982931 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f078406ace0 0x7f078406d190 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f079c009930 tx=0x7f079c008040 comp rx=0 tx=0).stop 2023-07-05T23:33:07.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.876+0000 7f07a7bfa700 1 -- 172.21.15.27:0/906982931 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f07a0070dc0 msgr2=0x7f07a01486d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:07.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.876+0000 7f07a7bfa700 1 --2- 172.21.15.27:0/906982931 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f07a0070dc0 0x7f07a01486d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f07900090b0 tx=0x7f07900047c0 comp rx=0 tx=0).stop 2023-07-05T23:33:07.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.876+0000 7f07a7bfa700 1 -- 172.21.15.27:0/906982931 shutdown_connections 2023-07-05T23:33:07.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.876+0000 7f07a7bfa700 1 --2- 172.21.15.27:0/906982931 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07a00cb0f0 0x7f07a00c8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:07.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.876+0000 7f07a7bfa700 1 --2- 172.21.15.27:0/906982931 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f078406ace0 0x7f078406d190 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:07.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.876+0000 7f07a7bfa700 1 --2- 172.21.15.27:0/906982931 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f07a0069ef0 0x7f07a01e2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:07.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.876+0000 7f07a7bfa700 1 --2- 172.21.15.27:0/906982931 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f07a0070dc0 0x7f07a01486d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:07.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.876+0000 7f07a7bfa700 1 -- 172.21.15.27:0/906982931 >> 172.21.15.27:0/906982931 conn(0x7f07a00b1990 msgr2=0x7f07a00cf180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:07.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.876+0000 7f07a7bfa700 1 -- 172.21.15.27:0/906982931 shutdown_connections 2023-07-05T23:33:07.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:07.876+0000 7f07a7bfa700 1 -- 172.21.15.27:0/906982931 wait complete. 2023-07-05T23:33:07.891 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-05T23:33:08.016 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.013+0000 7f3eb8459700 1 Processor -- start 2023-07-05T23:33:08.017 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.013+0000 7f3eb8459700 1 -- start start 2023-07-05T23:33:08.018 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.014+0000 7f3eb8459700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3eb00cd830 0x7f3eb0160340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:08.019 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.014+0000 7f3eb8459700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3eb0160880 0x7f3eb00d0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:08.019 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.014+0000 7f3eb8459700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eb01610a0 con 0x7f3eb015c570 2023-07-05T23:33:08.019 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.014+0000 7f3eb8459700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3eb015d670 con 0x7f3eb0160880 2023-07-05T23:33:08.019 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.014+0000 7f3eb8459700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb015da90 con 0x7f3eb00cd830 2023-07-05T23:33:08.019 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.014+0000 7f3eb61f5700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f3eb015c570 0x7f3eb00cd120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:52232/0 (socket says 172.21.15.27:52232) 2023-07-05T23:33:08.019 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.014+0000 7f3eb61f5700 1 -- 172.21.15.27:0/217072451 learned_addr learned my addr 172.21.15.27:0/217072451 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-07-05T23:33:08.019 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.015+0000 7f3eb59f4700 1 --2- 172.21.15.27:0/217072451 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3eb00cd830 0x7f3eb0160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:08.020 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.015+0000 7f3eb69f6700 1 --2- 172.21.15.27:0/217072451 >> v2:172.21.15.162:3300/0 conn(0x7f3eb0160880 0x7f3eb00d0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:08.020 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.015+0000 7f3eb51f3700 1 -- 172.21.15.27:0/217072451 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3042012893 0 0) 0x7f3eb01610a0 con 0x7f3eb015c570 2023-07-05T23:33:08.020 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.015+0000 7f3eb51f3700 1 -- 172.21.15.27:0/217072451 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e9c0035b0 con 0x7f3eb015c570 2023-07-05T23:33:08.020 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.015+0000 7f3eb59f4700 1 -- 172.21.15.27:0/217072451 >> v2:172.21.15.162:3300/0 conn(0x7f3eb0160880 msgr2=0x7f3eb00d0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:08.020 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.015+0000 7f3eb59f4700 1 --2- 172.21.15.27:0/217072451 >> v2:172.21.15.162:3300/0 conn(0x7f3eb0160880 0x7f3eb00d0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:08.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.015+0000 7f3eb59f4700 1 -- 172.21.15.27:0/217072451 >> v1:172.21.15.27:6789/0 conn(0x7f3eb015c570 legacy=0x7f3eb00cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:08.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.015+0000 7f3eb51f3700 1 -- 172.21.15.27:0/217072451 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3880232711 0 0) 0x7f3e9c0035b0 con 0x7f3eb015c570 2023-07-05T23:33:08.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.015+0000 7f3eb59f4700 1 -- 172.21.15.27:0/217072451 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eb015ccd0 con 0x7f3eb00cd830 2023-07-05T23:33:08.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.015+0000 7f3eb69f6700 1 --2- 172.21.15.27:0/217072451 >> v2:172.21.15.162:3300/0 conn(0x7f3eb0160880 0x7f3eb00d0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T23:33:08.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.015+0000 7f3eb59f4700 1 --2- 172.21.15.27:0/217072451 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3eb00cd830 0x7f3eb0160340 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3eac009840 tx=0x7f3eac009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=743e4fd0fcdcc4e5 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:08.022 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.015+0000 7f3eb51f3700 1 -- 172.21.15.27:0/217072451 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea0001670 con 0x7f3eb00cd830 2023-07-05T23:33:08.022 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.015+0000 7f3eb51f3700 1 -- 172.21.15.27:0/217072451 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eac004030 con 0x7f3eb00cd830 2023-07-05T23:33:08.022 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.015+0000 7f3eb51f3700 1 -- 172.21.15.27:0/217072451 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eac0043c0 con 0x7f3eb00cd830 2023-07-05T23:33:08.025 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.016+0000 7f3eb8459700 1 -- 172.21.15.27:0/217072451 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3eb00cd830 msgr2=0x7f3eb0160340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:08.025 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.016+0000 7f3eb8459700 1 --2- 172.21.15.27:0/217072451 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3eb00cd830 0x7f3eb0160340 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3eac009840 tx=0x7f3eac009b50 comp rx=0 tx=0).stop 2023-07-05T23:33:08.025 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.016+0000 7f3eb8459700 1 -- 172.21.15.27:0/217072451 shutdown_connections 2023-07-05T23:33:08.025 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.016+0000 7f3eb8459700 1 --2- 172.21.15.27:0/217072451 >> v2:172.21.15.162:3300/0 conn(0x7f3eb0160880 0x7f3eb00d0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:08.025 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.016+0000 7f3eb8459700 1 --2- 172.21.15.27:0/217072451 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3eb00cd830 0x7f3eb0160340 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:08.025 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.016+0000 7f3eb8459700 1 -- 172.21.15.27:0/217072451 >> 172.21.15.27:0/217072451 conn(0x7f3eb0071620 msgr2=0x7f3eb00719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:08.025 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.016+0000 7f3eb8459700 1 -- 172.21.15.27:0/217072451 shutdown_connections 2023-07-05T23:33:08.026 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.016+0000 7f3eb8459700 1 -- 172.21.15.27:0/217072451 wait complete. 2023-07-05T23:33:08.026 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.017+0000 7f3eb8459700 1 Processor -- start 2023-07-05T23:33:08.026 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.017+0000 7f3eb8459700 1 -- start start 2023-07-05T23:33:08.026 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.018+0000 7f3eb8459700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3eb00cd830 0x7f3eb00c6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:08.026 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.018+0000 7f3eb8459700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3eb015c570 0x7f3eb014fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:08.027 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.018+0000 7f3eb8459700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3eb0160880 0x7f3eb00b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:08.027 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.018+0000 7f3eb8459700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb00ca990 con 0x7f3eb0160880 2023-07-05T23:33:08.027 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.018+0000 7f3eb8459700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb00cac70 con 0x7f3eb015c570 2023-07-05T23:33:08.027 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.018+0000 7f3eb8459700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb00caf50 con 0x7f3eb00cd830 2023-07-05T23:33:08.027 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.018+0000 7f3eb69f6700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3eb0160880 0x7f3eb00b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:08.027 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.018+0000 7f3eb69f6700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3eb0160880 0x7f3eb00b3aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45076/0 (socket says 172.21.15.27:45076) 2023-07-05T23:33:08.027 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.018+0000 7f3eb69f6700 1 -- 172.21.15.27:0/3744972322 learned_addr learned my addr 172.21.15.27:0/3744972322 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:08.028 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.018+0000 7f3eb61f5700 1 --2- 172.21.15.27:0/3744972322 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3eb00cd830 0x7f3eb00c6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:08.028 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.018+0000 7f3eb59f4700 1 --2- 172.21.15.27:0/3744972322 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3eb015c570 0x7f3eb014fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:08.028 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.019+0000 7f3eb69f6700 1 -- 172.21.15.27:0/3744972322 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3eb00cd830 msgr2=0x7f3eb00c6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:08.028 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.019+0000 7f3eb69f6700 1 --2- 172.21.15.27:0/3744972322 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3eb00cd830 0x7f3eb00c6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:08.028 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.019+0000 7f3eb69f6700 1 -- 172.21.15.27:0/3744972322 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3eb015c570 msgr2=0x7f3eb014fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:08.028 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.019+0000 7f3eb69f6700 1 --2- 172.21.15.27:0/3744972322 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3eb015c570 0x7f3eb014fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:08.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.019+0000 7f3eb69f6700 1 -- 172.21.15.27:0/3744972322 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea8009a70 con 0x7f3eb0160880 2023-07-05T23:33:08.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.019+0000 7f3eb69f6700 1 --2- 172.21.15.27:0/3744972322 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3eb0160880 0x7f3eb00b3aa0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3ea800efc0 tx=0x7f3ea800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:08.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.019+0000 7f3ea6ffd700 1 -- 172.21.15.27:0/3744972322 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea800ca90 con 0x7f3eb0160880 2023-07-05T23:33:08.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.019+0000 7f3ea6ffd700 1 -- 172.21.15.27:0/3744972322 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea800f040 con 0x7f3eb0160880 2023-07-05T23:33:08.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.019+0000 7f3eb8459700 1 -- 172.21.15.27:0/3744972322 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3eac0094a0 con 0x7f3eb0160880 2023-07-05T23:33:08.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.019+0000 7f3ea6ffd700 1 -- 172.21.15.27:0/3744972322 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea800ce30 con 0x7f3eb0160880 2023-07-05T23:33:08.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.019+0000 7f3eb8459700 1 -- 172.21.15.27:0/3744972322 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eb00cb510 con 0x7f3eb0160880 2023-07-05T23:33:08.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.020+0000 7f3eb8459700 1 -- 172.21.15.27:0/3744972322 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3eb01606a0 con 0x7f3eb0160880 2023-07-05T23:33:08.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.020+0000 7f3ea6ffd700 1 -- 172.21.15.27:0/3744972322 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3ea8014480 con 0x7f3eb0160880 2023-07-05T23:33:08.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.021+0000 7f3ea6ffd700 1 --2- 172.21.15.27:0/3744972322 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f3e9406ace0 0x7f3e9406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:08.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.021+0000 7f3ea6ffd700 1 -- 172.21.15.27:0/3744972322 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3ea8089dd0 con 0x7f3eb0160880 2023-07-05T23:33:08.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.021+0000 7f3eb61f5700 1 --2- 172.21.15.27:0/3744972322 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f3e9406ace0 0x7f3e9406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:08.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.021+0000 7f3eb61f5700 1 --2- 172.21.15.27:0/3744972322 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f3e9406ace0 0x7f3e9406d190 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3ea0000f60 tx=0x7f3ea0001230 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:08.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.025+0000 7f3ea6ffd700 1 -- 172.21.15.27:0/3744972322 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3ea8054b90 con 0x7f3eb0160880 2023-07-05T23:33:08.242 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.239+0000 7f3eb8459700 1 -- 172.21.15.27:0/3744972322 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3eb0073910 con 0x7f3eb0160880 2023-07-05T23:33:08.242 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.239+0000 7f3ea6ffd700 1 -- 172.21.15.27:0/3744972322 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3ea8009cd0 con 0x7f3eb0160880 2023-07-05T23:33:08.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.241+0000 7f3eb8459700 1 -- 172.21.15.27:0/3744972322 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f3e9406ace0 msgr2=0x7f3e9406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:08.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.241+0000 7f3eb8459700 1 --2- 172.21.15.27:0/3744972322 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f3e9406ace0 0x7f3e9406d190 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3ea0000f60 tx=0x7f3ea0001230 comp rx=0 tx=0).stop 2023-07-05T23:33:08.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.241+0000 7f3eb8459700 1 -- 172.21.15.27:0/3744972322 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3eb0160880 msgr2=0x7f3eb00b3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:08.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.241+0000 7f3eb8459700 1 --2- 172.21.15.27:0/3744972322 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3eb0160880 0x7f3eb00b3aa0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3ea800efc0 tx=0x7f3ea800c3a0 comp rx=0 tx=0).stop 2023-07-05T23:33:08.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.241+0000 7f3eb8459700 1 -- 172.21.15.27:0/3744972322 shutdown_connections 2023-07-05T23:33:08.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.241+0000 7f3eb8459700 1 --2- 172.21.15.27:0/3744972322 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f3e9406ace0 0x7f3e9406d190 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:08.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.241+0000 7f3eb8459700 1 --2- 172.21.15.27:0/3744972322 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3eb0160880 0x7f3eb00b3aa0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:08.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.241+0000 7f3eb8459700 1 --2- 172.21.15.27:0/3744972322 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3eb00cd830 0x7f3eb00c6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:08.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.241+0000 7f3eb8459700 1 --2- 172.21.15.27:0/3744972322 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3eb015c570 0x7f3eb014fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:08.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.241+0000 7f3eb8459700 1 -- 172.21.15.27:0/3744972322 >> 172.21.15.27:0/3744972322 conn(0x7f3eb0071620 msgr2=0x7f3eb015b530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:08.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.241+0000 7f3eb8459700 1 -- 172.21.15.27:0/3744972322 shutdown_connections 2023-07-05T23:33:08.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:08.241+0000 7f3eb8459700 1 -- 172.21.15.27:0/3744972322 wait complete. 2023-07-05T23:33:08.246 INFO:teuthology.orchestra.run.smithi027.stderr:listed 0 entries 2023-07-05T23:33:08.256 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi027.front.sepia.ceph.com... 2023-07-05T23:33:08.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:08.257 DEBUG:teuthology.orchestra.run.smithi027:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-07-05T23:33:08.289 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi027.stderr:ceph-fuse[109259]: fuse finished with error 0 and tester_r 0 2023-07-05T23:33:08.290 INFO:teuthology.orchestra.run:waiting for 300 2023-07-05T23:33:14.392 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi027.front.sepia.ceph.com 2023-07-05T23:33:14.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:14.393 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-07-05T23:33:14.425 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-05T23:33:14.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.600+0000 7f691a8e1700 1 Processor -- start 2023-07-05T23:33:14.604 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.600+0000 7f691a8e1700 1 -- start start 2023-07-05T23:33:14.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.601+0000 7f691a8e1700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69140aed30 0x7f6914160580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:14.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.601+0000 7f691a8e1700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f69140cc1d0 0x7f69140cc650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:14.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.601+0000 7f691a8e1700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69140cee80 con 0x7f6914156880 2023-07-05T23:33:14.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.601+0000 7f691a8e1700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69140ccb90 con 0x7f69140cc1d0 2023-07-05T23:33:14.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.601+0000 7f691a8e1700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69140cf100 con 0x7f69140aed30 2023-07-05T23:33:14.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.601+0000 7f6918e7e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f69140cc1d0 0x7f69140cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:14.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.601+0000 7f6918e7e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f69140cc1d0 0x7f69140cc650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45084/0 (socket says 172.21.15.27:45084) 2023-07-05T23:33:14.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.601+0000 7f6918e7e700 1 -- 172.21.15.27:0/3012070146 learned_addr learned my addr 172.21.15.27:0/3012070146 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:14.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.602+0000 7f69137fe700 1 --2- 172.21.15.27:0/3012070146 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69140aed30 0x7f6914160580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:14.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.602+0000 7f6918e7e700 1 -- 172.21.15.27:0/3012070146 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69140aed30 msgr2=0x7f6914160580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:14.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.602+0000 7f6918e7e700 1 --2- 172.21.15.27:0/3012070146 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69140aed30 0x7f6914160580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:14.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.602+0000 7f6918e7e700 1 -- 172.21.15.27:0/3012070146 >> v1:172.21.15.162:6789/0 conn(0x7f6914156880 legacy=0x7f6914069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:14.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.602+0000 7f6918e7e700 1 -- 172.21.15.27:0/3012070146 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69140cf3e0 con 0x7f69140cc1d0 2023-07-05T23:33:14.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.602+0000 7f6918e7e700 1 --2- 172.21.15.27:0/3012070146 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69140cc1d0 0x7f69140cc650 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f690c009e50 tx=0x7f690c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9841cb282dfcdaee server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:14.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.602+0000 7f6912ffd700 1 -- 172.21.15.27:0/3012070146 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690c00e070 con 0x7f69140cc1d0 2023-07-05T23:33:14.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.602+0000 7f6912ffd700 1 -- 172.21.15.27:0/3012070146 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f690c00b910 con 0x7f69140cc1d0 2023-07-05T23:33:14.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.602+0000 7f6912ffd700 1 -- 172.21.15.27:0/3012070146 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690c00bcc0 con 0x7f69140cc1d0 2023-07-05T23:33:14.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.603+0000 7f691a8e1700 1 -- 172.21.15.27:0/3012070146 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69140cc1d0 msgr2=0x7f69140cc650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:14.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.603+0000 7f691a8e1700 1 --2- 172.21.15.27:0/3012070146 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69140cc1d0 0x7f69140cc650 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f690c009e50 tx=0x7f690c00b330 comp rx=0 tx=0).stop 2023-07-05T23:33:14.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.603+0000 7f691a8e1700 1 -- 172.21.15.27:0/3012070146 shutdown_connections 2023-07-05T23:33:14.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.603+0000 7f691a8e1700 1 --2- 172.21.15.27:0/3012070146 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69140cc1d0 0x7f69140cc650 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:14.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.603+0000 7f691a8e1700 1 --2- 172.21.15.27:0/3012070146 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69140aed30 0x7f6914160580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:14.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.603+0000 7f691a8e1700 1 -- 172.21.15.27:0/3012070146 >> 172.21.15.27:0/3012070146 conn(0x7f691406d4a0 msgr2=0x7f691406d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:14.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.603+0000 7f691a8e1700 1 -- 172.21.15.27:0/3012070146 shutdown_connections 2023-07-05T23:33:14.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.603+0000 7f691a8e1700 1 -- 172.21.15.27:0/3012070146 wait complete. 2023-07-05T23:33:14.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.604+0000 7f691a8e1700 1 Processor -- start 2023-07-05T23:33:14.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.605+0000 7f691a8e1700 1 -- start start 2023-07-05T23:33:14.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.606+0000 7f691a8e1700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69140aed30 0x7f69140b3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:14.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.606+0000 7f691a8e1700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69140cc1d0 0x7f691414ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:14.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.606+0000 7f691a8e1700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6914156880 0x7f6914069ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:14.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.606+0000 7f691a8e1700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69140b3eb0 con 0x7f69140cc1d0 2023-07-05T23:33:14.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.606+0000 7f691a8e1700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69140b4190 con 0x7f6914156880 2023-07-05T23:33:14.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.606+0000 7f691a8e1700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69140b4470 con 0x7f69140aed30 2023-07-05T23:33:14.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.606+0000 7f69137fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69140cc1d0 0x7f691414ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:14.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.606+0000 7f69137fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69140cc1d0 0x7f691414ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45088/0 (socket says 172.21.15.27:45088) 2023-07-05T23:33:14.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.606+0000 7f69137fe700 1 -- 172.21.15.27:0/1099920542 learned_addr learned my addr 172.21.15.27:0/1099920542 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:14.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.606+0000 7f6913fff700 1 --2- 172.21.15.27:0/1099920542 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69140aed30 0x7f69140b3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:14.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.606+0000 7f6918e7e700 1 --2- 172.21.15.27:0/1099920542 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6914156880 0x7f6914069ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:14.616 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.606+0000 7f69137fe700 1 -- 172.21.15.27:0/1099920542 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69140aed30 msgr2=0x7f69140b3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:14.616 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.606+0000 7f69137fe700 1 --2- 172.21.15.27:0/1099920542 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69140aed30 0x7f69140b3660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:14.616 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.606+0000 7f69137fe700 1 -- 172.21.15.27:0/1099920542 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6914156880 msgr2=0x7f6914069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:14.616 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.606+0000 7f69137fe700 1 --2- 172.21.15.27:0/1099920542 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6914156880 0x7f6914069ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:14.616 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.606+0000 7f69137fe700 1 -- 172.21.15.27:0/1099920542 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f690c009b30 con 0x7f69140cc1d0 2023-07-05T23:33:14.616 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.606+0000 7f69137fe700 1 --2- 172.21.15.27:0/1099920542 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69140cc1d0 0x7f691414ebc0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f690800e870 tx=0x7f690800eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:14.616 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.606+0000 7f6910ff9700 1 -- 172.21.15.27:0/1099920542 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6908009590 con 0x7f69140cc1d0 2023-07-05T23:33:14.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.606+0000 7f6910ff9700 1 -- 172.21.15.27:0/1099920542 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6908013680 con 0x7f69140cc1d0 2023-07-05T23:33:14.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.606+0000 7f691a8e1700 1 -- 172.21.15.27:0/1099920542 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69140c4270 con 0x7f69140cc1d0 2023-07-05T23:33:14.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.607+0000 7f6910ff9700 1 -- 172.21.15.27:0/1099920542 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69080139f0 con 0x7f69140cc1d0 2023-07-05T23:33:14.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.607+0000 7f691a8e1700 1 -- 172.21.15.27:0/1099920542 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69140c3f20 con 0x7f69140cc1d0 2023-07-05T23:33:14.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.607+0000 7f691a8e1700 1 -- 172.21.15.27:0/1099920542 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69140cd180 con 0x7f69140cc1d0 2023-07-05T23:33:14.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.608+0000 7f6910ff9700 1 -- 172.21.15.27:0/1099920542 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6908013b50 con 0x7f69140cc1d0 2023-07-05T23:33:14.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.608+0000 7f6910ff9700 1 --2- 172.21.15.27:0/1099920542 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f690006ace0 0x7f690006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:14.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.608+0000 7f6910ff9700 1 -- 172.21.15.27:0/1099920542 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6908089540 con 0x7f69140cc1d0 2023-07-05T23:33:14.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.609+0000 7f6913fff700 1 --2- 172.21.15.27:0/1099920542 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f690006ace0 0x7f690006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:14.619 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.609+0000 7f6913fff700 1 --2- 172.21.15.27:0/1099920542 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f690006ace0 0x7f690006d190 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6904007fd0 tx=0x7f6904009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:14.619 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.613+0000 7f6910ff9700 1 -- 172.21.15.27:0/1099920542 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6908057e20 con 0x7f69140cc1d0 2023-07-05T23:33:14.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.811+0000 7f691a8e1700 1 -- 172.21.15.27:0/1099920542 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6914073910 con 0x7f69140cc1d0 2023-07-05T23:33:14.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.812+0000 7f6910ff9700 1 -- 172.21.15.27:0/1099920542 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20120 (secure 0 0 0) 0x7f69080579b0 con 0x7f69140cc1d0 2023-07-05T23:33:14.816 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:33:14.816 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":28,"fsid":"23eebe48-65f5-4d3c-8c2d-4aa171c055d5","created":"2023-07-05T23:32:27.989612+0000","modified":"2023-07-05T23:32:57.768949+0000","last_up_change":"2023-07-05T23:32:39.601570+0000","last_in_change":"2023-07-05T23:32:30.488261+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-05T23:32:41.624598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-05T23:32:46.481587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-05T23:32:51.025210+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-05T23:32:52.286964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-05T23:32:55.354212+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ac2071e4-394b-4385-b9ba-fad5265efc65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6814","nonce":3766536605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6818","nonce":3766536605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6823","nonce":3766536605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6821","nonce":3766536605}]},"public_addr":"172.21.15.27:6814/3766536605","cluster_addr":"172.21.15.27:6818/3766536605","heartbeat_back_addr":"172.21.15.27:6823/3766536605","heartbeat_front_addr":"172.21.15.27:6821/3766536605","state":["exists","up"]},{"osd":1,"uuid":"8c9b61a0-39d5-46bf-afd6-5add78453ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6801","nonce":1579117455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6803","nonce":1579117455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6807","nonce":1579117455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6805","nonce":1579117455}]},"public_addr":"172.21.15.27:6801/1579117455","cluster_addr":"172.21.15.27:6803/1579117455","heartbeat_back_addr":"172.21.15.27:6807/1579117455","heartbeat_front_addr":"172.21.15.27:6805/1579117455","state":["exists","up"]},{"osd":2,"uuid":"dcd032a2-06b1-4055-b798-b86c71a7107d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6825","nonce":807520271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6827","nonce":807520271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6831","nonce":807520271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6829","nonce":807520271}]},"public_addr":"172.21.15.27:6825/807520271","cluster_addr":"172.21.15.27:6827/807520271","heartbeat_back_addr":"172.21.15.27:6831/807520271","heartbeat_front_addr":"172.21.15.27:6829/807520271","state":["exists","up"]},{"osd":3,"uuid":"b0ffe0fc-47ba-4636-b5ea-6bab637642c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6809","nonce":2125656143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6811","nonce":2125656143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6817","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6819","nonce":2125656143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6813","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6815","nonce":2125656143}]},"public_addr":"172.21.15.27:6809/2125656143","cluster_addr":"172.21.15.27:6811/2125656143","heartbeat_back_addr":"172.21.15.27:6819/2125656143","heartbeat_front_addr":"172.21.15.27:6815/2125656143","state":["exists","up"]},{"osd":4,"uuid":"7fab4e5a-1246-4efe-9562-10c4a6c789ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6801","nonce":2111223016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6803","nonce":2111223016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6807","nonce":2111223016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6805","nonce":2111223016}]},"public_addr":"172.21.15.162:6801/2111223016","cluster_addr":"172.21.15.162:6803/2111223016","heartbeat_back_addr":"172.21.15.162:6807/2111223016","heartbeat_front_addr":"172.21.15.162:6805/2111223016","state":["exists","up"]},{"osd":5,"uuid":"110c4d9f-cef6-48ab-a818-5a81e72372af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6825","nonce":3102609008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6827","nonce":3102609008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6831","nonce":3102609008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6829","nonce":3102609008}]},"public_addr":"172.21.15.162:6825/3102609008","cluster_addr":"172.21.15.162:6827/3102609008","heartbeat_back_addr":"172.21.15.162:6831/3102609008","heartbeat_front_addr":"172.21.15.162:6829/3102609008","state":["exists","up"]},{"osd":6,"uuid":"16803bcc-2c92-4aed-954e-487938c9f24a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6809","nonce":2657688865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6811","nonce":2657688865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6815","nonce":2657688865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6813","nonce":2657688865}]},"public_addr":"172.21.15.162:6809/2657688865","cluster_addr":"172.21.15.162:6811/2657688865","heartbeat_back_addr":"172.21.15.162:6815/2657688865","heartbeat_front_addr":"172.21.15.162:6813/2657688865","state":["exists","up"]},{"osd":7,"uuid":"b7c35377-3cf2-4569-b6b9-72376eb463bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6817","nonce":2096609978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6819","nonce":2096609978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6823","nonce":2096609978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6821","nonce":2096609978}]},"public_addr":"172.21.15.162:6817/2096609978","cluster_addr":"172.21.15.162:6819/2096609978","heartbeat_back_addr":"172.21.15.162:6823/2096609978","heartbeat_front_addr":"172.21.15.162:6821/2096609978","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.735448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.645561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.759120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.682507+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.736228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.694664+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.716002+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.680485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-05T23:33:14.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.814+0000 7f691a8e1700 1 -- 172.21.15.27:0/1099920542 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f690006ace0 msgr2=0x7f690006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:14.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.814+0000 7f691a8e1700 1 --2- 172.21.15.27:0/1099920542 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f690006ace0 0x7f690006d190 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6904007fd0 tx=0x7f6904009040 comp rx=0 tx=0).stop 2023-07-05T23:33:14.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.814+0000 7f691a8e1700 1 -- 172.21.15.27:0/1099920542 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69140cc1d0 msgr2=0x7f691414ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:14.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.814+0000 7f691a8e1700 1 --2- 172.21.15.27:0/1099920542 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69140cc1d0 0x7f691414ebc0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f690800e870 tx=0x7f690800eb80 comp rx=0 tx=0).stop 2023-07-05T23:33:14.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.814+0000 7f691a8e1700 1 -- 172.21.15.27:0/1099920542 shutdown_connections 2023-07-05T23:33:14.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.814+0000 7f691a8e1700 1 --2- 172.21.15.27:0/1099920542 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6914156880 0x7f6914069ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:14.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.814+0000 7f691a8e1700 1 --2- 172.21.15.27:0/1099920542 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f690006ace0 0x7f690006d190 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:14.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.814+0000 7f691a8e1700 1 --2- 172.21.15.27:0/1099920542 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69140aed30 0x7f69140b3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:14.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.814+0000 7f691a8e1700 1 --2- 172.21.15.27:0/1099920542 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69140cc1d0 0x7f691414ebc0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:14.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.814+0000 7f691a8e1700 1 -- 172.21.15.27:0/1099920542 >> 172.21.15.27:0/1099920542 conn(0x7f691406d4a0 msgr2=0x7f691415d850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:14.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.815+0000 7f691a8e1700 1 -- 172.21.15.27:0/1099920542 shutdown_connections 2023-07-05T23:33:14.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.815+0000 7f691a8e1700 1 -- 172.21.15.27:0/1099920542 wait complete. 2023-07-05T23:33:14.830 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-05T23:33:14.954 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.951+0000 7f3bb8cd2700 1 Processor -- start 2023-07-05T23:33:14.955 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.951+0000 7f3bb8cd2700 1 -- start start 2023-07-05T23:33:14.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.952+0000 7f3bb8cd2700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3bb415d700 0x7f3bb406e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:14.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.952+0000 7f3bb8cd2700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f3bb40caea0 0x7f3bb40cb300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:14.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.952+0000 7f3bb8cd2700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bb406f220 con 0x7f3bb415cb60 2023-07-05T23:33:14.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.952+0000 7f3bb8cd2700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bb40c9e60 con 0x7f3bb40caea0 2023-07-05T23:33:14.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.952+0000 7f3bb8cd2700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bb40ca0e0 con 0x7f3bb415d700 2023-07-05T23:33:14.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.952+0000 7f3bb2d9d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f3bb40caea0 0x7f3bb40cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:14.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.953+0000 7f3bb2d9d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f3bb40caea0 0x7f3bb40cb300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45098/0 (socket says 172.21.15.27:45098) 2023-07-05T23:33:14.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.953+0000 7f3bb2d9d700 1 -- 172.21.15.27:0/702912435 learned_addr learned my addr 172.21.15.27:0/702912435 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:14.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.953+0000 7f3bb259c700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f3bb415cb60 0x7f3bb415cf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:52260/0 (socket says 172.21.15.27:52260) 2023-07-05T23:33:14.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.953+0000 7f3bb1d9b700 1 --2- 172.21.15.27:0/702912435 >> v2:172.21.15.162:3300/0 conn(0x7f3bb415d700 0x7f3bb406e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:14.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.953+0000 7f3bb2d9d700 1 -- 172.21.15.27:0/702912435 >> v2:172.21.15.162:3300/0 conn(0x7f3bb415d700 msgr2=0x7f3bb406e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:14.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.953+0000 7f3bb2d9d700 1 --2- 172.21.15.27:0/702912435 >> v2:172.21.15.162:3300/0 conn(0x7f3bb415d700 0x7f3bb406e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:14.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.953+0000 7f3bb2d9d700 1 -- 172.21.15.27:0/702912435 >> v1:172.21.15.27:6789/0 conn(0x7f3bb415cb60 legacy=0x7f3bb415cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:14.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.953+0000 7f3bb2d9d700 1 -- 172.21.15.27:0/702912435 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb40ca3c0 con 0x7f3bb40caea0 2023-07-05T23:33:14.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.953+0000 7f3bb159a700 1 -- 172.21.15.27:0/702912435 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3785610110 0 0) 0x7f3ba4001110 con 0x7f3bb415cb60 2023-07-05T23:33:14.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.953+0000 7f3bb2d9d700 1 --2- 172.21.15.27:0/702912435 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3bb40caea0 0x7f3bb40cb300 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3bac009e50 tx=0x7f3bac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4ddaca1576da3f6 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:14.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.953+0000 7f3bb159a700 1 -- 172.21.15.27:0/702912435 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac00e070 con 0x7f3bb40caea0 2023-07-05T23:33:14.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.953+0000 7f3bb159a700 1 -- 172.21.15.27:0/702912435 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bac00b8d0 con 0x7f3bb40caea0 2023-07-05T23:33:14.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.953+0000 7f3bb159a700 1 -- 172.21.15.27:0/702912435 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac00bc80 con 0x7f3bb40caea0 2023-07-05T23:33:14.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.954+0000 7f3bb8cd2700 1 -- 172.21.15.27:0/702912435 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3bb40caea0 msgr2=0x7f3bb40cb300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:14.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.954+0000 7f3bb8cd2700 1 --2- 172.21.15.27:0/702912435 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3bb40caea0 0x7f3bb40cb300 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3bac009e50 tx=0x7f3bac00b330 comp rx=0 tx=0).stop 2023-07-05T23:33:14.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.954+0000 7f3bb8cd2700 1 -- 172.21.15.27:0/702912435 shutdown_connections 2023-07-05T23:33:14.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.954+0000 7f3bb8cd2700 1 --2- 172.21.15.27:0/702912435 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3bb40caea0 0x7f3bb40cb300 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:14.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.954+0000 7f3bb8cd2700 1 --2- 172.21.15.27:0/702912435 >> v2:172.21.15.162:3300/0 conn(0x7f3bb415d700 0x7f3bb406e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:14.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.954+0000 7f3bb8cd2700 1 -- 172.21.15.27:0/702912435 >> 172.21.15.27:0/702912435 conn(0x7f3bb40b1740 msgr2=0x7f3bb406cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:14.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.954+0000 7f3bb8cd2700 1 -- 172.21.15.27:0/702912435 shutdown_connections 2023-07-05T23:33:14.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.954+0000 7f3bb8cd2700 1 -- 172.21.15.27:0/702912435 wait complete. 2023-07-05T23:33:14.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.955+0000 7f3bb8cd2700 1 Processor -- start 2023-07-05T23:33:14.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.955+0000 7f3bb8cd2700 1 -- start start 2023-07-05T23:33:14.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.956+0000 7f3bb8cd2700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3bb40caea0 0x7f3bb40b1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:14.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.956+0000 7f3bb8cd2700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3bb415cb60 0x7f3bb40cb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:14.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.956+0000 7f3bb8cd2700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3bb415d700 0x7f3bb40cbde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:14.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.956+0000 7f3bb8cd2700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb40b4ca0 con 0x7f3bb40caea0 2023-07-05T23:33:14.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.956+0000 7f3bb8cd2700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb40acbf0 con 0x7f3bb415cb60 2023-07-05T23:33:14.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.956+0000 7f3bb8cd2700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb40b2340 con 0x7f3bb415d700 2023-07-05T23:33:14.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.956+0000 7f3bb259c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3bb40caea0 0x7f3bb40b1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:14.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.956+0000 7f3bb259c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3bb40caea0 0x7f3bb40b1e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45100/0 (socket says 172.21.15.27:45100) 2023-07-05T23:33:14.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.956+0000 7f3bb259c700 1 -- 172.21.15.27:0/3886813531 learned_addr learned my addr 172.21.15.27:0/3886813531 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:14.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.956+0000 7f3bb2d9d700 1 --2- 172.21.15.27:0/3886813531 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3bb415d700 0x7f3bb40cbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:14.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.956+0000 7f3bb1d9b700 1 --2- 172.21.15.27:0/3886813531 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3bb415cb60 0x7f3bb40cb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:14.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.956+0000 7f3bb259c700 1 -- 172.21.15.27:0/3886813531 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3bb415d700 msgr2=0x7f3bb40cbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:14.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.956+0000 7f3bb259c700 1 --2- 172.21.15.27:0/3886813531 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3bb415d700 0x7f3bb40cbde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:14.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.956+0000 7f3bb259c700 1 -- 172.21.15.27:0/3886813531 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3bb415cb60 msgr2=0x7f3bb40cb8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:14.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.956+0000 7f3bb259c700 1 --2- 172.21.15.27:0/3886813531 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3bb415cb60 0x7f3bb40cb8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:14.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.956+0000 7f3bb259c700 1 -- 172.21.15.27:0/3886813531 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bac009b30 con 0x7f3bb40caea0 2023-07-05T23:33:14.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.957+0000 7f3bb259c700 1 --2- 172.21.15.27:0/3886813531 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3bb40caea0 0x7f3bb40b1e00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3ba400c520 tx=0x7f3ba400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:14.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.957+0000 7f3ba2ffd700 1 -- 172.21.15.27:0/3886813531 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba4004c80 con 0x7f3bb40caea0 2023-07-05T23:33:14.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.957+0000 7f3ba2ffd700 1 -- 172.21.15.27:0/3886813531 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ba4004e20 con 0x7f3bb40caea0 2023-07-05T23:33:14.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.957+0000 7f3bb8cd2700 1 -- 172.21.15.27:0/3886813531 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bb40b3050 con 0x7f3bb40caea0 2023-07-05T23:33:14.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.957+0000 7f3ba2ffd700 1 -- 172.21.15.27:0/3886813531 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba4007310 con 0x7f3bb40caea0 2023-07-05T23:33:14.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.957+0000 7f3bb8cd2700 1 -- 172.21.15.27:0/3886813531 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bb40b3610 con 0x7f3bb40caea0 2023-07-05T23:33:14.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.958+0000 7f3bb8cd2700 1 -- 172.21.15.27:0/3886813531 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bb40aeff0 con 0x7f3bb40caea0 2023-07-05T23:33:14.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.958+0000 7f3ba2ffd700 1 -- 172.21.15.27:0/3886813531 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3ba4007470 con 0x7f3bb40caea0 2023-07-05T23:33:14.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.959+0000 7f3ba2ffd700 1 --2- 172.21.15.27:0/3886813531 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f3b9406ace0 0x7f3b9406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:14.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.959+0000 7f3ba2ffd700 1 -- 172.21.15.27:0/3886813531 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3ba40892a0 con 0x7f3bb40caea0 2023-07-05T23:33:14.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.959+0000 7f3bb1d9b700 1 --2- 172.21.15.27:0/3886813531 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f3b9406ace0 0x7f3b9406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:14.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.959+0000 7f3bb1d9b700 1 --2- 172.21.15.27:0/3886813531 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f3b9406ace0 0x7f3b9406d190 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3bb41f5770 tx=0x7f3ba8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:14.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:14.963+0000 7f3ba2ffd700 1 -- 172.21.15.27:0/3886813531 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3ba4054060 con 0x7f3bb40caea0 2023-07-05T23:33:15.165 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.163+0000 7f3bb8cd2700 1 -- 172.21.15.27:0/3886813531 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3bb406f220 con 0x7f3bb40caea0 2023-07-05T23:33:15.166 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.164+0000 7f3ba2ffd700 1 -- 172.21.15.27:0/3886813531 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20120 (secure 0 0 0) 0x7f3bb406f220 con 0x7f3bb40caea0 2023-07-05T23:33:15.167 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:33:15.167 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":28,"fsid":"23eebe48-65f5-4d3c-8c2d-4aa171c055d5","created":"2023-07-05T23:32:27.989612+0000","modified":"2023-07-05T23:32:57.768949+0000","last_up_change":"2023-07-05T23:32:39.601570+0000","last_in_change":"2023-07-05T23:32:30.488261+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-05T23:32:41.624598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-05T23:32:46.481587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-05T23:32:51.025210+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-05T23:32:52.286964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-05T23:32:55.354212+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ac2071e4-394b-4385-b9ba-fad5265efc65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6814","nonce":3766536605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6818","nonce":3766536605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6823","nonce":3766536605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6821","nonce":3766536605}]},"public_addr":"172.21.15.27:6814/3766536605","cluster_addr":"172.21.15.27:6818/3766536605","heartbeat_back_addr":"172.21.15.27:6823/3766536605","heartbeat_front_addr":"172.21.15.27:6821/3766536605","state":["exists","up"]},{"osd":1,"uuid":"8c9b61a0-39d5-46bf-afd6-5add78453ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6801","nonce":1579117455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6803","nonce":1579117455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6807","nonce":1579117455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6805","nonce":1579117455}]},"public_addr":"172.21.15.27:6801/1579117455","cluster_addr":"172.21.15.27:6803/1579117455","heartbeat_back_addr":"172.21.15.27:6807/1579117455","heartbeat_front_addr":"172.21.15.27:6805/1579117455","state":["exists","up"]},{"osd":2,"uuid":"dcd032a2-06b1-4055-b798-b86c71a7107d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6825","nonce":807520271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6827","nonce":807520271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6831","nonce":807520271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6829","nonce":807520271}]},"public_addr":"172.21.15.27:6825/807520271","cluster_addr":"172.21.15.27:6827/807520271","heartbeat_back_addr":"172.21.15.27:6831/807520271","heartbeat_front_addr":"172.21.15.27:6829/807520271","state":["exists","up"]},{"osd":3,"uuid":"b0ffe0fc-47ba-4636-b5ea-6bab637642c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6809","nonce":2125656143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6811","nonce":2125656143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6817","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6819","nonce":2125656143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6813","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6815","nonce":2125656143}]},"public_addr":"172.21.15.27:6809/2125656143","cluster_addr":"172.21.15.27:6811/2125656143","heartbeat_back_addr":"172.21.15.27:6819/2125656143","heartbeat_front_addr":"172.21.15.27:6815/2125656143","state":["exists","up"]},{"osd":4,"uuid":"7fab4e5a-1246-4efe-9562-10c4a6c789ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6801","nonce":2111223016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6803","nonce":2111223016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6807","nonce":2111223016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6805","nonce":2111223016}]},"public_addr":"172.21.15.162:6801/2111223016","cluster_addr":"172.21.15.162:6803/2111223016","heartbeat_back_addr":"172.21.15.162:6807/2111223016","heartbeat_front_addr":"172.21.15.162:6805/2111223016","state":["exists","up"]},{"osd":5,"uuid":"110c4d9f-cef6-48ab-a818-5a81e72372af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6825","nonce":3102609008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6827","nonce":3102609008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6831","nonce":3102609008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6829","nonce":3102609008}]},"public_addr":"172.21.15.162:6825/3102609008","cluster_addr":"172.21.15.162:6827/3102609008","heartbeat_back_addr":"172.21.15.162:6831/3102609008","heartbeat_front_addr":"172.21.15.162:6829/3102609008","state":["exists","up"]},{"osd":6,"uuid":"16803bcc-2c92-4aed-954e-487938c9f24a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6809","nonce":2657688865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6811","nonce":2657688865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6815","nonce":2657688865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6813","nonce":2657688865}]},"public_addr":"172.21.15.162:6809/2657688865","cluster_addr":"172.21.15.162:6811/2657688865","heartbeat_back_addr":"172.21.15.162:6815/2657688865","heartbeat_front_addr":"172.21.15.162:6813/2657688865","state":["exists","up"]},{"osd":7,"uuid":"b7c35377-3cf2-4569-b6b9-72376eb463bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6817","nonce":2096609978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6819","nonce":2096609978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6823","nonce":2096609978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6821","nonce":2096609978}]},"public_addr":"172.21.15.162:6817/2096609978","cluster_addr":"172.21.15.162:6819/2096609978","heartbeat_back_addr":"172.21.15.162:6823/2096609978","heartbeat_front_addr":"172.21.15.162:6821/2096609978","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.735448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.645561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.759120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.682507+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.736228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.694664+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.716002+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.680485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-05T23:33:15.169 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.166+0000 7f3bb8cd2700 1 -- 172.21.15.27:0/3886813531 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f3b9406ace0 msgr2=0x7f3b9406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:15.169 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.166+0000 7f3bb8cd2700 1 --2- 172.21.15.27:0/3886813531 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f3b9406ace0 0x7f3b9406d190 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3bb41f5770 tx=0x7f3ba8008040 comp rx=0 tx=0).stop 2023-07-05T23:33:15.169 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.166+0000 7f3bb8cd2700 1 -- 172.21.15.27:0/3886813531 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3bb40caea0 msgr2=0x7f3bb40b1e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:15.169 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.166+0000 7f3bb8cd2700 1 --2- 172.21.15.27:0/3886813531 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3bb40caea0 0x7f3bb40b1e00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3ba400c520 tx=0x7f3ba400c8e0 comp rx=0 tx=0).stop 2023-07-05T23:33:15.169 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.166+0000 7f3bb8cd2700 1 -- 172.21.15.27:0/3886813531 shutdown_connections 2023-07-05T23:33:15.170 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.166+0000 7f3bb8cd2700 1 --2- 172.21.15.27:0/3886813531 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f3b9406ace0 0x7f3b9406d190 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:15.170 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.166+0000 7f3bb8cd2700 1 --2- 172.21.15.27:0/3886813531 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3bb415d700 0x7f3bb40cbde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:15.170 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.166+0000 7f3bb8cd2700 1 --2- 172.21.15.27:0/3886813531 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3bb40caea0 0x7f3bb40b1e00 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:15.170 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.166+0000 7f3bb8cd2700 1 --2- 172.21.15.27:0/3886813531 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3bb415cb60 0x7f3bb40cb8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:15.170 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.166+0000 7f3bb8cd2700 1 -- 172.21.15.27:0/3886813531 >> 172.21.15.27:0/3886813531 conn(0x7f3bb40b1740 msgr2=0x7f3bb406cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:15.170 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.166+0000 7f3bb8cd2700 1 -- 172.21.15.27:0/3886813531 shutdown_connections 2023-07-05T23:33:15.170 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.166+0000 7f3bb8cd2700 1 -- 172.21.15.27:0/3886813531 wait complete. 2023-07-05T23:33:15.181 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-05T23:33:15.308 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.305+0000 7f15e5fa6700 1 Processor -- start 2023-07-05T23:33:15.308 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.305+0000 7f15e5fa6700 1 -- start start 2023-07-05T23:33:15.315 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.306+0000 7f15e5fa6700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15e015a430 0x7f15e006e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:15.315 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.306+0000 7f15e5fa6700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f15e00acd10 0x7f15e015e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:15.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.306+0000 7f15e5fa6700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15e00aee00 con 0x7f15e00ae8b0 2023-07-05T23:33:15.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.306+0000 7f15e5fa6700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15e00af330 con 0x7f15e00acd10 2023-07-05T23:33:15.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.306+0000 7f15e5fa6700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15e006e340 con 0x7f15e015a430 2023-07-05T23:33:15.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.306+0000 7f15deffd700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f15e00ae8b0 0x7f15e00ac600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:52276/0 (socket says 172.21.15.27:52276) 2023-07-05T23:33:15.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.306+0000 7f15deffd700 1 -- 172.21.15.27:0/3969882806 learned_addr learned my addr 172.21.15.27:0/3969882806 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-07-05T23:33:15.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.306+0000 7f15df7fe700 1 --2- 172.21.15.27:0/3969882806 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15e015a430 0x7f15e006e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:15.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.306+0000 7f15dffff700 1 --2- 172.21.15.27:0/3969882806 >> v2:172.21.15.162:3300/0 conn(0x7f15e00acd10 0x7f15e015e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:15.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.306+0000 7f15de7fc700 1 -- 172.21.15.27:0/3969882806 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2884950584 0 0) 0x7f15e00aee00 con 0x7f15e00ae8b0 2023-07-05T23:33:15.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.306+0000 7f15de7fc700 1 -- 172.21.15.27:0/3969882806 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15cc0035b0 con 0x7f15e00ae8b0 2023-07-05T23:33:15.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.306+0000 7f15de7fc700 1 -- 172.21.15.27:0/3969882806 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2553123421 0 0) 0x7f15cc0035b0 con 0x7f15e00ae8b0 2023-07-05T23:33:15.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.306+0000 7f15de7fc700 1 -- 172.21.15.27:0/3969882806 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15e015a430 msgr2=0x7f15e006e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:15.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.306+0000 7f15de7fc700 1 --2- 172.21.15.27:0/3969882806 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15e015a430 0x7f15e006e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:15.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.306+0000 7f15de7fc700 1 -- 172.21.15.27:0/3969882806 >> v2:172.21.15.162:3300/0 conn(0x7f15e00acd10 msgr2=0x7f15e015e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:15.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.306+0000 7f15de7fc700 1 --2- 172.21.15.27:0/3969882806 >> v2:172.21.15.162:3300/0 conn(0x7f15e00acd10 0x7f15e015e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:15.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.306+0000 7f15de7fc700 1 -- 172.21.15.27:0/3969882806 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e00af050 con 0x7f15e00ae8b0 2023-07-05T23:33:15.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.306+0000 7f15de7fc700 1 -- 172.21.15.27:0/3969882806 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1246168953 0 0) 0x7f15c8001670 con 0x7f15e00ae8b0 2023-07-05T23:33:15.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.307+0000 7f15de7fc700 1 -- 172.21.15.27:0/3969882806 >> v1:172.21.15.27:6789/0 conn(0x7f15e00ae8b0 legacy=0x7f15e00ac600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:15.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.307+0000 7f15de7fc700 1 --2- 172.21.15.27:0/3969882806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15cc003a00 0x7f15cc003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:15.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.307+0000 7f15de7fc700 1 --2- 172.21.15.27:0/3969882806 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15e015a430 0x7f15cc004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:15.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.307+0000 7f15de7fc700 1 --2- 172.21.15.27:0/3969882806 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15cc004d90 0x7f15cc005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:15.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.307+0000 7f15de7fc700 1 -- 172.21.15.27:0/3969882806 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e00af330 con 0x7f15cc004d90 2023-07-05T23:33:15.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.307+0000 7f15de7fc700 1 -- 172.21.15.27:0/3969882806 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e006e340 con 0x7f15cc003a00 2023-07-05T23:33:15.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.307+0000 7f15de7fc700 1 -- 172.21.15.27:0/3969882806 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15cc00ba10 con 0x7f15e015a430 2023-07-05T23:33:15.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.307+0000 7f15dffff700 1 --2- 172.21.15.27:0/3969882806 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15cc004d90 0x7f15cc005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:15.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.307+0000 7f15deffd700 1 --2- 172.21.15.27:0/3969882806 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15e015a430 0x7f15cc004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:15.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.307+0000 7f15df7fe700 1 --2- 172.21.15.27:0/3969882806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15cc003a00 0x7f15cc003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:15.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.307+0000 7f15dffff700 1 -- 172.21.15.27:0/3969882806 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15e015a430 msgr2=0x7f15cc004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:15.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.307+0000 7f15dffff700 1 --2- 172.21.15.27:0/3969882806 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15e015a430 0x7f15cc004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:15.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.307+0000 7f15dffff700 1 -- 172.21.15.27:0/3969882806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15cc003a00 msgr2=0x7f15cc003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:15.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.307+0000 7f15dffff700 1 --2- 172.21.15.27:0/3969882806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15cc003a00 0x7f15cc003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:15.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.307+0000 7f15dffff700 1 -- 172.21.15.27:0/3969882806 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15cc0035b0 con 0x7f15cc004d90 2023-07-05T23:33:15.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.307+0000 7f15dffff700 1 --2- 172.21.15.27:0/3969882806 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15cc004d90 0x7f15cc005200 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f15d8009fc0 tx=0x7f15cc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a2b8b8cb9008eca server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:15.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.307+0000 7f15de7fc700 1 -- 172.21.15.27:0/3969882806 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d800ebd0 con 0x7f15cc004d90 2023-07-05T23:33:15.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.307+0000 7f15de7fc700 1 -- 172.21.15.27:0/3969882806 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15d800f040 con 0x7f15cc004d90 2023-07-05T23:33:15.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.307+0000 7f15de7fc700 1 -- 172.21.15.27:0/3969882806 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d8014480 con 0x7f15cc004d90 2023-07-05T23:33:15.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.308+0000 7f15e5fa6700 1 -- 172.21.15.27:0/3969882806 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15cc004d90 msgr2=0x7f15cc005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:15.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.308+0000 7f15e5fa6700 1 --2- 172.21.15.27:0/3969882806 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15cc004d90 0x7f15cc005200 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f15d8009fc0 tx=0x7f15cc005880 comp rx=0 tx=0).stop 2023-07-05T23:33:15.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.308+0000 7f15dffff700 1 -- 172.21.15.27:0/3969882806 reap_dead start 2023-07-05T23:33:15.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.308+0000 7f15e5fa6700 1 -- 172.21.15.27:0/3969882806 shutdown_connections 2023-07-05T23:33:15.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.308+0000 7f15e5fa6700 1 -- 172.21.15.27:0/3969882806 >> 172.21.15.27:0/3969882806 conn(0x7f15e006b920 msgr2=0x7f15e00cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:15.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.308+0000 7f15e5fa6700 1 -- 172.21.15.27:0/3969882806 shutdown_connections 2023-07-05T23:33:15.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.308+0000 7f15e5fa6700 1 -- 172.21.15.27:0/3969882806 wait complete. 2023-07-05T23:33:15.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.309+0000 7f15e5fa6700 1 Processor -- start 2023-07-05T23:33:15.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.309+0000 7f15e5fa6700 1 -- start start 2023-07-05T23:33:15.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.310+0000 7f15e5fa6700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15e0142760 0x7f15e0142b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:15.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.310+0000 7f15e5fa6700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15e00c89b0 0x7f15e00c8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:15.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.310+0000 7f15e5fa6700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15e00c6ae0 0x7f15e00c6f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:15.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.310+0000 7f15e5fa6700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e00c7490 con 0x7f15e00c6ae0 2023-07-05T23:33:15.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.310+0000 7f15e5fa6700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e00b3070 con 0x7f15e0142760 2023-07-05T23:33:15.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.310+0000 7f15e5fa6700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15e00c9420 con 0x7f15e00c89b0 2023-07-05T23:33:15.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.310+0000 7f15dffff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15e00c6ae0 0x7f15e00c6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:15.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.310+0000 7f15dffff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15e00c6ae0 0x7f15e00c6f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45124/0 (socket says 172.21.15.27:45124) 2023-07-05T23:33:15.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.310+0000 7f15dffff700 1 -- 172.21.15.27:0/2942208846 learned_addr learned my addr 172.21.15.27:0/2942208846 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:15.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.310+0000 7f15df7fe700 1 --2- 172.21.15.27:0/2942208846 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15e0142760 0x7f15e0142b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:15.330 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.310+0000 7f15deffd700 1 --2- 172.21.15.27:0/2942208846 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15e00c89b0 0x7f15e00c8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:15.330 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.311+0000 7f15dffff700 1 -- 172.21.15.27:0/2942208846 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15e00c89b0 msgr2=0x7f15e00c8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:15.330 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.311+0000 7f15dffff700 1 --2- 172.21.15.27:0/2942208846 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15e00c89b0 0x7f15e00c8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:15.330 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.311+0000 7f15dffff700 1 -- 172.21.15.27:0/2942208846 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15e0142760 msgr2=0x7f15e0142b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:15.331 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.311+0000 7f15dffff700 1 --2- 172.21.15.27:0/2942208846 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15e0142760 0x7f15e0142b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:15.331 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.311+0000 7f15dffff700 1 -- 172.21.15.27:0/2942208846 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e00c9700 con 0x7f15e00c6ae0 2023-07-05T23:33:15.331 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.311+0000 7f15dffff700 1 --2- 172.21.15.27:0/2942208846 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15e00c6ae0 0x7f15e00c6f50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f15cc0046d0 tx=0x7f15d8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:15.331 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.311+0000 7f15d7fff700 1 -- 172.21.15.27:0/2942208846 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d8007000 con 0x7f15e00c6ae0 2023-07-05T23:33:15.332 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.311+0000 7f15d7fff700 1 -- 172.21.15.27:0/2942208846 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15d8015b30 con 0x7f15e00c6ae0 2023-07-05T23:33:15.332 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.311+0000 7f15e5fa6700 1 -- 172.21.15.27:0/2942208846 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15e00c99e0 con 0x7f15e00c6ae0 2023-07-05T23:33:15.332 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.311+0000 7f15d7fff700 1 -- 172.21.15.27:0/2942208846 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d801d420 con 0x7f15e00c6ae0 2023-07-05T23:33:15.333 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.311+0000 7f15e5fa6700 1 -- 172.21.15.27:0/2942208846 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15e0143070 con 0x7f15e00c6ae0 2023-07-05T23:33:15.333 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.312+0000 7f15e5fa6700 1 -- 172.21.15.27:0/2942208846 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15e00b3500 con 0x7f15e00c6ae0 2023-07-05T23:33:15.333 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.312+0000 7f15d7fff700 1 -- 172.21.15.27:0/2942208846 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f15d801d580 con 0x7f15e00c6ae0 2023-07-05T23:33:15.335 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.313+0000 7f15d7fff700 1 --2- 172.21.15.27:0/2942208846 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f15c006ace0 0x7f15c006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:15.335 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.313+0000 7f15d7fff700 1 -- 172.21.15.27:0/2942208846 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f15d808ae00 con 0x7f15e00c6ae0 2023-07-05T23:33:15.335 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.313+0000 7f15df7fe700 1 --2- 172.21.15.27:0/2942208846 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f15c006ace0 0x7f15c006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:15.336 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.313+0000 7f15df7fe700 1 --2- 172.21.15.27:0/2942208846 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f15c006ace0 0x7f15c006d190 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f15d0009bc0 tx=0x7f15d00091c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:15.336 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.317+0000 7f15d7fff700 1 -- 172.21.15.27:0/2942208846 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f15e00b3500 con 0x7f15e00c6ae0 2023-07-05T23:33:15.563 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.561+0000 7f15e5fa6700 1 -- 172.21.15.27:0/2942208846 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f15e004ea20 con 0x7f15e00c6ae0 2023-07-05T23:33:15.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.799+0000 7f15d7fff700 1 -- 172.21.15.27:0/2942208846 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7f15d8055e30 con 0x7f15e00c6ae0 2023-07-05T23:33:15.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.801+0000 7f15e5fa6700 1 -- 172.21.15.27:0/2942208846 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f15c006ace0 msgr2=0x7f15c006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:15.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.801+0000 7f15e5fa6700 1 --2- 172.21.15.27:0/2942208846 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f15c006ace0 0x7f15c006d190 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f15d0009bc0 tx=0x7f15d00091c0 comp rx=0 tx=0).stop 2023-07-05T23:33:15.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.801+0000 7f15e5fa6700 1 -- 172.21.15.27:0/2942208846 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15e00c6ae0 msgr2=0x7f15e00c6f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:15.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.801+0000 7f15e5fa6700 1 --2- 172.21.15.27:0/2942208846 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15e00c6ae0 0x7f15e00c6f50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f15cc0046d0 tx=0x7f15d8009750 comp rx=0 tx=0).stop 2023-07-05T23:33:15.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.801+0000 7f15e5fa6700 1 -- 172.21.15.27:0/2942208846 shutdown_connections 2023-07-05T23:33:15.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.801+0000 7f15e5fa6700 1 --2- 172.21.15.27:0/2942208846 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15e0142760 0x7f15e0142b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:15.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.801+0000 7f15e5fa6700 1 --2- 172.21.15.27:0/2942208846 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f15c006ace0 0x7f15c006d190 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:15.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.801+0000 7f15e5fa6700 1 --2- 172.21.15.27:0/2942208846 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15e00c6ae0 0x7f15e00c6f50 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:15.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.801+0000 7f15e5fa6700 1 --2- 172.21.15.27:0/2942208846 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15e00c89b0 0x7f15e00c8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:15.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.801+0000 7f15e5fa6700 1 -- 172.21.15.27:0/2942208846 >> 172.21.15.27:0/2942208846 conn(0x7f15e006b920 msgr2=0x7f15e00cf970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:15.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.801+0000 7f15e5fa6700 1 -- 172.21.15.27:0/2942208846 shutdown_connections 2023-07-05T23:33:15.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.801+0000 7f15e5fa6700 1 -- 172.21.15.27:0/2942208846 wait complete. 2023-07-05T23:33:15.817 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-07-05T23:33:15.817 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-05T23:33:15.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.942+0000 7f301c4d2700 1 Processor -- start 2023-07-05T23:33:15.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.942+0000 7f301c4d2700 1 -- start start 2023-07-05T23:33:15.948 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.943+0000 7f301c4d2700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30140cd5e0 0x7f30140cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:15.949 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.943+0000 7f301c4d2700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f30140adf40 0x7f301406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:15.949 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.943+0000 7f301c4d2700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f301406f0e0 con 0x7f301406e030 2023-07-05T23:33:15.949 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.943+0000 7f301c4d2700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30140ce2c0 con 0x7f30140adf40 2023-07-05T23:33:15.950 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.943+0000 7f301c4d2700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30140cdef0 con 0x7f30140cd5e0 2023-07-05T23:33:15.950 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.943+0000 7f301aa6f700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f30140adf40 0x7f301406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:15.950 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.943+0000 7f301aa6f700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f30140adf40 0x7f301406e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45132/0 (socket says 172.21.15.27:45132) 2023-07-05T23:33:15.950 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.943+0000 7f301aa6f700 1 -- 172.21.15.27:0/3807682493 learned_addr learned my addr 172.21.15.27:0/3807682493 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:15.951 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.944+0000 7f301a26e700 1 --2- 172.21.15.27:0/3807682493 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30140cd5e0 0x7f30140cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:15.951 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.944+0000 7f301aa6f700 1 -- 172.21.15.27:0/3807682493 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30140cd5e0 msgr2=0x7f30140cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:15.951 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.944+0000 7f301aa6f700 1 --2- 172.21.15.27:0/3807682493 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30140cd5e0 0x7f30140cd9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:15.952 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.944+0000 7f301aa6f700 1 -- 172.21.15.27:0/3807682493 >> v1:172.21.15.162:6789/0 conn(0x7f301406e030 legacy=0x7f301415cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:15.952 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.944+0000 7f301aa6f700 1 -- 172.21.15.27:0/3807682493 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f301406eb20 con 0x7f30140adf40 2023-07-05T23:33:15.952 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.944+0000 7f301aa6f700 1 --2- 172.21.15.27:0/3807682493 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f30140adf40 0x7f301406e4a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f300c00d150 tx=0x7f300c00d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36fce19e4c8e0f05 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:15.952 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.944+0000 7f301926c700 1 -- 172.21.15.27:0/3807682493 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f300c010070 con 0x7f30140adf40 2023-07-05T23:33:15.953 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.944+0000 7f301926c700 1 -- 172.21.15.27:0/3807682493 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f300c00ddc0 con 0x7f30140adf40 2023-07-05T23:33:15.953 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.944+0000 7f301926c700 1 -- 172.21.15.27:0/3807682493 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f300c00b310 con 0x7f30140adf40 2023-07-05T23:33:15.953 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.945+0000 7f301c4d2700 1 -- 172.21.15.27:0/3807682493 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f30140adf40 msgr2=0x7f301406e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:15.953 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.945+0000 7f301c4d2700 1 --2- 172.21.15.27:0/3807682493 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f30140adf40 0x7f301406e4a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f300c00d150 tx=0x7f300c00d460 comp rx=0 tx=0).stop 2023-07-05T23:33:15.954 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.945+0000 7f301c4d2700 1 -- 172.21.15.27:0/3807682493 shutdown_connections 2023-07-05T23:33:15.955 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.945+0000 7f301c4d2700 1 --2- 172.21.15.27:0/3807682493 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f30140adf40 0x7f301406e4a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:15.955 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.945+0000 7f301c4d2700 1 --2- 172.21.15.27:0/3807682493 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30140cd5e0 0x7f30140cd9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:15.955 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.945+0000 7f301c4d2700 1 -- 172.21.15.27:0/3807682493 >> 172.21.15.27:0/3807682493 conn(0x7f301406b920 msgr2=0x7f30140cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:15.955 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.945+0000 7f301c4d2700 1 -- 172.21.15.27:0/3807682493 shutdown_connections 2023-07-05T23:33:15.955 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.945+0000 7f301c4d2700 1 -- 172.21.15.27:0/3807682493 wait complete. 2023-07-05T23:33:15.958 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.946+0000 7f301c4d2700 1 Processor -- start 2023-07-05T23:33:15.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.946+0000 7f301c4d2700 1 -- start start 2023-07-05T23:33:15.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.947+0000 7f301c4d2700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f301406e030 0x7f3014146f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:15.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.947+0000 7f301c4d2700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30140adf40 0x7f30141564a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:15.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.947+0000 7f301c4d2700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30140cd5e0 0x7f30141520e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:15.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.947+0000 7f301c4d2700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3014155400 con 0x7f301406e030 2023-07-05T23:33:15.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.947+0000 7f301c4d2700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30141556e0 con 0x7f30140cd5e0 2023-07-05T23:33:15.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.947+0000 7f301c4d2700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30141559c0 con 0x7f30140adf40 2023-07-05T23:33:15.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.947+0000 7f301a26e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f301406e030 0x7f3014146f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:15.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.947+0000 7f301a26e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f301406e030 0x7f3014146f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45134/0 (socket says 172.21.15.27:45134) 2023-07-05T23:33:15.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.947+0000 7f301a26e700 1 -- 172.21.15.27:0/1022531786 learned_addr learned my addr 172.21.15.27:0/1022531786 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:15.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.947+0000 7f301aa6f700 1 --2- 172.21.15.27:0/1022531786 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30140cd5e0 0x7f30141520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:15.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.947+0000 7f3019a6d700 1 --2- 172.21.15.27:0/1022531786 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30140adf40 0x7f30141564a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:15.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.947+0000 7f301a26e700 1 -- 172.21.15.27:0/1022531786 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30140adf40 msgr2=0x7f30141564a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:15.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.947+0000 7f301a26e700 1 --2- 172.21.15.27:0/1022531786 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30140adf40 0x7f30141564a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:15.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.947+0000 7f301a26e700 1 -- 172.21.15.27:0/1022531786 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30140cd5e0 msgr2=0x7f30141520e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:15.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.947+0000 7f301a26e700 1 --2- 172.21.15.27:0/1022531786 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30140cd5e0 0x7f30141520e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:15.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.947+0000 7f301a26e700 1 -- 172.21.15.27:0/1022531786 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f300c00bd40 con 0x7f301406e030 2023-07-05T23:33:15.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.947+0000 7f3019a6d700 1 --2- 172.21.15.27:0/1022531786 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30140adf40 0x7f30141564a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T23:33:15.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.947+0000 7f301a26e700 1 --2- 172.21.15.27:0/1022531786 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f301406e030 0x7f3014146f20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f300400d7d0 tx=0x7f300400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:15.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.947+0000 7f300affd700 1 -- 172.21.15.27:0/1022531786 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30040125f0 con 0x7f301406e030 2023-07-05T23:33:15.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.947+0000 7f300affd700 1 -- 172.21.15.27:0/1022531786 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3004012750 con 0x7f301406e030 2023-07-05T23:33:15.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.947+0000 7f301c4d2700 1 -- 172.21.15.27:0/1022531786 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3014155ca0 con 0x7f301406e030 2023-07-05T23:33:15.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.947+0000 7f300affd700 1 -- 172.21.15.27:0/1022531786 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3004012b00 con 0x7f301406e030 2023-07-05T23:33:15.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.948+0000 7f301c4d2700 1 -- 172.21.15.27:0/1022531786 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30141539d0 con 0x7f301406e030 2023-07-05T23:33:15.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.949+0000 7f301c4d2700 1 -- 172.21.15.27:0/1022531786 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30141562f0 con 0x7f301406e030 2023-07-05T23:33:15.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.949+0000 7f300affd700 1 -- 172.21.15.27:0/1022531786 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3004012c60 con 0x7f301406e030 2023-07-05T23:33:15.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.949+0000 7f300affd700 1 --2- 172.21.15.27:0/1022531786 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f2ff806ace0 0x7f2ff806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:15.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.950+0000 7f300affd700 1 -- 172.21.15.27:0/1022531786 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3004089780 con 0x7f301406e030 2023-07-05T23:33:15.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.950+0000 7f3019a6d700 1 --2- 172.21.15.27:0/1022531786 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f2ff806ace0 0x7f2ff806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:15.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.950+0000 7f3019a6d700 1 --2- 172.21.15.27:0/1022531786 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f2ff806ace0 0x7f2ff806d190 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f30141f61f0 tx=0x7f3010009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:15.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:15.954+0000 7f300affd700 1 -- 172.21.15.27:0/1022531786 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3004054540 con 0x7f301406e030 2023-07-05T23:33:16.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.201+0000 7f301c4d2700 1 -- 172.21.15.27:0/1022531786 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f301404ea20 con 0x7f301406e030 2023-07-05T23:33:16.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.803+0000 7f300affd700 1 -- 172.21.15.27:0/1022531786 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3004057b60 con 0x7f301406e030 2023-07-05T23:33:16.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.806+0000 7f301c4d2700 1 -- 172.21.15.27:0/1022531786 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f2ff806ace0 msgr2=0x7f2ff806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:16.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.806+0000 7f301c4d2700 1 --2- 172.21.15.27:0/1022531786 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f2ff806ace0 0x7f2ff806d190 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f30141f61f0 tx=0x7f3010009040 comp rx=0 tx=0).stop 2023-07-05T23:33:16.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.806+0000 7f301c4d2700 1 -- 172.21.15.27:0/1022531786 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f301406e030 msgr2=0x7f3014146f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:16.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.806+0000 7f301c4d2700 1 --2- 172.21.15.27:0/1022531786 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f301406e030 0x7f3014146f20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f300400d7d0 tx=0x7f300400dae0 comp rx=0 tx=0).stop 2023-07-05T23:33:16.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.806+0000 7f301c4d2700 1 -- 172.21.15.27:0/1022531786 shutdown_connections 2023-07-05T23:33:16.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.806+0000 7f301c4d2700 1 --2- 172.21.15.27:0/1022531786 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30140cd5e0 0x7f30141520e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:16.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.806+0000 7f301c4d2700 1 --2- 172.21.15.27:0/1022531786 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f2ff806ace0 0x7f2ff806d190 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:16.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.806+0000 7f301c4d2700 1 --2- 172.21.15.27:0/1022531786 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f301406e030 0x7f3014146f20 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:16.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.806+0000 7f301c4d2700 1 --2- 172.21.15.27:0/1022531786 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30140adf40 0x7f30141564a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:16.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.806+0000 7f301c4d2700 1 -- 172.21.15.27:0/1022531786 >> 172.21.15.27:0/1022531786 conn(0x7f301406b920 msgr2=0x7f30140af470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:16.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.806+0000 7f301c4d2700 1 -- 172.21.15.27:0/1022531786 shutdown_connections 2023-07-05T23:33:16.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.806+0000 7f301c4d2700 1 -- 172.21.15.27:0/1022531786 wait complete. 2023-07-05T23:33:16.824 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-05T23:33:16.825 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-05T23:33:16.958 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.954+0000 7f92574de700 1 Processor -- start 2023-07-05T23:33:16.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.954+0000 7f92574de700 1 -- start start 2023-07-05T23:33:16.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.955+0000 7f92574de700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92500ae6c0 0x7f925015a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:16.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.955+0000 7f92574de700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f92500aec10 0x7f92500714a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:16.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.955+0000 7f92574de700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92500af090 con 0x7f92500cddd0 2023-07-05T23:33:16.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.955+0000 7f92574de700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92500cdc80 con 0x7f92500aec10 2023-07-05T23:33:16.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.955+0000 7f92574de700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f925015d6a0 con 0x7f92500ae6c0 2023-07-05T23:33:16.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.955+0000 7f925527a700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f92500cddd0 0x7f92500ce1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:52308/0 (socket says 172.21.15.27:52308) 2023-07-05T23:33:16.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.955+0000 7f925527a700 1 -- 172.21.15.27:0/2473826507 learned_addr learned my addr 172.21.15.27:0/2473826507 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-07-05T23:33:16.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.955+0000 7f9255a7b700 1 --2- 172.21.15.27:0/2473826507 >> v2:172.21.15.27:3300/0 conn(0x7f92500aec10 0x7f92500714a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:16.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.955+0000 7f9247fff700 1 -- 172.21.15.27:0/2473826507 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3215700185 0 0) 0x7f92500af090 con 0x7f92500cddd0 2023-07-05T23:33:16.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.955+0000 7f9254a79700 1 --2- 172.21.15.27:0/2473826507 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92500ae6c0 0x7f925015a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:16.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.955+0000 7f9247fff700 1 -- 172.21.15.27:0/2473826507 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f923c0035b0 con 0x7f92500cddd0 2023-07-05T23:33:16.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.955+0000 7f9255a7b700 1 -- 172.21.15.27:0/2473826507 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92500ae6c0 msgr2=0x7f925015a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:16.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.955+0000 7f9255a7b700 1 --2- 172.21.15.27:0/2473826507 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92500ae6c0 0x7f925015a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:16.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.955+0000 7f9255a7b700 1 -- 172.21.15.27:0/2473826507 >> v1:172.21.15.27:6789/0 conn(0x7f92500cddd0 legacy=0x7f92500ce1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:16.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.955+0000 7f9255a7b700 1 -- 172.21.15.27:0/2473826507 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9250159700 con 0x7f92500aec10 2023-07-05T23:33:16.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.955+0000 7f9255a7b700 1 --2- 172.21.15.27:0/2473826507 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f92500aec10 0x7f92500714a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9248009d90 tx=0x7f924800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b975145e855b4c8 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:16.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.956+0000 7f9247fff700 1 -- 172.21.15.27:0/2473826507 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924800e070 con 0x7f92500aec10 2023-07-05T23:33:16.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.956+0000 7f9247fff700 1 -- 172.21.15.27:0/2473826507 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f924800bb20 con 0x7f92500aec10 2023-07-05T23:33:16.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.956+0000 7f9247fff700 1 -- 172.21.15.27:0/2473826507 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9248012430 con 0x7f92500aec10 2023-07-05T23:33:16.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.956+0000 7f92574de700 1 -- 172.21.15.27:0/2473826507 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f92500aec10 msgr2=0x7f92500714a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:16.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.956+0000 7f92574de700 1 --2- 172.21.15.27:0/2473826507 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f92500aec10 0x7f92500714a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9248009d90 tx=0x7f924800b330 comp rx=0 tx=0).stop 2023-07-05T23:33:16.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.956+0000 7f92574de700 1 -- 172.21.15.27:0/2473826507 shutdown_connections 2023-07-05T23:33:16.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.956+0000 7f92574de700 1 --2- 172.21.15.27:0/2473826507 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f92500aec10 0x7f92500714a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:16.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.956+0000 7f92574de700 1 --2- 172.21.15.27:0/2473826507 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92500ae6c0 0x7f925015a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:16.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.956+0000 7f92574de700 1 -- 172.21.15.27:0/2473826507 >> 172.21.15.27:0/2473826507 conn(0x7f925006d4a0 msgr2=0x7f925006d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:16.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.956+0000 7f92574de700 1 -- 172.21.15.27:0/2473826507 shutdown_connections 2023-07-05T23:33:16.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.956+0000 7f92574de700 1 -- 172.21.15.27:0/2473826507 wait complete. 2023-07-05T23:33:16.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.957+0000 7f92574de700 1 Processor -- start 2023-07-05T23:33:16.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.957+0000 7f92574de700 1 -- start start 2023-07-05T23:33:16.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.958+0000 7f92574de700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92500ae6c0 0x7f9250151dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:16.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.958+0000 7f92574de700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92500aec10 0x7f925014fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:16.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.958+0000 7f92574de700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f92500cddd0 0x7f9250150580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:16.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.958+0000 7f92574de700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9250152fa0 con 0x7f92500cddd0 2023-07-05T23:33:16.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.958+0000 7f92574de700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9250152300 con 0x7f92500ae6c0 2023-07-05T23:33:16.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.958+0000 7f92574de700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9250150330 con 0x7f92500aec10 2023-07-05T23:33:16.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.958+0000 7f9255a7b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f92500cddd0 0x7f9250150580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:16.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.958+0000 7f9255a7b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f92500cddd0 0x7f9250150580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45152/0 (socket says 172.21.15.27:45152) 2023-07-05T23:33:16.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.958+0000 7f9255a7b700 1 -- 172.21.15.27:0/3884979934 learned_addr learned my addr 172.21.15.27:0/3884979934 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:16.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.958+0000 7f9254a79700 1 --2- 172.21.15.27:0/3884979934 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92500aec10 0x7f925014fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:16.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.958+0000 7f925527a700 1 --2- 172.21.15.27:0/3884979934 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92500ae6c0 0x7f9250151dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:16.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.959+0000 7f9255a7b700 1 -- 172.21.15.27:0/3884979934 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92500aec10 msgr2=0x7f925014fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:16.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.959+0000 7f9255a7b700 1 --2- 172.21.15.27:0/3884979934 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92500aec10 0x7f925014fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:16.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.959+0000 7f9255a7b700 1 -- 172.21.15.27:0/3884979934 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92500ae6c0 msgr2=0x7f9250151dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:16.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.959+0000 7f9255a7b700 1 --2- 172.21.15.27:0/3884979934 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92500ae6c0 0x7f9250151dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:16.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.959+0000 7f9255a7b700 1 -- 172.21.15.27:0/3884979934 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9248009a70 con 0x7f92500cddd0 2023-07-05T23:33:16.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.959+0000 7f925527a700 1 --2- 172.21.15.27:0/3884979934 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92500ae6c0 0x7f9250151dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T23:33:16.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.959+0000 7f9255a7b700 1 --2- 172.21.15.27:0/3884979934 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f92500cddd0 0x7f9250150580 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f92500ccf50 tx=0x7f9248004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:16.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.959+0000 7f9245ffb700 1 -- 172.21.15.27:0/3884979934 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9248012430 con 0x7f92500cddd0 2023-07-05T23:33:16.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.959+0000 7f9245ffb700 1 -- 172.21.15.27:0/3884979934 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9248020070 con 0x7f92500cddd0 2023-07-05T23:33:16.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.959+0000 7f9245ffb700 1 -- 172.21.15.27:0/3884979934 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9248003ea0 con 0x7f92500cddd0 2023-07-05T23:33:16.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.959+0000 7f92574de700 1 -- 172.21.15.27:0/3884979934 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92501529e0 con 0x7f92500cddd0 2023-07-05T23:33:16.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.959+0000 7f92574de700 1 -- 172.21.15.27:0/3884979934 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92501515c0 con 0x7f92500cddd0 2023-07-05T23:33:16.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.960+0000 7f92574de700 1 -- 172.21.15.27:0/3884979934 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f925006f120 con 0x7f92500cddd0 2023-07-05T23:33:16.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.961+0000 7f9245ffb700 1 -- 172.21.15.27:0/3884979934 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9248004280 con 0x7f92500cddd0 2023-07-05T23:33:16.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.961+0000 7f9245ffb700 1 --2- 172.21.15.27:0/3884979934 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f923406ace0 0x7f923406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:16.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.961+0000 7f9245ffb700 1 -- 172.21.15.27:0/3884979934 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9248022070 con 0x7f92500cddd0 2023-07-05T23:33:16.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.961+0000 7f925527a700 1 --2- 172.21.15.27:0/3884979934 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f923406ace0 0x7f923406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:16.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.962+0000 7f925527a700 1 --2- 172.21.15.27:0/3884979934 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f923406ace0 0x7f923406d190 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f924c0011e0 tx=0x7f924c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:16.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:16.965+0000 7f9245ffb700 1 -- 172.21.15.27:0/3884979934 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9248056270 con 0x7f92500cddd0 2023-07-05T23:33:17.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.205+0000 7f92574de700 1 -- 172.21.15.27:0/3884979934 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9250151420 con 0x7f92500cddd0 2023-07-05T23:33:17.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.206+0000 7f9245ffb700 1 -- 172.21.15.27:0/3884979934 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4670 (secure 0 0 0) 0x7f9250151420 con 0x7f92500cddd0 2023-07-05T23:33:17.209 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:33:17.209 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/4263442347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":4263442347},{"type":"v1","addr":"172.21.15.162:6837","nonce":4263442347}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/2486008632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2486008632},{"type":"v1","addr":"172.21.15.162:6836","nonce":2486008632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/217781445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":217781445},{"type":"v1","addr":"172.21.15.27:6834","nonce":217781445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-05T23:32:53.313219+0000","modified":"2023-07-05T23:33:16.797372+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6835/3387103520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":3387103520},{"type":"v1","addr":"172.21.15.27:6835","nonce":3387103520}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-05T23:33:17.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.208+0000 7f92574de700 1 -- 172.21.15.27:0/3884979934 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f923406ace0 msgr2=0x7f923406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:17.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.208+0000 7f92574de700 1 --2- 172.21.15.27:0/3884979934 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f923406ace0 0x7f923406d190 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f924c0011e0 tx=0x7f924c009040 comp rx=0 tx=0).stop 2023-07-05T23:33:17.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.208+0000 7f92574de700 1 -- 172.21.15.27:0/3884979934 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f92500cddd0 msgr2=0x7f9250150580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:17.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.208+0000 7f92574de700 1 --2- 172.21.15.27:0/3884979934 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f92500cddd0 0x7f9250150580 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f92500ccf50 tx=0x7f9248004ad0 comp rx=0 tx=0).stop 2023-07-05T23:33:17.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.208+0000 7f92574de700 1 -- 172.21.15.27:0/3884979934 shutdown_connections 2023-07-05T23:33:17.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.208+0000 7f92574de700 1 --2- 172.21.15.27:0/3884979934 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92500ae6c0 0x7f9250151dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:17.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.208+0000 7f92574de700 1 --2- 172.21.15.27:0/3884979934 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f923406ace0 0x7f923406d190 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:17.213 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.208+0000 7f92574de700 1 --2- 172.21.15.27:0/3884979934 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f92500cddd0 0x7f9250150580 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:17.213 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.208+0000 7f92574de700 1 --2- 172.21.15.27:0/3884979934 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92500aec10 0x7f925014fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:17.213 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.208+0000 7f92574de700 1 -- 172.21.15.27:0/3884979934 >> 172.21.15.27:0/3884979934 conn(0x7f925006d4a0 msgr2=0x7f92500d00d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:17.213 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.208+0000 7f92574de700 1 -- 172.21.15.27:0/3884979934 shutdown_connections 2023-07-05T23:33:17.213 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.208+0000 7f92574de700 1 -- 172.21.15.27:0/3884979934 wait complete. 2023-07-05T23:33:17.214 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 9 2023-07-05T23:33:17.223 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-05T23:33:17.350 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.347+0000 7f3f6e34c700 1 Processor -- start 2023-07-05T23:33:17.350 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.347+0000 7f3f6e34c700 1 -- start start 2023-07-05T23:33:17.352 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.348+0000 7f3f6e34c700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3f680ccf90 0x7f3f680cd360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:17.352 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.348+0000 7f3f6e34c700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3f6806a890 0x7f3f6806acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:17.352 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.348+0000 7f3f6e34c700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f680cd8a0 con 0x7f3f68158850 2023-07-05T23:33:17.353 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.348+0000 7f3f6e34c700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f6815d1f0 con 0x7f3f680ccf90 2023-07-05T23:33:17.353 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.348+0000 7f3f6e34c700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6815cc30 con 0x7f3f6806a890 2023-07-05T23:33:17.353 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.348+0000 7f3f6c8e9700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3f6806a890 0x7f3f6806acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:17.353 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.348+0000 7f3f67fff700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3f680ccf90 0x7f3f680cd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:17.353 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.348+0000 7f3f6c8e9700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3f6806a890 0x7f3f6806acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.27:45196/0 (socket says 172.21.15.27:45196) 2023-07-05T23:33:17.353 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.348+0000 7f3f67fff700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3f680ccf90 0x7f3f680cd360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.27:43094/0 (socket says 172.21.15.27:43094) 2023-07-05T23:33:17.353 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.348+0000 7f3f677fe700 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f3f68158850 0x7f3f6815c1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.27:33292/0 (socket says 172.21.15.27:33292) 2023-07-05T23:33:17.354 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.348+0000 7f3f6c8e9700 1 -- 172.21.15.27:0/985800970 learned_addr learned my addr 172.21.15.27:0/985800970 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:17.354 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.349+0000 7f3f67fff700 1 -- 172.21.15.27:0/985800970 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3f6806a890 msgr2=0x7f3f6806acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:17.354 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.349+0000 7f3f67fff700 1 --2- 172.21.15.27:0/985800970 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3f6806a890 0x7f3f6806acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:17.354 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.349+0000 7f3f67fff700 1 -- 172.21.15.27:0/985800970 >> v1:172.21.15.162:6789/0 conn(0x7f3f68158850 legacy=0x7f3f6815c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:17.354 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.349+0000 7f3f67fff700 1 -- 172.21.15.27:0/985800970 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f6815cf10 con 0x7f3f680ccf90 2023-07-05T23:33:17.354 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.349+0000 7f3f66ffd700 1 -- 172.21.15.27:0/985800970 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1387571668 0 0) 0x7f3f680cd8a0 con 0x7f3f68158850 2023-07-05T23:33:17.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.349+0000 7f3f67fff700 1 --2- 172.21.15.27:0/985800970 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f680ccf90 0x7f3f680cd360 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3f58009840 tx=0x7f3f58009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a638c9ee1bc1e07d server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:17.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.349+0000 7f3f66ffd700 1 -- 172.21.15.27:0/985800970 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f58011830 con 0x7f3f680ccf90 2023-07-05T23:33:17.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.349+0000 7f3f66ffd700 1 -- 172.21.15.27:0/985800970 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f58011990 con 0x7f3f680ccf90 2023-07-05T23:33:17.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.349+0000 7f3f66ffd700 1 -- 172.21.15.27:0/985800970 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f58011d20 con 0x7f3f680ccf90 2023-07-05T23:33:17.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.350+0000 7f3f6e34c700 1 -- 172.21.15.27:0/985800970 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f680ccf90 msgr2=0x7f3f680cd360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:17.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.350+0000 7f3f6e34c700 1 --2- 172.21.15.27:0/985800970 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f680ccf90 0x7f3f680cd360 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3f58009840 tx=0x7f3f58009b50 comp rx=0 tx=0).stop 2023-07-05T23:33:17.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.350+0000 7f3f6e34c700 1 -- 172.21.15.27:0/985800970 shutdown_connections 2023-07-05T23:33:17.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.350+0000 7f3f6e34c700 1 --2- 172.21.15.27:0/985800970 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f680ccf90 0x7f3f680cd360 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:17.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.350+0000 7f3f6e34c700 1 --2- 172.21.15.27:0/985800970 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3f6806a890 0x7f3f6806acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:17.360 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.350+0000 7f3f6e34c700 1 -- 172.21.15.27:0/985800970 >> 172.21.15.27:0/985800970 conn(0x7f3f680b1740 msgr2=0x7f3f6806cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:17.360 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.350+0000 7f3f6e34c700 1 -- 172.21.15.27:0/985800970 shutdown_connections 2023-07-05T23:33:17.360 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.350+0000 7f3f6e34c700 1 -- 172.21.15.27:0/985800970 wait complete. 2023-07-05T23:33:17.360 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.351+0000 7f3f6e34c700 1 Processor -- start 2023-07-05T23:33:17.360 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.351+0000 7f3f6e34c700 1 -- start start 2023-07-05T23:33:17.360 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.352+0000 7f3f6e34c700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3f6806a890 0x7f3f6814a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:17.361 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.352+0000 7f3f6e34c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3f680ccf90 0x7f3f68155780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:17.361 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.352+0000 7f3f6e34c700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f68158850 0x7f3f68150e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:17.361 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.352+0000 7f3f6e34c700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f681513d0 con 0x7f3f680ccf90 2023-07-05T23:33:17.361 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.352+0000 7f3f6e34c700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f681552f0 con 0x7f3f68158850 2023-07-05T23:33:17.361 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.352+0000 7f3f6e34c700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f68159630 con 0x7f3f6806a890 2023-07-05T23:33:17.361 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.352+0000 7f3f677fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3f680ccf90 0x7f3f68155780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:17.361 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.352+0000 7f3f677fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3f680ccf90 0x7f3f68155780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45162/0 (socket says 172.21.15.27:45162) 2023-07-05T23:33:17.361 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.352+0000 7f3f677fe700 1 -- 172.21.15.27:0/2674406861 learned_addr learned my addr 172.21.15.27:0/2674406861 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:17.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.352+0000 7f3f67fff700 1 --2- 172.21.15.27:0/2674406861 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3f6806a890 0x7f3f6814a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:17.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.352+0000 7f3f6c8e9700 1 --2- 172.21.15.27:0/2674406861 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f68158850 0x7f3f68150e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:17.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.352+0000 7f3f677fe700 1 -- 172.21.15.27:0/2674406861 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3f6806a890 msgr2=0x7f3f6814a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:17.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.352+0000 7f3f677fe700 1 --2- 172.21.15.27:0/2674406861 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3f6806a890 0x7f3f6814a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:17.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.353+0000 7f3f677fe700 1 -- 172.21.15.27:0/2674406861 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f68158850 msgr2=0x7f3f68150e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:17.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.353+0000 7f3f677fe700 1 --2- 172.21.15.27:0/2674406861 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f68158850 0x7f3f68150e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:17.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.353+0000 7f3f677fe700 1 -- 172.21.15.27:0/2674406861 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f580094a0 con 0x7f3f680ccf90 2023-07-05T23:33:17.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.353+0000 7f3f677fe700 1 --2- 172.21.15.27:0/2674406861 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3f680ccf90 0x7f3f68155780 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c00c550 tx=0x7f3f5c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:17.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.353+0000 7f3f64ff9700 1 -- 172.21.15.27:0/2674406861 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5c004c80 con 0x7f3f680ccf90 2023-07-05T23:33:17.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.353+0000 7f3f64ff9700 1 -- 172.21.15.27:0/2674406861 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f5c004e00 con 0x7f3f680ccf90 2023-07-05T23:33:17.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.353+0000 7f3f6e34c700 1 -- 172.21.15.27:0/2674406861 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f681598f0 con 0x7f3f680ccf90 2023-07-05T23:33:17.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.353+0000 7f3f64ff9700 1 -- 172.21.15.27:0/2674406861 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5c007310 con 0x7f3f680ccf90 2023-07-05T23:33:17.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.353+0000 7f3f6e34c700 1 -- 172.21.15.27:0/2674406861 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f68154ca0 con 0x7f3f680ccf90 2023-07-05T23:33:17.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.354+0000 7f3f6e34c700 1 -- 172.21.15.27:0/2674406861 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f6804ea20 con 0x7f3f680ccf90 2023-07-05T23:33:17.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.354+0000 7f3f64ff9700 1 -- 172.21.15.27:0/2674406861 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3f5c007470 con 0x7f3f680ccf90 2023-07-05T23:33:17.364 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.355+0000 7f3f64ff9700 1 --2- 172.21.15.27:0/2674406861 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f3f5406ace0 0x7f3f5406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:17.364 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.355+0000 7f3f64ff9700 1 -- 172.21.15.27:0/2674406861 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3f5c0893b0 con 0x7f3f680ccf90 2023-07-05T23:33:17.364 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.355+0000 7f3f67fff700 1 --2- 172.21.15.27:0/2674406861 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f3f5406ace0 0x7f3f5406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:17.364 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.356+0000 7f3f67fff700 1 --2- 172.21.15.27:0/2674406861 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f3f5406ace0 0x7f3f5406d190 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3f580090b0 tx=0x7f3f58008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:17.364 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.359+0000 7f3f64ff9700 1 -- 172.21.15.27:0/2674406861 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3f5c0540f0 con 0x7f3f680ccf90 2023-07-05T23:33:17.559 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.557+0000 7f3f6e34c700 1 -- 172.21.15.27:0/2674406861 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3f68073910 con 0x7f3f680ccf90 2023-07-05T23:33:17.561 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.558+0000 7f3f64ff9700 1 -- 172.21.15.27:0/2674406861 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20120 (secure 0 0 0) 0x7f3f5c057710 con 0x7f3f680ccf90 2023-07-05T23:33:17.561 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:33:17.561 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":28,"fsid":"23eebe48-65f5-4d3c-8c2d-4aa171c055d5","created":"2023-07-05T23:32:27.989612+0000","modified":"2023-07-05T23:32:57.768949+0000","last_up_change":"2023-07-05T23:32:39.601570+0000","last_in_change":"2023-07-05T23:32:30.488261+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-05T23:32:41.624598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-05T23:32:46.481587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-05T23:32:51.025210+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-05T23:32:52.286964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-05T23:32:55.354212+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ac2071e4-394b-4385-b9ba-fad5265efc65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6814","nonce":3766536605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6818","nonce":3766536605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6823","nonce":3766536605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6821","nonce":3766536605}]},"public_addr":"172.21.15.27:6814/3766536605","cluster_addr":"172.21.15.27:6818/3766536605","heartbeat_back_addr":"172.21.15.27:6823/3766536605","heartbeat_front_addr":"172.21.15.27:6821/3766536605","state":["exists","up"]},{"osd":1,"uuid":"8c9b61a0-39d5-46bf-afd6-5add78453ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6801","nonce":1579117455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6803","nonce":1579117455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6807","nonce":1579117455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6805","nonce":1579117455}]},"public_addr":"172.21.15.27:6801/1579117455","cluster_addr":"172.21.15.27:6803/1579117455","heartbeat_back_addr":"172.21.15.27:6807/1579117455","heartbeat_front_addr":"172.21.15.27:6805/1579117455","state":["exists","up"]},{"osd":2,"uuid":"dcd032a2-06b1-4055-b798-b86c71a7107d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6825","nonce":807520271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6827","nonce":807520271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6831","nonce":807520271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6829","nonce":807520271}]},"public_addr":"172.21.15.27:6825/807520271","cluster_addr":"172.21.15.27:6827/807520271","heartbeat_back_addr":"172.21.15.27:6831/807520271","heartbeat_front_addr":"172.21.15.27:6829/807520271","state":["exists","up"]},{"osd":3,"uuid":"b0ffe0fc-47ba-4636-b5ea-6bab637642c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6809","nonce":2125656143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6811","nonce":2125656143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6817","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6819","nonce":2125656143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6813","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6815","nonce":2125656143}]},"public_addr":"172.21.15.27:6809/2125656143","cluster_addr":"172.21.15.27:6811/2125656143","heartbeat_back_addr":"172.21.15.27:6819/2125656143","heartbeat_front_addr":"172.21.15.27:6815/2125656143","state":["exists","up"]},{"osd":4,"uuid":"7fab4e5a-1246-4efe-9562-10c4a6c789ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6801","nonce":2111223016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6803","nonce":2111223016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6807","nonce":2111223016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6805","nonce":2111223016}]},"public_addr":"172.21.15.162:6801/2111223016","cluster_addr":"172.21.15.162:6803/2111223016","heartbeat_back_addr":"172.21.15.162:6807/2111223016","heartbeat_front_addr":"172.21.15.162:6805/2111223016","state":["exists","up"]},{"osd":5,"uuid":"110c4d9f-cef6-48ab-a818-5a81e72372af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6825","nonce":3102609008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6827","nonce":3102609008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6831","nonce":3102609008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6829","nonce":3102609008}]},"public_addr":"172.21.15.162:6825/3102609008","cluster_addr":"172.21.15.162:6827/3102609008","heartbeat_back_addr":"172.21.15.162:6831/3102609008","heartbeat_front_addr":"172.21.15.162:6829/3102609008","state":["exists","up"]},{"osd":6,"uuid":"16803bcc-2c92-4aed-954e-487938c9f24a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6809","nonce":2657688865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6811","nonce":2657688865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6815","nonce":2657688865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6813","nonce":2657688865}]},"public_addr":"172.21.15.162:6809/2657688865","cluster_addr":"172.21.15.162:6811/2657688865","heartbeat_back_addr":"172.21.15.162:6815/2657688865","heartbeat_front_addr":"172.21.15.162:6813/2657688865","state":["exists","up"]},{"osd":7,"uuid":"b7c35377-3cf2-4569-b6b9-72376eb463bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6817","nonce":2096609978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6819","nonce":2096609978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6823","nonce":2096609978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6821","nonce":2096609978}]},"public_addr":"172.21.15.162:6817/2096609978","cluster_addr":"172.21.15.162:6819/2096609978","heartbeat_back_addr":"172.21.15.162:6823/2096609978","heartbeat_front_addr":"172.21.15.162:6821/2096609978","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.735448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.645561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.759120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.682507+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.736228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.694664+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.716002+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.680485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-05T23:33:17.563 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.560+0000 7f3f6e34c700 1 -- 172.21.15.27:0/2674406861 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f3f5406ace0 msgr2=0x7f3f5406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:17.563 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.560+0000 7f3f6e34c700 1 --2- 172.21.15.27:0/2674406861 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f3f5406ace0 0x7f3f5406d190 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3f580090b0 tx=0x7f3f58008030 comp rx=0 tx=0).stop 2023-07-05T23:33:17.563 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.560+0000 7f3f6e34c700 1 -- 172.21.15.27:0/2674406861 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3f680ccf90 msgr2=0x7f3f68155780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:17.563 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.560+0000 7f3f6e34c700 1 --2- 172.21.15.27:0/2674406861 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3f680ccf90 0x7f3f68155780 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c00c550 tx=0x7f3f5c00c860 comp rx=0 tx=0).stop 2023-07-05T23:33:17.563 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.560+0000 7f3f6e34c700 1 -- 172.21.15.27:0/2674406861 shutdown_connections 2023-07-05T23:33:17.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.560+0000 7f3f6e34c700 1 --2- 172.21.15.27:0/2674406861 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f68158850 0x7f3f68150e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:17.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.560+0000 7f3f6e34c700 1 --2- 172.21.15.27:0/2674406861 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f3f5406ace0 0x7f3f5406d190 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:17.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.560+0000 7f3f6e34c700 1 --2- 172.21.15.27:0/2674406861 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3f6806a890 0x7f3f6814a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:17.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.560+0000 7f3f6e34c700 1 --2- 172.21.15.27:0/2674406861 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3f680ccf90 0x7f3f68155780 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:17.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.560+0000 7f3f6e34c700 1 -- 172.21.15.27:0/2674406861 >> 172.21.15.27:0/2674406861 conn(0x7f3f680b1740 msgr2=0x7f3f68072a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:17.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.560+0000 7f3f6e34c700 1 -- 172.21.15.27:0/2674406861 shutdown_connections 2023-07-05T23:33:17.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.560+0000 7f3f6e34c700 1 -- 172.21.15.27:0/2674406861 wait complete. 2023-07-05T23:33:17.575 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-05T23:33:17.576 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-05T23:33:17.704 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.697+0000 7fcdff143700 1 Processor -- start 2023-07-05T23:33:17.705 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.697+0000 7fcdff143700 1 -- start start 2023-07-05T23:33:17.705 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.698+0000 7fcdff143700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fcdf80d05d0 0x7fcdf806fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:17.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.698+0000 7fcdff143700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fcdf80cec80 0x7fcdf80aea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:17.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.698+0000 7fcdff143700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdf80ae580 con 0x7fcdf815a640 2023-07-05T23:33:17.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.698+0000 7fcdff143700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdf806f610 con 0x7fcdf80cec80 2023-07-05T23:33:17.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.698+0000 7fcdff143700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdf80adf70 con 0x7fcdf80d05d0 2023-07-05T23:33:17.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.698+0000 7fcdfd6e0700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fcdf80cec80 0x7fcdf80aea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:17.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.698+0000 7fcdfd6e0700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fcdf80cec80 0x7fcdf80aea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45174/0 (socket says 172.21.15.27:45174) 2023-07-05T23:33:17.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.698+0000 7fcdfd6e0700 1 -- 172.21.15.27:0/1059780102 learned_addr learned my addr 172.21.15.27:0/1059780102 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:17.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.699+0000 7fcdf7fff700 1 --2- 172.21.15.27:0/1059780102 >> v2:172.21.15.162:3300/0 conn(0x7fcdf80d05d0 0x7fcdf806fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:17.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.699+0000 7fcdfd6e0700 1 -- 172.21.15.27:0/1059780102 >> v2:172.21.15.162:3300/0 conn(0x7fcdf80d05d0 msgr2=0x7fcdf806fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:17.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.699+0000 7fcdfd6e0700 1 --2- 172.21.15.27:0/1059780102 >> v2:172.21.15.162:3300/0 conn(0x7fcdf80d05d0 0x7fcdf806fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:17.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.699+0000 7fcdfd6e0700 1 -- 172.21.15.27:0/1059780102 >> v1:172.21.15.162:6789/0 conn(0x7fcdf815a640 legacy=0x7fcdf80ce570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:17.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.699+0000 7fcdfd6e0700 1 -- 172.21.15.27:0/1059780102 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf806f860 con 0x7fcdf80cec80 2023-07-05T23:33:17.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.699+0000 7fcdfd6e0700 1 --2- 172.21.15.27:0/1059780102 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcdf80cec80 0x7fcdf80aea10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcdf8066be0 tx=0x7fcde0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a53400ee5d84c571 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:17.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.699+0000 7fcdf77fe700 1 -- 172.21.15.27:0/1059780102 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde0011830 con 0x7fcdf80cec80 2023-07-05T23:33:17.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.699+0000 7fcdf77fe700 1 -- 172.21.15.27:0/1059780102 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcde0011990 con 0x7fcdf80cec80 2023-07-05T23:33:17.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.699+0000 7fcdf77fe700 1 -- 172.21.15.27:0/1059780102 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde0011d20 con 0x7fcdf80cec80 2023-07-05T23:33:17.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.700+0000 7fcdff143700 1 -- 172.21.15.27:0/1059780102 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcdf80cec80 msgr2=0x7fcdf80aea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:17.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.700+0000 7fcdff143700 1 --2- 172.21.15.27:0/1059780102 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcdf80cec80 0x7fcdf80aea10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcdf8066be0 tx=0x7fcde0009bd0 comp rx=0 tx=0).stop 2023-07-05T23:33:17.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.700+0000 7fcdff143700 1 -- 172.21.15.27:0/1059780102 shutdown_connections 2023-07-05T23:33:17.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.700+0000 7fcdff143700 1 --2- 172.21.15.27:0/1059780102 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcdf80cec80 0x7fcdf80aea10 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:17.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.700+0000 7fcdff143700 1 --2- 172.21.15.27:0/1059780102 >> v2:172.21.15.162:3300/0 conn(0x7fcdf80d05d0 0x7fcdf806fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:17.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.700+0000 7fcdff143700 1 -- 172.21.15.27:0/1059780102 >> 172.21.15.27:0/1059780102 conn(0x7fcdf8089fe0 msgr2=0x7fcdf80d09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:17.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.700+0000 7fcdff143700 1 -- 172.21.15.27:0/1059780102 shutdown_connections 2023-07-05T23:33:17.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.700+0000 7fcdff143700 1 -- 172.21.15.27:0/1059780102 wait complete. 2023-07-05T23:33:17.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.701+0000 7fcdff143700 1 Processor -- start 2023-07-05T23:33:17.710 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.701+0000 7fcdff143700 1 -- start start 2023-07-05T23:33:17.712 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.702+0000 7fcdff143700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcdf80cec80 0x7fcdf8155e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:17.712 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.702+0000 7fcdff143700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcdf80d05d0 0x7fcdf8154a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:17.712 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.702+0000 7fcdff143700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcdf815a640 0x7fcdf8156850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:17.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.702+0000 7fcdff143700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf81f0d90 con 0x7fcdf80cec80 2023-07-05T23:33:17.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.702+0000 7fcdff143700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf8155360 con 0x7fcdf815a640 2023-07-05T23:33:17.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.702+0000 7fcdff143700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf8155640 con 0x7fcdf80d05d0 2023-07-05T23:33:17.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.702+0000 7fcdfcedf700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcdf80cec80 0x7fcdf8155e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:17.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.702+0000 7fcdfcedf700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcdf80cec80 0x7fcdf8155e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45176/0 (socket says 172.21.15.27:45176) 2023-07-05T23:33:17.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.702+0000 7fcdfcedf700 1 -- 172.21.15.27:0/1919771454 learned_addr learned my addr 172.21.15.27:0/1919771454 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:17.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.702+0000 7fcdf7fff700 1 --2- 172.21.15.27:0/1919771454 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcdf80d05d0 0x7fcdf8154a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:17.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.702+0000 7fcdfd6e0700 1 --2- 172.21.15.27:0/1919771454 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcdf815a640 0x7fcdf8156850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:17.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.702+0000 7fcdfcedf700 1 -- 172.21.15.27:0/1919771454 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcdf80d05d0 msgr2=0x7fcdf8154a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:17.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.702+0000 7fcdfcedf700 1 --2- 172.21.15.27:0/1919771454 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcdf80d05d0 0x7fcdf8154a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:17.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.702+0000 7fcdfcedf700 1 -- 172.21.15.27:0/1919771454 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcdf815a640 msgr2=0x7fcdf8156850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:17.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.702+0000 7fcdfcedf700 1 --2- 172.21.15.27:0/1919771454 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcdf815a640 0x7fcdf8156850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:17.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.702+0000 7fcdfcedf700 1 -- 172.21.15.27:0/1919771454 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcde0009550 con 0x7fcdf80cec80 2023-07-05T23:33:17.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.702+0000 7fcdfcedf700 1 --2- 172.21.15.27:0/1919771454 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcdf80cec80 0x7fcdf8155e40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcdf000c4e0 tx=0x7fcdf000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:17.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.702+0000 7fcdf57fa700 1 -- 172.21.15.27:0/1919771454 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf00052d0 con 0x7fcdf80cec80 2023-07-05T23:33:17.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.702+0000 7fcdf57fa700 1 -- 172.21.15.27:0/1919771454 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdf0005430 con 0x7fcdf80cec80 2023-07-05T23:33:17.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.703+0000 7fcdff143700 1 -- 172.21.15.27:0/1919771454 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdf8155920 con 0x7fcdf80cec80 2023-07-05T23:33:17.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.703+0000 7fcdf57fa700 1 -- 172.21.15.27:0/1919771454 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf00038c0 con 0x7fcdf80cec80 2023-07-05T23:33:17.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.703+0000 7fcdff143700 1 -- 172.21.15.27:0/1919771454 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdf8154f70 con 0x7fcdf80cec80 2023-07-05T23:33:17.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.703+0000 7fcdff143700 1 -- 172.21.15.27:0/1919771454 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdf8155160 con 0x7fcdf80cec80 2023-07-05T23:33:17.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.704+0000 7fcdf57fa700 1 -- 172.21.15.27:0/1919771454 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcdf0003a20 con 0x7fcdf80cec80 2023-07-05T23:33:17.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.704+0000 7fcdf57fa700 1 --2- 172.21.15.27:0/1919771454 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fcdd806ace0 0x7fcdd806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:17.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.705+0000 7fcdf57fa700 1 -- 172.21.15.27:0/1919771454 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fcdf0088b10 con 0x7fcdf80cec80 2023-07-05T23:33:17.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.705+0000 7fcdf7fff700 1 --2- 172.21.15.27:0/1919771454 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fcdd806ace0 0x7fcdd806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:17.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.705+0000 7fcdf7fff700 1 --2- 172.21.15.27:0/1919771454 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fcdd806ace0 0x7fcdd806d190 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fcde80113e0 tx=0x7fcde800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:17.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.709+0000 7fcdf57fa700 1 -- 172.21.15.27:0/1919771454 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcdf00538d0 con 0x7fcdf80cec80 2023-07-05T23:33:17.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.906+0000 7fcdff143700 1 -- 172.21.15.27:0/1919771454 --> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcdf80ae210 con 0x7fcdd806ace0 2023-07-05T23:33:17.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.918+0000 7fcdf57fa700 1 -- 172.21.15.27:0/1919771454 <== mgr.4105 v2:172.21.15.162:6832/3790028097 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367317 (secure 0 0 0) 0x7fcde800f040 con 0x7fcdd806ace0 2023-07-05T23:33:17.926 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:33:17.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.921+0000 7fcdff143700 1 -- 172.21.15.27:0/1919771454 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fcdd806ace0 msgr2=0x7fcdd806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:17.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.921+0000 7fcdff143700 1 --2- 172.21.15.27:0/1919771454 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fcdd806ace0 0x7fcdd806d190 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fcde80113e0 tx=0x7fcde800b040 comp rx=0 tx=0).stop 2023-07-05T23:33:17.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.921+0000 7fcdff143700 1 -- 172.21.15.27:0/1919771454 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcdf80cec80 msgr2=0x7fcdf8155e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:17.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.921+0000 7fcdff143700 1 --2- 172.21.15.27:0/1919771454 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcdf80cec80 0x7fcdf8155e40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcdf000c4e0 tx=0x7fcdf000c7f0 comp rx=0 tx=0).stop 2023-07-05T23:33:17.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.921+0000 7fcdff143700 1 -- 172.21.15.27:0/1919771454 shutdown_connections 2023-07-05T23:33:17.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.921+0000 7fcdff143700 1 --2- 172.21.15.27:0/1919771454 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcdf815a640 0x7fcdf8156850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:17.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.921+0000 7fcdff143700 1 --2- 172.21.15.27:0/1919771454 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fcdd806ace0 0x7fcdd806d190 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:17.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.921+0000 7fcdff143700 1 --2- 172.21.15.27:0/1919771454 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcdf80cec80 0x7fcdf8155e40 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:17.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.921+0000 7fcdff143700 1 --2- 172.21.15.27:0/1919771454 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcdf80d05d0 0x7fcdf8154a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:17.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.921+0000 7fcdff143700 1 -- 172.21.15.27:0/1919771454 >> 172.21.15.27:0/1919771454 conn(0x7fcdf8089fe0 msgr2=0x7fcdf81580f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:17.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.921+0000 7fcdff143700 1 -- 172.21.15.27:0/1919771454 shutdown_connections 2023-07-05T23:33:17.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:17.922+0000 7fcdff143700 1 -- 172.21.15.27:0/1919771454 wait complete. 2023-07-05T23:33:17.930 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2023-07-05T23:33:17.937 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2023-07-05T23:33:17.575063+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219208,"kb_used_data":3592,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755512,"statfs":{"total":773094113280,"available":772869644288,"internally_reserved":0,"allocated":3678208,"data_stored":2186496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003529"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781415+0000","last_change":"2023-07-05T23:32:53.342316+0000","last_active":"2023-07-05T23:32:57.781415+0000","last_peered":"2023-07-05T23:32:57.781415+0000","last_clean":"2023-07-05T23:32:57.781415+0000","last_became_active":"2023-07-05T23:32:53.342061+0000","last_became_peered":"2023-07-05T23:32:53.342061+0000","last_unstale":"2023-07-05T23:32:57.781415+0000","last_undegraded":"2023-07-05T23:32:57.781415+0000","last_fullsized":"2023-07-05T23:32:57.781415+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:38:35.161436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779776+0000","last_change":"2023-07-05T23:32:53.343107+0000","last_active":"2023-07-05T23:32:57.779776+0000","last_peered":"2023-07-05T23:32:57.779776+0000","last_clean":"2023-07-05T23:32:57.779776+0000","last_became_active":"2023-07-05T23:32:53.342843+0000","last_became_peered":"2023-07-05T23:32:53.342843+0000","last_unstale":"2023-07-05T23:32:57.779776+0000","last_undegraded":"2023-07-05T23:32:57.779776+0000","last_fullsized":"2023-07-05T23:32:57.779776+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:20:57.393702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.783279+0000","last_change":"2023-07-05T23:32:53.339304+0000","last_active":"2023-07-05T23:32:57.783279+0000","last_peered":"2023-07-05T23:32:57.783279+0000","last_clean":"2023-07-05T23:32:57.783279+0000","last_became_active":"2023-07-05T23:32:53.338973+0000","last_became_peered":"2023-07-05T23:32:53.338973+0000","last_unstale":"2023-07-05T23:32:57.783279+0000","last_undegraded":"2023-07-05T23:32:57.783279+0000","last_fullsized":"2023-07-05T23:32:57.783279+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:10:47.650972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781305+0000","last_change":"2023-07-05T23:32:53.334788+0000","last_active":"2023-07-05T23:32:57.781305+0000","last_peered":"2023-07-05T23:32:57.781305+0000","last_clean":"2023-07-05T23:32:57.781305+0000","last_became_active":"2023-07-05T23:32:53.334473+0000","last_became_peered":"2023-07-05T23:32:53.334473+0000","last_unstale":"2023-07-05T23:32:57.781305+0000","last_undegraded":"2023-07-05T23:32:57.781305+0000","last_fullsized":"2023-07-05T23:32:57.781305+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:41:19.407762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780497+0000","last_change":"2023-07-05T23:32:53.346034+0000","last_active":"2023-07-05T23:32:57.780497+0000","last_peered":"2023-07-05T23:32:57.780497+0000","last_clean":"2023-07-05T23:32:57.780497+0000","last_became_active":"2023-07-05T23:32:53.345743+0000","last_became_peered":"2023-07-05T23:32:53.345743+0000","last_unstale":"2023-07-05T23:32:57.780497+0000","last_undegraded":"2023-07-05T23:32:57.780497+0000","last_fullsized":"2023-07-05T23:32:57.780497+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:07:52.872003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.782814+0000","last_change":"2023-07-05T23:32:53.335744+0000","last_active":"2023-07-05T23:32:57.782814+0000","last_peered":"2023-07-05T23:32:57.782814+0000","last_clean":"2023-07-05T23:32:57.782814+0000","last_became_active":"2023-07-05T23:32:53.335456+0000","last_became_peered":"2023-07-05T23:32:53.335456+0000","last_unstale":"2023-07-05T23:32:57.782814+0000","last_undegraded":"2023-07-05T23:32:57.782814+0000","last_fullsized":"2023-07-05T23:32:57.782814+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:32:51.547111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781403+0000","last_change":"2023-07-05T23:32:53.341154+0000","last_active":"2023-07-05T23:32:57.781403+0000","last_peered":"2023-07-05T23:32:57.781403+0000","last_clean":"2023-07-05T23:32:57.781403+0000","last_became_active":"2023-07-05T23:32:53.340639+0000","last_became_peered":"2023-07-05T23:32:53.340639+0000","last_unstale":"2023-07-05T23:32:57.781403+0000","last_undegraded":"2023-07-05T23:32:57.781403+0000","last_fullsized":"2023-07-05T23:32:57.781403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:20:29.661027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.778451+0000","last_change":"2023-07-05T23:32:53.336514+0000","last_active":"2023-07-05T23:32:57.778451+0000","last_peered":"2023-07-05T23:32:57.778451+0000","last_clean":"2023-07-05T23:32:57.778451+0000","last_became_active":"2023-07-05T23:32:53.336216+0000","last_became_peered":"2023-07-05T23:32:53.336216+0000","last_unstale":"2023-07-05T23:32:57.778451+0000","last_undegraded":"2023-07-05T23:32:57.778451+0000","last_fullsized":"2023-07-05T23:32:57.778451+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:15:41.388811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781197+0000","last_change":"2023-07-05T23:32:53.348265+0000","last_active":"2023-07-05T23:32:57.781197+0000","last_peered":"2023-07-05T23:32:57.781197+0000","last_clean":"2023-07-05T23:32:57.781197+0000","last_became_active":"2023-07-05T23:32:53.347948+0000","last_became_peered":"2023-07-05T23:32:53.347948+0000","last_unstale":"2023-07-05T23:32:57.781197+0000","last_undegraded":"2023-07-05T23:32:57.781197+0000","last_fullsized":"2023-07-05T23:32:57.781197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:36:17.743168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780020+0000","last_change":"2023-07-05T23:32:53.330422+0000","last_active":"2023-07-05T23:32:57.780020+0000","last_peered":"2023-07-05T23:32:57.780020+0000","last_clean":"2023-07-05T23:32:57.780020+0000","last_became_active":"2023-07-05T23:32:53.330135+0000","last_became_peered":"2023-07-05T23:32:53.330135+0000","last_unstale":"2023-07-05T23:32:57.780020+0000","last_undegraded":"2023-07-05T23:32:57.780020+0000","last_fullsized":"2023-07-05T23:32:57.780020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:51:41.704756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.783413+0000","last_change":"2023-07-05T23:32:53.341815+0000","last_active":"2023-07-05T23:32:57.783413+0000","last_peered":"2023-07-05T23:32:57.783413+0000","last_clean":"2023-07-05T23:32:57.783413+0000","last_became_active":"2023-07-05T23:32:53.341526+0000","last_became_peered":"2023-07-05T23:32:53.341526+0000","last_unstale":"2023-07-05T23:32:57.783413+0000","last_undegraded":"2023-07-05T23:32:57.783413+0000","last_fullsized":"2023-07-05T23:32:57.783413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:32:19.839362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780813+0000","last_change":"2023-07-05T23:32:53.337552+0000","last_active":"2023-07-05T23:32:57.780813+0000","last_peered":"2023-07-05T23:32:57.780813+0000","last_clean":"2023-07-05T23:32:57.780813+0000","last_became_active":"2023-07-05T23:32:53.337279+0000","last_became_peered":"2023-07-05T23:32:53.337279+0000","last_unstale":"2023-07-05T23:32:57.780813+0000","last_undegraded":"2023-07-05T23:32:57.780813+0000","last_fullsized":"2023-07-05T23:32:57.780813+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:02:45.623527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780599+0000","last_change":"2023-07-05T23:32:53.336366+0000","last_active":"2023-07-05T23:32:57.780599+0000","last_peered":"2023-07-05T23:32:57.780599+0000","last_clean":"2023-07-05T23:32:57.780599+0000","last_became_active":"2023-07-05T23:32:53.336083+0000","last_became_peered":"2023-07-05T23:32:53.336083+0000","last_unstale":"2023-07-05T23:32:57.780599+0000","last_undegraded":"2023-07-05T23:32:57.780599+0000","last_fullsized":"2023-07-05T23:32:57.780599+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:38:52.290400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779072+0000","last_change":"2023-07-05T23:32:53.328235+0000","last_active":"2023-07-05T23:32:57.779072+0000","last_peered":"2023-07-05T23:32:57.779072+0000","last_clean":"2023-07-05T23:32:57.779072+0000","last_became_active":"2023-07-05T23:32:53.327918+0000","last_became_peered":"2023-07-05T23:32:53.327918+0000","last_unstale":"2023-07-05T23:32:57.779072+0000","last_undegraded":"2023-07-05T23:32:57.779072+0000","last_fullsized":"2023-07-05T23:32:57.779072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:17:18.286061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780570+0000","last_change":"2023-07-05T23:32:53.340929+0000","last_active":"2023-07-05T23:32:57.780570+0000","last_peered":"2023-07-05T23:32:57.780570+0000","last_clean":"2023-07-05T23:32:57.780570+0000","last_became_active":"2023-07-05T23:32:53.340246+0000","last_became_peered":"2023-07-05T23:32:53.340246+0000","last_unstale":"2023-07-05T23:32:57.780570+0000","last_undegraded":"2023-07-05T23:32:57.780570+0000","last_fullsized":"2023-07-05T23:32:57.780570+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:40:46.792647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.782427+0000","last_change":"2023-07-05T23:32:53.336278+0000","last_active":"2023-07-05T23:32:57.782427+0000","last_peered":"2023-07-05T23:32:57.782427+0000","last_clean":"2023-07-05T23:32:57.782427+0000","last_became_active":"2023-07-05T23:32:53.336006+0000","last_became_peered":"2023-07-05T23:32:53.336006+0000","last_unstale":"2023-07-05T23:32:57.782427+0000","last_undegraded":"2023-07-05T23:32:57.782427+0000","last_fullsized":"2023-07-05T23:32:57.782427+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:22:27.347492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781279+0000","last_change":"2023-07-05T23:32:53.346115+0000","last_active":"2023-07-05T23:32:57.781279+0000","last_peered":"2023-07-05T23:32:57.781279+0000","last_clean":"2023-07-05T23:32:57.781279+0000","last_became_active":"2023-07-05T23:32:53.345848+0000","last_became_peered":"2023-07-05T23:32:53.345848+0000","last_unstale":"2023-07-05T23:32:57.781279+0000","last_undegraded":"2023-07-05T23:32:57.781279+0000","last_fullsized":"2023-07-05T23:32:57.781279+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:25:19.741667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.782779+0000","last_change":"2023-07-05T23:32:53.339001+0000","last_active":"2023-07-05T23:32:57.782779+0000","last_peered":"2023-07-05T23:32:57.782779+0000","last_clean":"2023-07-05T23:32:57.782779+0000","last_became_active":"2023-07-05T23:32:53.335535+0000","last_became_peered":"2023-07-05T23:32:53.335535+0000","last_unstale":"2023-07-05T23:32:57.782779+0000","last_undegraded":"2023-07-05T23:32:57.782779+0000","last_fullsized":"2023-07-05T23:32:57.782779+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:52:25.342366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781210+0000","last_change":"2023-07-05T23:32:53.338403+0000","last_active":"2023-07-05T23:32:57.781210+0000","last_peered":"2023-07-05T23:32:57.781210+0000","last_clean":"2023-07-05T23:32:57.781210+0000","last_became_active":"2023-07-05T23:32:53.338095+0000","last_became_peered":"2023-07-05T23:32:53.338095+0000","last_unstale":"2023-07-05T23:32:57.781210+0000","last_undegraded":"2023-07-05T23:32:57.781210+0000","last_fullsized":"2023-07-05T23:32:57.781210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:53:30.928953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.783844+0000","last_change":"2023-07-05T23:32:53.341961+0000","last_active":"2023-07-05T23:32:57.783844+0000","last_peered":"2023-07-05T23:32:57.783844+0000","last_clean":"2023-07-05T23:32:57.783844+0000","last_became_active":"2023-07-05T23:32:53.341783+0000","last_became_peered":"2023-07-05T23:32:53.341783+0000","last_unstale":"2023-07-05T23:32:57.783844+0000","last_undegraded":"2023-07-05T23:32:57.783844+0000","last_fullsized":"2023-07-05T23:32:57.783844+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:11:32.403021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780722+0000","last_change":"2023-07-05T23:32:53.348405+0000","last_active":"2023-07-05T23:32:57.780722+0000","last_peered":"2023-07-05T23:32:57.780722+0000","last_clean":"2023-07-05T23:32:57.780722+0000","last_became_active":"2023-07-05T23:32:53.348108+0000","last_became_peered":"2023-07-05T23:32:53.348108+0000","last_unstale":"2023-07-05T23:32:57.780722+0000","last_undegraded":"2023-07-05T23:32:57.780722+0000","last_fullsized":"2023-07-05T23:32:57.780722+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:36:17.743168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781700+0000","last_change":"2023-07-05T23:32:53.340963+0000","last_active":"2023-07-05T23:32:57.781700+0000","last_peered":"2023-07-05T23:32:57.781700+0000","last_clean":"2023-07-05T23:32:57.781700+0000","last_became_active":"2023-07-05T23:32:53.340698+0000","last_became_peered":"2023-07-05T23:32:53.340698+0000","last_unstale":"2023-07-05T23:32:57.781700+0000","last_undegraded":"2023-07-05T23:32:57.781700+0000","last_fullsized":"2023-07-05T23:32:57.781700+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:19:10.358522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781287+0000","last_change":"2023-07-05T23:32:53.345981+0000","last_active":"2023-07-05T23:32:57.781287+0000","last_peered":"2023-07-05T23:32:57.781287+0000","last_clean":"2023-07-05T23:32:57.781287+0000","last_became_active":"2023-07-05T23:32:53.345403+0000","last_became_peered":"2023-07-05T23:32:53.345403+0000","last_unstale":"2023-07-05T23:32:57.781287+0000","last_undegraded":"2023-07-05T23:32:57.781287+0000","last_fullsized":"2023-07-05T23:32:57.781287+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:00:21.148640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780634+0000","last_change":"2023-07-05T23:32:53.348335+0000","last_active":"2023-07-05T23:32:57.780634+0000","last_peered":"2023-07-05T23:32:57.780634+0000","last_clean":"2023-07-05T23:32:57.780634+0000","last_became_active":"2023-07-05T23:32:53.348053+0000","last_became_peered":"2023-07-05T23:32:53.348053+0000","last_unstale":"2023-07-05T23:32:57.780634+0000","last_undegraded":"2023-07-05T23:32:57.780634+0000","last_fullsized":"2023-07-05T23:32:57.780634+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:21:31.956439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.777146+0000","last_change":"2023-07-05T23:32:53.339227+0000","last_active":"2023-07-05T23:32:57.777146+0000","last_peered":"2023-07-05T23:32:57.777146+0000","last_clean":"2023-07-05T23:32:57.777146+0000","last_became_active":"2023-07-05T23:32:53.338935+0000","last_became_peered":"2023-07-05T23:32:53.338935+0000","last_unstale":"2023-07-05T23:32:57.777146+0000","last_undegraded":"2023-07-05T23:32:57.777146+0000","last_fullsized":"2023-07-05T23:32:57.777146+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:27:27.060118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.777271+0000","last_change":"2023-07-05T23:32:53.342191+0000","last_active":"2023-07-05T23:32:57.777271+0000","last_peered":"2023-07-05T23:32:57.777271+0000","last_clean":"2023-07-05T23:32:57.777271+0000","last_became_active":"2023-07-05T23:32:53.341948+0000","last_became_peered":"2023-07-05T23:32:53.341948+0000","last_unstale":"2023-07-05T23:32:57.777271+0000","last_undegraded":"2023-07-05T23:32:57.777271+0000","last_fullsized":"2023-07-05T23:32:57.777271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:38:13.889745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779405+0000","last_change":"2023-07-05T23:32:53.336623+0000","last_active":"2023-07-05T23:32:57.779405+0000","last_peered":"2023-07-05T23:32:57.779405+0000","last_clean":"2023-07-05T23:32:57.779405+0000","last_became_active":"2023-07-05T23:32:53.335857+0000","last_became_peered":"2023-07-05T23:32:53.335857+0000","last_unstale":"2023-07-05T23:32:57.779405+0000","last_undegraded":"2023-07-05T23:32:57.779405+0000","last_fullsized":"2023-07-05T23:32:57.779405+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:17:20.092941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.784100+0000","last_change":"2023-07-05T23:32:57.365825+0000","last_active":"2023-07-05T23:32:57.784100+0000","last_peered":"2023-07-05T23:32:57.784100+0000","last_clean":"2023-07-05T23:32:57.784100+0000","last_became_active":"2023-07-05T23:32:57.365409+0000","last_became_peered":"2023-07-05T23:32:57.365409+0000","last_unstale":"2023-07-05T23:32:57.784100+0000","last_undegraded":"2023-07-05T23:32:57.784100+0000","last_fullsized":"2023-07-05T23:32:57.784100+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:47:37.647980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.782903+0000","last_change":"2023-07-05T23:32:52.901348+0000","last_active":"2023-07-05T23:32:57.782903+0000","last_peered":"2023-07-05T23:32:57.782903+0000","last_clean":"2023-07-05T23:32:57.782903+0000","last_became_active":"2023-07-05T23:32:52.901080+0000","last_became_peered":"2023-07-05T23:32:52.901080+0000","last_unstale":"2023-07-05T23:32:57.782903+0000","last_undegraded":"2023-07-05T23:32:57.782903+0000","last_fullsized":"2023-07-05T23:32:57.782903+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:11:28.344067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780698+0000","last_change":"2023-07-05T23:32:53.339739+0000","last_active":"2023-07-05T23:32:57.780698+0000","last_peered":"2023-07-05T23:32:57.780698+0000","last_clean":"2023-07-05T23:32:57.780698+0000","last_became_active":"2023-07-05T23:32:53.339464+0000","last_became_peered":"2023-07-05T23:32:53.339464+0000","last_unstale":"2023-07-05T23:32:57.780698+0000","last_undegraded":"2023-07-05T23:32:57.780698+0000","last_fullsized":"2023-07-05T23:32:57.780698+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:17:18.286061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780977+0000","last_change":"2023-07-05T23:32:57.354002+0000","last_active":"2023-07-05T23:32:57.780977+0000","last_peered":"2023-07-05T23:32:57.780977+0000","last_clean":"2023-07-05T23:32:57.780977+0000","last_became_active":"2023-07-05T23:32:57.353465+0000","last_became_peered":"2023-07-05T23:32:57.353465+0000","last_unstale":"2023-07-05T23:32:57.780977+0000","last_undegraded":"2023-07-05T23:32:57.780977+0000","last_fullsized":"2023-07-05T23:32:57.780977+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:22:44.688998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.776277+0000","last_change":"2023-07-05T23:32:52.909685+0000","last_active":"2023-07-05T23:32:57.776277+0000","last_peered":"2023-07-05T23:32:57.776277+0000","last_clean":"2023-07-05T23:32:57.776277+0000","last_became_active":"2023-07-05T23:32:52.909347+0000","last_became_peered":"2023-07-05T23:32:52.909347+0000","last_unstale":"2023-07-05T23:32:57.776277+0000","last_undegraded":"2023-07-05T23:32:57.776277+0000","last_fullsized":"2023-07-05T23:32:57.776277+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:00:03.115621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780890+0000","last_change":"2023-07-05T23:32:53.339219+0000","last_active":"2023-07-05T23:32:57.780890+0000","last_peered":"2023-07-05T23:32:57.780890+0000","last_clean":"2023-07-05T23:32:57.780890+0000","last_became_active":"2023-07-05T23:32:53.338825+0000","last_became_peered":"2023-07-05T23:32:53.338825+0000","last_unstale":"2023-07-05T23:32:57.780890+0000","last_undegraded":"2023-07-05T23:32:57.780890+0000","last_fullsized":"2023-07-05T23:32:57.780890+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:15:41.388811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781104+0000","last_change":"2023-07-05T23:32:57.359406+0000","last_active":"2023-07-05T23:32:57.781104+0000","last_peered":"2023-07-05T23:32:57.781104+0000","last_clean":"2023-07-05T23:32:57.781104+0000","last_became_active":"2023-07-05T23:32:57.358965+0000","last_became_peered":"2023-07-05T23:32:57.358965+0000","last_unstale":"2023-07-05T23:32:57.781104+0000","last_undegraded":"2023-07-05T23:32:57.781104+0000","last_fullsized":"2023-07-05T23:32:57.781104+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:21:35.396133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780223+0000","last_change":"2023-07-05T23:32:52.909226+0000","last_active":"2023-07-05T23:32:57.780223+0000","last_peered":"2023-07-05T23:32:57.780223+0000","last_clean":"2023-07-05T23:32:57.780223+0000","last_became_active":"2023-07-05T23:32:52.908756+0000","last_became_peered":"2023-07-05T23:32:52.908756+0000","last_unstale":"2023-07-05T23:32:57.780223+0000","last_undegraded":"2023-07-05T23:32:57.780223+0000","last_fullsized":"2023-07-05T23:32:57.780223+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:19:37.582219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781082+0000","last_change":"2023-07-05T23:32:53.337872+0000","last_active":"2023-07-05T23:32:57.781082+0000","last_peered":"2023-07-05T23:32:57.781082+0000","last_clean":"2023-07-05T23:32:57.781082+0000","last_became_active":"2023-07-05T23:32:53.337480+0000","last_became_peered":"2023-07-05T23:32:53.337480+0000","last_unstale":"2023-07-05T23:32:57.781082+0000","last_undegraded":"2023-07-05T23:32:57.781082+0000","last_fullsized":"2023-07-05T23:32:57.781082+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:01:53.561649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780601+0000","last_change":"2023-07-05T23:32:57.356296+0000","last_active":"2023-07-05T23:32:57.780601+0000","last_peered":"2023-07-05T23:32:57.780601+0000","last_clean":"2023-07-05T23:32:57.780601+0000","last_became_active":"2023-07-05T23:32:57.355940+0000","last_became_peered":"2023-07-05T23:32:57.355940+0000","last_unstale":"2023-07-05T23:32:57.780601+0000","last_undegraded":"2023-07-05T23:32:57.780601+0000","last_fullsized":"2023-07-05T23:32:57.780601+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:44:10.928501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781337+0000","last_change":"2023-07-05T23:32:52.904533+0000","last_active":"2023-07-05T23:32:57.781337+0000","last_peered":"2023-07-05T23:32:57.781337+0000","last_clean":"2023-07-05T23:32:57.781337+0000","last_became_active":"2023-07-05T23:32:52.904140+0000","last_became_peered":"2023-07-05T23:32:52.904140+0000","last_unstale":"2023-07-05T23:32:57.781337+0000","last_undegraded":"2023-07-05T23:32:57.781337+0000","last_fullsized":"2023-07-05T23:32:57.781337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:13:04.590957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780100+0000","last_change":"2023-07-05T23:32:53.338517+0000","last_active":"2023-07-05T23:32:57.780100+0000","last_peered":"2023-07-05T23:32:57.780100+0000","last_clean":"2023-07-05T23:32:57.780100+0000","last_became_active":"2023-07-05T23:32:53.338248+0000","last_became_peered":"2023-07-05T23:32:53.338248+0000","last_unstale":"2023-07-05T23:32:57.780100+0000","last_undegraded":"2023-07-05T23:32:57.780100+0000","last_fullsized":"2023-07-05T23:32:57.780100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:38:13.889745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780227+0000","last_change":"2023-07-05T23:32:57.357483+0000","last_active":"2023-07-05T23:32:57.780227+0000","last_peered":"2023-07-05T23:32:57.780227+0000","last_clean":"2023-07-05T23:32:57.780227+0000","last_became_active":"2023-07-05T23:32:57.357039+0000","last_became_peered":"2023-07-05T23:32:57.357039+0000","last_unstale":"2023-07-05T23:32:57.780227+0000","last_undegraded":"2023-07-05T23:32:57.780227+0000","last_fullsized":"2023-07-05T23:32:57.780227+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:07:56.311696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780139+0000","last_change":"2023-07-05T23:32:52.900665+0000","last_active":"2023-07-05T23:32:57.780139+0000","last_peered":"2023-07-05T23:32:57.780139+0000","last_clean":"2023-07-05T23:32:57.780139+0000","last_became_active":"2023-07-05T23:32:52.900352+0000","last_became_peered":"2023-07-05T23:32:52.900352+0000","last_unstale":"2023-07-05T23:32:57.780139+0000","last_undegraded":"2023-07-05T23:32:57.780139+0000","last_fullsized":"2023-07-05T23:32:57.780139+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:43:30.790838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781414+0000","last_change":"2023-07-05T23:32:53.346621+0000","last_active":"2023-07-05T23:32:57.781414+0000","last_peered":"2023-07-05T23:32:57.781414+0000","last_clean":"2023-07-05T23:32:57.781414+0000","last_became_active":"2023-07-05T23:32:53.346373+0000","last_became_peered":"2023-07-05T23:32:53.346373+0000","last_unstale":"2023-07-05T23:32:57.781414+0000","last_undegraded":"2023-07-05T23:32:57.781414+0000","last_fullsized":"2023-07-05T23:32:57.781414+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:22:27.347492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781066+0000","last_change":"2023-07-05T23:32:57.365669+0000","last_active":"2023-07-05T23:32:57.781066+0000","last_peered":"2023-07-05T23:32:57.781066+0000","last_clean":"2023-07-05T23:32:57.781066+0000","last_became_active":"2023-07-05T23:32:57.365200+0000","last_became_peered":"2023-07-05T23:32:57.365200+0000","last_unstale":"2023-07-05T23:32:57.781066+0000","last_undegraded":"2023-07-05T23:32:57.781066+0000","last_fullsized":"2023-07-05T23:32:57.781066+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:51:45.144450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781045+0000","last_change":"2023-07-05T23:32:52.913055+0000","last_active":"2023-07-05T23:32:57.781045+0000","last_peered":"2023-07-05T23:32:57.781045+0000","last_clean":"2023-07-05T23:32:57.781045+0000","last_became_active":"2023-07-05T23:32:52.912749+0000","last_became_peered":"2023-07-05T23:32:52.912749+0000","last_unstale":"2023-07-05T23:32:57.781045+0000","last_undegraded":"2023-07-05T23:32:57.781045+0000","last_fullsized":"2023-07-05T23:32:57.781045+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:13:04.590957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.776668+0000","last_change":"2023-07-05T23:32:53.339331+0000","last_active":"2023-07-05T23:32:57.776668+0000","last_peered":"2023-07-05T23:32:57.776668+0000","last_clean":"2023-07-05T23:32:57.776668+0000","last_became_active":"2023-07-05T23:32:53.339001+0000","last_became_peered":"2023-07-05T23:32:53.339001+0000","last_unstale":"2023-07-05T23:32:57.776668+0000","last_undegraded":"2023-07-05T23:32:57.776668+0000","last_fullsized":"2023-07-05T23:32:57.776668+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:51:56.888322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.776408+0000","last_change":"2023-07-05T23:32:57.354307+0000","last_active":"2023-07-05T23:32:57.776408+0000","last_peered":"2023-07-05T23:32:57.776408+0000","last_clean":"2023-07-05T23:32:57.776408+0000","last_became_active":"2023-07-05T23:32:57.353848+0000","last_became_peered":"2023-07-05T23:32:57.353848+0000","last_unstale":"2023-07-05T23:32:57.776408+0000","last_undegraded":"2023-07-05T23:32:57.776408+0000","last_fullsized":"2023-07-05T23:32:57.776408+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:34:23.584285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'9","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:33:03.186592+0000","last_change":"2023-07-05T23:32:52.904627+0000","last_active":"2023-07-05T23:33:03.186592+0000","last_peered":"2023-07-05T23:33:03.186592+0000","last_clean":"2023-07-05T23:33:03.186592+0000","last_became_active":"2023-07-05T23:32:52.904318+0000","last_became_peered":"2023-07-05T23:32:52.904318+0000","last_unstale":"2023-07-05T23:33:03.186592+0000","last_undegraded":"2023-07-05T23:33:03.186592+0000","last_fullsized":"2023-07-05T23:33:03.186592+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:19:32.514981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.783509+0000","last_change":"2023-07-05T23:32:53.339884+0000","last_active":"2023-07-05T23:32:57.783509+0000","last_peered":"2023-07-05T23:32:57.783509+0000","last_clean":"2023-07-05T23:32:57.783509+0000","last_became_active":"2023-07-05T23:32:53.339583+0000","last_became_peered":"2023-07-05T23:32:53.339583+0000","last_unstale":"2023-07-05T23:32:57.783509+0000","last_undegraded":"2023-07-05T23:32:57.783509+0000","last_fullsized":"2023-07-05T23:32:57.783509+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:24:46.698746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779739+0000","last_change":"2023-07-05T23:32:57.365703+0000","last_active":"2023-07-05T23:32:57.779739+0000","last_peered":"2023-07-05T23:32:57.779739+0000","last_clean":"2023-07-05T23:32:57.779739+0000","last_became_active":"2023-07-05T23:32:57.365204+0000","last_became_peered":"2023-07-05T23:32:57.365204+0000","last_unstale":"2023-07-05T23:32:57.779739+0000","last_undegraded":"2023-07-05T23:32:57.779739+0000","last_fullsized":"2023-07-05T23:32:57.779739+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:20:33.100720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780561+0000","last_change":"2023-07-05T23:32:52.908276+0000","last_active":"2023-07-05T23:32:57.780561+0000","last_peered":"2023-07-05T23:32:57.780561+0000","last_clean":"2023-07-05T23:32:57.780561+0000","last_became_active":"2023-07-05T23:32:52.907970+0000","last_became_peered":"2023-07-05T23:32:52.907970+0000","last_unstale":"2023-07-05T23:32:57.780561+0000","last_undegraded":"2023-07-05T23:32:57.780561+0000","last_fullsized":"2023-07-05T23:32:57.780561+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:15:40.384473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780360+0000","last_change":"2023-07-05T23:32:53.340093+0000","last_active":"2023-07-05T23:32:57.780360+0000","last_peered":"2023-07-05T23:32:57.780360+0000","last_clean":"2023-07-05T23:32:57.780360+0000","last_became_active":"2023-07-05T23:32:53.339827+0000","last_became_peered":"2023-07-05T23:32:53.339827+0000","last_unstale":"2023-07-05T23:32:57.780360+0000","last_undegraded":"2023-07-05T23:32:57.780360+0000","last_fullsized":"2023-07-05T23:32:57.780360+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:19:10.358522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780060+0000","last_change":"2023-07-05T23:32:57.354664+0000","last_active":"2023-07-05T23:32:57.780060+0000","last_peered":"2023-07-05T23:32:57.780060+0000","last_clean":"2023-07-05T23:32:57.780060+0000","last_became_active":"2023-07-05T23:32:57.354235+0000","last_became_peered":"2023-07-05T23:32:57.354235+0000","last_unstale":"2023-07-05T23:32:57.780060+0000","last_undegraded":"2023-07-05T23:32:57.780060+0000","last_fullsized":"2023-07-05T23:32:57.780060+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:13:09.034988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781505+0000","last_change":"2023-07-05T23:32:52.900677+0000","last_active":"2023-07-05T23:32:57.781505+0000","last_peered":"2023-07-05T23:32:57.781505+0000","last_clean":"2023-07-05T23:32:57.781505+0000","last_became_active":"2023-07-05T23:32:52.900387+0000","last_became_peered":"2023-07-05T23:32:52.900387+0000","last_unstale":"2023-07-05T23:32:57.781505+0000","last_undegraded":"2023-07-05T23:32:57.781505+0000","last_fullsized":"2023-07-05T23:32:57.781505+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:19:37.582219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779376+0000","last_change":"2023-07-05T23:32:53.335865+0000","last_active":"2023-07-05T23:32:57.779376+0000","last_peered":"2023-07-05T23:32:57.779376+0000","last_clean":"2023-07-05T23:32:57.779376+0000","last_became_active":"2023-07-05T23:32:53.335513+0000","last_became_peered":"2023-07-05T23:32:53.335513+0000","last_unstale":"2023-07-05T23:32:57.779376+0000","last_undegraded":"2023-07-05T23:32:57.779376+0000","last_fullsized":"2023-07-05T23:32:57.779376+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:19:10.358522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780865+0000","last_change":"2023-07-05T23:32:57.362840+0000","last_active":"2023-07-05T23:32:57.780865+0000","last_peered":"2023-07-05T23:32:57.780865+0000","last_clean":"2023-07-05T23:32:57.780865+0000","last_became_active":"2023-07-05T23:32:57.362407+0000","last_became_peered":"2023-07-05T23:32:57.362407+0000","last_unstale":"2023-07-05T23:32:57.780865+0000","last_undegraded":"2023-07-05T23:32:57.780865+0000","last_fullsized":"2023-07-05T23:32:57.780865+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:20:33.100720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781326+0000","last_change":"2023-07-05T23:32:52.905899+0000","last_active":"2023-07-05T23:32:57.781326+0000","last_peered":"2023-07-05T23:32:57.781326+0000","last_clean":"2023-07-05T23:32:57.781326+0000","last_became_active":"2023-07-05T23:32:52.905595+0000","last_became_peered":"2023-07-05T23:32:52.905595+0000","last_unstale":"2023-07-05T23:32:57.781326+0000","last_undegraded":"2023-07-05T23:32:57.781326+0000","last_fullsized":"2023-07-05T23:32:57.781326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:17:19.088603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780958+0000","last_change":"2023-07-05T23:32:53.342284+0000","last_active":"2023-07-05T23:32:57.780958+0000","last_peered":"2023-07-05T23:32:57.780958+0000","last_clean":"2023-07-05T23:32:57.780958+0000","last_became_active":"2023-07-05T23:32:53.342033+0000","last_became_peered":"2023-07-05T23:32:53.342033+0000","last_unstale":"2023-07-05T23:32:57.780958+0000","last_undegraded":"2023-07-05T23:32:57.780958+0000","last_fullsized":"2023-07-05T23:32:57.780958+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:27:27.060118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779740+0000","last_change":"2023-07-05T23:32:57.360505+0000","last_active":"2023-07-05T23:32:57.779740+0000","last_peered":"2023-07-05T23:32:57.779740+0000","last_clean":"2023-07-05T23:32:57.779740+0000","last_became_active":"2023-07-05T23:32:57.359532+0000","last_became_peered":"2023-07-05T23:32:57.359532+0000","last_unstale":"2023-07-05T23:32:57.779740+0000","last_undegraded":"2023-07-05T23:32:57.779740+0000","last_fullsized":"2023-07-05T23:32:57.779740+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:44:00.668654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780375+0000","last_change":"2023-07-05T23:32:52.903656+0000","last_active":"2023-07-05T23:32:57.780375+0000","last_peered":"2023-07-05T23:32:57.780375+0000","last_clean":"2023-07-05T23:32:57.780375+0000","last_became_active":"2023-07-05T23:32:52.903419+0000","last_became_peered":"2023-07-05T23:32:52.903419+0000","last_unstale":"2023-07-05T23:32:57.780375+0000","last_undegraded":"2023-07-05T23:32:57.780375+0000","last_fullsized":"2023-07-05T23:32:57.780375+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:38:34.157098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780921+0000","last_change":"2023-07-05T23:32:53.341509+0000","last_active":"2023-07-05T23:32:57.780921+0000","last_peered":"2023-07-05T23:32:57.780921+0000","last_clean":"2023-07-05T23:32:57.780921+0000","last_became_active":"2023-07-05T23:32:53.341162+0000","last_became_peered":"2023-07-05T23:32:53.341162+0000","last_unstale":"2023-07-05T23:32:57.780921+0000","last_undegraded":"2023-07-05T23:32:57.780921+0000","last_fullsized":"2023-07-05T23:32:57.780921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:43:57.228961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781521+0000","last_change":"2023-07-05T23:32:57.358009+0000","last_active":"2023-07-05T23:32:57.781521+0000","last_peered":"2023-07-05T23:32:57.781521+0000","last_clean":"2023-07-05T23:32:57.781521+0000","last_became_active":"2023-07-05T23:32:57.357082+0000","last_became_peered":"2023-07-05T23:32:57.357082+0000","last_unstale":"2023-07-05T23:32:57.781521+0000","last_undegraded":"2023-07-05T23:32:57.781521+0000","last_fullsized":"2023-07-05T23:32:57.781521+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:44:00.668654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781205+0000","last_change":"2023-07-05T23:32:52.907916+0000","last_active":"2023-07-05T23:32:57.781205+0000","last_peered":"2023-07-05T23:32:57.781205+0000","last_clean":"2023-07-05T23:32:57.781205+0000","last_became_active":"2023-07-05T23:32:52.907397+0000","last_became_peered":"2023-07-05T23:32:52.907397+0000","last_unstale":"2023-07-05T23:32:57.781205+0000","last_undegraded":"2023-07-05T23:32:57.781205+0000","last_fullsized":"2023-07-05T23:32:57.781205+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:19:37.582219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.778327+0000","last_change":"2023-07-05T23:32:53.334487+0000","last_active":"2023-07-05T23:32:57.778327+0000","last_peered":"2023-07-05T23:32:57.778327+0000","last_clean":"2023-07-05T23:32:57.778327+0000","last_became_active":"2023-07-05T23:32:53.333978+0000","last_became_peered":"2023-07-05T23:32:53.333978+0000","last_unstale":"2023-07-05T23:32:57.778327+0000","last_undegraded":"2023-07-05T23:32:57.778327+0000","last_fullsized":"2023-07-05T23:32:57.778327+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:40:46.792647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780055+0000","last_change":"2023-07-05T23:32:57.362413+0000","last_active":"2023-07-05T23:32:57.780055+0000","last_peered":"2023-07-05T23:32:57.780055+0000","last_clean":"2023-07-05T23:32:57.780055+0000","last_became_active":"2023-07-05T23:32:57.361892+0000","last_became_peered":"2023-07-05T23:32:57.361892+0000","last_unstale":"2023-07-05T23:32:57.780055+0000","last_undegraded":"2023-07-05T23:32:57.780055+0000","last_fullsized":"2023-07-05T23:32:57.780055+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:36:17.176610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781017+0000","last_change":"2023-07-05T23:32:52.908261+0000","last_active":"2023-07-05T23:32:57.781017+0000","last_peered":"2023-07-05T23:32:57.781017+0000","last_clean":"2023-07-05T23:32:57.781017+0000","last_became_active":"2023-07-05T23:32:52.907975+0000","last_became_peered":"2023-07-05T23:32:52.907975+0000","last_unstale":"2023-07-05T23:32:57.781017+0000","last_undegraded":"2023-07-05T23:32:57.781017+0000","last_fullsized":"2023-07-05T23:32:57.781017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:38:12.885407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.782750+0000","last_change":"2023-07-05T23:32:53.339917+0000","last_active":"2023-07-05T23:32:57.782750+0000","last_peered":"2023-07-05T23:32:57.782750+0000","last_clean":"2023-07-05T23:32:57.782750+0000","last_became_active":"2023-07-05T23:32:53.339543+0000","last_became_peered":"2023-07-05T23:32:53.339543+0000","last_unstale":"2023-07-05T23:32:57.782750+0000","last_undegraded":"2023-07-05T23:32:57.782750+0000","last_fullsized":"2023-07-05T23:32:57.782750+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:52:59.154723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780459+0000","last_change":"2023-07-05T23:32:57.361110+0000","last_active":"2023-07-05T23:32:57.780459+0000","last_peered":"2023-07-05T23:32:57.780459+0000","last_clean":"2023-07-05T23:32:57.780459+0000","last_became_active":"2023-07-05T23:32:57.360614+0000","last_became_peered":"2023-07-05T23:32:57.360614+0000","last_unstale":"2023-07-05T23:32:57.780459+0000","last_undegraded":"2023-07-05T23:32:57.780459+0000","last_fullsized":"2023-07-05T23:32:57.780459+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:20:27.254800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781378+0000","last_change":"2023-07-05T23:32:52.907840+0000","last_active":"2023-07-05T23:32:57.781378+0000","last_peered":"2023-07-05T23:32:57.781378+0000","last_clean":"2023-07-05T23:32:57.781378+0000","last_became_active":"2023-07-05T23:32:52.907441+0000","last_became_peered":"2023-07-05T23:32:52.907441+0000","last_unstale":"2023-07-05T23:32:57.781378+0000","last_undegraded":"2023-07-05T23:32:57.781378+0000","last_fullsized":"2023-07-05T23:32:57.781378+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:17:17.281723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.782067+0000","last_change":"2023-07-05T23:32:53.343984+0000","last_active":"2023-07-05T23:32:57.782067+0000","last_peered":"2023-07-05T23:32:57.782067+0000","last_clean":"2023-07-05T23:32:57.782067+0000","last_became_active":"2023-07-05T23:32:53.343566+0000","last_became_peered":"2023-07-05T23:32:53.343566+0000","last_unstale":"2023-07-05T23:32:57.782067+0000","last_undegraded":"2023-07-05T23:32:57.782067+0000","last_fullsized":"2023-07-05T23:32:57.782067+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:37:24.930328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779979+0000","last_change":"2023-07-05T23:32:57.356615+0000","last_active":"2023-07-05T23:32:57.779979+0000","last_peered":"2023-07-05T23:32:57.779979+0000","last_clean":"2023-07-05T23:32:57.779979+0000","last_became_active":"2023-07-05T23:32:57.356091+0000","last_became_peered":"2023-07-05T23:32:57.356091+0000","last_unstale":"2023-07-05T23:32:57.779979+0000","last_undegraded":"2023-07-05T23:32:57.779979+0000","last_fullsized":"2023-07-05T23:32:57.779979+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:10:06.378615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.778881+0000","last_change":"2023-07-05T23:32:52.906210+0000","last_active":"2023-07-05T23:32:57.778881+0000","last_peered":"2023-07-05T23:32:57.778881+0000","last_clean":"2023-07-05T23:32:57.778881+0000","last_became_active":"2023-07-05T23:32:52.905988+0000","last_became_peered":"2023-07-05T23:32:52.905988+0000","last_unstale":"2023-07-05T23:32:57.778881+0000","last_undegraded":"2023-07-05T23:32:57.778881+0000","last_fullsized":"2023-07-05T23:32:57.778881+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:21:30.952101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780176+0000","last_change":"2023-07-05T23:32:53.339662+0000","last_active":"2023-07-05T23:32:57.780176+0000","last_peered":"2023-07-05T23:32:57.780176+0000","last_clean":"2023-07-05T23:32:57.780176+0000","last_became_active":"2023-07-05T23:32:53.339382+0000","last_became_peered":"2023-07-05T23:32:53.339382+0000","last_unstale":"2023-07-05T23:32:57.780176+0000","last_undegraded":"2023-07-05T23:32:57.780176+0000","last_fullsized":"2023-07-05T23:32:57.780176+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:02:13.839378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781483+0000","last_change":"2023-07-05T23:32:57.354958+0000","last_active":"2023-07-05T23:32:57.781483+0000","last_peered":"2023-07-05T23:32:57.781483+0000","last_clean":"2023-07-05T23:32:57.781483+0000","last_became_active":"2023-07-05T23:32:57.354576+0000","last_became_peered":"2023-07-05T23:32:57.354576+0000","last_unstale":"2023-07-05T23:32:57.781483+0000","last_undegraded":"2023-07-05T23:32:57.781483+0000","last_fullsized":"2023-07-05T23:32:57.781483+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:44:10.928501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779954+0000","last_change":"2023-07-05T23:32:52.906470+0000","last_active":"2023-07-05T23:32:57.779954+0000","last_peered":"2023-07-05T23:32:57.779954+0000","last_clean":"2023-07-05T23:32:57.779954+0000","last_became_active":"2023-07-05T23:32:52.906187+0000","last_became_peered":"2023-07-05T23:32:52.906187+0000","last_unstale":"2023-07-05T23:32:57.779954+0000","last_undegraded":"2023-07-05T23:32:57.779954+0000","last_fullsized":"2023-07-05T23:32:57.779954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:25:18.737329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.783687+0000","last_change":"2023-07-05T23:32:53.344178+0000","last_active":"2023-07-05T23:32:57.783687+0000","last_peered":"2023-07-05T23:32:57.783687+0000","last_clean":"2023-07-05T23:32:57.783687+0000","last_became_active":"2023-07-05T23:32:53.343393+0000","last_became_peered":"2023-07-05T23:32:53.343393+0000","last_unstale":"2023-07-05T23:32:57.783687+0000","last_undegraded":"2023-07-05T23:32:57.783687+0000","last_fullsized":"2023-07-05T23:32:57.783687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:01:16.732067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.776877+0000","last_change":"2023-07-05T23:32:57.362812+0000","last_active":"2023-07-05T23:32:57.776877+0000","last_peered":"2023-07-05T23:32:57.776877+0000","last_clean":"2023-07-05T23:32:57.776877+0000","last_became_active":"2023-07-05T23:32:57.362431+0000","last_became_peered":"2023-07-05T23:32:57.362431+0000","last_unstale":"2023-07-05T23:32:57.776877+0000","last_undegraded":"2023-07-05T23:32:57.776877+0000","last_fullsized":"2023-07-05T23:32:57.776877+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:24:35.809378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780786+0000","last_change":"2023-07-05T23:32:52.908272+0000","last_active":"2023-07-05T23:32:57.780786+0000","last_peered":"2023-07-05T23:32:57.780786+0000","last_clean":"2023-07-05T23:32:57.780786+0000","last_became_active":"2023-07-05T23:32:52.907983+0000","last_became_peered":"2023-07-05T23:32:52.907983+0000","last_unstale":"2023-07-05T23:32:57.780786+0000","last_undegraded":"2023-07-05T23:32:57.780786+0000","last_fullsized":"2023-07-05T23:32:57.780786+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:28:38.558463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.783118+0000","last_change":"2023-07-05T23:32:53.339766+0000","last_active":"2023-07-05T23:32:57.783118+0000","last_peered":"2023-07-05T23:32:57.783118+0000","last_clean":"2023-07-05T23:32:57.783118+0000","last_became_active":"2023-07-05T23:32:53.338903+0000","last_became_peered":"2023-07-05T23:32:53.338903+0000","last_unstale":"2023-07-05T23:32:57.783118+0000","last_undegraded":"2023-07-05T23:32:57.783118+0000","last_fullsized":"2023-07-05T23:32:57.783118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:32:24.944898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780131+0000","last_change":"2023-07-05T23:32:57.357001+0000","last_active":"2023-07-05T23:32:57.780131+0000","last_peered":"2023-07-05T23:32:57.780131+0000","last_clean":"2023-07-05T23:32:57.780131+0000","last_became_active":"2023-07-05T23:32:57.356611+0000","last_became_peered":"2023-07-05T23:32:57.356611+0000","last_unstale":"2023-07-05T23:32:57.780131+0000","last_undegraded":"2023-07-05T23:32:57.780131+0000","last_fullsized":"2023-07-05T23:32:57.780131+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:00:24.588333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.782328+0000","last_change":"2023-07-05T23:32:52.907064+0000","last_active":"2023-07-05T23:32:57.782328+0000","last_peered":"2023-07-05T23:32:57.782328+0000","last_clean":"2023-07-05T23:32:57.782328+0000","last_became_active":"2023-07-05T23:32:52.906779+0000","last_became_peered":"2023-07-05T23:32:52.906779+0000","last_unstale":"2023-07-05T23:32:57.782328+0000","last_undegraded":"2023-07-05T23:32:57.782328+0000","last_fullsized":"2023-07-05T23:32:57.782328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:15:22.364630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.782950+0000","last_change":"2023-07-05T23:32:53.341824+0000","last_active":"2023-07-05T23:32:57.782950+0000","last_peered":"2023-07-05T23:32:57.782950+0000","last_clean":"2023-07-05T23:32:57.782950+0000","last_became_active":"2023-07-05T23:32:53.339869+0000","last_became_peered":"2023-07-05T23:32:53.339869+0000","last_unstale":"2023-07-05T23:32:57.782950+0000","last_undegraded":"2023-07-05T23:32:57.782950+0000","last_fullsized":"2023-07-05T23:32:57.782950+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:24:31.034513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.783115+0000","last_change":"2023-07-05T23:32:57.363813+0000","last_active":"2023-07-05T23:32:57.783115+0000","last_peered":"2023-07-05T23:32:57.783115+0000","last_clean":"2023-07-05T23:32:57.783115+0000","last_became_active":"2023-07-05T23:32:57.363409+0000","last_became_peered":"2023-07-05T23:32:57.363409+0000","last_unstale":"2023-07-05T23:32:57.783115+0000","last_undegraded":"2023-07-05T23:32:57.783115+0000","last_fullsized":"2023-07-05T23:32:57.783115+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:28:02.584137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779951+0000","last_change":"2023-07-05T23:32:52.910057+0000","last_active":"2023-07-05T23:32:57.779951+0000","last_peered":"2023-07-05T23:32:57.779951+0000","last_clean":"2023-07-05T23:32:57.779951+0000","last_became_active":"2023-07-05T23:32:52.909169+0000","last_became_peered":"2023-07-05T23:32:52.909169+0000","last_unstale":"2023-07-05T23:32:57.779951+0000","last_undegraded":"2023-07-05T23:32:57.779951+0000","last_fullsized":"2023-07-05T23:32:57.779951+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:36:16.738830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.777230+0000","last_change":"2023-07-05T23:32:53.342851+0000","last_active":"2023-07-05T23:32:57.777230+0000","last_peered":"2023-07-05T23:32:57.777230+0000","last_clean":"2023-07-05T23:32:57.777230+0000","last_became_active":"2023-07-05T23:32:53.342420+0000","last_became_peered":"2023-07-05T23:32:53.342420+0000","last_unstale":"2023-07-05T23:32:57.777230+0000","last_undegraded":"2023-07-05T23:32:57.777230+0000","last_fullsized":"2023-07-05T23:32:57.777230+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:36:17.743168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780080+0000","last_change":"2023-07-05T23:32:57.358997+0000","last_active":"2023-07-05T23:32:57.780080+0000","last_peered":"2023-07-05T23:32:57.780080+0000","last_clean":"2023-07-05T23:32:57.780080+0000","last_became_active":"2023-07-05T23:32:57.358647+0000","last_became_peered":"2023-07-05T23:32:57.358647+0000","last_unstale":"2023-07-05T23:32:57.780080+0000","last_undegraded":"2023-07-05T23:32:57.780080+0000","last_fullsized":"2023-07-05T23:32:57.780080+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:34:23.584285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.777274+0000","last_change":"2023-07-05T23:32:47.790871+0000","last_active":"2023-07-05T23:32:57.777274+0000","last_peered":"2023-07-05T23:32:57.777274+0000","last_clean":"2023-07-05T23:32:57.777274+0000","last_became_active":"2023-07-05T23:32:47.790546+0000","last_became_peered":"2023-07-05T23:32:47.790546+0000","last_unstale":"2023-07-05T23:32:57.777274+0000","last_undegraded":"2023-07-05T23:32:57.777274+0000","last_fullsized":"2023-07-05T23:32:57.777274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_clean_scrub_stamp":"2023-07-05T23:32:46.741565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:12:59.454577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779269+0000","last_change":"2023-07-05T23:32:52.912985+0000","last_active":"2023-07-05T23:32:57.779269+0000","last_peered":"2023-07-05T23:32:57.779269+0000","last_clean":"2023-07-05T23:32:57.779269+0000","last_became_active":"2023-07-05T23:32:52.912682+0000","last_became_peered":"2023-07-05T23:32:52.912682+0000","last_unstale":"2023-07-05T23:32:57.779269+0000","last_undegraded":"2023-07-05T23:32:57.779269+0000","last_fullsized":"2023-07-05T23:32:57.779269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:38:12.885407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.776539+0000","last_change":"2023-07-05T23:32:53.335398+0000","last_active":"2023-07-05T23:32:57.776539+0000","last_peered":"2023-07-05T23:32:57.776539+0000","last_clean":"2023-07-05T23:32:57.776539+0000","last_became_active":"2023-07-05T23:32:53.335073+0000","last_became_peered":"2023-07-05T23:32:53.335073+0000","last_unstale":"2023-07-05T23:32:57.776539+0000","last_undegraded":"2023-07-05T23:32:57.776539+0000","last_fullsized":"2023-07-05T23:32:57.776539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:16:05.844225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780381+0000","last_change":"2023-07-05T23:32:57.368301+0000","last_active":"2023-07-05T23:32:57.780381+0000","last_peered":"2023-07-05T23:32:57.780381+0000","last_clean":"2023-07-05T23:32:57.780381+0000","last_became_active":"2023-07-05T23:32:57.368030+0000","last_became_peered":"2023-07-05T23:32:57.368030+0000","last_unstale":"2023-07-05T23:32:57.780381+0000","last_undegraded":"2023-07-05T23:32:57.780381+0000","last_fullsized":"2023-07-05T23:32:57.780381+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:16:09.283919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.778814+0000","last_change":"2023-07-05T23:32:47.762370+0000","last_active":"2023-07-05T23:32:57.778814+0000","last_peered":"2023-07-05T23:32:57.778814+0000","last_clean":"2023-07-05T23:32:57.778814+0000","last_became_active":"2023-07-05T23:32:47.761996+0000","last_became_peered":"2023-07-05T23:32:47.761996+0000","last_unstale":"2023-07-05T23:32:57.778814+0000","last_undegraded":"2023-07-05T23:32:57.778814+0000","last_fullsized":"2023-07-05T23:32:57.778814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_clean_scrub_stamp":"2023-07-05T23:32:46.741565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:27:20.919400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.783445+0000","last_change":"2023-07-05T23:32:52.904472+0000","last_active":"2023-07-05T23:32:57.783445+0000","last_peered":"2023-07-05T23:32:57.783445+0000","last_clean":"2023-07-05T23:32:57.783445+0000","last_became_active":"2023-07-05T23:32:52.904202+0000","last_became_peered":"2023-07-05T23:32:52.904202+0000","last_unstale":"2023-07-05T23:32:57.783445+0000","last_undegraded":"2023-07-05T23:32:57.783445+0000","last_fullsized":"2023-07-05T23:32:57.783445+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:14:11.507519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.776981+0000","last_change":"2023-07-05T23:32:53.341847+0000","last_active":"2023-07-05T23:32:57.776981+0000","last_peered":"2023-07-05T23:32:57.776981+0000","last_clean":"2023-07-05T23:32:57.776981+0000","last_became_active":"2023-07-05T23:32:53.338626+0000","last_became_peered":"2023-07-05T23:32:53.338626+0000","last_unstale":"2023-07-05T23:32:57.776981+0000","last_undegraded":"2023-07-05T23:32:57.776981+0000","last_fullsized":"2023-07-05T23:32:57.776981+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:07:52.872003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780950+0000","last_change":"2023-07-05T23:32:57.356351+0000","last_active":"2023-07-05T23:32:57.780950+0000","last_peered":"2023-07-05T23:32:57.780950+0000","last_clean":"2023-07-05T23:32:57.780950+0000","last_became_active":"2023-07-05T23:32:57.355882+0000","last_became_peered":"2023-07-05T23:32:57.355882+0000","last_unstale":"2023-07-05T23:32:57.780950+0000","last_undegraded":"2023-07-05T23:32:57.780950+0000","last_fullsized":"2023-07-05T23:32:57.780950+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:22:43.105654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780220+0000","last_change":"2023-07-05T23:32:47.979611+0000","last_active":"2023-07-05T23:32:57.780220+0000","last_peered":"2023-07-05T23:32:57.780220+0000","last_clean":"2023-07-05T23:32:57.780220+0000","last_became_active":"2023-07-05T23:32:47.979348+0000","last_became_peered":"2023-07-05T23:32:47.979348+0000","last_unstale":"2023-07-05T23:32:57.780220+0000","last_undegraded":"2023-07-05T23:32:57.780220+0000","last_fullsized":"2023-07-05T23:32:57.780220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_clean_scrub_stamp":"2023-07-05T23:32:46.741565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:28:01.280864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.776456+0000","last_change":"2023-07-05T23:32:52.907652+0000","last_active":"2023-07-05T23:32:57.776456+0000","last_peered":"2023-07-05T23:32:57.776456+0000","last_clean":"2023-07-05T23:32:57.776456+0000","last_became_active":"2023-07-05T23:32:52.907307+0000","last_became_peered":"2023-07-05T23:32:52.907307+0000","last_unstale":"2023-07-05T23:32:57.776456+0000","last_undegraded":"2023-07-05T23:32:57.776456+0000","last_fullsized":"2023-07-05T23:32:57.776456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:02:12.835040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.777189+0000","last_change":"2023-07-05T23:32:53.338185+0000","last_active":"2023-07-05T23:32:57.777189+0000","last_peered":"2023-07-05T23:32:57.777189+0000","last_clean":"2023-07-05T23:32:57.777189+0000","last_became_active":"2023-07-05T23:32:53.337896+0000","last_became_peered":"2023-07-05T23:32:53.337896+0000","last_unstale":"2023-07-05T23:32:57.777189+0000","last_undegraded":"2023-07-05T23:32:57.777189+0000","last_fullsized":"2023-07-05T23:32:57.777189+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:21:31.956439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780653+0000","last_change":"2023-07-05T23:32:57.355885+0000","last_active":"2023-07-05T23:32:57.780653+0000","last_peered":"2023-07-05T23:32:57.780653+0000","last_clean":"2023-07-05T23:32:57.780653+0000","last_became_active":"2023-07-05T23:32:57.355475+0000","last_became_peered":"2023-07-05T23:32:57.355475+0000","last_unstale":"2023-07-05T23:32:57.780653+0000","last_undegraded":"2023-07-05T23:32:57.780653+0000","last_fullsized":"2023-07-05T23:32:57.780653+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:27:30.499811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779129+0000","last_change":"2023-07-05T23:32:47.761727+0000","last_active":"2023-07-05T23:32:57.779129+0000","last_peered":"2023-07-05T23:32:57.779129+0000","last_clean":"2023-07-05T23:32:57.779129+0000","last_became_active":"2023-07-05T23:32:47.761392+0000","last_became_peered":"2023-07-05T23:32:47.761392+0000","last_unstale":"2023-07-05T23:32:57.779129+0000","last_undegraded":"2023-07-05T23:32:57.779129+0000","last_fullsized":"2023-07-05T23:32:57.779129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_clean_scrub_stamp":"2023-07-05T23:32:46.741565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:36:11.602450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":183,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780467+0000","last_change":"2023-07-05T23:32:42.737690+0000","last_active":"2023-07-05T23:32:57.780467+0000","last_peered":"2023-07-05T23:32:57.780467+0000","last_clean":"2023-07-05T23:32:57.780467+0000","last_became_active":"2023-07-05T23:32:42.736736+0000","last_became_peered":"2023-07-05T23:32:42.736736+0000","last_unstale":"2023-07-05T23:32:57.780467+0000","last_undegraded":"2023-07-05T23:32:57.780467+0000","last_fullsized":"2023-07-05T23:32:57.780467+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:41.674741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:41.674741+0000","last_clean_scrub_stamp":"2023-07-05T23:32:41.674741+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:58:57.987862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779842+0000","last_change":"2023-07-05T23:32:52.912999+0000","last_active":"2023-07-05T23:32:57.779842+0000","last_peered":"2023-07-05T23:32:57.779842+0000","last_clean":"2023-07-05T23:32:57.779842+0000","last_became_active":"2023-07-05T23:32:52.912684+0000","last_became_peered":"2023-07-05T23:32:52.912684+0000","last_unstale":"2023-07-05T23:32:57.779842+0000","last_undegraded":"2023-07-05T23:32:57.779842+0000","last_fullsized":"2023-07-05T23:32:57.779842+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:21:30.952101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780509+0000","last_change":"2023-07-05T23:32:53.344142+0000","last_active":"2023-07-05T23:32:57.780509+0000","last_peered":"2023-07-05T23:32:57.780509+0000","last_clean":"2023-07-05T23:32:57.780509+0000","last_became_active":"2023-07-05T23:32:53.343848+0000","last_became_peered":"2023-07-05T23:32:53.343848+0000","last_unstale":"2023-07-05T23:32:57.780509+0000","last_undegraded":"2023-07-05T23:32:57.780509+0000","last_fullsized":"2023-07-05T23:32:57.780509+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:20:35.381998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780142+0000","last_change":"2023-07-05T23:32:57.366415+0000","last_active":"2023-07-05T23:32:57.780142+0000","last_peered":"2023-07-05T23:32:57.780142+0000","last_clean":"2023-07-05T23:32:57.780142+0000","last_became_active":"2023-07-05T23:32:57.365013+0000","last_became_peered":"2023-07-05T23:32:57.365013+0000","last_unstale":"2023-07-05T23:32:57.780142+0000","last_undegraded":"2023-07-05T23:32:57.780142+0000","last_fullsized":"2023-07-05T23:32:57.780142+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:15:26.808661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780785+0000","last_change":"2023-07-05T23:32:47.767600+0000","last_active":"2023-07-05T23:32:57.780785+0000","last_peered":"2023-07-05T23:32:57.780785+0000","last_clean":"2023-07-05T23:32:57.780785+0000","last_became_active":"2023-07-05T23:32:47.767297+0000","last_became_peered":"2023-07-05T23:32:47.767297+0000","last_unstale":"2023-07-05T23:32:57.780785+0000","last_undegraded":"2023-07-05T23:32:57.780785+0000","last_fullsized":"2023-07-05T23:32:57.780785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_clean_scrub_stamp":"2023-07-05T23:32:46.741565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:25:13.600949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780399+0000","last_change":"2023-07-05T23:32:52.906517+0000","last_active":"2023-07-05T23:32:57.780399+0000","last_peered":"2023-07-05T23:32:57.780399+0000","last_clean":"2023-07-05T23:32:57.780399+0000","last_became_active":"2023-07-05T23:32:52.906204+0000","last_became_peered":"2023-07-05T23:32:52.906204+0000","last_unstale":"2023-07-05T23:32:57.780399+0000","last_undegraded":"2023-07-05T23:32:57.780399+0000","last_fullsized":"2023-07-05T23:32:57.780399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:24:31.365347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780712+0000","last_change":"2023-07-05T23:32:53.340334+0000","last_active":"2023-07-05T23:32:57.780712+0000","last_peered":"2023-07-05T23:32:57.780712+0000","last_clean":"2023-07-05T23:32:57.780712+0000","last_became_active":"2023-07-05T23:32:53.340061+0000","last_became_peered":"2023-07-05T23:32:53.340061+0000","last_unstale":"2023-07-05T23:32:57.780712+0000","last_undegraded":"2023-07-05T23:32:57.780712+0000","last_fullsized":"2023-07-05T23:32:57.780712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:59:09.195404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781199+0000","last_change":"2023-07-05T23:32:57.362424+0000","last_active":"2023-07-05T23:32:57.781199+0000","last_peered":"2023-07-05T23:32:57.781199+0000","last_clean":"2023-07-05T23:32:57.781199+0000","last_became_active":"2023-07-05T23:32:57.361941+0000","last_became_peered":"2023-07-05T23:32:57.361941+0000","last_unstale":"2023-07-05T23:32:57.781199+0000","last_undegraded":"2023-07-05T23:32:57.781199+0000","last_fullsized":"2023-07-05T23:32:57.781199+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:22:39.370920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781202+0000","last_change":"2023-07-05T23:32:47.790754+0000","last_active":"2023-07-05T23:32:57.781202+0000","last_peered":"2023-07-05T23:32:57.781202+0000","last_clean":"2023-07-05T23:32:57.781202+0000","last_became_active":"2023-07-05T23:32:47.790408+0000","last_became_peered":"2023-07-05T23:32:47.790408+0000","last_unstale":"2023-07-05T23:32:57.781202+0000","last_undegraded":"2023-07-05T23:32:57.781202+0000","last_fullsized":"2023-07-05T23:32:57.781202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_clean_scrub_stamp":"2023-07-05T23:32:46.741565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:19:04.217804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.777239+0000","last_change":"2023-07-05T23:32:52.908711+0000","last_active":"2023-07-05T23:32:57.777239+0000","last_peered":"2023-07-05T23:32:57.777239+0000","last_clean":"2023-07-05T23:32:57.777239+0000","last_became_active":"2023-07-05T23:32:52.908379+0000","last_became_peered":"2023-07-05T23:32:52.908379+0000","last_unstale":"2023-07-05T23:32:57.777239+0000","last_undegraded":"2023-07-05T23:32:57.777239+0000","last_fullsized":"2023-07-05T23:32:57.777239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:25:18.737329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780378+0000","last_change":"2023-07-05T23:32:53.331042+0000","last_active":"2023-07-05T23:32:57.780378+0000","last_peered":"2023-07-05T23:32:57.780378+0000","last_clean":"2023-07-05T23:32:57.780378+0000","last_became_active":"2023-07-05T23:32:53.330771+0000","last_became_peered":"2023-07-05T23:32:53.330771+0000","last_unstale":"2023-07-05T23:32:57.780378+0000","last_undegraded":"2023-07-05T23:32:57.780378+0000","last_fullsized":"2023-07-05T23:32:57.780378+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:51:56.888322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.782732+0000","last_change":"2023-07-05T23:32:57.357223+0000","last_active":"2023-07-05T23:32:57.782732+0000","last_peered":"2023-07-05T23:32:57.782732+0000","last_clean":"2023-07-05T23:32:57.782732+0000","last_became_active":"2023-07-05T23:32:57.356797+0000","last_became_peered":"2023-07-05T23:32:57.356797+0000","last_unstale":"2023-07-05T23:32:57.782732+0000","last_undegraded":"2023-07-05T23:32:57.782732+0000","last_fullsized":"2023-07-05T23:32:57.782732+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:49:42.024861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780991+0000","last_change":"2023-07-05T23:32:52.906030+0000","last_active":"2023-07-05T23:32:57.780991+0000","last_peered":"2023-07-05T23:32:57.780991+0000","last_clean":"2023-07-05T23:32:57.780991+0000","last_became_active":"2023-07-05T23:32:52.905704+0000","last_became_peered":"2023-07-05T23:32:52.905704+0000","last_unstale":"2023-07-05T23:32:57.780991+0000","last_undegraded":"2023-07-05T23:32:57.780991+0000","last_fullsized":"2023-07-05T23:32:57.780991+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:20:56.389364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.776986+0000","last_change":"2023-07-05T23:32:47.769126+0000","last_active":"2023-07-05T23:32:57.776986+0000","last_peered":"2023-07-05T23:32:57.776986+0000","last_clean":"2023-07-05T23:32:57.776986+0000","last_became_active":"2023-07-05T23:32:47.768844+0000","last_became_peered":"2023-07-05T23:32:47.768844+0000","last_unstale":"2023-07-05T23:32:57.776986+0000","last_undegraded":"2023-07-05T23:32:57.776986+0000","last_fullsized":"2023-07-05T23:32:57.776986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_clean_scrub_stamp":"2023-07-05T23:32:46.741565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:59:03.054686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779815+0000","last_change":"2023-07-05T23:32:53.335749+0000","last_active":"2023-07-05T23:32:57.779815+0000","last_peered":"2023-07-05T23:32:57.779815+0000","last_clean":"2023-07-05T23:32:57.779815+0000","last_became_active":"2023-07-05T23:32:53.335506+0000","last_became_peered":"2023-07-05T23:32:53.335506+0000","last_unstale":"2023-07-05T23:32:57.779815+0000","last_undegraded":"2023-07-05T23:32:57.779815+0000","last_fullsized":"2023-07-05T23:32:57.779815+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:27:27.060118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779649+0000","last_change":"2023-07-05T23:32:57.362654+0000","last_active":"2023-07-05T23:32:57.779649+0000","last_peered":"2023-07-05T23:32:57.779649+0000","last_clean":"2023-07-05T23:32:57.779649+0000","last_became_active":"2023-07-05T23:32:57.362112+0000","last_became_peered":"2023-07-05T23:32:57.362112+0000","last_unstale":"2023-07-05T23:32:57.779649+0000","last_undegraded":"2023-07-05T23:32:57.779649+0000","last_fullsized":"2023-07-05T23:32:57.779649+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:40:50.232341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780887+0000","last_change":"2023-07-05T23:32:47.769537+0000","last_active":"2023-07-05T23:32:57.780887+0000","last_peered":"2023-07-05T23:32:57.780887+0000","last_clean":"2023-07-05T23:32:57.780887+0000","last_became_active":"2023-07-05T23:32:47.769141+0000","last_became_peered":"2023-07-05T23:32:47.769141+0000","last_unstale":"2023-07-05T23:32:57.780887+0000","last_undegraded":"2023-07-05T23:32:57.780887+0000","last_fullsized":"2023-07-05T23:32:57.780887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_clean_scrub_stamp":"2023-07-05T23:32:46.741565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:48:48.465852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"28'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780818+0000","last_change":"2023-07-05T23:32:52.905759+0000","last_active":"2023-07-05T23:32:57.780818+0000","last_peered":"2023-07-05T23:32:57.780818+0000","last_clean":"2023-07-05T23:32:57.780818+0000","last_became_active":"2023-07-05T23:32:52.905451+0000","last_became_peered":"2023-07-05T23:32:52.905451+0000","last_unstale":"2023-07-05T23:32:57.780818+0000","last_undegraded":"2023-07-05T23:32:57.780818+0000","last_fullsized":"2023-07-05T23:32:57.780818+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:40:45.788309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.782350+0000","last_change":"2023-07-05T23:32:53.332443+0000","last_active":"2023-07-05T23:32:57.782350+0000","last_peered":"2023-07-05T23:32:57.782350+0000","last_clean":"2023-07-05T23:32:57.782350+0000","last_became_active":"2023-07-05T23:32:53.332159+0000","last_became_peered":"2023-07-05T23:32:53.332159+0000","last_unstale":"2023-07-05T23:32:57.782350+0000","last_undegraded":"2023-07-05T23:32:57.782350+0000","last_fullsized":"2023-07-05T23:32:57.782350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:43:31.795176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.777051+0000","last_change":"2023-07-05T23:32:57.363998+0000","last_active":"2023-07-05T23:32:57.777051+0000","last_peered":"2023-07-05T23:32:57.777051+0000","last_clean":"2023-07-05T23:32:57.777051+0000","last_became_active":"2023-07-05T23:32:57.363620+0000","last_became_peered":"2023-07-05T23:32:57.363620+0000","last_unstale":"2023-07-05T23:32:57.777051+0000","last_undegraded":"2023-07-05T23:32:57.777051+0000","last_fullsized":"2023-07-05T23:32:57.777051+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:40:50.232341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780355+0000","last_change":"2023-07-05T23:32:52.908550+0000","last_active":"2023-07-05T23:32:57.780355+0000","last_peered":"2023-07-05T23:32:57.780355+0000","last_clean":"2023-07-05T23:32:57.780355+0000","last_became_active":"2023-07-05T23:32:52.908111+0000","last_became_peered":"2023-07-05T23:32:52.908111+0000","last_unstale":"2023-07-05T23:32:57.780355+0000","last_undegraded":"2023-07-05T23:32:57.780355+0000","last_fullsized":"2023-07-05T23:32:57.780355+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:03:19.819620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781012+0000","last_change":"2023-07-05T23:32:53.340098+0000","last_active":"2023-07-05T23:32:57.781012+0000","last_peered":"2023-07-05T23:32:57.781012+0000","last_clean":"2023-07-05T23:32:57.781012+0000","last_became_active":"2023-07-05T23:32:53.339686+0000","last_became_peered":"2023-07-05T23:32:53.339686+0000","last_unstale":"2023-07-05T23:32:57.781012+0000","last_undegraded":"2023-07-05T23:32:57.781012+0000","last_fullsized":"2023-07-05T23:32:57.781012+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:23:39.749927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781965+0000","last_change":"2023-07-05T23:32:57.356309+0000","last_active":"2023-07-05T23:32:57.781965+0000","last_peered":"2023-07-05T23:32:57.781965+0000","last_clean":"2023-07-05T23:32:57.781965+0000","last_became_active":"2023-07-05T23:32:57.355910+0000","last_became_peered":"2023-07-05T23:32:57.355910+0000","last_unstale":"2023-07-05T23:32:57.781965+0000","last_undegraded":"2023-07-05T23:32:57.781965+0000","last_fullsized":"2023-07-05T23:32:57.781965+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:21:00.833395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779153+0000","last_change":"2023-07-05T23:32:52.899481+0000","last_active":"2023-07-05T23:32:57.779153+0000","last_peered":"2023-07-05T23:32:57.779153+0000","last_clean":"2023-07-05T23:32:57.779153+0000","last_became_active":"2023-07-05T23:32:52.899159+0000","last_became_peered":"2023-07-05T23:32:52.899159+0000","last_unstale":"2023-07-05T23:32:57.779153+0000","last_undegraded":"2023-07-05T23:32:57.779153+0000","last_fullsized":"2023-07-05T23:32:57.779153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:25:18.737329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.782590+0000","last_change":"2023-07-05T23:32:53.343643+0000","last_active":"2023-07-05T23:32:57.782590+0000","last_peered":"2023-07-05T23:32:57.782590+0000","last_clean":"2023-07-05T23:32:57.782590+0000","last_became_active":"2023-07-05T23:32:53.343262+0000","last_became_peered":"2023-07-05T23:32:53.343262+0000","last_unstale":"2023-07-05T23:32:57.782590+0000","last_undegraded":"2023-07-05T23:32:57.782590+0000","last_fullsized":"2023-07-05T23:32:57.782590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:22:31.213068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779248+0000","last_change":"2023-07-05T23:32:57.365478+0000","last_active":"2023-07-05T23:32:57.779248+0000","last_peered":"2023-07-05T23:32:57.779248+0000","last_clean":"2023-07-05T23:32:57.779248+0000","last_became_active":"2023-07-05T23:32:57.365087+0000","last_became_peered":"2023-07-05T23:32:57.365087+0000","last_unstale":"2023-07-05T23:32:57.779248+0000","last_undegraded":"2023-07-05T23:32:57.779248+0000","last_fullsized":"2023-07-05T23:32:57.779248+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:13:09.034988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779268+0000","last_change":"2023-07-05T23:32:52.902806+0000","last_active":"2023-07-05T23:32:57.779268+0000","last_peered":"2023-07-05T23:32:57.779268+0000","last_clean":"2023-07-05T23:32:57.779268+0000","last_became_active":"2023-07-05T23:32:52.901689+0000","last_became_peered":"2023-07-05T23:32:52.901689+0000","last_unstale":"2023-07-05T23:32:57.779268+0000","last_undegraded":"2023-07-05T23:32:57.779268+0000","last_fullsized":"2023-07-05T23:32:57.779268+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:19:37.582219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.782489+0000","last_change":"2023-07-05T23:32:53.346776+0000","last_active":"2023-07-05T23:32:57.782489+0000","last_peered":"2023-07-05T23:32:57.782489+0000","last_clean":"2023-07-05T23:32:57.782489+0000","last_became_active":"2023-07-05T23:32:53.346553+0000","last_became_peered":"2023-07-05T23:32:53.346553+0000","last_unstale":"2023-07-05T23:32:57.782489+0000","last_undegraded":"2023-07-05T23:32:57.782489+0000","last_fullsized":"2023-07-05T23:32:57.782489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:21:03.950759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.782335+0000","last_change":"2023-07-05T23:32:57.353173+0000","last_active":"2023-07-05T23:32:57.782335+0000","last_peered":"2023-07-05T23:32:57.782335+0000","last_clean":"2023-07-05T23:32:57.782335+0000","last_became_active":"2023-07-05T23:32:57.352716+0000","last_became_peered":"2023-07-05T23:32:57.352716+0000","last_unstale":"2023-07-05T23:32:57.782335+0000","last_undegraded":"2023-07-05T23:32:57.782335+0000","last_fullsized":"2023-07-05T23:32:57.782335+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:00:24.588333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780499+0000","last_change":"2023-07-05T23:32:52.906954+0000","last_active":"2023-07-05T23:32:57.780499+0000","last_peered":"2023-07-05T23:32:57.780499+0000","last_clean":"2023-07-05T23:32:57.780499+0000","last_became_active":"2023-07-05T23:32:52.906688+0000","last_became_peered":"2023-07-05T23:32:52.906688+0000","last_unstale":"2023-07-05T23:32:57.780499+0000","last_undegraded":"2023-07-05T23:32:57.780499+0000","last_fullsized":"2023-07-05T23:32:57.780499+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:17:19.088603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781851+0000","last_change":"2023-07-05T23:32:53.348210+0000","last_active":"2023-07-05T23:32:57.781851+0000","last_peered":"2023-07-05T23:32:57.781851+0000","last_clean":"2023-07-05T23:32:57.781851+0000","last_became_active":"2023-07-05T23:32:53.346652+0000","last_became_peered":"2023-07-05T23:32:53.346652+0000","last_unstale":"2023-07-05T23:32:57.781851+0000","last_undegraded":"2023-07-05T23:32:57.781851+0000","last_fullsized":"2023-07-05T23:32:57.781851+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:15:23.368968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.776688+0000","last_change":"2023-07-05T23:32:57.357185+0000","last_active":"2023-07-05T23:32:57.776688+0000","last_peered":"2023-07-05T23:32:57.776688+0000","last_clean":"2023-07-05T23:32:57.776688+0000","last_became_active":"2023-07-05T23:32:57.356637+0000","last_became_peered":"2023-07-05T23:32:57.356637+0000","last_unstale":"2023-07-05T23:32:57.776688+0000","last_undegraded":"2023-07-05T23:32:57.776688+0000","last_fullsized":"2023-07-05T23:32:57.776688+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:03:24.263651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781492+0000","last_change":"2023-07-05T23:32:52.904412+0000","last_active":"2023-07-05T23:32:57.781492+0000","last_peered":"2023-07-05T23:32:57.781492+0000","last_clean":"2023-07-05T23:32:57.781492+0000","last_became_active":"2023-07-05T23:32:52.903823+0000","last_became_peered":"2023-07-05T23:32:52.903823+0000","last_unstale":"2023-07-05T23:32:57.781492+0000","last_undegraded":"2023-07-05T23:32:57.781492+0000","last_fullsized":"2023-07-05T23:32:57.781492+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:38:12.885407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.782622+0000","last_change":"2023-07-05T23:32:53.342800+0000","last_active":"2023-07-05T23:32:57.782622+0000","last_peered":"2023-07-05T23:32:57.782622+0000","last_clean":"2023-07-05T23:32:57.782622+0000","last_became_active":"2023-07-05T23:32:53.339863+0000","last_became_peered":"2023-07-05T23:32:53.339863+0000","last_unstale":"2023-07-05T23:32:57.782622+0000","last_undegraded":"2023-07-05T23:32:57.782622+0000","last_fullsized":"2023-07-05T23:32:57.782622+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:23:04.385250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780633+0000","last_change":"2023-07-05T23:32:53.337066+0000","last_active":"2023-07-05T23:32:57.780633+0000","last_peered":"2023-07-05T23:32:57.780633+0000","last_clean":"2023-07-05T23:32:57.780633+0000","last_became_active":"2023-07-05T23:32:53.336759+0000","last_became_peered":"2023-07-05T23:32:53.336759+0000","last_unstale":"2023-07-05T23:32:57.780633+0000","last_undegraded":"2023-07-05T23:32:57.780633+0000","last_fullsized":"2023-07-05T23:32:57.780633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:37:57.921126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781993+0000","last_change":"2023-07-05T23:32:53.346160+0000","last_active":"2023-07-05T23:32:57.781993+0000","last_peered":"2023-07-05T23:32:57.781993+0000","last_clean":"2023-07-05T23:32:57.781993+0000","last_became_active":"2023-07-05T23:32:53.345711+0000","last_became_peered":"2023-07-05T23:32:53.345711+0000","last_unstale":"2023-07-05T23:32:57.781993+0000","last_undegraded":"2023-07-05T23:32:57.781993+0000","last_fullsized":"2023-07-05T23:32:57.781993+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:43:31.795176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.783058+0000","last_change":"2023-07-05T23:32:53.339729+0000","last_active":"2023-07-05T23:32:57.783058+0000","last_peered":"2023-07-05T23:32:57.783058+0000","last_clean":"2023-07-05T23:32:57.783058+0000","last_became_active":"2023-07-05T23:32:53.339431+0000","last_became_peered":"2023-07-05T23:32:53.339431+0000","last_unstale":"2023-07-05T23:32:57.783058+0000","last_undegraded":"2023-07-05T23:32:57.783058+0000","last_fullsized":"2023-07-05T23:32:57.783058+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:37:45.661547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779811+0000","last_change":"2023-07-05T23:32:53.335512+0000","last_active":"2023-07-05T23:32:57.779811+0000","last_peered":"2023-07-05T23:32:57.779811+0000","last_clean":"2023-07-05T23:32:57.779811+0000","last_became_active":"2023-07-05T23:32:53.335181+0000","last_became_peered":"2023-07-05T23:32:53.335181+0000","last_unstale":"2023-07-05T23:32:57.779811+0000","last_undegraded":"2023-07-05T23:32:57.779811+0000","last_fullsized":"2023-07-05T23:32:57.779811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:15:41.388811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.777103+0000","last_change":"2023-07-05T23:32:53.338171+0000","last_active":"2023-07-05T23:32:57.777103+0000","last_peered":"2023-07-05T23:32:57.777103+0000","last_clean":"2023-07-05T23:32:57.777103+0000","last_became_active":"2023-07-05T23:32:53.337835+0000","last_became_peered":"2023-07-05T23:32:53.337835+0000","last_unstale":"2023-07-05T23:32:57.777103+0000","last_undegraded":"2023-07-05T23:32:57.777103+0000","last_fullsized":"2023-07-05T23:32:57.777103+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:15:41.388811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":904,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":925696,"data_stored":718950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":303104,"data_stored":124572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":303104,"data_stored":124572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]}]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":901120,"data_stored":715522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":303104,"data_stored":124572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":307200,"data_stored":124662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":323584,"data_stored":128422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]}]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":311296,"data_stored":125224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-05T23:33:17.950 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-05T23:33:18.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.098+0000 7f0181a4c700 1 Processor -- start 2023-07-05T23:33:18.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.098+0000 7f0181a4c700 1 -- start start 2023-07-05T23:33:18.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.099+0000 7f0181a4c700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f017c06ccc0 0x7f017c15fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:18.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.099+0000 7f0181a4c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f017c160340 0x7f017c0d0840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:18.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.099+0000 7f0181a4c700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f017c0afdb0 con 0x7f017c15c2e0 2023-07-05T23:33:18.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.099+0000 7f0181a4c700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f017c0ceb90 con 0x7f017c160340 2023-07-05T23:33:18.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.099+0000 7f0181a4c700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f017c15c6b0 con 0x7f017c06ccc0 2023-07-05T23:33:18.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.099+0000 7f017b7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f017c160340 0x7f017c0d0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:18.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.099+0000 7f017b7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f017c160340 0x7f017c0d0840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45186/0 (socket says 172.21.15.27:45186) 2023-07-05T23:33:18.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.099+0000 7f017b7fe700 1 -- 172.21.15.27:0/2471214524 learned_addr learned my addr 172.21.15.27:0/2471214524 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:18.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.099+0000 7f017a7fc700 1 --2- 172.21.15.27:0/2471214524 >> v2:172.21.15.162:3300/0 conn(0x7f017c06ccc0 0x7f017c15fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:18.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.100+0000 7f017b7fe700 1 -- 172.21.15.27:0/2471214524 >> v2:172.21.15.162:3300/0 conn(0x7f017c06ccc0 msgr2=0x7f017c15fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:18.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.100+0000 7f017b7fe700 1 --2- 172.21.15.27:0/2471214524 >> v2:172.21.15.162:3300/0 conn(0x7f017c06ccc0 0x7f017c15fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:18.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.100+0000 7f017b7fe700 1 -- 172.21.15.27:0/2471214524 >> v1:172.21.15.162:6789/0 conn(0x7f017c15c2e0 legacy=0x7f017c0ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:18.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.100+0000 7f017b7fe700 1 -- 172.21.15.27:0/2471214524 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f017c0b0000 con 0x7f017c160340 2023-07-05T23:33:18.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.100+0000 7f017b7fe700 1 --2- 172.21.15.27:0/2471214524 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f017c160340 0x7f017c0d0840 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f017c071f90 tx=0x7f017400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7990b9b03310908 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:18.106 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.100+0000 7f0179ffb700 1 -- 172.21.15.27:0/2471214524 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017400e070 con 0x7f017c160340 2023-07-05T23:33:18.106 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.100+0000 7f0179ffb700 1 -- 172.21.15.27:0/2471214524 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f017400b9c0 con 0x7f017c160340 2023-07-05T23:33:18.106 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.100+0000 7f0179ffb700 1 -- 172.21.15.27:0/2471214524 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017400bd70 con 0x7f017c160340 2023-07-05T23:33:18.106 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.100+0000 7f0181a4c700 1 -- 172.21.15.27:0/2471214524 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f017c160340 msgr2=0x7f017c0d0840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:18.106 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.100+0000 7f0181a4c700 1 --2- 172.21.15.27:0/2471214524 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f017c160340 0x7f017c0d0840 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f017c071f90 tx=0x7f017400b330 comp rx=0 tx=0).stop 2023-07-05T23:33:18.106 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.100+0000 7f0181a4c700 1 -- 172.21.15.27:0/2471214524 shutdown_connections 2023-07-05T23:33:18.106 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.100+0000 7f0181a4c700 1 --2- 172.21.15.27:0/2471214524 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f017c160340 0x7f017c0d0840 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:18.106 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.100+0000 7f0181a4c700 1 --2- 172.21.15.27:0/2471214524 >> v2:172.21.15.162:3300/0 conn(0x7f017c06ccc0 0x7f017c15fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:18.107 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.100+0000 7f0181a4c700 1 -- 172.21.15.27:0/2471214524 >> 172.21.15.27:0/2471214524 conn(0x7f017c06e530 msgr2=0x7f017c06e900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:18.107 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.101+0000 7f0181a4c700 1 -- 172.21.15.27:0/2471214524 shutdown_connections 2023-07-05T23:33:18.107 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.101+0000 7f0181a4c700 1 -- 172.21.15.27:0/2471214524 wait complete. 2023-07-05T23:33:18.111 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.102+0000 7f0181a4c700 1 Processor -- start 2023-07-05T23:33:18.111 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.102+0000 7f0181a4c700 1 -- start start 2023-07-05T23:33:18.111 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.103+0000 7f0181a4c700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f017c06ccc0 0x7f017c14bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:18.111 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.103+0000 7f0181a4c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f017c15c2e0 0x7f017c0b0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:18.111 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.103+0000 7f0181a4c700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f017c160340 0x7f017c156940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:18.111 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.103+0000 7f0181a4c700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f017c158510 con 0x7f017c15c2e0 2023-07-05T23:33:18.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.103+0000 7f0181a4c700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f017c157f00 con 0x7f017c06ccc0 2023-07-05T23:33:18.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.103+0000 7f0181a4c700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f017c0c7420 con 0x7f017c160340 2023-07-05T23:33:18.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.103+0000 7f017a7fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f017c15c2e0 0x7f017c0b0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:18.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.103+0000 7f017a7fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f017c15c2e0 0x7f017c0b0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45192/0 (socket says 172.21.15.27:45192) 2023-07-05T23:33:18.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.103+0000 7f017a7fc700 1 -- 172.21.15.27:0/2381248053 learned_addr learned my addr 172.21.15.27:0/2381248053 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:18.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.104+0000 7f017affd700 1 --2- 172.21.15.27:0/2381248053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f017c06ccc0 0x7f017c14bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:18.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.104+0000 7f017b7fe700 1 --2- 172.21.15.27:0/2381248053 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f017c160340 0x7f017c156940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:18.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.104+0000 7f017a7fc700 1 -- 172.21.15.27:0/2381248053 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f017c160340 msgr2=0x7f017c156940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:18.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.104+0000 7f017a7fc700 1 --2- 172.21.15.27:0/2381248053 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f017c160340 0x7f017c156940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:18.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.104+0000 7f017a7fc700 1 -- 172.21.15.27:0/2381248053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f017c06ccc0 msgr2=0x7f017c14bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:18.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.104+0000 7f017a7fc700 1 --2- 172.21.15.27:0/2381248053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f017c06ccc0 0x7f017c14bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:18.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.104+0000 7f017a7fc700 1 -- 172.21.15.27:0/2381248053 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0174009b30 con 0x7f017c15c2e0 2023-07-05T23:33:18.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.104+0000 7f017affd700 1 --2- 172.21.15.27:0/2381248053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f017c06ccc0 0x7f017c14bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T23:33:18.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.104+0000 7f017b7fe700 1 --2- 172.21.15.27:0/2381248053 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f017c160340 0x7f017c156940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T23:33:18.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.104+0000 7f017a7fc700 1 --2- 172.21.15.27:0/2381248053 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f017c15c2e0 0x7f017c0b0a50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f016c00e810 tx=0x7f016c00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:18.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.104+0000 7f0163fff700 1 -- 172.21.15.27:0/2381248053 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016c013610 con 0x7f017c15c2e0 2023-07-05T23:33:18.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.104+0000 7f0163fff700 1 -- 172.21.15.27:0/2381248053 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f016c013770 con 0x7f017c15c2e0 2023-07-05T23:33:18.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.104+0000 7f0163fff700 1 -- 172.21.15.27:0/2381248053 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016c013b20 con 0x7f017c15c2e0 2023-07-05T23:33:18.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.104+0000 7f0181a4c700 1 -- 172.21.15.27:0/2381248053 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f017c1581a0 con 0x7f017c15c2e0 2023-07-05T23:33:18.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.104+0000 7f0181a4c700 1 -- 172.21.15.27:0/2381248053 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f017c14c010 con 0x7f017c15c2e0 2023-07-05T23:33:18.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.105+0000 7f0181a4c700 1 -- 172.21.15.27:0/2381248053 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f017c1586c0 con 0x7f017c15c2e0 2023-07-05T23:33:18.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.105+0000 7f0163fff700 1 -- 172.21.15.27:0/2381248053 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f016c013c80 con 0x7f017c15c2e0 2023-07-05T23:33:18.116 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.106+0000 7f0163fff700 1 --2- 172.21.15.27:0/2381248053 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f016806ace0 0x7f016806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:18.116 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.106+0000 7f0163fff700 1 -- 172.21.15.27:0/2381248053 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f016c0894a0 con 0x7f017c15c2e0 2023-07-05T23:33:18.116 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.106+0000 7f017affd700 1 --2- 172.21.15.27:0/2381248053 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f016806ace0 0x7f016806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:18.116 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.107+0000 7f017affd700 1 --2- 172.21.15.27:0/2381248053 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f016806ace0 0x7f016806d190 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0170000f60 tx=0x7f0170009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:18.116 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.110+0000 7f0163fff700 1 -- 172.21.15.27:0/2381248053 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f016c054270 con 0x7f017c15c2e0 2023-07-05T23:33:18.306 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.303+0000 7f0181a4c700 1 -- 172.21.15.27:0/2381248053 --> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f017c06bcf0 con 0x7f016806ace0 2023-07-05T23:33:18.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.314+0000 7f0163fff700 1 -- 172.21.15.27:0/2381248053 <== mgr.4105 v2:172.21.15.162:6832/3790028097 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367317 (secure 0 0 0) 0x7f01700123d0 con 0x7f016806ace0 2023-07-05T23:33:18.320 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:33:18.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.317+0000 7f0181a4c700 1 -- 172.21.15.27:0/2381248053 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f016806ace0 msgr2=0x7f016806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:18.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.317+0000 7f0181a4c700 1 --2- 172.21.15.27:0/2381248053 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f016806ace0 0x7f016806d190 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0170000f60 tx=0x7f0170009040 comp rx=0 tx=0).stop 2023-07-05T23:33:18.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.317+0000 7f0181a4c700 1 -- 172.21.15.27:0/2381248053 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f017c15c2e0 msgr2=0x7f017c0b0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:18.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.317+0000 7f0181a4c700 1 --2- 172.21.15.27:0/2381248053 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f017c15c2e0 0x7f017c0b0a50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f016c00e810 tx=0x7f016c00ebd0 comp rx=0 tx=0).stop 2023-07-05T23:33:18.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.318+0000 7f0181a4c700 1 -- 172.21.15.27:0/2381248053 shutdown_connections 2023-07-05T23:33:18.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.318+0000 7f0181a4c700 1 --2- 172.21.15.27:0/2381248053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f017c06ccc0 0x7f017c14bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:18.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.318+0000 7f0181a4c700 1 --2- 172.21.15.27:0/2381248053 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f016806ace0 0x7f016806d190 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:18.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.318+0000 7f0181a4c700 1 --2- 172.21.15.27:0/2381248053 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f017c160340 0x7f017c156940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:18.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.318+0000 7f0181a4c700 1 --2- 172.21.15.27:0/2381248053 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f017c15c2e0 0x7f017c0b0a50 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:18.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.318+0000 7f0181a4c700 1 -- 172.21.15.27:0/2381248053 >> 172.21.15.27:0/2381248053 conn(0x7f017c06e530 msgr2=0x7f017c15f130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:18.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.318+0000 7f0181a4c700 1 -- 172.21.15.27:0/2381248053 shutdown_connections 2023-07-05T23:33:18.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.318+0000 7f0181a4c700 1 -- 172.21.15.27:0/2381248053 wait complete. 2023-07-05T23:33:18.324 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2023-07-05T23:33:18.333 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2023-07-05T23:33:17.575063+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219208,"kb_used_data":3592,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755512,"statfs":{"total":773094113280,"available":772869644288,"internally_reserved":0,"allocated":3678208,"data_stored":2186496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003529"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781415+0000","last_change":"2023-07-05T23:32:53.342316+0000","last_active":"2023-07-05T23:32:57.781415+0000","last_peered":"2023-07-05T23:32:57.781415+0000","last_clean":"2023-07-05T23:32:57.781415+0000","last_became_active":"2023-07-05T23:32:53.342061+0000","last_became_peered":"2023-07-05T23:32:53.342061+0000","last_unstale":"2023-07-05T23:32:57.781415+0000","last_undegraded":"2023-07-05T23:32:57.781415+0000","last_fullsized":"2023-07-05T23:32:57.781415+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:38:35.161436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779776+0000","last_change":"2023-07-05T23:32:53.343107+0000","last_active":"2023-07-05T23:32:57.779776+0000","last_peered":"2023-07-05T23:32:57.779776+0000","last_clean":"2023-07-05T23:32:57.779776+0000","last_became_active":"2023-07-05T23:32:53.342843+0000","last_became_peered":"2023-07-05T23:32:53.342843+0000","last_unstale":"2023-07-05T23:32:57.779776+0000","last_undegraded":"2023-07-05T23:32:57.779776+0000","last_fullsized":"2023-07-05T23:32:57.779776+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:20:57.393702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.783279+0000","last_change":"2023-07-05T23:32:53.339304+0000","last_active":"2023-07-05T23:32:57.783279+0000","last_peered":"2023-07-05T23:32:57.783279+0000","last_clean":"2023-07-05T23:32:57.783279+0000","last_became_active":"2023-07-05T23:32:53.338973+0000","last_became_peered":"2023-07-05T23:32:53.338973+0000","last_unstale":"2023-07-05T23:32:57.783279+0000","last_undegraded":"2023-07-05T23:32:57.783279+0000","last_fullsized":"2023-07-05T23:32:57.783279+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:10:47.650972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781305+0000","last_change":"2023-07-05T23:32:53.334788+0000","last_active":"2023-07-05T23:32:57.781305+0000","last_peered":"2023-07-05T23:32:57.781305+0000","last_clean":"2023-07-05T23:32:57.781305+0000","last_became_active":"2023-07-05T23:32:53.334473+0000","last_became_peered":"2023-07-05T23:32:53.334473+0000","last_unstale":"2023-07-05T23:32:57.781305+0000","last_undegraded":"2023-07-05T23:32:57.781305+0000","last_fullsized":"2023-07-05T23:32:57.781305+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:41:19.407762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780497+0000","last_change":"2023-07-05T23:32:53.346034+0000","last_active":"2023-07-05T23:32:57.780497+0000","last_peered":"2023-07-05T23:32:57.780497+0000","last_clean":"2023-07-05T23:32:57.780497+0000","last_became_active":"2023-07-05T23:32:53.345743+0000","last_became_peered":"2023-07-05T23:32:53.345743+0000","last_unstale":"2023-07-05T23:32:57.780497+0000","last_undegraded":"2023-07-05T23:32:57.780497+0000","last_fullsized":"2023-07-05T23:32:57.780497+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:07:52.872003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.782814+0000","last_change":"2023-07-05T23:32:53.335744+0000","last_active":"2023-07-05T23:32:57.782814+0000","last_peered":"2023-07-05T23:32:57.782814+0000","last_clean":"2023-07-05T23:32:57.782814+0000","last_became_active":"2023-07-05T23:32:53.335456+0000","last_became_peered":"2023-07-05T23:32:53.335456+0000","last_unstale":"2023-07-05T23:32:57.782814+0000","last_undegraded":"2023-07-05T23:32:57.782814+0000","last_fullsized":"2023-07-05T23:32:57.782814+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:32:51.547111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781403+0000","last_change":"2023-07-05T23:32:53.341154+0000","last_active":"2023-07-05T23:32:57.781403+0000","last_peered":"2023-07-05T23:32:57.781403+0000","last_clean":"2023-07-05T23:32:57.781403+0000","last_became_active":"2023-07-05T23:32:53.340639+0000","last_became_peered":"2023-07-05T23:32:53.340639+0000","last_unstale":"2023-07-05T23:32:57.781403+0000","last_undegraded":"2023-07-05T23:32:57.781403+0000","last_fullsized":"2023-07-05T23:32:57.781403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:20:29.661027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.778451+0000","last_change":"2023-07-05T23:32:53.336514+0000","last_active":"2023-07-05T23:32:57.778451+0000","last_peered":"2023-07-05T23:32:57.778451+0000","last_clean":"2023-07-05T23:32:57.778451+0000","last_became_active":"2023-07-05T23:32:53.336216+0000","last_became_peered":"2023-07-05T23:32:53.336216+0000","last_unstale":"2023-07-05T23:32:57.778451+0000","last_undegraded":"2023-07-05T23:32:57.778451+0000","last_fullsized":"2023-07-05T23:32:57.778451+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:15:41.388811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781197+0000","last_change":"2023-07-05T23:32:53.348265+0000","last_active":"2023-07-05T23:32:57.781197+0000","last_peered":"2023-07-05T23:32:57.781197+0000","last_clean":"2023-07-05T23:32:57.781197+0000","last_became_active":"2023-07-05T23:32:53.347948+0000","last_became_peered":"2023-07-05T23:32:53.347948+0000","last_unstale":"2023-07-05T23:32:57.781197+0000","last_undegraded":"2023-07-05T23:32:57.781197+0000","last_fullsized":"2023-07-05T23:32:57.781197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:36:17.743168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780020+0000","last_change":"2023-07-05T23:32:53.330422+0000","last_active":"2023-07-05T23:32:57.780020+0000","last_peered":"2023-07-05T23:32:57.780020+0000","last_clean":"2023-07-05T23:32:57.780020+0000","last_became_active":"2023-07-05T23:32:53.330135+0000","last_became_peered":"2023-07-05T23:32:53.330135+0000","last_unstale":"2023-07-05T23:32:57.780020+0000","last_undegraded":"2023-07-05T23:32:57.780020+0000","last_fullsized":"2023-07-05T23:32:57.780020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:51:41.704756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.783413+0000","last_change":"2023-07-05T23:32:53.341815+0000","last_active":"2023-07-05T23:32:57.783413+0000","last_peered":"2023-07-05T23:32:57.783413+0000","last_clean":"2023-07-05T23:32:57.783413+0000","last_became_active":"2023-07-05T23:32:53.341526+0000","last_became_peered":"2023-07-05T23:32:53.341526+0000","last_unstale":"2023-07-05T23:32:57.783413+0000","last_undegraded":"2023-07-05T23:32:57.783413+0000","last_fullsized":"2023-07-05T23:32:57.783413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:32:19.839362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780813+0000","last_change":"2023-07-05T23:32:53.337552+0000","last_active":"2023-07-05T23:32:57.780813+0000","last_peered":"2023-07-05T23:32:57.780813+0000","last_clean":"2023-07-05T23:32:57.780813+0000","last_became_active":"2023-07-05T23:32:53.337279+0000","last_became_peered":"2023-07-05T23:32:53.337279+0000","last_unstale":"2023-07-05T23:32:57.780813+0000","last_undegraded":"2023-07-05T23:32:57.780813+0000","last_fullsized":"2023-07-05T23:32:57.780813+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:02:45.623527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780599+0000","last_change":"2023-07-05T23:32:53.336366+0000","last_active":"2023-07-05T23:32:57.780599+0000","last_peered":"2023-07-05T23:32:57.780599+0000","last_clean":"2023-07-05T23:32:57.780599+0000","last_became_active":"2023-07-05T23:32:53.336083+0000","last_became_peered":"2023-07-05T23:32:53.336083+0000","last_unstale":"2023-07-05T23:32:57.780599+0000","last_undegraded":"2023-07-05T23:32:57.780599+0000","last_fullsized":"2023-07-05T23:32:57.780599+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:38:52.290400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779072+0000","last_change":"2023-07-05T23:32:53.328235+0000","last_active":"2023-07-05T23:32:57.779072+0000","last_peered":"2023-07-05T23:32:57.779072+0000","last_clean":"2023-07-05T23:32:57.779072+0000","last_became_active":"2023-07-05T23:32:53.327918+0000","last_became_peered":"2023-07-05T23:32:53.327918+0000","last_unstale":"2023-07-05T23:32:57.779072+0000","last_undegraded":"2023-07-05T23:32:57.779072+0000","last_fullsized":"2023-07-05T23:32:57.779072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:17:18.286061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780570+0000","last_change":"2023-07-05T23:32:53.340929+0000","last_active":"2023-07-05T23:32:57.780570+0000","last_peered":"2023-07-05T23:32:57.780570+0000","last_clean":"2023-07-05T23:32:57.780570+0000","last_became_active":"2023-07-05T23:32:53.340246+0000","last_became_peered":"2023-07-05T23:32:53.340246+0000","last_unstale":"2023-07-05T23:32:57.780570+0000","last_undegraded":"2023-07-05T23:32:57.780570+0000","last_fullsized":"2023-07-05T23:32:57.780570+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:40:46.792647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.782427+0000","last_change":"2023-07-05T23:32:53.336278+0000","last_active":"2023-07-05T23:32:57.782427+0000","last_peered":"2023-07-05T23:32:57.782427+0000","last_clean":"2023-07-05T23:32:57.782427+0000","last_became_active":"2023-07-05T23:32:53.336006+0000","last_became_peered":"2023-07-05T23:32:53.336006+0000","last_unstale":"2023-07-05T23:32:57.782427+0000","last_undegraded":"2023-07-05T23:32:57.782427+0000","last_fullsized":"2023-07-05T23:32:57.782427+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:22:27.347492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781279+0000","last_change":"2023-07-05T23:32:53.346115+0000","last_active":"2023-07-05T23:32:57.781279+0000","last_peered":"2023-07-05T23:32:57.781279+0000","last_clean":"2023-07-05T23:32:57.781279+0000","last_became_active":"2023-07-05T23:32:53.345848+0000","last_became_peered":"2023-07-05T23:32:53.345848+0000","last_unstale":"2023-07-05T23:32:57.781279+0000","last_undegraded":"2023-07-05T23:32:57.781279+0000","last_fullsized":"2023-07-05T23:32:57.781279+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:25:19.741667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.782779+0000","last_change":"2023-07-05T23:32:53.339001+0000","last_active":"2023-07-05T23:32:57.782779+0000","last_peered":"2023-07-05T23:32:57.782779+0000","last_clean":"2023-07-05T23:32:57.782779+0000","last_became_active":"2023-07-05T23:32:53.335535+0000","last_became_peered":"2023-07-05T23:32:53.335535+0000","last_unstale":"2023-07-05T23:32:57.782779+0000","last_undegraded":"2023-07-05T23:32:57.782779+0000","last_fullsized":"2023-07-05T23:32:57.782779+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:52:25.342366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781210+0000","last_change":"2023-07-05T23:32:53.338403+0000","last_active":"2023-07-05T23:32:57.781210+0000","last_peered":"2023-07-05T23:32:57.781210+0000","last_clean":"2023-07-05T23:32:57.781210+0000","last_became_active":"2023-07-05T23:32:53.338095+0000","last_became_peered":"2023-07-05T23:32:53.338095+0000","last_unstale":"2023-07-05T23:32:57.781210+0000","last_undegraded":"2023-07-05T23:32:57.781210+0000","last_fullsized":"2023-07-05T23:32:57.781210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:53:30.928953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.783844+0000","last_change":"2023-07-05T23:32:53.341961+0000","last_active":"2023-07-05T23:32:57.783844+0000","last_peered":"2023-07-05T23:32:57.783844+0000","last_clean":"2023-07-05T23:32:57.783844+0000","last_became_active":"2023-07-05T23:32:53.341783+0000","last_became_peered":"2023-07-05T23:32:53.341783+0000","last_unstale":"2023-07-05T23:32:57.783844+0000","last_undegraded":"2023-07-05T23:32:57.783844+0000","last_fullsized":"2023-07-05T23:32:57.783844+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:11:32.403021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780722+0000","last_change":"2023-07-05T23:32:53.348405+0000","last_active":"2023-07-05T23:32:57.780722+0000","last_peered":"2023-07-05T23:32:57.780722+0000","last_clean":"2023-07-05T23:32:57.780722+0000","last_became_active":"2023-07-05T23:32:53.348108+0000","last_became_peered":"2023-07-05T23:32:53.348108+0000","last_unstale":"2023-07-05T23:32:57.780722+0000","last_undegraded":"2023-07-05T23:32:57.780722+0000","last_fullsized":"2023-07-05T23:32:57.780722+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:36:17.743168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781700+0000","last_change":"2023-07-05T23:32:53.340963+0000","last_active":"2023-07-05T23:32:57.781700+0000","last_peered":"2023-07-05T23:32:57.781700+0000","last_clean":"2023-07-05T23:32:57.781700+0000","last_became_active":"2023-07-05T23:32:53.340698+0000","last_became_peered":"2023-07-05T23:32:53.340698+0000","last_unstale":"2023-07-05T23:32:57.781700+0000","last_undegraded":"2023-07-05T23:32:57.781700+0000","last_fullsized":"2023-07-05T23:32:57.781700+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:19:10.358522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781287+0000","last_change":"2023-07-05T23:32:53.345981+0000","last_active":"2023-07-05T23:32:57.781287+0000","last_peered":"2023-07-05T23:32:57.781287+0000","last_clean":"2023-07-05T23:32:57.781287+0000","last_became_active":"2023-07-05T23:32:53.345403+0000","last_became_peered":"2023-07-05T23:32:53.345403+0000","last_unstale":"2023-07-05T23:32:57.781287+0000","last_undegraded":"2023-07-05T23:32:57.781287+0000","last_fullsized":"2023-07-05T23:32:57.781287+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:00:21.148640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780634+0000","last_change":"2023-07-05T23:32:53.348335+0000","last_active":"2023-07-05T23:32:57.780634+0000","last_peered":"2023-07-05T23:32:57.780634+0000","last_clean":"2023-07-05T23:32:57.780634+0000","last_became_active":"2023-07-05T23:32:53.348053+0000","last_became_peered":"2023-07-05T23:32:53.348053+0000","last_unstale":"2023-07-05T23:32:57.780634+0000","last_undegraded":"2023-07-05T23:32:57.780634+0000","last_fullsized":"2023-07-05T23:32:57.780634+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:21:31.956439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.777146+0000","last_change":"2023-07-05T23:32:53.339227+0000","last_active":"2023-07-05T23:32:57.777146+0000","last_peered":"2023-07-05T23:32:57.777146+0000","last_clean":"2023-07-05T23:32:57.777146+0000","last_became_active":"2023-07-05T23:32:53.338935+0000","last_became_peered":"2023-07-05T23:32:53.338935+0000","last_unstale":"2023-07-05T23:32:57.777146+0000","last_undegraded":"2023-07-05T23:32:57.777146+0000","last_fullsized":"2023-07-05T23:32:57.777146+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:27:27.060118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.777271+0000","last_change":"2023-07-05T23:32:53.342191+0000","last_active":"2023-07-05T23:32:57.777271+0000","last_peered":"2023-07-05T23:32:57.777271+0000","last_clean":"2023-07-05T23:32:57.777271+0000","last_became_active":"2023-07-05T23:32:53.341948+0000","last_became_peered":"2023-07-05T23:32:53.341948+0000","last_unstale":"2023-07-05T23:32:57.777271+0000","last_undegraded":"2023-07-05T23:32:57.777271+0000","last_fullsized":"2023-07-05T23:32:57.777271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:38:13.889745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779405+0000","last_change":"2023-07-05T23:32:53.336623+0000","last_active":"2023-07-05T23:32:57.779405+0000","last_peered":"2023-07-05T23:32:57.779405+0000","last_clean":"2023-07-05T23:32:57.779405+0000","last_became_active":"2023-07-05T23:32:53.335857+0000","last_became_peered":"2023-07-05T23:32:53.335857+0000","last_unstale":"2023-07-05T23:32:57.779405+0000","last_undegraded":"2023-07-05T23:32:57.779405+0000","last_fullsized":"2023-07-05T23:32:57.779405+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:17:20.092941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.784100+0000","last_change":"2023-07-05T23:32:57.365825+0000","last_active":"2023-07-05T23:32:57.784100+0000","last_peered":"2023-07-05T23:32:57.784100+0000","last_clean":"2023-07-05T23:32:57.784100+0000","last_became_active":"2023-07-05T23:32:57.365409+0000","last_became_peered":"2023-07-05T23:32:57.365409+0000","last_unstale":"2023-07-05T23:32:57.784100+0000","last_undegraded":"2023-07-05T23:32:57.784100+0000","last_fullsized":"2023-07-05T23:32:57.784100+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:47:37.647980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.782903+0000","last_change":"2023-07-05T23:32:52.901348+0000","last_active":"2023-07-05T23:32:57.782903+0000","last_peered":"2023-07-05T23:32:57.782903+0000","last_clean":"2023-07-05T23:32:57.782903+0000","last_became_active":"2023-07-05T23:32:52.901080+0000","last_became_peered":"2023-07-05T23:32:52.901080+0000","last_unstale":"2023-07-05T23:32:57.782903+0000","last_undegraded":"2023-07-05T23:32:57.782903+0000","last_fullsized":"2023-07-05T23:32:57.782903+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:11:28.344067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780698+0000","last_change":"2023-07-05T23:32:53.339739+0000","last_active":"2023-07-05T23:32:57.780698+0000","last_peered":"2023-07-05T23:32:57.780698+0000","last_clean":"2023-07-05T23:32:57.780698+0000","last_became_active":"2023-07-05T23:32:53.339464+0000","last_became_peered":"2023-07-05T23:32:53.339464+0000","last_unstale":"2023-07-05T23:32:57.780698+0000","last_undegraded":"2023-07-05T23:32:57.780698+0000","last_fullsized":"2023-07-05T23:32:57.780698+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:17:18.286061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780977+0000","last_change":"2023-07-05T23:32:57.354002+0000","last_active":"2023-07-05T23:32:57.780977+0000","last_peered":"2023-07-05T23:32:57.780977+0000","last_clean":"2023-07-05T23:32:57.780977+0000","last_became_active":"2023-07-05T23:32:57.353465+0000","last_became_peered":"2023-07-05T23:32:57.353465+0000","last_unstale":"2023-07-05T23:32:57.780977+0000","last_undegraded":"2023-07-05T23:32:57.780977+0000","last_fullsized":"2023-07-05T23:32:57.780977+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:22:44.688998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.776277+0000","last_change":"2023-07-05T23:32:52.909685+0000","last_active":"2023-07-05T23:32:57.776277+0000","last_peered":"2023-07-05T23:32:57.776277+0000","last_clean":"2023-07-05T23:32:57.776277+0000","last_became_active":"2023-07-05T23:32:52.909347+0000","last_became_peered":"2023-07-05T23:32:52.909347+0000","last_unstale":"2023-07-05T23:32:57.776277+0000","last_undegraded":"2023-07-05T23:32:57.776277+0000","last_fullsized":"2023-07-05T23:32:57.776277+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:00:03.115621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780890+0000","last_change":"2023-07-05T23:32:53.339219+0000","last_active":"2023-07-05T23:32:57.780890+0000","last_peered":"2023-07-05T23:32:57.780890+0000","last_clean":"2023-07-05T23:32:57.780890+0000","last_became_active":"2023-07-05T23:32:53.338825+0000","last_became_peered":"2023-07-05T23:32:53.338825+0000","last_unstale":"2023-07-05T23:32:57.780890+0000","last_undegraded":"2023-07-05T23:32:57.780890+0000","last_fullsized":"2023-07-05T23:32:57.780890+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:15:41.388811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781104+0000","last_change":"2023-07-05T23:32:57.359406+0000","last_active":"2023-07-05T23:32:57.781104+0000","last_peered":"2023-07-05T23:32:57.781104+0000","last_clean":"2023-07-05T23:32:57.781104+0000","last_became_active":"2023-07-05T23:32:57.358965+0000","last_became_peered":"2023-07-05T23:32:57.358965+0000","last_unstale":"2023-07-05T23:32:57.781104+0000","last_undegraded":"2023-07-05T23:32:57.781104+0000","last_fullsized":"2023-07-05T23:32:57.781104+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:21:35.396133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780223+0000","last_change":"2023-07-05T23:32:52.909226+0000","last_active":"2023-07-05T23:32:57.780223+0000","last_peered":"2023-07-05T23:32:57.780223+0000","last_clean":"2023-07-05T23:32:57.780223+0000","last_became_active":"2023-07-05T23:32:52.908756+0000","last_became_peered":"2023-07-05T23:32:52.908756+0000","last_unstale":"2023-07-05T23:32:57.780223+0000","last_undegraded":"2023-07-05T23:32:57.780223+0000","last_fullsized":"2023-07-05T23:32:57.780223+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:19:37.582219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781082+0000","last_change":"2023-07-05T23:32:53.337872+0000","last_active":"2023-07-05T23:32:57.781082+0000","last_peered":"2023-07-05T23:32:57.781082+0000","last_clean":"2023-07-05T23:32:57.781082+0000","last_became_active":"2023-07-05T23:32:53.337480+0000","last_became_peered":"2023-07-05T23:32:53.337480+0000","last_unstale":"2023-07-05T23:32:57.781082+0000","last_undegraded":"2023-07-05T23:32:57.781082+0000","last_fullsized":"2023-07-05T23:32:57.781082+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:01:53.561649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780601+0000","last_change":"2023-07-05T23:32:57.356296+0000","last_active":"2023-07-05T23:32:57.780601+0000","last_peered":"2023-07-05T23:32:57.780601+0000","last_clean":"2023-07-05T23:32:57.780601+0000","last_became_active":"2023-07-05T23:32:57.355940+0000","last_became_peered":"2023-07-05T23:32:57.355940+0000","last_unstale":"2023-07-05T23:32:57.780601+0000","last_undegraded":"2023-07-05T23:32:57.780601+0000","last_fullsized":"2023-07-05T23:32:57.780601+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:44:10.928501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781337+0000","last_change":"2023-07-05T23:32:52.904533+0000","last_active":"2023-07-05T23:32:57.781337+0000","last_peered":"2023-07-05T23:32:57.781337+0000","last_clean":"2023-07-05T23:32:57.781337+0000","last_became_active":"2023-07-05T23:32:52.904140+0000","last_became_peered":"2023-07-05T23:32:52.904140+0000","last_unstale":"2023-07-05T23:32:57.781337+0000","last_undegraded":"2023-07-05T23:32:57.781337+0000","last_fullsized":"2023-07-05T23:32:57.781337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:13:04.590957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780100+0000","last_change":"2023-07-05T23:32:53.338517+0000","last_active":"2023-07-05T23:32:57.780100+0000","last_peered":"2023-07-05T23:32:57.780100+0000","last_clean":"2023-07-05T23:32:57.780100+0000","last_became_active":"2023-07-05T23:32:53.338248+0000","last_became_peered":"2023-07-05T23:32:53.338248+0000","last_unstale":"2023-07-05T23:32:57.780100+0000","last_undegraded":"2023-07-05T23:32:57.780100+0000","last_fullsized":"2023-07-05T23:32:57.780100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:38:13.889745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780227+0000","last_change":"2023-07-05T23:32:57.357483+0000","last_active":"2023-07-05T23:32:57.780227+0000","last_peered":"2023-07-05T23:32:57.780227+0000","last_clean":"2023-07-05T23:32:57.780227+0000","last_became_active":"2023-07-05T23:32:57.357039+0000","last_became_peered":"2023-07-05T23:32:57.357039+0000","last_unstale":"2023-07-05T23:32:57.780227+0000","last_undegraded":"2023-07-05T23:32:57.780227+0000","last_fullsized":"2023-07-05T23:32:57.780227+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:07:56.311696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780139+0000","last_change":"2023-07-05T23:32:52.900665+0000","last_active":"2023-07-05T23:32:57.780139+0000","last_peered":"2023-07-05T23:32:57.780139+0000","last_clean":"2023-07-05T23:32:57.780139+0000","last_became_active":"2023-07-05T23:32:52.900352+0000","last_became_peered":"2023-07-05T23:32:52.900352+0000","last_unstale":"2023-07-05T23:32:57.780139+0000","last_undegraded":"2023-07-05T23:32:57.780139+0000","last_fullsized":"2023-07-05T23:32:57.780139+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:43:30.790838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781414+0000","last_change":"2023-07-05T23:32:53.346621+0000","last_active":"2023-07-05T23:32:57.781414+0000","last_peered":"2023-07-05T23:32:57.781414+0000","last_clean":"2023-07-05T23:32:57.781414+0000","last_became_active":"2023-07-05T23:32:53.346373+0000","last_became_peered":"2023-07-05T23:32:53.346373+0000","last_unstale":"2023-07-05T23:32:57.781414+0000","last_undegraded":"2023-07-05T23:32:57.781414+0000","last_fullsized":"2023-07-05T23:32:57.781414+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:22:27.347492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781066+0000","last_change":"2023-07-05T23:32:57.365669+0000","last_active":"2023-07-05T23:32:57.781066+0000","last_peered":"2023-07-05T23:32:57.781066+0000","last_clean":"2023-07-05T23:32:57.781066+0000","last_became_active":"2023-07-05T23:32:57.365200+0000","last_became_peered":"2023-07-05T23:32:57.365200+0000","last_unstale":"2023-07-05T23:32:57.781066+0000","last_undegraded":"2023-07-05T23:32:57.781066+0000","last_fullsized":"2023-07-05T23:32:57.781066+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:51:45.144450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781045+0000","last_change":"2023-07-05T23:32:52.913055+0000","last_active":"2023-07-05T23:32:57.781045+0000","last_peered":"2023-07-05T23:32:57.781045+0000","last_clean":"2023-07-05T23:32:57.781045+0000","last_became_active":"2023-07-05T23:32:52.912749+0000","last_became_peered":"2023-07-05T23:32:52.912749+0000","last_unstale":"2023-07-05T23:32:57.781045+0000","last_undegraded":"2023-07-05T23:32:57.781045+0000","last_fullsized":"2023-07-05T23:32:57.781045+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:13:04.590957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.776668+0000","last_change":"2023-07-05T23:32:53.339331+0000","last_active":"2023-07-05T23:32:57.776668+0000","last_peered":"2023-07-05T23:32:57.776668+0000","last_clean":"2023-07-05T23:32:57.776668+0000","last_became_active":"2023-07-05T23:32:53.339001+0000","last_became_peered":"2023-07-05T23:32:53.339001+0000","last_unstale":"2023-07-05T23:32:57.776668+0000","last_undegraded":"2023-07-05T23:32:57.776668+0000","last_fullsized":"2023-07-05T23:32:57.776668+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:51:56.888322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.776408+0000","last_change":"2023-07-05T23:32:57.354307+0000","last_active":"2023-07-05T23:32:57.776408+0000","last_peered":"2023-07-05T23:32:57.776408+0000","last_clean":"2023-07-05T23:32:57.776408+0000","last_became_active":"2023-07-05T23:32:57.353848+0000","last_became_peered":"2023-07-05T23:32:57.353848+0000","last_unstale":"2023-07-05T23:32:57.776408+0000","last_undegraded":"2023-07-05T23:32:57.776408+0000","last_fullsized":"2023-07-05T23:32:57.776408+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:34:23.584285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'9","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:33:03.186592+0000","last_change":"2023-07-05T23:32:52.904627+0000","last_active":"2023-07-05T23:33:03.186592+0000","last_peered":"2023-07-05T23:33:03.186592+0000","last_clean":"2023-07-05T23:33:03.186592+0000","last_became_active":"2023-07-05T23:32:52.904318+0000","last_became_peered":"2023-07-05T23:32:52.904318+0000","last_unstale":"2023-07-05T23:33:03.186592+0000","last_undegraded":"2023-07-05T23:33:03.186592+0000","last_fullsized":"2023-07-05T23:33:03.186592+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:19:32.514981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.783509+0000","last_change":"2023-07-05T23:32:53.339884+0000","last_active":"2023-07-05T23:32:57.783509+0000","last_peered":"2023-07-05T23:32:57.783509+0000","last_clean":"2023-07-05T23:32:57.783509+0000","last_became_active":"2023-07-05T23:32:53.339583+0000","last_became_peered":"2023-07-05T23:32:53.339583+0000","last_unstale":"2023-07-05T23:32:57.783509+0000","last_undegraded":"2023-07-05T23:32:57.783509+0000","last_fullsized":"2023-07-05T23:32:57.783509+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:24:46.698746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779739+0000","last_change":"2023-07-05T23:32:57.365703+0000","last_active":"2023-07-05T23:32:57.779739+0000","last_peered":"2023-07-05T23:32:57.779739+0000","last_clean":"2023-07-05T23:32:57.779739+0000","last_became_active":"2023-07-05T23:32:57.365204+0000","last_became_peered":"2023-07-05T23:32:57.365204+0000","last_unstale":"2023-07-05T23:32:57.779739+0000","last_undegraded":"2023-07-05T23:32:57.779739+0000","last_fullsized":"2023-07-05T23:32:57.779739+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:20:33.100720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780561+0000","last_change":"2023-07-05T23:32:52.908276+0000","last_active":"2023-07-05T23:32:57.780561+0000","last_peered":"2023-07-05T23:32:57.780561+0000","last_clean":"2023-07-05T23:32:57.780561+0000","last_became_active":"2023-07-05T23:32:52.907970+0000","last_became_peered":"2023-07-05T23:32:52.907970+0000","last_unstale":"2023-07-05T23:32:57.780561+0000","last_undegraded":"2023-07-05T23:32:57.780561+0000","last_fullsized":"2023-07-05T23:32:57.780561+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:15:40.384473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780360+0000","last_change":"2023-07-05T23:32:53.340093+0000","last_active":"2023-07-05T23:32:57.780360+0000","last_peered":"2023-07-05T23:32:57.780360+0000","last_clean":"2023-07-05T23:32:57.780360+0000","last_became_active":"2023-07-05T23:32:53.339827+0000","last_became_peered":"2023-07-05T23:32:53.339827+0000","last_unstale":"2023-07-05T23:32:57.780360+0000","last_undegraded":"2023-07-05T23:32:57.780360+0000","last_fullsized":"2023-07-05T23:32:57.780360+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:19:10.358522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780060+0000","last_change":"2023-07-05T23:32:57.354664+0000","last_active":"2023-07-05T23:32:57.780060+0000","last_peered":"2023-07-05T23:32:57.780060+0000","last_clean":"2023-07-05T23:32:57.780060+0000","last_became_active":"2023-07-05T23:32:57.354235+0000","last_became_peered":"2023-07-05T23:32:57.354235+0000","last_unstale":"2023-07-05T23:32:57.780060+0000","last_undegraded":"2023-07-05T23:32:57.780060+0000","last_fullsized":"2023-07-05T23:32:57.780060+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:13:09.034988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781505+0000","last_change":"2023-07-05T23:32:52.900677+0000","last_active":"2023-07-05T23:32:57.781505+0000","last_peered":"2023-07-05T23:32:57.781505+0000","last_clean":"2023-07-05T23:32:57.781505+0000","last_became_active":"2023-07-05T23:32:52.900387+0000","last_became_peered":"2023-07-05T23:32:52.900387+0000","last_unstale":"2023-07-05T23:32:57.781505+0000","last_undegraded":"2023-07-05T23:32:57.781505+0000","last_fullsized":"2023-07-05T23:32:57.781505+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:19:37.582219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779376+0000","last_change":"2023-07-05T23:32:53.335865+0000","last_active":"2023-07-05T23:32:57.779376+0000","last_peered":"2023-07-05T23:32:57.779376+0000","last_clean":"2023-07-05T23:32:57.779376+0000","last_became_active":"2023-07-05T23:32:53.335513+0000","last_became_peered":"2023-07-05T23:32:53.335513+0000","last_unstale":"2023-07-05T23:32:57.779376+0000","last_undegraded":"2023-07-05T23:32:57.779376+0000","last_fullsized":"2023-07-05T23:32:57.779376+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:19:10.358522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780865+0000","last_change":"2023-07-05T23:32:57.362840+0000","last_active":"2023-07-05T23:32:57.780865+0000","last_peered":"2023-07-05T23:32:57.780865+0000","last_clean":"2023-07-05T23:32:57.780865+0000","last_became_active":"2023-07-05T23:32:57.362407+0000","last_became_peered":"2023-07-05T23:32:57.362407+0000","last_unstale":"2023-07-05T23:32:57.780865+0000","last_undegraded":"2023-07-05T23:32:57.780865+0000","last_fullsized":"2023-07-05T23:32:57.780865+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:20:33.100720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781326+0000","last_change":"2023-07-05T23:32:52.905899+0000","last_active":"2023-07-05T23:32:57.781326+0000","last_peered":"2023-07-05T23:32:57.781326+0000","last_clean":"2023-07-05T23:32:57.781326+0000","last_became_active":"2023-07-05T23:32:52.905595+0000","last_became_peered":"2023-07-05T23:32:52.905595+0000","last_unstale":"2023-07-05T23:32:57.781326+0000","last_undegraded":"2023-07-05T23:32:57.781326+0000","last_fullsized":"2023-07-05T23:32:57.781326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:17:19.088603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780958+0000","last_change":"2023-07-05T23:32:53.342284+0000","last_active":"2023-07-05T23:32:57.780958+0000","last_peered":"2023-07-05T23:32:57.780958+0000","last_clean":"2023-07-05T23:32:57.780958+0000","last_became_active":"2023-07-05T23:32:53.342033+0000","last_became_peered":"2023-07-05T23:32:53.342033+0000","last_unstale":"2023-07-05T23:32:57.780958+0000","last_undegraded":"2023-07-05T23:32:57.780958+0000","last_fullsized":"2023-07-05T23:32:57.780958+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:27:27.060118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779740+0000","last_change":"2023-07-05T23:32:57.360505+0000","last_active":"2023-07-05T23:32:57.779740+0000","last_peered":"2023-07-05T23:32:57.779740+0000","last_clean":"2023-07-05T23:32:57.779740+0000","last_became_active":"2023-07-05T23:32:57.359532+0000","last_became_peered":"2023-07-05T23:32:57.359532+0000","last_unstale":"2023-07-05T23:32:57.779740+0000","last_undegraded":"2023-07-05T23:32:57.779740+0000","last_fullsized":"2023-07-05T23:32:57.779740+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:44:00.668654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780375+0000","last_change":"2023-07-05T23:32:52.903656+0000","last_active":"2023-07-05T23:32:57.780375+0000","last_peered":"2023-07-05T23:32:57.780375+0000","last_clean":"2023-07-05T23:32:57.780375+0000","last_became_active":"2023-07-05T23:32:52.903419+0000","last_became_peered":"2023-07-05T23:32:52.903419+0000","last_unstale":"2023-07-05T23:32:57.780375+0000","last_undegraded":"2023-07-05T23:32:57.780375+0000","last_fullsized":"2023-07-05T23:32:57.780375+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:38:34.157098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780921+0000","last_change":"2023-07-05T23:32:53.341509+0000","last_active":"2023-07-05T23:32:57.780921+0000","last_peered":"2023-07-05T23:32:57.780921+0000","last_clean":"2023-07-05T23:32:57.780921+0000","last_became_active":"2023-07-05T23:32:53.341162+0000","last_became_peered":"2023-07-05T23:32:53.341162+0000","last_unstale":"2023-07-05T23:32:57.780921+0000","last_undegraded":"2023-07-05T23:32:57.780921+0000","last_fullsized":"2023-07-05T23:32:57.780921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:43:57.228961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781521+0000","last_change":"2023-07-05T23:32:57.358009+0000","last_active":"2023-07-05T23:32:57.781521+0000","last_peered":"2023-07-05T23:32:57.781521+0000","last_clean":"2023-07-05T23:32:57.781521+0000","last_became_active":"2023-07-05T23:32:57.357082+0000","last_became_peered":"2023-07-05T23:32:57.357082+0000","last_unstale":"2023-07-05T23:32:57.781521+0000","last_undegraded":"2023-07-05T23:32:57.781521+0000","last_fullsized":"2023-07-05T23:32:57.781521+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:44:00.668654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781205+0000","last_change":"2023-07-05T23:32:52.907916+0000","last_active":"2023-07-05T23:32:57.781205+0000","last_peered":"2023-07-05T23:32:57.781205+0000","last_clean":"2023-07-05T23:32:57.781205+0000","last_became_active":"2023-07-05T23:32:52.907397+0000","last_became_peered":"2023-07-05T23:32:52.907397+0000","last_unstale":"2023-07-05T23:32:57.781205+0000","last_undegraded":"2023-07-05T23:32:57.781205+0000","last_fullsized":"2023-07-05T23:32:57.781205+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:19:37.582219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.778327+0000","last_change":"2023-07-05T23:32:53.334487+0000","last_active":"2023-07-05T23:32:57.778327+0000","last_peered":"2023-07-05T23:32:57.778327+0000","last_clean":"2023-07-05T23:32:57.778327+0000","last_became_active":"2023-07-05T23:32:53.333978+0000","last_became_peered":"2023-07-05T23:32:53.333978+0000","last_unstale":"2023-07-05T23:32:57.778327+0000","last_undegraded":"2023-07-05T23:32:57.778327+0000","last_fullsized":"2023-07-05T23:32:57.778327+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:40:46.792647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780055+0000","last_change":"2023-07-05T23:32:57.362413+0000","last_active":"2023-07-05T23:32:57.780055+0000","last_peered":"2023-07-05T23:32:57.780055+0000","last_clean":"2023-07-05T23:32:57.780055+0000","last_became_active":"2023-07-05T23:32:57.361892+0000","last_became_peered":"2023-07-05T23:32:57.361892+0000","last_unstale":"2023-07-05T23:32:57.780055+0000","last_undegraded":"2023-07-05T23:32:57.780055+0000","last_fullsized":"2023-07-05T23:32:57.780055+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:36:17.176610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781017+0000","last_change":"2023-07-05T23:32:52.908261+0000","last_active":"2023-07-05T23:32:57.781017+0000","last_peered":"2023-07-05T23:32:57.781017+0000","last_clean":"2023-07-05T23:32:57.781017+0000","last_became_active":"2023-07-05T23:32:52.907975+0000","last_became_peered":"2023-07-05T23:32:52.907975+0000","last_unstale":"2023-07-05T23:32:57.781017+0000","last_undegraded":"2023-07-05T23:32:57.781017+0000","last_fullsized":"2023-07-05T23:32:57.781017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:38:12.885407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.782750+0000","last_change":"2023-07-05T23:32:53.339917+0000","last_active":"2023-07-05T23:32:57.782750+0000","last_peered":"2023-07-05T23:32:57.782750+0000","last_clean":"2023-07-05T23:32:57.782750+0000","last_became_active":"2023-07-05T23:32:53.339543+0000","last_became_peered":"2023-07-05T23:32:53.339543+0000","last_unstale":"2023-07-05T23:32:57.782750+0000","last_undegraded":"2023-07-05T23:32:57.782750+0000","last_fullsized":"2023-07-05T23:32:57.782750+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:52:59.154723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780459+0000","last_change":"2023-07-05T23:32:57.361110+0000","last_active":"2023-07-05T23:32:57.780459+0000","last_peered":"2023-07-05T23:32:57.780459+0000","last_clean":"2023-07-05T23:32:57.780459+0000","last_became_active":"2023-07-05T23:32:57.360614+0000","last_became_peered":"2023-07-05T23:32:57.360614+0000","last_unstale":"2023-07-05T23:32:57.780459+0000","last_undegraded":"2023-07-05T23:32:57.780459+0000","last_fullsized":"2023-07-05T23:32:57.780459+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:20:27.254800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781378+0000","last_change":"2023-07-05T23:32:52.907840+0000","last_active":"2023-07-05T23:32:57.781378+0000","last_peered":"2023-07-05T23:32:57.781378+0000","last_clean":"2023-07-05T23:32:57.781378+0000","last_became_active":"2023-07-05T23:32:52.907441+0000","last_became_peered":"2023-07-05T23:32:52.907441+0000","last_unstale":"2023-07-05T23:32:57.781378+0000","last_undegraded":"2023-07-05T23:32:57.781378+0000","last_fullsized":"2023-07-05T23:32:57.781378+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:17:17.281723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.782067+0000","last_change":"2023-07-05T23:32:53.343984+0000","last_active":"2023-07-05T23:32:57.782067+0000","last_peered":"2023-07-05T23:32:57.782067+0000","last_clean":"2023-07-05T23:32:57.782067+0000","last_became_active":"2023-07-05T23:32:53.343566+0000","last_became_peered":"2023-07-05T23:32:53.343566+0000","last_unstale":"2023-07-05T23:32:57.782067+0000","last_undegraded":"2023-07-05T23:32:57.782067+0000","last_fullsized":"2023-07-05T23:32:57.782067+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:37:24.930328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779979+0000","last_change":"2023-07-05T23:32:57.356615+0000","last_active":"2023-07-05T23:32:57.779979+0000","last_peered":"2023-07-05T23:32:57.779979+0000","last_clean":"2023-07-05T23:32:57.779979+0000","last_became_active":"2023-07-05T23:32:57.356091+0000","last_became_peered":"2023-07-05T23:32:57.356091+0000","last_unstale":"2023-07-05T23:32:57.779979+0000","last_undegraded":"2023-07-05T23:32:57.779979+0000","last_fullsized":"2023-07-05T23:32:57.779979+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:10:06.378615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.778881+0000","last_change":"2023-07-05T23:32:52.906210+0000","last_active":"2023-07-05T23:32:57.778881+0000","last_peered":"2023-07-05T23:32:57.778881+0000","last_clean":"2023-07-05T23:32:57.778881+0000","last_became_active":"2023-07-05T23:32:52.905988+0000","last_became_peered":"2023-07-05T23:32:52.905988+0000","last_unstale":"2023-07-05T23:32:57.778881+0000","last_undegraded":"2023-07-05T23:32:57.778881+0000","last_fullsized":"2023-07-05T23:32:57.778881+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:21:30.952101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780176+0000","last_change":"2023-07-05T23:32:53.339662+0000","last_active":"2023-07-05T23:32:57.780176+0000","last_peered":"2023-07-05T23:32:57.780176+0000","last_clean":"2023-07-05T23:32:57.780176+0000","last_became_active":"2023-07-05T23:32:53.339382+0000","last_became_peered":"2023-07-05T23:32:53.339382+0000","last_unstale":"2023-07-05T23:32:57.780176+0000","last_undegraded":"2023-07-05T23:32:57.780176+0000","last_fullsized":"2023-07-05T23:32:57.780176+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:02:13.839378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781483+0000","last_change":"2023-07-05T23:32:57.354958+0000","last_active":"2023-07-05T23:32:57.781483+0000","last_peered":"2023-07-05T23:32:57.781483+0000","last_clean":"2023-07-05T23:32:57.781483+0000","last_became_active":"2023-07-05T23:32:57.354576+0000","last_became_peered":"2023-07-05T23:32:57.354576+0000","last_unstale":"2023-07-05T23:32:57.781483+0000","last_undegraded":"2023-07-05T23:32:57.781483+0000","last_fullsized":"2023-07-05T23:32:57.781483+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:44:10.928501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779954+0000","last_change":"2023-07-05T23:32:52.906470+0000","last_active":"2023-07-05T23:32:57.779954+0000","last_peered":"2023-07-05T23:32:57.779954+0000","last_clean":"2023-07-05T23:32:57.779954+0000","last_became_active":"2023-07-05T23:32:52.906187+0000","last_became_peered":"2023-07-05T23:32:52.906187+0000","last_unstale":"2023-07-05T23:32:57.779954+0000","last_undegraded":"2023-07-05T23:32:57.779954+0000","last_fullsized":"2023-07-05T23:32:57.779954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:25:18.737329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.783687+0000","last_change":"2023-07-05T23:32:53.344178+0000","last_active":"2023-07-05T23:32:57.783687+0000","last_peered":"2023-07-05T23:32:57.783687+0000","last_clean":"2023-07-05T23:32:57.783687+0000","last_became_active":"2023-07-05T23:32:53.343393+0000","last_became_peered":"2023-07-05T23:32:53.343393+0000","last_unstale":"2023-07-05T23:32:57.783687+0000","last_undegraded":"2023-07-05T23:32:57.783687+0000","last_fullsized":"2023-07-05T23:32:57.783687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:01:16.732067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.776877+0000","last_change":"2023-07-05T23:32:57.362812+0000","last_active":"2023-07-05T23:32:57.776877+0000","last_peered":"2023-07-05T23:32:57.776877+0000","last_clean":"2023-07-05T23:32:57.776877+0000","last_became_active":"2023-07-05T23:32:57.362431+0000","last_became_peered":"2023-07-05T23:32:57.362431+0000","last_unstale":"2023-07-05T23:32:57.776877+0000","last_undegraded":"2023-07-05T23:32:57.776877+0000","last_fullsized":"2023-07-05T23:32:57.776877+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:24:35.809378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780786+0000","last_change":"2023-07-05T23:32:52.908272+0000","last_active":"2023-07-05T23:32:57.780786+0000","last_peered":"2023-07-05T23:32:57.780786+0000","last_clean":"2023-07-05T23:32:57.780786+0000","last_became_active":"2023-07-05T23:32:52.907983+0000","last_became_peered":"2023-07-05T23:32:52.907983+0000","last_unstale":"2023-07-05T23:32:57.780786+0000","last_undegraded":"2023-07-05T23:32:57.780786+0000","last_fullsized":"2023-07-05T23:32:57.780786+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:28:38.558463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.783118+0000","last_change":"2023-07-05T23:32:53.339766+0000","last_active":"2023-07-05T23:32:57.783118+0000","last_peered":"2023-07-05T23:32:57.783118+0000","last_clean":"2023-07-05T23:32:57.783118+0000","last_became_active":"2023-07-05T23:32:53.338903+0000","last_became_peered":"2023-07-05T23:32:53.338903+0000","last_unstale":"2023-07-05T23:32:57.783118+0000","last_undegraded":"2023-07-05T23:32:57.783118+0000","last_fullsized":"2023-07-05T23:32:57.783118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:32:24.944898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780131+0000","last_change":"2023-07-05T23:32:57.357001+0000","last_active":"2023-07-05T23:32:57.780131+0000","last_peered":"2023-07-05T23:32:57.780131+0000","last_clean":"2023-07-05T23:32:57.780131+0000","last_became_active":"2023-07-05T23:32:57.356611+0000","last_became_peered":"2023-07-05T23:32:57.356611+0000","last_unstale":"2023-07-05T23:32:57.780131+0000","last_undegraded":"2023-07-05T23:32:57.780131+0000","last_fullsized":"2023-07-05T23:32:57.780131+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:00:24.588333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.782328+0000","last_change":"2023-07-05T23:32:52.907064+0000","last_active":"2023-07-05T23:32:57.782328+0000","last_peered":"2023-07-05T23:32:57.782328+0000","last_clean":"2023-07-05T23:32:57.782328+0000","last_became_active":"2023-07-05T23:32:52.906779+0000","last_became_peered":"2023-07-05T23:32:52.906779+0000","last_unstale":"2023-07-05T23:32:57.782328+0000","last_undegraded":"2023-07-05T23:32:57.782328+0000","last_fullsized":"2023-07-05T23:32:57.782328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:15:22.364630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.782950+0000","last_change":"2023-07-05T23:32:53.341824+0000","last_active":"2023-07-05T23:32:57.782950+0000","last_peered":"2023-07-05T23:32:57.782950+0000","last_clean":"2023-07-05T23:32:57.782950+0000","last_became_active":"2023-07-05T23:32:53.339869+0000","last_became_peered":"2023-07-05T23:32:53.339869+0000","last_unstale":"2023-07-05T23:32:57.782950+0000","last_undegraded":"2023-07-05T23:32:57.782950+0000","last_fullsized":"2023-07-05T23:32:57.782950+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:24:31.034513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.783115+0000","last_change":"2023-07-05T23:32:57.363813+0000","last_active":"2023-07-05T23:32:57.783115+0000","last_peered":"2023-07-05T23:32:57.783115+0000","last_clean":"2023-07-05T23:32:57.783115+0000","last_became_active":"2023-07-05T23:32:57.363409+0000","last_became_peered":"2023-07-05T23:32:57.363409+0000","last_unstale":"2023-07-05T23:32:57.783115+0000","last_undegraded":"2023-07-05T23:32:57.783115+0000","last_fullsized":"2023-07-05T23:32:57.783115+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:28:02.584137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779951+0000","last_change":"2023-07-05T23:32:52.910057+0000","last_active":"2023-07-05T23:32:57.779951+0000","last_peered":"2023-07-05T23:32:57.779951+0000","last_clean":"2023-07-05T23:32:57.779951+0000","last_became_active":"2023-07-05T23:32:52.909169+0000","last_became_peered":"2023-07-05T23:32:52.909169+0000","last_unstale":"2023-07-05T23:32:57.779951+0000","last_undegraded":"2023-07-05T23:32:57.779951+0000","last_fullsized":"2023-07-05T23:32:57.779951+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:36:16.738830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.777230+0000","last_change":"2023-07-05T23:32:53.342851+0000","last_active":"2023-07-05T23:32:57.777230+0000","last_peered":"2023-07-05T23:32:57.777230+0000","last_clean":"2023-07-05T23:32:57.777230+0000","last_became_active":"2023-07-05T23:32:53.342420+0000","last_became_peered":"2023-07-05T23:32:53.342420+0000","last_unstale":"2023-07-05T23:32:57.777230+0000","last_undegraded":"2023-07-05T23:32:57.777230+0000","last_fullsized":"2023-07-05T23:32:57.777230+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:36:17.743168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780080+0000","last_change":"2023-07-05T23:32:57.358997+0000","last_active":"2023-07-05T23:32:57.780080+0000","last_peered":"2023-07-05T23:32:57.780080+0000","last_clean":"2023-07-05T23:32:57.780080+0000","last_became_active":"2023-07-05T23:32:57.358647+0000","last_became_peered":"2023-07-05T23:32:57.358647+0000","last_unstale":"2023-07-05T23:32:57.780080+0000","last_undegraded":"2023-07-05T23:32:57.780080+0000","last_fullsized":"2023-07-05T23:32:57.780080+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:34:23.584285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.777274+0000","last_change":"2023-07-05T23:32:47.790871+0000","last_active":"2023-07-05T23:32:57.777274+0000","last_peered":"2023-07-05T23:32:57.777274+0000","last_clean":"2023-07-05T23:32:57.777274+0000","last_became_active":"2023-07-05T23:32:47.790546+0000","last_became_peered":"2023-07-05T23:32:47.790546+0000","last_unstale":"2023-07-05T23:32:57.777274+0000","last_undegraded":"2023-07-05T23:32:57.777274+0000","last_fullsized":"2023-07-05T23:32:57.777274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_clean_scrub_stamp":"2023-07-05T23:32:46.741565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:12:59.454577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779269+0000","last_change":"2023-07-05T23:32:52.912985+0000","last_active":"2023-07-05T23:32:57.779269+0000","last_peered":"2023-07-05T23:32:57.779269+0000","last_clean":"2023-07-05T23:32:57.779269+0000","last_became_active":"2023-07-05T23:32:52.912682+0000","last_became_peered":"2023-07-05T23:32:52.912682+0000","last_unstale":"2023-07-05T23:32:57.779269+0000","last_undegraded":"2023-07-05T23:32:57.779269+0000","last_fullsized":"2023-07-05T23:32:57.779269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:38:12.885407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.776539+0000","last_change":"2023-07-05T23:32:53.335398+0000","last_active":"2023-07-05T23:32:57.776539+0000","last_peered":"2023-07-05T23:32:57.776539+0000","last_clean":"2023-07-05T23:32:57.776539+0000","last_became_active":"2023-07-05T23:32:53.335073+0000","last_became_peered":"2023-07-05T23:32:53.335073+0000","last_unstale":"2023-07-05T23:32:57.776539+0000","last_undegraded":"2023-07-05T23:32:57.776539+0000","last_fullsized":"2023-07-05T23:32:57.776539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:16:05.844225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780381+0000","last_change":"2023-07-05T23:32:57.368301+0000","last_active":"2023-07-05T23:32:57.780381+0000","last_peered":"2023-07-05T23:32:57.780381+0000","last_clean":"2023-07-05T23:32:57.780381+0000","last_became_active":"2023-07-05T23:32:57.368030+0000","last_became_peered":"2023-07-05T23:32:57.368030+0000","last_unstale":"2023-07-05T23:32:57.780381+0000","last_undegraded":"2023-07-05T23:32:57.780381+0000","last_fullsized":"2023-07-05T23:32:57.780381+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:16:09.283919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.778814+0000","last_change":"2023-07-05T23:32:47.762370+0000","last_active":"2023-07-05T23:32:57.778814+0000","last_peered":"2023-07-05T23:32:57.778814+0000","last_clean":"2023-07-05T23:32:57.778814+0000","last_became_active":"2023-07-05T23:32:47.761996+0000","last_became_peered":"2023-07-05T23:32:47.761996+0000","last_unstale":"2023-07-05T23:32:57.778814+0000","last_undegraded":"2023-07-05T23:32:57.778814+0000","last_fullsized":"2023-07-05T23:32:57.778814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_clean_scrub_stamp":"2023-07-05T23:32:46.741565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:27:20.919400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.783445+0000","last_change":"2023-07-05T23:32:52.904472+0000","last_active":"2023-07-05T23:32:57.783445+0000","last_peered":"2023-07-05T23:32:57.783445+0000","last_clean":"2023-07-05T23:32:57.783445+0000","last_became_active":"2023-07-05T23:32:52.904202+0000","last_became_peered":"2023-07-05T23:32:52.904202+0000","last_unstale":"2023-07-05T23:32:57.783445+0000","last_undegraded":"2023-07-05T23:32:57.783445+0000","last_fullsized":"2023-07-05T23:32:57.783445+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:14:11.507519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.776981+0000","last_change":"2023-07-05T23:32:53.341847+0000","last_active":"2023-07-05T23:32:57.776981+0000","last_peered":"2023-07-05T23:32:57.776981+0000","last_clean":"2023-07-05T23:32:57.776981+0000","last_became_active":"2023-07-05T23:32:53.338626+0000","last_became_peered":"2023-07-05T23:32:53.338626+0000","last_unstale":"2023-07-05T23:32:57.776981+0000","last_undegraded":"2023-07-05T23:32:57.776981+0000","last_fullsized":"2023-07-05T23:32:57.776981+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:07:52.872003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780950+0000","last_change":"2023-07-05T23:32:57.356351+0000","last_active":"2023-07-05T23:32:57.780950+0000","last_peered":"2023-07-05T23:32:57.780950+0000","last_clean":"2023-07-05T23:32:57.780950+0000","last_became_active":"2023-07-05T23:32:57.355882+0000","last_became_peered":"2023-07-05T23:32:57.355882+0000","last_unstale":"2023-07-05T23:32:57.780950+0000","last_undegraded":"2023-07-05T23:32:57.780950+0000","last_fullsized":"2023-07-05T23:32:57.780950+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:22:43.105654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780220+0000","last_change":"2023-07-05T23:32:47.979611+0000","last_active":"2023-07-05T23:32:57.780220+0000","last_peered":"2023-07-05T23:32:57.780220+0000","last_clean":"2023-07-05T23:32:57.780220+0000","last_became_active":"2023-07-05T23:32:47.979348+0000","last_became_peered":"2023-07-05T23:32:47.979348+0000","last_unstale":"2023-07-05T23:32:57.780220+0000","last_undegraded":"2023-07-05T23:32:57.780220+0000","last_fullsized":"2023-07-05T23:32:57.780220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_clean_scrub_stamp":"2023-07-05T23:32:46.741565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:28:01.280864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.776456+0000","last_change":"2023-07-05T23:32:52.907652+0000","last_active":"2023-07-05T23:32:57.776456+0000","last_peered":"2023-07-05T23:32:57.776456+0000","last_clean":"2023-07-05T23:32:57.776456+0000","last_became_active":"2023-07-05T23:32:52.907307+0000","last_became_peered":"2023-07-05T23:32:52.907307+0000","last_unstale":"2023-07-05T23:32:57.776456+0000","last_undegraded":"2023-07-05T23:32:57.776456+0000","last_fullsized":"2023-07-05T23:32:57.776456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:02:12.835040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.777189+0000","last_change":"2023-07-05T23:32:53.338185+0000","last_active":"2023-07-05T23:32:57.777189+0000","last_peered":"2023-07-05T23:32:57.777189+0000","last_clean":"2023-07-05T23:32:57.777189+0000","last_became_active":"2023-07-05T23:32:53.337896+0000","last_became_peered":"2023-07-05T23:32:53.337896+0000","last_unstale":"2023-07-05T23:32:57.777189+0000","last_undegraded":"2023-07-05T23:32:57.777189+0000","last_fullsized":"2023-07-05T23:32:57.777189+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:21:31.956439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780653+0000","last_change":"2023-07-05T23:32:57.355885+0000","last_active":"2023-07-05T23:32:57.780653+0000","last_peered":"2023-07-05T23:32:57.780653+0000","last_clean":"2023-07-05T23:32:57.780653+0000","last_became_active":"2023-07-05T23:32:57.355475+0000","last_became_peered":"2023-07-05T23:32:57.355475+0000","last_unstale":"2023-07-05T23:32:57.780653+0000","last_undegraded":"2023-07-05T23:32:57.780653+0000","last_fullsized":"2023-07-05T23:32:57.780653+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:27:30.499811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779129+0000","last_change":"2023-07-05T23:32:47.761727+0000","last_active":"2023-07-05T23:32:57.779129+0000","last_peered":"2023-07-05T23:32:57.779129+0000","last_clean":"2023-07-05T23:32:57.779129+0000","last_became_active":"2023-07-05T23:32:47.761392+0000","last_became_peered":"2023-07-05T23:32:47.761392+0000","last_unstale":"2023-07-05T23:32:57.779129+0000","last_undegraded":"2023-07-05T23:32:57.779129+0000","last_fullsized":"2023-07-05T23:32:57.779129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_clean_scrub_stamp":"2023-07-05T23:32:46.741565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:36:11.602450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":183,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780467+0000","last_change":"2023-07-05T23:32:42.737690+0000","last_active":"2023-07-05T23:32:57.780467+0000","last_peered":"2023-07-05T23:32:57.780467+0000","last_clean":"2023-07-05T23:32:57.780467+0000","last_became_active":"2023-07-05T23:32:42.736736+0000","last_became_peered":"2023-07-05T23:32:42.736736+0000","last_unstale":"2023-07-05T23:32:57.780467+0000","last_undegraded":"2023-07-05T23:32:57.780467+0000","last_fullsized":"2023-07-05T23:32:57.780467+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:41.674741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:41.674741+0000","last_clean_scrub_stamp":"2023-07-05T23:32:41.674741+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:58:57.987862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779842+0000","last_change":"2023-07-05T23:32:52.912999+0000","last_active":"2023-07-05T23:32:57.779842+0000","last_peered":"2023-07-05T23:32:57.779842+0000","last_clean":"2023-07-05T23:32:57.779842+0000","last_became_active":"2023-07-05T23:32:52.912684+0000","last_became_peered":"2023-07-05T23:32:52.912684+0000","last_unstale":"2023-07-05T23:32:57.779842+0000","last_undegraded":"2023-07-05T23:32:57.779842+0000","last_fullsized":"2023-07-05T23:32:57.779842+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:21:30.952101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780509+0000","last_change":"2023-07-05T23:32:53.344142+0000","last_active":"2023-07-05T23:32:57.780509+0000","last_peered":"2023-07-05T23:32:57.780509+0000","last_clean":"2023-07-05T23:32:57.780509+0000","last_became_active":"2023-07-05T23:32:53.343848+0000","last_became_peered":"2023-07-05T23:32:53.343848+0000","last_unstale":"2023-07-05T23:32:57.780509+0000","last_undegraded":"2023-07-05T23:32:57.780509+0000","last_fullsized":"2023-07-05T23:32:57.780509+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:20:35.381998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780142+0000","last_change":"2023-07-05T23:32:57.366415+0000","last_active":"2023-07-05T23:32:57.780142+0000","last_peered":"2023-07-05T23:32:57.780142+0000","last_clean":"2023-07-05T23:32:57.780142+0000","last_became_active":"2023-07-05T23:32:57.365013+0000","last_became_peered":"2023-07-05T23:32:57.365013+0000","last_unstale":"2023-07-05T23:32:57.780142+0000","last_undegraded":"2023-07-05T23:32:57.780142+0000","last_fullsized":"2023-07-05T23:32:57.780142+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:15:26.808661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780785+0000","last_change":"2023-07-05T23:32:47.767600+0000","last_active":"2023-07-05T23:32:57.780785+0000","last_peered":"2023-07-05T23:32:57.780785+0000","last_clean":"2023-07-05T23:32:57.780785+0000","last_became_active":"2023-07-05T23:32:47.767297+0000","last_became_peered":"2023-07-05T23:32:47.767297+0000","last_unstale":"2023-07-05T23:32:57.780785+0000","last_undegraded":"2023-07-05T23:32:57.780785+0000","last_fullsized":"2023-07-05T23:32:57.780785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_clean_scrub_stamp":"2023-07-05T23:32:46.741565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:25:13.600949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780399+0000","last_change":"2023-07-05T23:32:52.906517+0000","last_active":"2023-07-05T23:32:57.780399+0000","last_peered":"2023-07-05T23:32:57.780399+0000","last_clean":"2023-07-05T23:32:57.780399+0000","last_became_active":"2023-07-05T23:32:52.906204+0000","last_became_peered":"2023-07-05T23:32:52.906204+0000","last_unstale":"2023-07-05T23:32:57.780399+0000","last_undegraded":"2023-07-05T23:32:57.780399+0000","last_fullsized":"2023-07-05T23:32:57.780399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:24:31.365347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780712+0000","last_change":"2023-07-05T23:32:53.340334+0000","last_active":"2023-07-05T23:32:57.780712+0000","last_peered":"2023-07-05T23:32:57.780712+0000","last_clean":"2023-07-05T23:32:57.780712+0000","last_became_active":"2023-07-05T23:32:53.340061+0000","last_became_peered":"2023-07-05T23:32:53.340061+0000","last_unstale":"2023-07-05T23:32:57.780712+0000","last_undegraded":"2023-07-05T23:32:57.780712+0000","last_fullsized":"2023-07-05T23:32:57.780712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:59:09.195404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781199+0000","last_change":"2023-07-05T23:32:57.362424+0000","last_active":"2023-07-05T23:32:57.781199+0000","last_peered":"2023-07-05T23:32:57.781199+0000","last_clean":"2023-07-05T23:32:57.781199+0000","last_became_active":"2023-07-05T23:32:57.361941+0000","last_became_peered":"2023-07-05T23:32:57.361941+0000","last_unstale":"2023-07-05T23:32:57.781199+0000","last_undegraded":"2023-07-05T23:32:57.781199+0000","last_fullsized":"2023-07-05T23:32:57.781199+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:22:39.370920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781202+0000","last_change":"2023-07-05T23:32:47.790754+0000","last_active":"2023-07-05T23:32:57.781202+0000","last_peered":"2023-07-05T23:32:57.781202+0000","last_clean":"2023-07-05T23:32:57.781202+0000","last_became_active":"2023-07-05T23:32:47.790408+0000","last_became_peered":"2023-07-05T23:32:47.790408+0000","last_unstale":"2023-07-05T23:32:57.781202+0000","last_undegraded":"2023-07-05T23:32:57.781202+0000","last_fullsized":"2023-07-05T23:32:57.781202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_clean_scrub_stamp":"2023-07-05T23:32:46.741565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:19:04.217804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.777239+0000","last_change":"2023-07-05T23:32:52.908711+0000","last_active":"2023-07-05T23:32:57.777239+0000","last_peered":"2023-07-05T23:32:57.777239+0000","last_clean":"2023-07-05T23:32:57.777239+0000","last_became_active":"2023-07-05T23:32:52.908379+0000","last_became_peered":"2023-07-05T23:32:52.908379+0000","last_unstale":"2023-07-05T23:32:57.777239+0000","last_undegraded":"2023-07-05T23:32:57.777239+0000","last_fullsized":"2023-07-05T23:32:57.777239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:25:18.737329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780378+0000","last_change":"2023-07-05T23:32:53.331042+0000","last_active":"2023-07-05T23:32:57.780378+0000","last_peered":"2023-07-05T23:32:57.780378+0000","last_clean":"2023-07-05T23:32:57.780378+0000","last_became_active":"2023-07-05T23:32:53.330771+0000","last_became_peered":"2023-07-05T23:32:53.330771+0000","last_unstale":"2023-07-05T23:32:57.780378+0000","last_undegraded":"2023-07-05T23:32:57.780378+0000","last_fullsized":"2023-07-05T23:32:57.780378+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:51:56.888322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.782732+0000","last_change":"2023-07-05T23:32:57.357223+0000","last_active":"2023-07-05T23:32:57.782732+0000","last_peered":"2023-07-05T23:32:57.782732+0000","last_clean":"2023-07-05T23:32:57.782732+0000","last_became_active":"2023-07-05T23:32:57.356797+0000","last_became_peered":"2023-07-05T23:32:57.356797+0000","last_unstale":"2023-07-05T23:32:57.782732+0000","last_undegraded":"2023-07-05T23:32:57.782732+0000","last_fullsized":"2023-07-05T23:32:57.782732+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:49:42.024861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780991+0000","last_change":"2023-07-05T23:32:52.906030+0000","last_active":"2023-07-05T23:32:57.780991+0000","last_peered":"2023-07-05T23:32:57.780991+0000","last_clean":"2023-07-05T23:32:57.780991+0000","last_became_active":"2023-07-05T23:32:52.905704+0000","last_became_peered":"2023-07-05T23:32:52.905704+0000","last_unstale":"2023-07-05T23:32:57.780991+0000","last_undegraded":"2023-07-05T23:32:57.780991+0000","last_fullsized":"2023-07-05T23:32:57.780991+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:20:56.389364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.776986+0000","last_change":"2023-07-05T23:32:47.769126+0000","last_active":"2023-07-05T23:32:57.776986+0000","last_peered":"2023-07-05T23:32:57.776986+0000","last_clean":"2023-07-05T23:32:57.776986+0000","last_became_active":"2023-07-05T23:32:47.768844+0000","last_became_peered":"2023-07-05T23:32:47.768844+0000","last_unstale":"2023-07-05T23:32:57.776986+0000","last_undegraded":"2023-07-05T23:32:57.776986+0000","last_fullsized":"2023-07-05T23:32:57.776986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_clean_scrub_stamp":"2023-07-05T23:32:46.741565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:59:03.054686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779815+0000","last_change":"2023-07-05T23:32:53.335749+0000","last_active":"2023-07-05T23:32:57.779815+0000","last_peered":"2023-07-05T23:32:57.779815+0000","last_clean":"2023-07-05T23:32:57.779815+0000","last_became_active":"2023-07-05T23:32:53.335506+0000","last_became_peered":"2023-07-05T23:32:53.335506+0000","last_unstale":"2023-07-05T23:32:57.779815+0000","last_undegraded":"2023-07-05T23:32:57.779815+0000","last_fullsized":"2023-07-05T23:32:57.779815+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:27:27.060118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779649+0000","last_change":"2023-07-05T23:32:57.362654+0000","last_active":"2023-07-05T23:32:57.779649+0000","last_peered":"2023-07-05T23:32:57.779649+0000","last_clean":"2023-07-05T23:32:57.779649+0000","last_became_active":"2023-07-05T23:32:57.362112+0000","last_became_peered":"2023-07-05T23:32:57.362112+0000","last_unstale":"2023-07-05T23:32:57.779649+0000","last_undegraded":"2023-07-05T23:32:57.779649+0000","last_fullsized":"2023-07-05T23:32:57.779649+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:40:50.232341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780887+0000","last_change":"2023-07-05T23:32:47.769537+0000","last_active":"2023-07-05T23:32:57.780887+0000","last_peered":"2023-07-05T23:32:57.780887+0000","last_clean":"2023-07-05T23:32:57.780887+0000","last_became_active":"2023-07-05T23:32:47.769141+0000","last_became_peered":"2023-07-05T23:32:47.769141+0000","last_unstale":"2023-07-05T23:32:57.780887+0000","last_undegraded":"2023-07-05T23:32:57.780887+0000","last_fullsized":"2023-07-05T23:32:57.780887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_clean_scrub_stamp":"2023-07-05T23:32:46.741565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:48:48.465852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"28'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780818+0000","last_change":"2023-07-05T23:32:52.905759+0000","last_active":"2023-07-05T23:32:57.780818+0000","last_peered":"2023-07-05T23:32:57.780818+0000","last_clean":"2023-07-05T23:32:57.780818+0000","last_became_active":"2023-07-05T23:32:52.905451+0000","last_became_peered":"2023-07-05T23:32:52.905451+0000","last_unstale":"2023-07-05T23:32:57.780818+0000","last_undegraded":"2023-07-05T23:32:57.780818+0000","last_fullsized":"2023-07-05T23:32:57.780818+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:40:45.788309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.782350+0000","last_change":"2023-07-05T23:32:53.332443+0000","last_active":"2023-07-05T23:32:57.782350+0000","last_peered":"2023-07-05T23:32:57.782350+0000","last_clean":"2023-07-05T23:32:57.782350+0000","last_became_active":"2023-07-05T23:32:53.332159+0000","last_became_peered":"2023-07-05T23:32:53.332159+0000","last_unstale":"2023-07-05T23:32:57.782350+0000","last_undegraded":"2023-07-05T23:32:57.782350+0000","last_fullsized":"2023-07-05T23:32:57.782350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:43:31.795176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.777051+0000","last_change":"2023-07-05T23:32:57.363998+0000","last_active":"2023-07-05T23:32:57.777051+0000","last_peered":"2023-07-05T23:32:57.777051+0000","last_clean":"2023-07-05T23:32:57.777051+0000","last_became_active":"2023-07-05T23:32:57.363620+0000","last_became_peered":"2023-07-05T23:32:57.363620+0000","last_unstale":"2023-07-05T23:32:57.777051+0000","last_undegraded":"2023-07-05T23:32:57.777051+0000","last_fullsized":"2023-07-05T23:32:57.777051+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:40:50.232341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780355+0000","last_change":"2023-07-05T23:32:52.908550+0000","last_active":"2023-07-05T23:32:57.780355+0000","last_peered":"2023-07-05T23:32:57.780355+0000","last_clean":"2023-07-05T23:32:57.780355+0000","last_became_active":"2023-07-05T23:32:52.908111+0000","last_became_peered":"2023-07-05T23:32:52.908111+0000","last_unstale":"2023-07-05T23:32:57.780355+0000","last_undegraded":"2023-07-05T23:32:57.780355+0000","last_fullsized":"2023-07-05T23:32:57.780355+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:03:19.819620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781012+0000","last_change":"2023-07-05T23:32:53.340098+0000","last_active":"2023-07-05T23:32:57.781012+0000","last_peered":"2023-07-05T23:32:57.781012+0000","last_clean":"2023-07-05T23:32:57.781012+0000","last_became_active":"2023-07-05T23:32:53.339686+0000","last_became_peered":"2023-07-05T23:32:53.339686+0000","last_unstale":"2023-07-05T23:32:57.781012+0000","last_undegraded":"2023-07-05T23:32:57.781012+0000","last_fullsized":"2023-07-05T23:32:57.781012+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:23:39.749927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781965+0000","last_change":"2023-07-05T23:32:57.356309+0000","last_active":"2023-07-05T23:32:57.781965+0000","last_peered":"2023-07-05T23:32:57.781965+0000","last_clean":"2023-07-05T23:32:57.781965+0000","last_became_active":"2023-07-05T23:32:57.355910+0000","last_became_peered":"2023-07-05T23:32:57.355910+0000","last_unstale":"2023-07-05T23:32:57.781965+0000","last_undegraded":"2023-07-05T23:32:57.781965+0000","last_fullsized":"2023-07-05T23:32:57.781965+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:21:00.833395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779153+0000","last_change":"2023-07-05T23:32:52.899481+0000","last_active":"2023-07-05T23:32:57.779153+0000","last_peered":"2023-07-05T23:32:57.779153+0000","last_clean":"2023-07-05T23:32:57.779153+0000","last_became_active":"2023-07-05T23:32:52.899159+0000","last_became_peered":"2023-07-05T23:32:52.899159+0000","last_unstale":"2023-07-05T23:32:57.779153+0000","last_undegraded":"2023-07-05T23:32:57.779153+0000","last_fullsized":"2023-07-05T23:32:57.779153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:25:18.737329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.782590+0000","last_change":"2023-07-05T23:32:53.343643+0000","last_active":"2023-07-05T23:32:57.782590+0000","last_peered":"2023-07-05T23:32:57.782590+0000","last_clean":"2023-07-05T23:32:57.782590+0000","last_became_active":"2023-07-05T23:32:53.343262+0000","last_became_peered":"2023-07-05T23:32:53.343262+0000","last_unstale":"2023-07-05T23:32:57.782590+0000","last_undegraded":"2023-07-05T23:32:57.782590+0000","last_fullsized":"2023-07-05T23:32:57.782590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:22:31.213068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779248+0000","last_change":"2023-07-05T23:32:57.365478+0000","last_active":"2023-07-05T23:32:57.779248+0000","last_peered":"2023-07-05T23:32:57.779248+0000","last_clean":"2023-07-05T23:32:57.779248+0000","last_became_active":"2023-07-05T23:32:57.365087+0000","last_became_peered":"2023-07-05T23:32:57.365087+0000","last_unstale":"2023-07-05T23:32:57.779248+0000","last_undegraded":"2023-07-05T23:32:57.779248+0000","last_fullsized":"2023-07-05T23:32:57.779248+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:13:09.034988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779268+0000","last_change":"2023-07-05T23:32:52.902806+0000","last_active":"2023-07-05T23:32:57.779268+0000","last_peered":"2023-07-05T23:32:57.779268+0000","last_clean":"2023-07-05T23:32:57.779268+0000","last_became_active":"2023-07-05T23:32:52.901689+0000","last_became_peered":"2023-07-05T23:32:52.901689+0000","last_unstale":"2023-07-05T23:32:57.779268+0000","last_undegraded":"2023-07-05T23:32:57.779268+0000","last_fullsized":"2023-07-05T23:32:57.779268+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:19:37.582219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.782489+0000","last_change":"2023-07-05T23:32:53.346776+0000","last_active":"2023-07-05T23:32:57.782489+0000","last_peered":"2023-07-05T23:32:57.782489+0000","last_clean":"2023-07-05T23:32:57.782489+0000","last_became_active":"2023-07-05T23:32:53.346553+0000","last_became_peered":"2023-07-05T23:32:53.346553+0000","last_unstale":"2023-07-05T23:32:57.782489+0000","last_undegraded":"2023-07-05T23:32:57.782489+0000","last_fullsized":"2023-07-05T23:32:57.782489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:21:03.950759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.782335+0000","last_change":"2023-07-05T23:32:57.353173+0000","last_active":"2023-07-05T23:32:57.782335+0000","last_peered":"2023-07-05T23:32:57.782335+0000","last_clean":"2023-07-05T23:32:57.782335+0000","last_became_active":"2023-07-05T23:32:57.352716+0000","last_became_peered":"2023-07-05T23:32:57.352716+0000","last_unstale":"2023-07-05T23:32:57.782335+0000","last_undegraded":"2023-07-05T23:32:57.782335+0000","last_fullsized":"2023-07-05T23:32:57.782335+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:00:24.588333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780499+0000","last_change":"2023-07-05T23:32:52.906954+0000","last_active":"2023-07-05T23:32:57.780499+0000","last_peered":"2023-07-05T23:32:57.780499+0000","last_clean":"2023-07-05T23:32:57.780499+0000","last_became_active":"2023-07-05T23:32:52.906688+0000","last_became_peered":"2023-07-05T23:32:52.906688+0000","last_unstale":"2023-07-05T23:32:57.780499+0000","last_undegraded":"2023-07-05T23:32:57.780499+0000","last_fullsized":"2023-07-05T23:32:57.780499+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:17:19.088603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781851+0000","last_change":"2023-07-05T23:32:53.348210+0000","last_active":"2023-07-05T23:32:57.781851+0000","last_peered":"2023-07-05T23:32:57.781851+0000","last_clean":"2023-07-05T23:32:57.781851+0000","last_became_active":"2023-07-05T23:32:53.346652+0000","last_became_peered":"2023-07-05T23:32:53.346652+0000","last_unstale":"2023-07-05T23:32:57.781851+0000","last_undegraded":"2023-07-05T23:32:57.781851+0000","last_fullsized":"2023-07-05T23:32:57.781851+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:15:23.368968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.776688+0000","last_change":"2023-07-05T23:32:57.357185+0000","last_active":"2023-07-05T23:32:57.776688+0000","last_peered":"2023-07-05T23:32:57.776688+0000","last_clean":"2023-07-05T23:32:57.776688+0000","last_became_active":"2023-07-05T23:32:57.356637+0000","last_became_peered":"2023-07-05T23:32:57.356637+0000","last_unstale":"2023-07-05T23:32:57.776688+0000","last_undegraded":"2023-07-05T23:32:57.776688+0000","last_fullsized":"2023-07-05T23:32:57.776688+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:03:24.263651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781492+0000","last_change":"2023-07-05T23:32:52.904412+0000","last_active":"2023-07-05T23:32:57.781492+0000","last_peered":"2023-07-05T23:32:57.781492+0000","last_clean":"2023-07-05T23:32:57.781492+0000","last_became_active":"2023-07-05T23:32:52.903823+0000","last_became_peered":"2023-07-05T23:32:52.903823+0000","last_unstale":"2023-07-05T23:32:57.781492+0000","last_undegraded":"2023-07-05T23:32:57.781492+0000","last_fullsized":"2023-07-05T23:32:57.781492+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:38:12.885407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.782622+0000","last_change":"2023-07-05T23:32:53.342800+0000","last_active":"2023-07-05T23:32:57.782622+0000","last_peered":"2023-07-05T23:32:57.782622+0000","last_clean":"2023-07-05T23:32:57.782622+0000","last_became_active":"2023-07-05T23:32:53.339863+0000","last_became_peered":"2023-07-05T23:32:53.339863+0000","last_unstale":"2023-07-05T23:32:57.782622+0000","last_undegraded":"2023-07-05T23:32:57.782622+0000","last_fullsized":"2023-07-05T23:32:57.782622+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:23:04.385250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780633+0000","last_change":"2023-07-05T23:32:53.337066+0000","last_active":"2023-07-05T23:32:57.780633+0000","last_peered":"2023-07-05T23:32:57.780633+0000","last_clean":"2023-07-05T23:32:57.780633+0000","last_became_active":"2023-07-05T23:32:53.336759+0000","last_became_peered":"2023-07-05T23:32:53.336759+0000","last_unstale":"2023-07-05T23:32:57.780633+0000","last_undegraded":"2023-07-05T23:32:57.780633+0000","last_fullsized":"2023-07-05T23:32:57.780633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:37:57.921126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781993+0000","last_change":"2023-07-05T23:32:53.346160+0000","last_active":"2023-07-05T23:32:57.781993+0000","last_peered":"2023-07-05T23:32:57.781993+0000","last_clean":"2023-07-05T23:32:57.781993+0000","last_became_active":"2023-07-05T23:32:53.345711+0000","last_became_peered":"2023-07-05T23:32:53.345711+0000","last_unstale":"2023-07-05T23:32:57.781993+0000","last_undegraded":"2023-07-05T23:32:57.781993+0000","last_fullsized":"2023-07-05T23:32:57.781993+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:43:31.795176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.783058+0000","last_change":"2023-07-05T23:32:53.339729+0000","last_active":"2023-07-05T23:32:57.783058+0000","last_peered":"2023-07-05T23:32:57.783058+0000","last_clean":"2023-07-05T23:32:57.783058+0000","last_became_active":"2023-07-05T23:32:53.339431+0000","last_became_peered":"2023-07-05T23:32:53.339431+0000","last_unstale":"2023-07-05T23:32:57.783058+0000","last_undegraded":"2023-07-05T23:32:57.783058+0000","last_fullsized":"2023-07-05T23:32:57.783058+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:37:45.661547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779811+0000","last_change":"2023-07-05T23:32:53.335512+0000","last_active":"2023-07-05T23:32:57.779811+0000","last_peered":"2023-07-05T23:32:57.779811+0000","last_clean":"2023-07-05T23:32:57.779811+0000","last_became_active":"2023-07-05T23:32:53.335181+0000","last_became_peered":"2023-07-05T23:32:53.335181+0000","last_unstale":"2023-07-05T23:32:57.779811+0000","last_undegraded":"2023-07-05T23:32:57.779811+0000","last_fullsized":"2023-07-05T23:32:57.779811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:15:41.388811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.777103+0000","last_change":"2023-07-05T23:32:53.338171+0000","last_active":"2023-07-05T23:32:57.777103+0000","last_peered":"2023-07-05T23:32:57.777103+0000","last_clean":"2023-07-05T23:32:57.777103+0000","last_became_active":"2023-07-05T23:32:53.337835+0000","last_became_peered":"2023-07-05T23:32:53.337835+0000","last_unstale":"2023-07-05T23:32:57.777103+0000","last_undegraded":"2023-07-05T23:32:57.777103+0000","last_fullsized":"2023-07-05T23:32:57.777103+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:15:41.388811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":904,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":925696,"data_stored":718950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":303104,"data_stored":124572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":303104,"data_stored":124572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]}]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":901120,"data_stored":715522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":303104,"data_stored":124572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":307200,"data_stored":124662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":323584,"data_stored":128422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]}]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":311296,"data_stored":125224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-05T23:33:18.341 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-05T23:33:18.341 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-07-05T23:33:18.342 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-07-05T23:33:18.342 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-07-05T23:33:18.343 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-07-05T23:33:18.497 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.494+0000 7fad334bf700 1 Processor -- start 2023-07-05T23:33:18.498 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.494+0000 7fad334bf700 1 -- start start 2023-07-05T23:33:18.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.495+0000 7fad334bf700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fad2c15c420 0x7fad2c069ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:18.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.495+0000 7fad334bf700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad2c0cf2a0 con 0x7fad2c0cae00 2023-07-05T23:33:18.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.495+0000 7fad334bf700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad2c0cce40 con 0x7fad2c0b08d0 2023-07-05T23:33:18.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.495+0000 7fad334bf700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad2c0ce690 con 0x7fad2c15c420 2023-07-05T23:33:18.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.495+0000 7fad3125b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fad2c15c420 0x7fad2c069ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:18.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.495+0000 7fad3125b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fad2c15c420 0x7fad2c069ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45198/0 (socket says 172.21.15.27:45198) 2023-07-05T23:33:18.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.495+0000 7fad3125b700 1 -- 172.21.15.27:0/350818435 learned_addr learned my addr 172.21.15.27:0/350818435 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:18.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.495+0000 7fad31a5c700 1 --1- 172.21.15.27:0/350818435 >> v1:172.21.15.27:6789/0 conn(0x7fad2c0cae00 0x7fad2c0cc730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:52364/0 (socket says 172.21.15.27:52364) 2023-07-05T23:33:18.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.496+0000 7fad3125b700 1 -- 172.21.15.27:0/350818435 >> v1:172.21.15.162:6789/0 conn(0x7fad2c0b08d0 legacy=0x7fad2c0cc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:18.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.496+0000 7fad3125b700 1 -- 172.21.15.27:0/350818435 >> v1:172.21.15.27:6789/0 conn(0x7fad2c0cae00 legacy=0x7fad2c0cc730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:18.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.496+0000 7fad3125b700 1 -- 172.21.15.27:0/350818435 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad2c0ce970 con 0x7fad2c15c420 2023-07-05T23:33:18.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.496+0000 7fad3125b700 1 --2- 172.21.15.27:0/350818435 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad2c15c420 0x7fad2c069ef0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fad1c0098f0 tx=0x7fad1c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eec00301c50eab9d server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:18.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.496+0000 7fad23fff700 1 -- 172.21.15.27:0/350818435 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1c00b8a0 con 0x7fad2c15c420 2023-07-05T23:33:18.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.496+0000 7fad23fff700 1 -- 172.21.15.27:0/350818435 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad1c00ba00 con 0x7fad2c15c420 2023-07-05T23:33:18.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.496+0000 7fad23fff700 1 -- 172.21.15.27:0/350818435 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1c00bd90 con 0x7fad2c15c420 2023-07-05T23:33:18.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.497+0000 7fad334bf700 1 -- 172.21.15.27:0/350818435 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad2c15c420 msgr2=0x7fad2c069ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:18.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.497+0000 7fad334bf700 1 --2- 172.21.15.27:0/350818435 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad2c15c420 0x7fad2c069ef0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fad1c0098f0 tx=0x7fad1c009c00 comp rx=0 tx=0).stop 2023-07-05T23:33:18.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.497+0000 7fad334bf700 1 -- 172.21.15.27:0/350818435 shutdown_connections 2023-07-05T23:33:18.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.497+0000 7fad334bf700 1 --2- 172.21.15.27:0/350818435 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad2c15c420 0x7fad2c069ef0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:18.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.497+0000 7fad334bf700 1 -- 172.21.15.27:0/350818435 >> 172.21.15.27:0/350818435 conn(0x7fad2c06b920 msgr2=0x7fad2c0cf7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:18.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.497+0000 7fad334bf700 1 -- 172.21.15.27:0/350818435 shutdown_connections 2023-07-05T23:33:18.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.497+0000 7fad334bf700 1 -- 172.21.15.27:0/350818435 wait complete. 2023-07-05T23:33:18.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.498+0000 7fad334bf700 1 Processor -- start 2023-07-05T23:33:18.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.498+0000 7fad334bf700 1 -- start start 2023-07-05T23:33:18.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.499+0000 7fad334bf700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad2c0b08d0 0x7fad2c1f1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:18.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.499+0000 7fad334bf700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad2c0cae00 0x7fad2c157600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:18.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.499+0000 7fad334bf700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad2c15c420 0x7fad2c1e5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:18.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.499+0000 7fad334bf700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad2c1f1ed0 con 0x7fad2c0b08d0 2023-07-05T23:33:18.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.499+0000 7fad334bf700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad2c143440 con 0x7fad2c0cae00 2023-07-05T23:33:18.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.499+0000 7fad334bf700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad2c158b60 con 0x7fad2c15c420 2023-07-05T23:33:18.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.499+0000 7fad3125b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad2c0b08d0 0x7fad2c1f1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:18.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.499+0000 7fad3125b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad2c0b08d0 0x7fad2c1f1990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45202/0 (socket says 172.21.15.27:45202) 2023-07-05T23:33:18.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.499+0000 7fad3125b700 1 -- 172.21.15.27:0/253512315 learned_addr learned my addr 172.21.15.27:0/253512315 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:18.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.500+0000 7fad31a5c700 1 --2- 172.21.15.27:0/253512315 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad2c15c420 0x7fad2c1e5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:18.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.500+0000 7fad30a5a700 1 --2- 172.21.15.27:0/253512315 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad2c0cae00 0x7fad2c157600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:18.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.500+0000 7fad3125b700 1 -- 172.21.15.27:0/253512315 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad2c15c420 msgr2=0x7fad2c1e5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:18.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.500+0000 7fad3125b700 1 --2- 172.21.15.27:0/253512315 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad2c15c420 0x7fad2c1e5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:18.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.500+0000 7fad3125b700 1 -- 172.21.15.27:0/253512315 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad2c0cae00 msgr2=0x7fad2c157600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:18.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.500+0000 7fad3125b700 1 --2- 172.21.15.27:0/253512315 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad2c0cae00 0x7fad2c157600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:18.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.500+0000 7fad3125b700 1 -- 172.21.15.27:0/253512315 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad1c009550 con 0x7fad2c0b08d0 2023-07-05T23:33:18.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.500+0000 7fad3125b700 1 --2- 172.21.15.27:0/253512315 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad2c0b08d0 0x7fad2c1f1990 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fad1c000c00 tx=0x7fad1c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:18.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.500+0000 7fad21ffb700 1 -- 172.21.15.27:0/253512315 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1c004380 con 0x7fad2c0b08d0 2023-07-05T23:33:18.508 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.500+0000 7fad21ffb700 1 -- 172.21.15.27:0/253512315 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad1c01f070 con 0x7fad2c0b08d0 2023-07-05T23:33:18.508 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.500+0000 7fad334bf700 1 -- 172.21.15.27:0/253512315 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad2c157f50 con 0x7fad2c0b08d0 2023-07-05T23:33:18.508 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.500+0000 7fad21ffb700 1 -- 172.21.15.27:0/253512315 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1c0036a0 con 0x7fad2c0b08d0 2023-07-05T23:33:18.508 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.500+0000 7fad334bf700 1 -- 172.21.15.27:0/253512315 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad2c158510 con 0x7fad2c0b08d0 2023-07-05T23:33:18.508 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.501+0000 7fad334bf700 1 -- 172.21.15.27:0/253512315 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad2c158cd0 con 0x7fad2c0b08d0 2023-07-05T23:33:18.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.502+0000 7fad21ffb700 1 -- 172.21.15.27:0/253512315 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fad1c021030 con 0x7fad2c0b08d0 2023-07-05T23:33:18.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.502+0000 7fad21ffb700 1 --2- 172.21.15.27:0/253512315 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fad1006ad10 0x7fad1006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:18.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.502+0000 7fad21ffb700 1 -- 172.21.15.27:0/253512315 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fad1c08abe0 con 0x7fad2c0b08d0 2023-07-05T23:33:18.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.502+0000 7fad30a5a700 1 --2- 172.21.15.27:0/253512315 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fad1006ad10 0x7fad1006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:18.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.503+0000 7fad30a5a700 1 --2- 172.21.15.27:0/253512315 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fad1006ad10 0x7fad1006d1c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fad2c0cff40 tx=0x7fad28009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:18.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.506+0000 7fad21ffb700 1 -- 172.21.15.27:0/253512315 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fad1c0559b0 con 0x7fad2c0b08d0 2023-07-05T23:33:18.766 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.763+0000 7fad334bf700 1 -- 172.21.15.27:0/253512315 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fad2c06d220 con 0x7fad2c0b08d0 2023-07-05T23:33:18.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.766+0000 7fad21ffb700 1 -- 172.21.15.27:0/253512315 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+170848 (secure 0 0 0) 0x7fad1c058fd0 con 0x7fad2c0b08d0 2023-07-05T23:33:18.773 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:33:18.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.768+0000 7fad334bf700 1 -- 172.21.15.27:0/253512315 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fad1006ad10 msgr2=0x7fad1006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:18.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.768+0000 7fad334bf700 1 --2- 172.21.15.27:0/253512315 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fad1006ad10 0x7fad1006d1c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fad2c0cff40 tx=0x7fad28009040 comp rx=0 tx=0).stop 2023-07-05T23:33:18.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.768+0000 7fad334bf700 1 -- 172.21.15.27:0/253512315 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad2c0b08d0 msgr2=0x7fad2c1f1990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:18.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.768+0000 7fad334bf700 1 --2- 172.21.15.27:0/253512315 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad2c0b08d0 0x7fad2c1f1990 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fad1c000c00 tx=0x7fad1c004750 comp rx=0 tx=0).stop 2023-07-05T23:33:18.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.769+0000 7fad334bf700 1 -- 172.21.15.27:0/253512315 shutdown_connections 2023-07-05T23:33:18.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.769+0000 7fad334bf700 1 --2- 172.21.15.27:0/253512315 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fad1006ad10 0x7fad1006d1c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:18.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.769+0000 7fad334bf700 1 --2- 172.21.15.27:0/253512315 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad2c15c420 0x7fad2c1e5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:18.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.769+0000 7fad334bf700 1 --2- 172.21.15.27:0/253512315 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad2c0b08d0 0x7fad2c1f1990 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:18.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.769+0000 7fad334bf700 1 --2- 172.21.15.27:0/253512315 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad2c0cae00 0x7fad2c157600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:18.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.769+0000 7fad334bf700 1 -- 172.21.15.27:0/253512315 >> 172.21.15.27:0/253512315 conn(0x7fad2c06b920 msgr2=0x7fad2c06ec70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:18.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.769+0000 7fad334bf700 1 -- 172.21.15.27:0/253512315 shutdown_connections 2023-07-05T23:33:18.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.769+0000 7fad334bf700 1 -- 172.21.15.27:0/253512315 wait complete. 2023-07-05T23:33:18.783 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":5,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3790028097},{"type":"v1","addr":"172.21.15.162:6833","nonce":3790028097}]},"active_addr":"172.21.15.162:6833/3790028097","active_change":"2023-07-05T23:32:33.559293+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4104,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.162:0","nonce":1499862487}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.162:0","nonce":3485029082}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.162:0","nonce":2508157915}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.162:0","nonce":131356708}]}]} 2023-07-05T23:33:18.789 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-07-05T23:33:18.790 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-07-05T23:33:18.790 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-05T23:33:18.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.912+0000 7f07833a1700 1 Processor -- start 2023-07-05T23:33:18.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.912+0000 7f07833a1700 1 -- start start 2023-07-05T23:33:18.916 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.913+0000 7f07833a1700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f077c15cb10 0x7f077c160650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:18.916 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.913+0000 7f07833a1700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f077c1601c0 con 0x7f077c069ef0 2023-07-05T23:33:18.916 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.913+0000 7f07833a1700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f077c0cedf0 con 0x7f077c0cd390 2023-07-05T23:33:18.916 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.913+0000 7f07833a1700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f077c0cf3b0 con 0x7f077c15cb10 2023-07-05T23:33:18.916 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.913+0000 7f0782ba0700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f077c069ef0 0x7f077c0b1010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:52380/0 (socket says 172.21.15.27:52380) 2023-07-05T23:33:18.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.913+0000 7f0782ba0700 1 -- 172.21.15.27:0/1648365956 learned_addr learned my addr 172.21.15.27:0/1648365956 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-07-05T23:33:18.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.913+0000 7f078239f700 1 --2- 172.21.15.27:0/1648365956 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f077c15cb10 0x7f077c160650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:18.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.913+0000 7f078139d700 1 -- 172.21.15.27:0/1648365956 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 904153289 0 0) 0x7f077c1601c0 con 0x7f077c069ef0 2023-07-05T23:33:18.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.913+0000 7f078139d700 1 -- 172.21.15.27:0/1648365956 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07680035b0 con 0x7f077c069ef0 2023-07-05T23:33:18.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.914+0000 7f078139d700 1 -- 172.21.15.27:0/1648365956 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2032819300 0 0) 0x7f077c0cedf0 con 0x7f077c0cd390 2023-07-05T23:33:18.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.914+0000 7f078139d700 1 -- 172.21.15.27:0/1648365956 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f077c1601c0 con 0x7f077c0cd390 2023-07-05T23:33:18.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.914+0000 7f078239f700 1 -- 172.21.15.27:0/1648365956 >> v1:172.21.15.162:6789/0 conn(0x7f077c0cd390 legacy=0x7f077c15cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:18.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.914+0000 7f078239f700 1 -- 172.21.15.27:0/1648365956 >> v1:172.21.15.27:6789/0 conn(0x7f077c069ef0 legacy=0x7f077c0b1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:18.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.914+0000 7f078239f700 1 -- 172.21.15.27:0/1648365956 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f077c0cf0d0 con 0x7f077c15cb10 2023-07-05T23:33:18.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.914+0000 7f078239f700 1 --2- 172.21.15.27:0/1648365956 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f077c15cb10 0x7f077c160650 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f076c009870 tx=0x7f076c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9aa0341aacfb4af5 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:18.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.914+0000 7f078139d700 1 -- 172.21.15.27:0/1648365956 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076c011830 con 0x7f077c15cb10 2023-07-05T23:33:18.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.914+0000 7f078139d700 1 -- 172.21.15.27:0/1648365956 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f076c011990 con 0x7f077c15cb10 2023-07-05T23:33:18.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.914+0000 7f078139d700 1 -- 172.21.15.27:0/1648365956 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076c011d20 con 0x7f077c15cb10 2023-07-05T23:33:18.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.914+0000 7f07833a1700 1 -- 172.21.15.27:0/1648365956 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f077c15cb10 msgr2=0x7f077c160650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:18.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.914+0000 7f07833a1700 1 --2- 172.21.15.27:0/1648365956 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f077c15cb10 0x7f077c160650 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f076c009870 tx=0x7f076c009b80 comp rx=0 tx=0).stop 2023-07-05T23:33:18.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.915+0000 7f07833a1700 1 -- 172.21.15.27:0/1648365956 shutdown_connections 2023-07-05T23:33:18.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.915+0000 7f07833a1700 1 --2- 172.21.15.27:0/1648365956 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f077c15cb10 0x7f077c160650 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:18.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.915+0000 7f07833a1700 1 -- 172.21.15.27:0/1648365956 >> 172.21.15.27:0/1648365956 conn(0x7f077c06b000 msgr2=0x7f077c06b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:18.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.915+0000 7f07833a1700 1 -- 172.21.15.27:0/1648365956 shutdown_connections 2023-07-05T23:33:18.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.915+0000 7f07833a1700 1 -- 172.21.15.27:0/1648365956 wait complete. 2023-07-05T23:33:18.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.916+0000 7f07833a1700 1 Processor -- start 2023-07-05T23:33:18.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.916+0000 7f07833a1700 1 -- start start 2023-07-05T23:33:18.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.917+0000 7f07833a1700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f077c069ef0 0x7f077c14a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:18.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.917+0000 7f07833a1700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f077c0cd390 0x7f077c147680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:18.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.917+0000 7f07833a1700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f077c15cb10 0x7f077c1f4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:18.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.917+0000 7f07833a1700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f077c0c5d20 con 0x7f077c069ef0 2023-07-05T23:33:18.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.917+0000 7f07833a1700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f077c14aed0 con 0x7f077c15cb10 2023-07-05T23:33:18.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.917+0000 7f07833a1700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f077c0c50a0 con 0x7f077c0cd390 2023-07-05T23:33:18.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.917+0000 7f078239f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f077c069ef0 0x7f077c14a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:18.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.917+0000 7f078239f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f077c069ef0 0x7f077c14a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45216/0 (socket says 172.21.15.27:45216) 2023-07-05T23:33:18.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.917+0000 7f078239f700 1 -- 172.21.15.27:0/3651214958 learned_addr learned my addr 172.21.15.27:0/3651214958 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:18.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.917+0000 7f0781b9e700 1 --2- 172.21.15.27:0/3651214958 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f077c0cd390 0x7f077c147680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:18.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.917+0000 7f078239f700 1 -- 172.21.15.27:0/3651214958 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f077c0cd390 msgr2=0x7f077c147680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:18.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.917+0000 7f078239f700 1 --2- 172.21.15.27:0/3651214958 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f077c0cd390 0x7f077c147680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:18.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.917+0000 7f078239f700 1 -- 172.21.15.27:0/3651214958 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f077c15cb10 msgr2=0x7f077c1f4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:18.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.917+0000 7f078239f700 1 --2- 172.21.15.27:0/3651214958 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f077c15cb10 0x7f077c1f4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:18.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.917+0000 7f078239f700 1 -- 172.21.15.27:0/3651214958 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f076c0094a0 con 0x7f077c069ef0 2023-07-05T23:33:18.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.917+0000 7f078239f700 1 --2- 172.21.15.27:0/3651214958 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f077c069ef0 0x7f077c14a990 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f076c014040 tx=0x7f076c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:18.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.917+0000 7f0772ffd700 1 -- 172.21.15.27:0/3651214958 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076c01a860 con 0x7f077c069ef0 2023-07-05T23:33:18.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.917+0000 7f0772ffd700 1 -- 172.21.15.27:0/3651214958 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f076c01a9c0 con 0x7f077c069ef0 2023-07-05T23:33:18.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.917+0000 7f07833a1700 1 -- 172.21.15.27:0/3651214958 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f077c0c5380 con 0x7f077c069ef0 2023-07-05T23:33:18.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.917+0000 7f0772ffd700 1 -- 172.21.15.27:0/3651214958 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076c01ad50 con 0x7f077c069ef0 2023-07-05T23:33:18.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.917+0000 7f07833a1700 1 -- 172.21.15.27:0/3651214958 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f077c0c5940 con 0x7f077c069ef0 2023-07-05T23:33:18.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.918+0000 7f07833a1700 1 -- 172.21.15.27:0/3651214958 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f077c04ea20 con 0x7f077c069ef0 2023-07-05T23:33:18.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.919+0000 7f0772ffd700 1 -- 172.21.15.27:0/3651214958 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f076c022070 con 0x7f077c069ef0 2023-07-05T23:33:18.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.919+0000 7f0772ffd700 1 --2- 172.21.15.27:0/3651214958 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f076006ace0 0x7f076006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:18.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.919+0000 7f0772ffd700 1 -- 172.21.15.27:0/3651214958 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f076c08a7d0 con 0x7f077c069ef0 2023-07-05T23:33:18.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.919+0000 7f0781b9e700 1 --2- 172.21.15.27:0/3651214958 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f076006ace0 0x7f076006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:18.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.920+0000 7f0781b9e700 1 --2- 172.21.15.27:0/3651214958 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f076006ace0 0x7f076006d190 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f077c0cb210 tx=0x7f0778009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:18.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:18.924+0000 7f0772ffd700 1 -- 172.21.15.27:0/3651214958 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f076c055620 con 0x7f077c069ef0 2023-07-05T23:33:19.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.122+0000 7f07833a1700 1 -- 172.21.15.27:0/3651214958 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f077c06db00 con 0x7f077c069ef0 2023-07-05T23:33:19.126 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.124+0000 7f0772ffd700 1 -- 172.21.15.27:0/3651214958 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20120 (secure 0 0 0) 0x7f076c058c40 con 0x7f077c069ef0 2023-07-05T23:33:19.127 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:33:19.127 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":28,"fsid":"23eebe48-65f5-4d3c-8c2d-4aa171c055d5","created":"2023-07-05T23:32:27.989612+0000","modified":"2023-07-05T23:32:57.768949+0000","last_up_change":"2023-07-05T23:32:39.601570+0000","last_in_change":"2023-07-05T23:32:30.488261+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-05T23:32:41.624598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-05T23:32:46.481587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-05T23:32:51.025210+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-05T23:32:52.286964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-05T23:32:55.354212+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ac2071e4-394b-4385-b9ba-fad5265efc65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6814","nonce":3766536605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6818","nonce":3766536605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6823","nonce":3766536605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6821","nonce":3766536605}]},"public_addr":"172.21.15.27:6814/3766536605","cluster_addr":"172.21.15.27:6818/3766536605","heartbeat_back_addr":"172.21.15.27:6823/3766536605","heartbeat_front_addr":"172.21.15.27:6821/3766536605","state":["exists","up"]},{"osd":1,"uuid":"8c9b61a0-39d5-46bf-afd6-5add78453ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6801","nonce":1579117455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6803","nonce":1579117455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6807","nonce":1579117455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6805","nonce":1579117455}]},"public_addr":"172.21.15.27:6801/1579117455","cluster_addr":"172.21.15.27:6803/1579117455","heartbeat_back_addr":"172.21.15.27:6807/1579117455","heartbeat_front_addr":"172.21.15.27:6805/1579117455","state":["exists","up"]},{"osd":2,"uuid":"dcd032a2-06b1-4055-b798-b86c71a7107d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6825","nonce":807520271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6827","nonce":807520271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6831","nonce":807520271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6829","nonce":807520271}]},"public_addr":"172.21.15.27:6825/807520271","cluster_addr":"172.21.15.27:6827/807520271","heartbeat_back_addr":"172.21.15.27:6831/807520271","heartbeat_front_addr":"172.21.15.27:6829/807520271","state":["exists","up"]},{"osd":3,"uuid":"b0ffe0fc-47ba-4636-b5ea-6bab637642c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6809","nonce":2125656143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6811","nonce":2125656143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6817","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6819","nonce":2125656143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6813","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6815","nonce":2125656143}]},"public_addr":"172.21.15.27:6809/2125656143","cluster_addr":"172.21.15.27:6811/2125656143","heartbeat_back_addr":"172.21.15.27:6819/2125656143","heartbeat_front_addr":"172.21.15.27:6815/2125656143","state":["exists","up"]},{"osd":4,"uuid":"7fab4e5a-1246-4efe-9562-10c4a6c789ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6801","nonce":2111223016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6803","nonce":2111223016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6807","nonce":2111223016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6805","nonce":2111223016}]},"public_addr":"172.21.15.162:6801/2111223016","cluster_addr":"172.21.15.162:6803/2111223016","heartbeat_back_addr":"172.21.15.162:6807/2111223016","heartbeat_front_addr":"172.21.15.162:6805/2111223016","state":["exists","up"]},{"osd":5,"uuid":"110c4d9f-cef6-48ab-a818-5a81e72372af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6825","nonce":3102609008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6827","nonce":3102609008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6831","nonce":3102609008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6829","nonce":3102609008}]},"public_addr":"172.21.15.162:6825/3102609008","cluster_addr":"172.21.15.162:6827/3102609008","heartbeat_back_addr":"172.21.15.162:6831/3102609008","heartbeat_front_addr":"172.21.15.162:6829/3102609008","state":["exists","up"]},{"osd":6,"uuid":"16803bcc-2c92-4aed-954e-487938c9f24a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6809","nonce":2657688865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6811","nonce":2657688865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6815","nonce":2657688865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6813","nonce":2657688865}]},"public_addr":"172.21.15.162:6809/2657688865","cluster_addr":"172.21.15.162:6811/2657688865","heartbeat_back_addr":"172.21.15.162:6815/2657688865","heartbeat_front_addr":"172.21.15.162:6813/2657688865","state":["exists","up"]},{"osd":7,"uuid":"b7c35377-3cf2-4569-b6b9-72376eb463bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6817","nonce":2096609978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6819","nonce":2096609978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6823","nonce":2096609978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6821","nonce":2096609978}]},"public_addr":"172.21.15.162:6817/2096609978","cluster_addr":"172.21.15.162:6819/2096609978","heartbeat_back_addr":"172.21.15.162:6823/2096609978","heartbeat_front_addr":"172.21.15.162:6821/2096609978","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.735448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.645561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.759120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.682507+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.736228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.694664+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.716002+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.680485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-05T23:33:19.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.126+0000 7f07833a1700 1 -- 172.21.15.27:0/3651214958 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f076006ace0 msgr2=0x7f076006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:19.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.126+0000 7f07833a1700 1 --2- 172.21.15.27:0/3651214958 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f076006ace0 0x7f076006d190 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f077c0cb210 tx=0x7f0778009040 comp rx=0 tx=0).stop 2023-07-05T23:33:19.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.126+0000 7f07833a1700 1 -- 172.21.15.27:0/3651214958 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f077c069ef0 msgr2=0x7f077c14a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:19.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.126+0000 7f07833a1700 1 --2- 172.21.15.27:0/3651214958 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f077c069ef0 0x7f077c14a990 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f076c014040 tx=0x7f076c004750 comp rx=0 tx=0).stop 2023-07-05T23:33:19.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.126+0000 7f07833a1700 1 -- 172.21.15.27:0/3651214958 shutdown_connections 2023-07-05T23:33:19.130 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.126+0000 7f07833a1700 1 --2- 172.21.15.27:0/3651214958 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f077c15cb10 0x7f077c1f4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:19.130 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.126+0000 7f07833a1700 1 --2- 172.21.15.27:0/3651214958 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f076006ace0 0x7f076006d190 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:19.130 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.126+0000 7f07833a1700 1 --2- 172.21.15.27:0/3651214958 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f077c069ef0 0x7f077c14a990 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:19.130 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.126+0000 7f07833a1700 1 --2- 172.21.15.27:0/3651214958 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f077c0cd390 0x7f077c147680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:19.130 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.126+0000 7f07833a1700 1 -- 172.21.15.27:0/3651214958 >> 172.21.15.27:0/3651214958 conn(0x7f077c06b000 msgr2=0x7f077c0c9f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:19.130 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.126+0000 7f07833a1700 1 -- 172.21.15.27:0/3651214958 shutdown_connections 2023-07-05T23:33:19.130 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.126+0000 7f07833a1700 1 -- 172.21.15.27:0/3651214958 wait complete. 2023-07-05T23:33:19.141 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-07-05T23:33:19.142 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-05T23:33:19.266 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.263+0000 7fd792e34700 1 Processor -- start 2023-07-05T23:33:19.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.263+0000 7fd792e34700 1 -- start start 2023-07-05T23:33:19.268 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.264+0000 7fd792e34700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd78c0aed30 0x7fd78c160580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:19.269 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.264+0000 7fd792e34700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd78c0cc1d0 0x7fd78c0cc650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:19.269 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.264+0000 7fd792e34700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd78c0cee80 con 0x7fd78c156880 2023-07-05T23:33:19.269 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.264+0000 7fd792e34700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd78c0ccb90 con 0x7fd78c0aed30 2023-07-05T23:33:19.269 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.264+0000 7fd792e34700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd78c0cf100 con 0x7fd78c0cc1d0 2023-07-05T23:33:19.269 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.264+0000 7fd78bfff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd78c0aed30 0x7fd78c160580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:19.270 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.264+0000 7fd78bfff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd78c0aed30 0x7fd78c160580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45226/0 (socket says 172.21.15.27:45226) 2023-07-05T23:33:19.270 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.264+0000 7fd78bfff700 1 -- 172.21.15.27:0/244426930 learned_addr learned my addr 172.21.15.27:0/244426930 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:19.270 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.265+0000 7fd7913d1700 1 --2- 172.21.15.27:0/244426930 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd78c0cc1d0 0x7fd78c0cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:19.270 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.265+0000 7fd78bfff700 1 -- 172.21.15.27:0/244426930 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd78c0cc1d0 msgr2=0x7fd78c0cc650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:19.271 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.265+0000 7fd78bfff700 1 --2- 172.21.15.27:0/244426930 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd78c0cc1d0 0x7fd78c0cc650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:19.271 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.265+0000 7fd78bfff700 1 -- 172.21.15.27:0/244426930 >> v1:172.21.15.162:6789/0 conn(0x7fd78c156880 legacy=0x7fd78c069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:19.271 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.265+0000 7fd78bfff700 1 -- 172.21.15.27:0/244426930 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd78c0cf3e0 con 0x7fd78c0aed30 2023-07-05T23:33:19.271 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.265+0000 7fd78bfff700 1 --2- 172.21.15.27:0/244426930 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd78c0aed30 0x7fd78c160580 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd7780098f0 tx=0x7fd778009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b18774bd21e738ec server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:19.271 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.265+0000 7fd78b7fe700 1 -- 172.21.15.27:0/244426930 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77800b8a0 con 0x7fd78c0aed30 2023-07-05T23:33:19.271 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.265+0000 7fd78b7fe700 1 -- 172.21.15.27:0/244426930 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd77800ba00 con 0x7fd78c0aed30 2023-07-05T23:33:19.271 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.265+0000 7fd78b7fe700 1 -- 172.21.15.27:0/244426930 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77800bd90 con 0x7fd78c0aed30 2023-07-05T23:33:19.272 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.265+0000 7fd792e34700 1 -- 172.21.15.27:0/244426930 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd78c0aed30 msgr2=0x7fd78c160580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:19.272 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.266+0000 7fd792e34700 1 --2- 172.21.15.27:0/244426930 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd78c0aed30 0x7fd78c160580 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd7780098f0 tx=0x7fd778009c00 comp rx=0 tx=0).stop 2023-07-05T23:33:19.272 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.266+0000 7fd792e34700 1 -- 172.21.15.27:0/244426930 shutdown_connections 2023-07-05T23:33:19.272 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.266+0000 7fd792e34700 1 --2- 172.21.15.27:0/244426930 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd78c0cc1d0 0x7fd78c0cc650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:19.272 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.266+0000 7fd792e34700 1 --2- 172.21.15.27:0/244426930 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd78c0aed30 0x7fd78c160580 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:19.272 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.266+0000 7fd792e34700 1 -- 172.21.15.27:0/244426930 >> 172.21.15.27:0/244426930 conn(0x7fd78c06d4a0 msgr2=0x7fd78c06d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:19.272 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.266+0000 7fd792e34700 1 -- 172.21.15.27:0/244426930 shutdown_connections 2023-07-05T23:33:19.273 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.266+0000 7fd792e34700 1 -- 172.21.15.27:0/244426930 wait complete. 2023-07-05T23:33:19.274 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.267+0000 7fd792e34700 1 Processor -- start 2023-07-05T23:33:19.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.267+0000 7fd792e34700 1 -- start start 2023-07-05T23:33:19.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.268+0000 7fd792e34700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd78c0aed30 0x7fd78c14ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:19.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.268+0000 7fd792e34700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd78c0cc1d0 0x7fd78c0b3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:19.276 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.268+0000 7fd792e34700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd78c156880 0x7fd78c1f2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:19.276 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.268+0000 7fd792e34700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd78c1f3130 con 0x7fd78c0aed30 2023-07-05T23:33:19.276 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.268+0000 7fd792e34700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd78c0b2ea0 con 0x7fd78c156880 2023-07-05T23:33:19.276 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.268+0000 7fd792e34700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd78c1f2b70 con 0x7fd78c0cc1d0 2023-07-05T23:33:19.276 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.268+0000 7fd790bd0700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd78c0aed30 0x7fd78c14ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:19.276 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.268+0000 7fd790bd0700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd78c0aed30 0x7fd78c14ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45230/0 (socket says 172.21.15.27:45230) 2023-07-05T23:33:19.276 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.268+0000 7fd790bd0700 1 -- 172.21.15.27:0/897146136 learned_addr learned my addr 172.21.15.27:0/897146136 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:19.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.268+0000 7fd78bfff700 1 --2- 172.21.15.27:0/897146136 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd78c0cc1d0 0x7fd78c0b3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:19.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.268+0000 7fd7913d1700 1 --2- 172.21.15.27:0/897146136 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd78c156880 0x7fd78c1f2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:19.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.268+0000 7fd790bd0700 1 -- 172.21.15.27:0/897146136 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd78c0cc1d0 msgr2=0x7fd78c0b3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:19.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.268+0000 7fd790bd0700 1 --2- 172.21.15.27:0/897146136 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd78c0cc1d0 0x7fd78c0b3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:19.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.268+0000 7fd790bd0700 1 -- 172.21.15.27:0/897146136 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd78c156880 msgr2=0x7fd78c1f2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:19.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.268+0000 7fd790bd0700 1 --2- 172.21.15.27:0/897146136 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd78c156880 0x7fd78c1f2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:19.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.268+0000 7fd790bd0700 1 -- 172.21.15.27:0/897146136 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd778009550 con 0x7fd78c0aed30 2023-07-05T23:33:19.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.268+0000 7fd78bfff700 1 --2- 172.21.15.27:0/897146136 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd78c0cc1d0 0x7fd78c0b3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T23:33:19.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.268+0000 7fd790bd0700 1 --2- 172.21.15.27:0/897146136 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd78c0aed30 0x7fd78c14ea00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd78000c4e0 tx=0x7fd78000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:19.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.268+0000 7fd7897fa700 1 -- 172.21.15.27:0/897146136 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7800052d0 con 0x7fd78c0aed30 2023-07-05T23:33:19.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.268+0000 7fd7897fa700 1 -- 172.21.15.27:0/897146136 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd780005430 con 0x7fd78c0aed30 2023-07-05T23:33:19.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.269+0000 7fd792e34700 1 -- 172.21.15.27:0/897146136 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd78c1f2e50 con 0x7fd78c0aed30 2023-07-05T23:33:19.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.269+0000 7fd7897fa700 1 -- 172.21.15.27:0/897146136 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7800038c0 con 0x7fd78c0aed30 2023-07-05T23:33:19.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.269+0000 7fd792e34700 1 -- 172.21.15.27:0/897146136 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd78c0b5160 con 0x7fd78c0aed30 2023-07-05T23:33:19.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.270+0000 7fd792e34700 1 -- 172.21.15.27:0/897146136 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd78c0b5350 con 0x7fd78c0aed30 2023-07-05T23:33:19.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.270+0000 7fd7897fa700 1 -- 172.21.15.27:0/897146136 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd780003a20 con 0x7fd78c0aed30 2023-07-05T23:33:19.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.270+0000 7fd7897fa700 1 --2- 172.21.15.27:0/897146136 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fd77006ace0 0x7fd77006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:19.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.270+0000 7fd7897fa700 1 -- 172.21.15.27:0/897146136 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd780088c80 con 0x7fd78c0aed30 2023-07-05T23:33:19.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.271+0000 7fd78bfff700 1 --2- 172.21.15.27:0/897146136 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fd77006ace0 0x7fd77006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:19.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.271+0000 7fd78bfff700 1 --2- 172.21.15.27:0/897146136 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fd77006ace0 0x7fd77006d190 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd778014040 tx=0x7fd778008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:19.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.275+0000 7fd7897fa700 1 -- 172.21.15.27:0/897146136 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd78c0b5350 con 0x7fd78c0aed30 2023-07-05T23:33:19.476 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.473+0000 7fd792e34700 1 -- 172.21.15.27:0/897146136 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd78c0b5350 con 0x7fd78c0aed30 2023-07-05T23:33:19.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.475+0000 7fd7897fa700 1 -- 172.21.15.27:0/897146136 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20120 (secure 0 0 0) 0x7fd78c0b5350 con 0x7fd78c0aed30 2023-07-05T23:33:19.478 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:33:19.478 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":28,"fsid":"23eebe48-65f5-4d3c-8c2d-4aa171c055d5","created":"2023-07-05T23:32:27.989612+0000","modified":"2023-07-05T23:32:57.768949+0000","last_up_change":"2023-07-05T23:32:39.601570+0000","last_in_change":"2023-07-05T23:32:30.488261+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-05T23:32:41.624598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-05T23:32:46.481587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-05T23:32:51.025210+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-05T23:32:52.286964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-05T23:32:55.354212+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ac2071e4-394b-4385-b9ba-fad5265efc65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6814","nonce":3766536605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6818","nonce":3766536605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6823","nonce":3766536605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6821","nonce":3766536605}]},"public_addr":"172.21.15.27:6814/3766536605","cluster_addr":"172.21.15.27:6818/3766536605","heartbeat_back_addr":"172.21.15.27:6823/3766536605","heartbeat_front_addr":"172.21.15.27:6821/3766536605","state":["exists","up"]},{"osd":1,"uuid":"8c9b61a0-39d5-46bf-afd6-5add78453ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6801","nonce":1579117455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6803","nonce":1579117455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6807","nonce":1579117455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6805","nonce":1579117455}]},"public_addr":"172.21.15.27:6801/1579117455","cluster_addr":"172.21.15.27:6803/1579117455","heartbeat_back_addr":"172.21.15.27:6807/1579117455","heartbeat_front_addr":"172.21.15.27:6805/1579117455","state":["exists","up"]},{"osd":2,"uuid":"dcd032a2-06b1-4055-b798-b86c71a7107d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6825","nonce":807520271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6827","nonce":807520271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6831","nonce":807520271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6829","nonce":807520271}]},"public_addr":"172.21.15.27:6825/807520271","cluster_addr":"172.21.15.27:6827/807520271","heartbeat_back_addr":"172.21.15.27:6831/807520271","heartbeat_front_addr":"172.21.15.27:6829/807520271","state":["exists","up"]},{"osd":3,"uuid":"b0ffe0fc-47ba-4636-b5ea-6bab637642c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6809","nonce":2125656143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6811","nonce":2125656143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6817","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6819","nonce":2125656143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6813","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6815","nonce":2125656143}]},"public_addr":"172.21.15.27:6809/2125656143","cluster_addr":"172.21.15.27:6811/2125656143","heartbeat_back_addr":"172.21.15.27:6819/2125656143","heartbeat_front_addr":"172.21.15.27:6815/2125656143","state":["exists","up"]},{"osd":4,"uuid":"7fab4e5a-1246-4efe-9562-10c4a6c789ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6801","nonce":2111223016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6803","nonce":2111223016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6807","nonce":2111223016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6805","nonce":2111223016}]},"public_addr":"172.21.15.162:6801/2111223016","cluster_addr":"172.21.15.162:6803/2111223016","heartbeat_back_addr":"172.21.15.162:6807/2111223016","heartbeat_front_addr":"172.21.15.162:6805/2111223016","state":["exists","up"]},{"osd":5,"uuid":"110c4d9f-cef6-48ab-a818-5a81e72372af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6825","nonce":3102609008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6827","nonce":3102609008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6831","nonce":3102609008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6829","nonce":3102609008}]},"public_addr":"172.21.15.162:6825/3102609008","cluster_addr":"172.21.15.162:6827/3102609008","heartbeat_back_addr":"172.21.15.162:6831/3102609008","heartbeat_front_addr":"172.21.15.162:6829/3102609008","state":["exists","up"]},{"osd":6,"uuid":"16803bcc-2c92-4aed-954e-487938c9f24a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6809","nonce":2657688865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6811","nonce":2657688865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6815","nonce":2657688865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6813","nonce":2657688865}]},"public_addr":"172.21.15.162:6809/2657688865","cluster_addr":"172.21.15.162:6811/2657688865","heartbeat_back_addr":"172.21.15.162:6815/2657688865","heartbeat_front_addr":"172.21.15.162:6813/2657688865","state":["exists","up"]},{"osd":7,"uuid":"b7c35377-3cf2-4569-b6b9-72376eb463bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6817","nonce":2096609978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6819","nonce":2096609978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6823","nonce":2096609978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6821","nonce":2096609978}]},"public_addr":"172.21.15.162:6817/2096609978","cluster_addr":"172.21.15.162:6819/2096609978","heartbeat_back_addr":"172.21.15.162:6823/2096609978","heartbeat_front_addr":"172.21.15.162:6821/2096609978","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.735448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.645561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.759120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.682507+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.736228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.694664+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.716002+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.680485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-05T23:33:19.480 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.477+0000 7fd792e34700 1 -- 172.21.15.27:0/897146136 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fd77006ace0 msgr2=0x7fd77006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:19.480 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.477+0000 7fd792e34700 1 --2- 172.21.15.27:0/897146136 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fd77006ace0 0x7fd77006d190 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd778014040 tx=0x7fd778008030 comp rx=0 tx=0).stop 2023-07-05T23:33:19.480 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.477+0000 7fd792e34700 1 -- 172.21.15.27:0/897146136 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd78c0aed30 msgr2=0x7fd78c14ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:19.480 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.477+0000 7fd792e34700 1 --2- 172.21.15.27:0/897146136 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd78c0aed30 0x7fd78c14ea00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd78000c4e0 tx=0x7fd78000c8a0 comp rx=0 tx=0).stop 2023-07-05T23:33:19.480 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.477+0000 7fd792e34700 1 -- 172.21.15.27:0/897146136 shutdown_connections 2023-07-05T23:33:19.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.477+0000 7fd792e34700 1 --2- 172.21.15.27:0/897146136 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd78c156880 0x7fd78c1f2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:19.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.477+0000 7fd792e34700 1 --2- 172.21.15.27:0/897146136 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fd77006ace0 0x7fd77006d190 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:19.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.477+0000 7fd792e34700 1 --2- 172.21.15.27:0/897146136 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd78c0aed30 0x7fd78c14ea00 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:19.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.477+0000 7fd792e34700 1 --2- 172.21.15.27:0/897146136 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd78c0cc1d0 0x7fd78c0b3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:19.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.477+0000 7fd792e34700 1 -- 172.21.15.27:0/897146136 >> 172.21.15.27:0/897146136 conn(0x7fd78c06d4a0 msgr2=0x7fd78c1e6bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:19.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.477+0000 7fd792e34700 1 -- 172.21.15.27:0/897146136 shutdown_connections 2023-07-05T23:33:19.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.477+0000 7fd792e34700 1 -- 172.21.15.27:0/897146136 wait complete. 2023-07-05T23:33:19.492 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-07-05T23:33:19.493 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-07-05T23:33:19.493 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-07-05T23:33:19.494 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-07-05T23:33:19.494 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-07-05T23:33:19.495 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-07-05T23:33:19.495 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-07-05T23:33:19.496 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-07-05T23:33:19.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.710+0000 7f7dcec02700 1 Processor -- start 2023-07-05T23:33:19.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.710+0000 7f7dcec02700 1 -- start start 2023-07-05T23:33:19.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.711+0000 7f7dcec02700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f7dc8159270 0x7f7dc806c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:19.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.711+0000 7f7dcec02700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dc8159690 con 0x7f7dc80b0d40 2023-07-05T23:33:19.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.711+0000 7f7dcec02700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dc815bd30 con 0x7f7dc80cc970 2023-07-05T23:33:19.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.711+0000 7f7dcec02700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dc81586a0 con 0x7f7dc8159270 2023-07-05T23:33:19.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.711+0000 7f7dcc99e700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f7dc80b0d40 0x7f7dc80cc260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:52404/0 (socket says 172.21.15.27:52404) 2023-07-05T23:33:19.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.711+0000 7f7dcc99e700 1 -- 172.21.15.27:0/4167481760 learned_addr learned my addr 172.21.15.27:0/4167481760 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-07-05T23:33:19.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.711+0000 7f7dcd19f700 1 --2- 172.21.15.27:0/4167481760 >> v2:172.21.15.27:3300/0 conn(0x7f7dc8159270 0x7f7dc806c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:19.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.712+0000 7f7dc77fe700 1 -- 172.21.15.27:0/4167481760 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2744995383 0 0) 0x7f7dc8159690 con 0x7f7dc80b0d40 2023-07-05T23:33:19.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.712+0000 7f7dcd19f700 1 -- 172.21.15.27:0/4167481760 >> v1:172.21.15.162:6789/0 conn(0x7f7dc80cc970 legacy=0x7f7dc806c270 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-05T23:33:19.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.712+0000 7f7dcd19f700 1 -- 172.21.15.27:0/4167481760 >> v1:172.21.15.27:6789/0 conn(0x7f7dc80b0d40 legacy=0x7f7dc80cc260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:19.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.712+0000 7f7dcd19f700 1 -- 172.21.15.27:0/4167481760 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc815bfd0 con 0x7f7dc8159270 2023-07-05T23:33:19.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.712+0000 7f524e4fb700 1 Processor -- start 2023-07-05T23:33:19.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.712+0000 7f524e4fb700 1 -- start start 2023-07-05T23:33:19.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.713+0000 7f7dcd19f700 1 --2- 172.21.15.27:0/4167481760 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7dc8159270 0x7f7dc806c980 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc009840 tx=0x7f7dbc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffeb1a174854f3e server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:19.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.714+0000 7effcad5b700 1 Processor -- start 2023-07-05T23:33:19.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.714+0000 7f7dc77fe700 1 -- 172.21.15.27:0/4167481760 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc004230 con 0x7f7dc8159270 2023-07-05T23:33:19.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.714+0000 7f7dc77fe700 1 -- 172.21.15.27:0/4167481760 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dbc004390 con 0x7f7dc8159270 2023-07-05T23:33:19.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.714+0000 7f7dc77fe700 1 -- 172.21.15.27:0/4167481760 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc0036a0 con 0x7f7dc8159270 2023-07-05T23:33:19.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.714+0000 7f524e4fb700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f52480cbbf0 0x7f52480cc260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:19.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.714+0000 7f524e4fb700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f524815bd30 con 0x7f52480cc7a0 2023-07-05T23:33:19.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.714+0000 7f524e4fb700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5248159640 con 0x7f5248159270 2023-07-05T23:33:19.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.714+0000 7f524e4fb700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52481586a0 con 0x7f52480cbbf0 2023-07-05T23:33:19.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.714+0000 7f524ca98700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f52480cc7a0 0x7f524806c270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:52410/0 (socket says 172.21.15.27:52410) 2023-07-05T23:33:19.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.714+0000 7f524ca98700 1 -- 172.21.15.27:0/4076177837 learned_addr learned my addr 172.21.15.27:0/4076177837 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-07-05T23:33:19.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.715+0000 7f5246ffd700 1 -- 172.21.15.27:0/4076177837 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 403031529 0 0) 0x7f524815bd30 con 0x7f52480cc7a0 2023-07-05T23:33:19.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.715+0000 7f5246ffd700 1 -- 172.21.15.27:0/4076177837 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52300035b0 con 0x7f52480cc7a0 2023-07-05T23:33:19.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.715+0000 7f5246ffd700 1 -- 172.21.15.27:0/4076177837 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1015869937 0 0) 0x7f52300035b0 con 0x7f52480cc7a0 2023-07-05T23:33:19.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.715+0000 7f5246ffd700 1 -- 172.21.15.27:0/4076177837 >> v2:172.21.15.27:3300/0 conn(0x7f52480cbbf0 msgr2=0x7f52480cc260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-05T23:33:19.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.715+0000 7f5246ffd700 1 --2- 172.21.15.27:0/4076177837 >> v2:172.21.15.27:3300/0 conn(0x7f52480cbbf0 0x7f52480cc260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:19.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.715+0000 7f5246ffd700 1 -- 172.21.15.27:0/4076177837 >> v1:172.21.15.162:6789/0 conn(0x7f5248159270 legacy=0x7f52480cb4e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-05T23:33:19.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.715+0000 7f5246ffd700 1 -- 172.21.15.27:0/4076177837 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52480ccbe0 con 0x7f52480cc7a0 2023-07-05T23:33:19.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.715+0000 7f5246ffd700 1 -- 172.21.15.27:0/4076177837 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1246168953 0 0) 0x7f5238001670 con 0x7f52480cc7a0 2023-07-05T23:33:19.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.715+0000 7f5246ffd700 1 -- 172.21.15.27:0/4076177837 >> v1:172.21.15.27:6789/0 conn(0x7f52480cc7a0 legacy=0x7f524806c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:19.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.714+0000 7effcad5b700 1 -- start start 2023-07-05T23:33:19.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.715+0000 7effcad5b700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7effc4159270 0x7effc40cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:19.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.715+0000 7effcad5b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7effc40cba20 0x7effc40cc260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:19.722 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.715+0000 7effcad5b700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effc415bd30 con 0x7effc40cc7a0 2023-07-05T23:33:19.722 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.715+0000 7effcad5b700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effc41586a0 con 0x7effc40cba20 2023-07-05T23:33:19.722 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.715+0000 7effcad5b700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effc40cbec0 con 0x7effc4159270 2023-07-05T23:33:19.722 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.715+0000 7f5246ffd700 1 --2- 172.21.15.27:0/4076177837 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f52300037f0 0x7f5230003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:19.722 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.715+0000 7f5246ffd700 1 --2- 172.21.15.27:0/4076177837 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5230004170 0x7f523000b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:19.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.715+0000 7f5246ffd700 1 --2- 172.21.15.27:0/4076177837 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f523000b690 0x7f523000db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:19.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.715+0000 7f5246ffd700 1 -- 172.21.15.27:0/4076177837 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f523000e3c0 con 0x7f52300037f0 2023-07-05T23:33:19.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.715+0000 7f5246ffd700 1 -- 172.21.15.27:0/4076177837 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f523000e530 con 0x7f5230004170 2023-07-05T23:33:19.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.715+0000 7f5246ffd700 1 -- 172.21.15.27:0/4076177837 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f523000e6f0 con 0x7f523000b690 2023-07-05T23:33:19.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.715+0000 7f52477fe700 1 --2- 172.21.15.27:0/4076177837 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5230004170 0x7f523000b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:19.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.715+0000 7f7dcec02700 1 -- 172.21.15.27:0/4167481760 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7dc8159270 msgr2=0x7f7dc806c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:19.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.715+0000 7f7dcec02700 1 --2- 172.21.15.27:0/4167481760 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7dc8159270 0x7f7dc806c980 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc009840 tx=0x7f7dbc009b50 comp rx=0 tx=0).stop 2023-07-05T23:33:19.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.716+0000 7f7dcec02700 1 -- 172.21.15.27:0/4167481760 shutdown_connections 2023-07-05T23:33:19.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.716+0000 7f7dcec02700 1 --2- 172.21.15.27:0/4167481760 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7dc8159270 0x7f7dc806c980 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:19.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.716+0000 7f7dcec02700 1 -- 172.21.15.27:0/4167481760 >> 172.21.15.27:0/4167481760 conn(0x7f7dc80b0260 msgr2=0x7f7dc80b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:19.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.715+0000 7effc3fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7effc40cba20 0x7effc40cc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:19.726 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.715+0000 7effc3fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7effc40cba20 0x7effc40cc260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45252/0 (socket says 172.21.15.27:45252) 2023-07-05T23:33:19.726 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.716+0000 7effc3fff700 1 -- 172.21.15.27:0/3901149215 learned_addr learned my addr 172.21.15.27:0/3901149215 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:19.726 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.716+0000 7effc8af7700 1 --2- 172.21.15.27:0/3901149215 >> v2:172.21.15.162:3300/0 conn(0x7effc4159270 0x7effc40cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:19.726 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.716+0000 7effc3fff700 1 -- 172.21.15.27:0/3901149215 >> v2:172.21.15.162:3300/0 conn(0x7effc4159270 msgr2=0x7effc40cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:19.726 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.716+0000 7effc3fff700 1 --2- 172.21.15.27:0/3901149215 >> v2:172.21.15.162:3300/0 conn(0x7effc4159270 0x7effc40cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:19.726 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.716+0000 7effc3fff700 1 -- 172.21.15.27:0/3901149215 >> v1:172.21.15.162:6789/0 conn(0x7effc40cc7a0 legacy=0x7effc4069ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-05T23:33:19.726 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.716+0000 7effc3fff700 1 -- 172.21.15.27:0/3901149215 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc4159640 con 0x7effc40cba20 2023-07-05T23:33:19.727 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.716+0000 7f48762e3700 1 Processor -- start 2023-07-05T23:33:19.727 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.716+0000 7effc3fff700 1 --2- 172.21.15.27:0/3901149215 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7effc40cba20 0x7effc40cc260 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7effc40b4820 tx=0x7effb000a2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e86583871fa9da8a server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:19.727 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.716+0000 7effc37fe700 1 -- 172.21.15.27:0/3901149215 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb000acf0 con 0x7effc40cba20 2023-07-05T23:33:19.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.716+0000 7effc37fe700 1 -- 172.21.15.27:0/3901149215 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effb000ae50 con 0x7effc40cba20 2023-07-05T23:33:19.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.716+0000 7effc37fe700 1 -- 172.21.15.27:0/3901149215 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb0004250 con 0x7effc40cba20 2023-07-05T23:33:19.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.717+0000 7f7dcec02700 1 -- 172.21.15.27:0/4167481760 shutdown_connections 2023-07-05T23:33:19.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.717+0000 7f7dcec02700 1 -- 172.21.15.27:0/4167481760 wait complete. 2023-07-05T23:33:19.729 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.717+0000 7f52477fe700 1 -- 172.21.15.27:0/4076177837 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f523000b690 msgr2=0x7f523000db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:19.729 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.717+0000 7f52477fe700 1 --2- 172.21.15.27:0/4076177837 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f523000b690 0x7f523000db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:19.729 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.717+0000 7f52477fe700 1 -- 172.21.15.27:0/4076177837 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f52300037f0 msgr2=0x7f5230003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:19.729 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.717+0000 7f52477fe700 1 --2- 172.21.15.27:0/4076177837 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f52300037f0 0x7f5230003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:19.729 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.717+0000 7f52477fe700 1 -- 172.21.15.27:0/4076177837 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52480ccbe0 con 0x7f5230004170 2023-07-05T23:33:19.730 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.716+0000 7f48762e3700 1 -- start start 2023-07-05T23:33:19.730 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.717+0000 7f48762e3700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f487015c570 0x7f48700cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:19.730 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.717+0000 7f48762e3700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f48700cd660 0x7f4870160340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:19.730 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.717+0000 7f48762e3700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48701610a0 con 0x7f4870160880 2023-07-05T23:33:19.730 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.717+0000 7f48762e3700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f487015d670 con 0x7f487015c570 2023-07-05T23:33:19.730 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.717+0000 7f48762e3700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48700cdae0 con 0x7f48700cd660 2023-07-05T23:33:19.731 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.718+0000 7effcad5b700 1 -- 172.21.15.27:0/3901149215 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7effc40cba20 msgr2=0x7effc40cc260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:19.731 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.718+0000 7effcad5b700 1 --2- 172.21.15.27:0/3901149215 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7effc40cba20 0x7effc40cc260 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7effc40b4820 tx=0x7effb000a2d0 comp rx=0 tx=0).stop 2023-07-05T23:33:19.731 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.718+0000 7f486ffff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f487015c570 0x7f48700cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:19.731 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.718+0000 7f486ffff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f487015c570 0x7f48700cd120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45258/0 (socket says 172.21.15.27:45258) 2023-07-05T23:33:19.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.718+0000 7f486ffff700 1 -- 172.21.15.27:0/1599604463 learned_addr learned my addr 172.21.15.27:0/1599604463 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:19.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.718+0000 7f486ffff700 1 -- 172.21.15.27:0/1599604463 >> v2:172.21.15.162:3300/0 conn(0x7f48700cd660 msgr2=0x7f4870160340 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-05T23:33:19.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.718+0000 7f486ffff700 1 --2- 172.21.15.27:0/1599604463 >> v2:172.21.15.162:3300/0 conn(0x7f48700cd660 0x7f4870160340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:19.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.718+0000 7f486ffff700 1 -- 172.21.15.27:0/1599604463 >> v1:172.21.15.162:6789/0 conn(0x7f4870160880 legacy=0x7f487006b200 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-05T23:33:19.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.718+0000 7f486ffff700 1 -- 172.21.15.27:0/1599604463 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f487015da90 con 0x7f487015c570 2023-07-05T23:33:19.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.718+0000 7f486ffff700 1 --2- 172.21.15.27:0/1599604463 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f487015c570 0x7f48700cd120 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f487008bc50 tx=0x7f486800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45f75baccd6b13ba server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:19.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.718+0000 7f486effd700 1 -- 172.21.15.27:0/1599604463 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4868003c20 con 0x7f487015c570 2023-07-05T23:33:19.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.718+0000 7f486effd700 1 -- 172.21.15.27:0/1599604463 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4868003d80 con 0x7f487015c570 2023-07-05T23:33:19.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.718+0000 7f486effd700 1 -- 172.21.15.27:0/1599604463 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486800bbc0 con 0x7f487015c570 2023-07-05T23:33:19.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.719+0000 7f52477fe700 1 --2- 172.21.15.27:0/4076177837 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5230004170 0x7f523000b0a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f523c009850 tx=0x7f5230004870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45a02710944a0a49 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:19.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.719+0000 7f524ca98700 1 -- 172.21.15.27:0/4076177837 reap_dead start 2023-07-05T23:33:19.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.719+0000 7f7dcec02700 1 Processor -- start 2023-07-05T23:33:19.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.719+0000 7f5246ffd700 1 -- 172.21.15.27:0/4076177837 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523c011620 con 0x7f5230004170 2023-07-05T23:33:19.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.719+0000 7f5246ffd700 1 -- 172.21.15.27:0/4076177837 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f523c011780 con 0x7f5230004170 2023-07-05T23:33:19.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.719+0000 7f5246ffd700 1 -- 172.21.15.27:0/4076177837 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523c011af0 con 0x7f5230004170 2023-07-05T23:33:19.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.719+0000 7effcad5b700 1 -- 172.21.15.27:0/3901149215 shutdown_connections 2023-07-05T23:33:19.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.719+0000 7effcad5b700 1 --2- 172.21.15.27:0/3901149215 >> v2:172.21.15.162:3300/0 conn(0x7effc4159270 0x7effc40cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:19.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.719+0000 7effcad5b700 1 --2- 172.21.15.27:0/3901149215 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7effc40cba20 0x7effc40cc260 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:19.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.719+0000 7effcad5b700 1 -- 172.21.15.27:0/3901149215 >> 172.21.15.27:0/3901149215 conn(0x7effc40b0260 msgr2=0x7effc40b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:19.736 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.719+0000 7effcad5b700 1 -- 172.21.15.27:0/3901149215 shutdown_connections 2023-07-05T23:33:19.736 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.719+0000 7effcad5b700 1 -- 172.21.15.27:0/3901149215 wait complete. 2023-07-05T23:33:19.736 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.719+0000 7f48762e3700 1 -- 172.21.15.27:0/1599604463 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f487015c570 msgr2=0x7f48700cd120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:19.736 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.719+0000 7f48762e3700 1 --2- 172.21.15.27:0/1599604463 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f487015c570 0x7f48700cd120 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f487008bc50 tx=0x7f486800b330 comp rx=0 tx=0).stop 2023-07-05T23:33:19.737 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.720+0000 7f48762e3700 1 -- 172.21.15.27:0/1599604463 shutdown_connections 2023-07-05T23:33:19.737 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.720+0000 7f48762e3700 1 --2- 172.21.15.27:0/1599604463 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f487015c570 0x7f48700cd120 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:19.737 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.720+0000 7f48762e3700 1 --2- 172.21.15.27:0/1599604463 >> v2:172.21.15.162:3300/0 conn(0x7f48700cd660 0x7f4870160340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:19.737 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.720+0000 7f48762e3700 1 -- 172.21.15.27:0/1599604463 >> 172.21.15.27:0/1599604463 conn(0x7f4870071620 msgr2=0x7f48700719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:19.737 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.720+0000 7f48762e3700 1 -- 172.21.15.27:0/1599604463 shutdown_connections 2023-07-05T23:33:19.737 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.720+0000 7f48762e3700 1 -- 172.21.15.27:0/1599604463 wait complete. 2023-07-05T23:33:19.738 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.719+0000 7f7dcec02700 1 -- start start 2023-07-05T23:33:19.738 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.720+0000 7f7dcec02700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7dc80b0d40 0x7f7dc80c1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:19.738 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.721+0000 7f7dcec02700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7dc8159270 0x7f7dc80b3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:19.738 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.721+0000 7f7dcec02700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7dc81fe5f0 0x7f7dc81fea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:19.738 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.721+0000 7f7dcec02700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc80c1b90 con 0x7f7dc80b0d40 2023-07-05T23:33:19.739 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.721+0000 7f7dcec02700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc80b3a20 con 0x7f7dc8159270 2023-07-05T23:33:19.739 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.721+0000 7f7dcec02700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc80c1dc0 con 0x7f7dc81fe5f0 2023-07-05T23:33:19.739 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.721+0000 7f524e4fb700 1 -- 172.21.15.27:0/4076177837 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5230004170 msgr2=0x7f523000b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:19.739 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.721+0000 7f524e4fb700 1 --2- 172.21.15.27:0/4076177837 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5230004170 0x7f523000b0a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f523c009850 tx=0x7f5230004870 comp rx=0 tx=0).stop 2023-07-05T23:33:19.740 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.721+0000 7effcad5b700 1 Processor -- start 2023-07-05T23:33:19.740 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.721+0000 7f524e4fb700 1 -- 172.21.15.27:0/4076177837 shutdown_connections 2023-07-05T23:33:19.740 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.721+0000 7f524e4fb700 1 --2- 172.21.15.27:0/4076177837 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5230004170 0x7f523000b0a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:19.740 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.721+0000 7f524e4fb700 1 -- 172.21.15.27:0/4076177837 >> 172.21.15.27:0/4076177837 conn(0x7f52480b0260 msgr2=0x7f52480b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:19.741 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.721+0000 7effcad5b700 1 -- start start 2023-07-05T23:33:19.741 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.721+0000 7f7dcc99e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7dc80b0d40 0x7f7dc80c1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:19.741 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.721+0000 7f7dcc99e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7dc80b0d40 0x7f7dc80c1650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45260/0 (socket says 172.21.15.27:45260) 2023-07-05T23:33:19.741 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.721+0000 7f7dcc99e700 1 -- 172.21.15.27:0/4213108578 learned_addr learned my addr 172.21.15.27:0/4213108578 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:19.741 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.721+0000 7f7dcc99e700 1 -- 172.21.15.27:0/4213108578 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7dc81fe5f0 msgr2=0x7f7dc81fea90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-05T23:33:19.742 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.721+0000 7f7dcc99e700 1 --2- 172.21.15.27:0/4213108578 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7dc81fe5f0 0x7f7dc81fea90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:19.742 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.721+0000 7f7dcc99e700 1 -- 172.21.15.27:0/4213108578 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7dc8159270 msgr2=0x7f7dc80b3eb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-05T23:33:19.742 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.721+0000 7f7dcc99e700 1 --2- 172.21.15.27:0/4213108578 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7dc8159270 0x7f7dc80b3eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:19.742 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.721+0000 7f7dcc99e700 1 -- 172.21.15.27:0/4213108578 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dbc0094a0 con 0x7f7dc80b0d40 2023-07-05T23:33:19.742 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.721+0000 7f48762e3700 1 Processor -- start 2023-07-05T23:33:19.743 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.721+0000 7f7dcc99e700 1 --2- 172.21.15.27:0/4213108578 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7dc80b0d40 0x7f7dc80c1650 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7db80011e0 tx=0x7f7db800cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:19.743 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.723+0000 7effcad5b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7effc40cba20 0x7effc414fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:19.743 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.723+0000 7effcad5b700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7effc40cc7a0 0x7effc40b4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:19.743 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.723+0000 7effcad5b700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7effc4159270 0x7effc40b1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:19.744 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.723+0000 7effcad5b700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc40b45d0 con 0x7effc40cba20 2023-07-05T23:33:19.744 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.723+0000 7effcad5b700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc41e1fd0 con 0x7effc40cc7a0 2023-07-05T23:33:19.744 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.723+0000 7effcad5b700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effc41e22b0 con 0x7effc4159270 2023-07-05T23:33:19.744 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.723+0000 7effc92f8700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7effc4159270 0x7effc40b1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:19.744 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.723+0000 7effc92f8700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7effc4159270 0x7effc40b1f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.27:45306/0 (socket says 172.21.15.27:45306) 2023-07-05T23:33:19.744 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.723+0000 7effc92f8700 1 -- 172.21.15.27:0/2570314848 learned_addr learned my addr 172.21.15.27:0/2570314848 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:19.744 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.723+0000 7effc8af7700 1 --2- 172.21.15.27:0/2570314848 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7effc40cba20 0x7effc414fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:19.744 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.723+0000 7effc3fff700 1 --2- 172.21.15.27:0/2570314848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7effc40cc7a0 0x7effc40b4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:19.745 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.722+0000 7f7dc57fa700 1 -- 172.21.15.27:0/4213108578 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db8004c80 con 0x7f7dc80b0d40 2023-07-05T23:33:19.745 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.722+0000 7f7dc57fa700 1 -- 172.21.15.27:0/4213108578 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7db8004de0 con 0x7f7dc80b0d40 2023-07-05T23:33:19.745 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.722+0000 7f7dc57fa700 1 -- 172.21.15.27:0/4213108578 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db8007310 con 0x7f7dc80b0d40 2023-07-05T23:33:19.745 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.722+0000 7f7dcec02700 1 -- 172.21.15.27:0/4213108578 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dc80b43f0 con 0x7f7dc80b0d40 2023-07-05T23:33:19.745 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.722+0000 7f7dcec02700 1 -- 172.21.15.27:0/4213108578 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dc80b30f0 con 0x7f7dc80b0d40 2023-07-05T23:33:19.746 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.723+0000 7f7dcec02700 1 -- 172.21.15.27:0/4213108578 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7dc815c590 con 0x7f7dc80b0d40 2023-07-05T23:33:19.746 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.722+0000 7feff8c52700 1 Processor -- start 2023-07-05T23:33:19.746 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.723+0000 7f6fad3c1700 1 Processor -- start 2023-07-05T23:33:19.747 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.722+0000 7f48762e3700 1 -- start start 2023-07-05T23:33:19.747 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.723+0000 7f48762e3700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f48700cd660 0x7f487014a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:19.747 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.723+0000 7f48762e3700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f487015c570 0x7f48700c7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:19.747 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.723+0000 7f48762e3700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4870160880 0x7f48701510b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:19.747 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.723+0000 7f48762e3700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f487014ae50 con 0x7f48700cd660 2023-07-05T23:33:19.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.723+0000 7f48762e3700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48701501b0 con 0x7f487015c570 2023-07-05T23:33:19.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.723+0000 7f48762e3700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4870150490 con 0x7f4870160880 2023-07-05T23:33:19.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.723+0000 7f486f7fe700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f487015c570 0x7f48700c7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:19.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.723+0000 7f486f7fe700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f487015c570 0x7f48700c7180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.27:43210/0 (socket says 172.21.15.27:43210) 2023-07-05T23:33:19.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.723+0000 7f486f7fe700 1 -- 172.21.15.27:0/725998864 learned_addr learned my addr 172.21.15.27:0/725998864 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:19.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.723+0000 7f4874880700 1 --2- 172.21.15.27:0/725998864 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4870160880 0x7f48701510b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:19.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.723+0000 7f6fad3c1700 1 -- start start 2023-07-05T23:33:19.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.724+0000 7f524e4fb700 1 -- 172.21.15.27:0/4076177837 shutdown_connections 2023-07-05T23:33:19.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.722+0000 7feff8c52700 1 -- start start 2023-07-05T23:33:19.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.723+0000 7feff8c52700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7feff41605d0 0x7feff406c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:19.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.723+0000 7feff8c52700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feff4071370 0x7feff406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:19.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.723+0000 7feff8c52700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feff40c8ce0 con 0x7feff40c1770 2023-07-05T23:33:19.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.723+0000 7feff8c52700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feff40cc8c0 con 0x7feff41605d0 2023-07-05T23:33:19.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.723+0000 7feff8c52700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feff41651a0 con 0x7feff4071370 2023-07-05T23:33:19.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.723+0000 7feff1d9b700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feff4071370 0x7feff406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:19.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.724+0000 7feff1d9b700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feff4071370 0x7feff406c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.27:45312/0 (socket says 172.21.15.27:45312) 2023-07-05T23:33:19.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.724+0000 7feff1d9b700 1 -- 172.21.15.27:0/2018465353 learned_addr learned my addr 172.21.15.27:0/2018465353 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:19.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.724+0000 7effc92f8700 1 -- 172.21.15.27:0/2570314848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7effc40cc7a0 msgr2=0x7effc40b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:19.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.724+0000 7effc92f8700 1 --2- 172.21.15.27:0/2570314848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7effc40cc7a0 0x7effc40b4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:19.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.724+0000 7effc92f8700 1 -- 172.21.15.27:0/2570314848 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7effc40cba20 msgr2=0x7effc414fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:19.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.724+0000 7effc92f8700 1 --2- 172.21.15.27:0/2570314848 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7effc40cba20 0x7effc414fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:19.752 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.724+0000 7effc92f8700 1 -- 172.21.15.27:0/2570314848 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb000a5f0 con 0x7effc4159270 2023-07-05T23:33:19.752 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.724+0000 7feff259c700 1 --2- 172.21.15.27:0/2018465353 >> v2:172.21.15.27:3300/0 conn(0x7feff41605d0 0x7feff406c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:19.752 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.724+0000 7f4874880700 1 -- 172.21.15.27:0/725998864 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f487015c570 msgr2=0x7f48700c7180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:19.752 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.724+0000 7f4874880700 1 --2- 172.21.15.27:0/725998864 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f487015c570 0x7f48700c7180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:19.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.724+0000 7f4874880700 1 -- 172.21.15.27:0/725998864 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f48700cd660 msgr2=0x7f487014a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:19.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.724+0000 7f4874880700 1 --2- 172.21.15.27:0/725998864 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f48700cd660 0x7f487014a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:19.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.724+0000 7f4874880700 1 -- 172.21.15.27:0/725998864 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4868009b30 con 0x7f4870160880 2023-07-05T23:33:19.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.724+0000 7feff1d9b700 1 -- 172.21.15.27:0/2018465353 >> v2:172.21.15.27:3300/0 conn(0x7feff41605d0 msgr2=0x7feff406c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:19.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.724+0000 7feff1d9b700 1 --2- 172.21.15.27:0/2018465353 >> v2:172.21.15.27:3300/0 conn(0x7feff41605d0 0x7feff406c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:19.754 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.724+0000 7feff1d9b700 1 -- 172.21.15.27:0/2018465353 >> v1:172.21.15.27:6789/0 conn(0x7feff40c1770 legacy=0x7feff4069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:19.754 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.724+0000 7feff1d9b700 1 -- 172.21.15.27:0/2018465353 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff40cdd50 con 0x7feff4071370 2023-07-05T23:33:19.754 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.724+0000 7effc92f8700 1 --2- 172.21.15.27:0/2570314848 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7effc4159270 0x7effc40b1f30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7effbc00b780 tx=0x7effbc00ba90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:19.754 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.724+0000 7f4874880700 1 --2- 172.21.15.27:0/725998864 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4870160880 0x7f48701510b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f486000b3e0 tx=0x7f486000b6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:19.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.724+0000 7feff1d9b700 1 --2- 172.21.15.27:0/2018465353 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feff4071370 0x7feff406c5a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fefec009e50 tx=0x7fefec00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4190220635143195 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:19.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.725+0000 7effc17fa700 1 -- 172.21.15.27:0/2570314848 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effbc010860 con 0x7effc4159270 2023-07-05T23:33:19.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.725+0000 7effc17fa700 1 -- 172.21.15.27:0/2570314848 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effbc0109c0 con 0x7effc4159270 2023-07-05T23:33:19.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.725+0000 7effc17fa700 1 -- 172.21.15.27:0/2570314848 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effbc010d70 con 0x7effc4159270 2023-07-05T23:33:19.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.725+0000 7f6fad3c1700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f6fa80ca2a0 0x7f6fa80cba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:19.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.725+0000 7f6fad3c1700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6fa81590e0 0x7f6fa80cef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:19.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.725+0000 7f6fad3c1700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fa80cf440 con 0x7f6fa80ceaa0 2023-07-05T23:33:19.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.725+0000 7f6fad3c1700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fa8159520 con 0x7f6fa80ca2a0 2023-07-05T23:33:19.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.725+0000 7f6fad3c1700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa80ca670 con 0x7f6fa81590e0 2023-07-05T23:33:19.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.725+0000 7feff159a700 1 -- 172.21.15.27:0/2018465353 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefec00e070 con 0x7feff4071370 2023-07-05T23:33:19.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.725+0000 7feff159a700 1 -- 172.21.15.27:0/2018465353 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefec003a20 con 0x7feff4071370 2023-07-05T23:33:19.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.725+0000 7feff159a700 1 -- 172.21.15.27:0/2018465353 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefec003dd0 con 0x7feff4071370 2023-07-05T23:33:19.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.725+0000 7f3878df3700 1 Processor -- start 2023-07-05T23:33:19.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.725+0000 7f6fa67fc700 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f6fa80ceaa0 0x7f6fa81589d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.27:33418/0 (socket says 172.21.15.27:33418) 2023-07-05T23:33:19.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.725+0000 7f6fa67fc700 1 -- 172.21.15.27:0/2560678648 learned_addr learned my addr 172.21.15.27:0/2560678648 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-07-05T23:33:19.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.725+0000 7f6fa77fe700 1 --2- 172.21.15.27:0/2560678648 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6fa81590e0 0x7f6fa80cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:19.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.725+0000 7f486cff9700 1 -- 172.21.15.27:0/725998864 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4860011620 con 0x7f4870160880 2023-07-05T23:33:19.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.725+0000 7f486cff9700 1 -- 172.21.15.27:0/725998864 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48600117a0 con 0x7f4870160880 2023-07-05T23:33:19.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.725+0000 7f486cff9700 1 -- 172.21.15.27:0/725998864 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4860011b50 con 0x7f4870160880 2023-07-05T23:33:19.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.725+0000 7f48762e3700 1 -- 172.21.15.27:0/725998864 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48700b2fd0 con 0x7f4870160880 2023-07-05T23:33:19.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.725+0000 7f48762e3700 1 -- 172.21.15.27:0/725998864 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f487014a860 con 0x7f4870160880 2023-07-05T23:33:19.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.726+0000 7f6fa77fe700 1 -- 172.21.15.27:0/2560678648 >> v2:172.21.15.27:3300/0 conn(0x7f6fa80ca2a0 msgr2=0x7f6fa80cba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:19.760 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.726+0000 7f6fa77fe700 1 --2- 172.21.15.27:0/2560678648 >> v2:172.21.15.27:3300/0 conn(0x7f6fa80ca2a0 0x7f6fa80cba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:19.760 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.726+0000 7f6fa77fe700 1 -- 172.21.15.27:0/2560678648 >> v1:172.21.15.162:6789/0 conn(0x7f6fa80ceaa0 legacy=0x7f6fa81589d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:19.760 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.726+0000 7f6fa77fe700 1 -- 172.21.15.27:0/2560678648 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa80cad10 con 0x7f6fa81590e0 2023-07-05T23:33:19.760 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.726+0000 7feff8c52700 1 -- 172.21.15.27:0/2018465353 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feff4071370 msgr2=0x7feff406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:19.760 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.726+0000 7feff8c52700 1 --2- 172.21.15.27:0/2018465353 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feff4071370 0x7feff406c5a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fefec009e50 tx=0x7fefec00b330 comp rx=0 tx=0).stop 2023-07-05T23:33:19.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.726+0000 7f7dc57fa700 1 -- 172.21.15.27:0/4213108578 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7db8007470 con 0x7f7dc80b0d40 2023-07-05T23:33:19.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.726+0000 7feff8c52700 1 -- 172.21.15.27:0/2018465353 shutdown_connections 2023-07-05T23:33:19.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.726+0000 7feff8c52700 1 --2- 172.21.15.27:0/2018465353 >> v2:172.21.15.27:3300/0 conn(0x7feff41605d0 0x7feff406c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:19.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.726+0000 7feff8c52700 1 --2- 172.21.15.27:0/2018465353 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feff4071370 0x7feff406c5a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:19.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.726+0000 7feff8c52700 1 -- 172.21.15.27:0/2018465353 >> 172.21.15.27:0/2018465353 conn(0x7feff40b0260 msgr2=0x7feff40b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:19.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.726+0000 7f6fa77fe700 1 --2- 172.21.15.27:0/2560678648 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6fa81590e0 0x7f6fa80cef00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6fa000aea0 tx=0x7f6fa000c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3675823adf9c9137 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:19.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.726+0000 7f6fa5ffb700 1 -- 172.21.15.27:0/2560678648 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa0003c20 con 0x7f6fa81590e0 2023-07-05T23:33:19.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.727+0000 7f6fa5ffb700 1 -- 172.21.15.27:0/2560678648 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fa0003d80 con 0x7f6fa81590e0 2023-07-05T23:33:19.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.727+0000 7f6fa5ffb700 1 -- 172.21.15.27:0/2560678648 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa000cb00 con 0x7f6fa81590e0 2023-07-05T23:33:19.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.727+0000 7f7dc57fa700 1 --2- 172.21.15.27:0/4213108578 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f7db406adb0 0x7f7db406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:19.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.725+0000 7effcad5b700 1 -- 172.21.15.27:0/2570314848 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effc41e2590 con 0x7effc4159270 2023-07-05T23:33:19.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.725+0000 7effcad5b700 1 -- 172.21.15.27:0/2570314848 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effc40b1b10 con 0x7effc4159270 2023-07-05T23:33:19.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.724+0000 7f524e4fb700 1 -- 172.21.15.27:0/4076177837 wait complete. 2023-07-05T23:33:19.764 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.727+0000 7feff8c52700 1 -- 172.21.15.27:0/2018465353 shutdown_connections 2023-07-05T23:33:19.764 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.727+0000 7feff8c52700 1 -- 172.21.15.27:0/2018465353 wait complete. 2023-07-05T23:33:19.764 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.727+0000 7f7dc57fa700 1 -- 172.21.15.27:0/4213108578 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7db8089dd0 con 0x7f7dc80b0d40 2023-07-05T23:33:19.765 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.727+0000 7f7dc57fa700 1 --2- 172.21.15.27:0/4213108578 >> [v2:172.21.15.27:6800/1579117455,v1:172.21.15.27:6801/1579117455] conn(0x7f7db4074a00 0x7f7db4076e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:19.765 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.727+0000 7f7dc57fa700 1 -- 172.21.15.27:0/4213108578 --> [v2:172.21.15.27:6800/1579117455,v1:172.21.15.27:6801/1579117455] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7db4077500 con 0x7f7db4074a00 2023-07-05T23:33:19.765 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.727+0000 7f7dcd19f700 1 --2- 172.21.15.27:0/4213108578 >> [v2:172.21.15.27:6800/1579117455,v1:172.21.15.27:6801/1579117455] conn(0x7f7db4074a00 0x7f7db4076e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:19.765 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.727+0000 7f7dc57fa700 1 -- 172.21.15.27:0/4213108578 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7db8007720 con 0x7f7dc80b0d40 2023-07-05T23:33:19.765 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.728+0000 7f6fad3c1700 1 -- 172.21.15.27:0/2560678648 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6fa81590e0 msgr2=0x7f6fa80cef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:19.765 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.728+0000 7f6fad3c1700 1 --2- 172.21.15.27:0/2560678648 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6fa81590e0 0x7f6fa80cef00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6fa000aea0 tx=0x7f6fa000c330 comp rx=0 tx=0).stop 2023-07-05T23:33:19.766 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.725+0000 7f3878df3700 1 -- start start 2023-07-05T23:33:19.766 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.727+0000 7f3878df3700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f3874164d40 0x7f38740ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:19.766 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.727+0000 7f3878df3700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38740cc680 con 0x7f387406e810 2023-07-05T23:33:19.766 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.728+0000 7f524e4fb700 1 Processor -- start 2023-07-05T23:33:19.767 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.727+0000 7f3878df3700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f387406c7f0 con 0x7f38741605d0 2023-07-05T23:33:19.767 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.727+0000 7f3878df3700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f387406cad0 con 0x7f3874164d40 2023-07-05T23:33:19.767 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.727+0000 7f387259c700 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f38741605d0 0x7f387406e100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.27:33424/0 (socket says 172.21.15.27:33424) 2023-07-05T23:33:19.767 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.727+0000 7f387259c700 1 -- 172.21.15.27:0/1333568988 learned_addr learned my addr 172.21.15.27:0/1333568988 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-07-05T23:33:19.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.728+0000 7f7dcd19f700 1 --2- 172.21.15.27:0/4213108578 >> [v2:172.21.15.27:6800/1579117455,v1:172.21.15.27:6801/1579117455] conn(0x7f7db4074a00 0x7f7db4076e30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:19.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.728+0000 7f6fad3c1700 1 -- 172.21.15.27:0/2560678648 shutdown_connections 2023-07-05T23:33:19.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.728+0000 7f6fad3c1700 1 --2- 172.21.15.27:0/2560678648 >> v2:172.21.15.27:3300/0 conn(0x7f6fa80ca2a0 0x7f6fa80cba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:19.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.728+0000 7f6fad3c1700 1 --2- 172.21.15.27:0/2560678648 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6fa81590e0 0x7f6fa80cef00 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:19.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.728+0000 7f6fad3c1700 1 -- 172.21.15.27:0/2560678648 >> 172.21.15.27:0/2560678648 conn(0x7f6fa806e260 msgr2=0x7f6fa806e630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:19.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.728+0000 7effcad5b700 1 -- 172.21.15.27:0/2570314848 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7effc41e2cb0 con 0x7effc4159270 2023-07-05T23:33:19.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.728+0000 7f387159a700 1 -- 172.21.15.27:0/1333568988 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 502218068 0 0) 0x7f387406c7f0 con 0x7f38741605d0 2023-07-05T23:33:19.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.728+0000 7f387159a700 1 -- 172.21.15.27:0/1333568988 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f385c0035b0 con 0x7f38741605d0 2023-07-05T23:33:19.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.728+0000 7f387159a700 1 -- 172.21.15.27:0/1333568988 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 182388157 0 0) 0x7f38740cc680 con 0x7f387406e810 2023-07-05T23:33:19.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.728+0000 7f387159a700 1 -- 172.21.15.27:0/1333568988 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f387406c7f0 con 0x7f387406e810 2023-07-05T23:33:19.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.729+0000 7f6fad3c1700 1 -- 172.21.15.27:0/2560678648 shutdown_connections 2023-07-05T23:33:19.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.729+0000 7feff8c52700 1 Processor -- start 2023-07-05T23:33:19.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.729+0000 7f387159a700 1 -- 172.21.15.27:0/1333568988 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2958576326 0 0) 0x7f387406c7f0 con 0x7f387406e810 2023-07-05T23:33:19.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.729+0000 7f387159a700 1 -- 172.21.15.27:0/1333568988 >> v2:172.21.15.27:3300/0 conn(0x7f3874164d40 msgr2=0x7f38740ccaf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-05T23:33:19.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.729+0000 7f387159a700 1 --2- 172.21.15.27:0/1333568988 >> v2:172.21.15.27:3300/0 conn(0x7f3874164d40 0x7f38740ccaf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:19.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.729+0000 7f387159a700 1 -- 172.21.15.27:0/1333568988 >> v1:172.21.15.162:6789/0 conn(0x7f38741605d0 legacy=0x7f387406e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:19.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.729+0000 7f387159a700 1 -- 172.21.15.27:0/1333568988 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f387406cdb0 con 0x7f387406e810 2023-07-05T23:33:19.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.729+0000 7f387159a700 1 -- 172.21.15.27:0/1333568988 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1246168953 0 0) 0x7f386c0018a0 con 0x7f387406e810 2023-07-05T23:33:19.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.729+0000 7f387159a700 1 -- 172.21.15.27:0/1333568988 >> v1:172.21.15.27:6789/0 conn(0x7f387406e810 legacy=0x7f3874070650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:19.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.729+0000 7f387159a700 1 --2- 172.21.15.27:0/1333568988 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f385c004bf0 0x7f385c004fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:19.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.729+0000 7f387159a700 1 --2- 172.21.15.27:0/1333568988 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f385c0037f0 0x7f385c003c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:19.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.729+0000 7f387159a700 1 --2- 172.21.15.27:0/1333568988 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f385c0042c0 0x7f385c00ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:19.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.729+0000 7f387159a700 1 -- 172.21.15.27:0/1333568988 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f387406cad0 con 0x7f385c004bf0 2023-07-05T23:33:19.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.729+0000 7f387159a700 1 -- 172.21.15.27:0/1333568988 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f385c00c260 con 0x7f385c0037f0 2023-07-05T23:33:19.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.729+0000 7f387159a700 1 -- 172.21.15.27:0/1333568988 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f385c00c420 con 0x7f385c0042c0 2023-07-05T23:33:19.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.728+0000 7f48762e3700 1 -- 172.21.15.27:0/725998864 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4850000fc0 con 0x7f4870160880 2023-07-05T23:33:19.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.729+0000 7f486cff9700 1 -- 172.21.15.27:0/725998864 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4860011cb0 con 0x7f4870160880 2023-07-05T23:33:19.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.729+0000 7f7dc7fff700 1 --2- 172.21.15.27:0/4213108578 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f7db406adb0 0x7f7db406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:19.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.729+0000 7feff8c52700 1 -- start start 2023-07-05T23:33:19.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.729+0000 7f486cff9700 1 --2- 172.21.15.27:0/725998864 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f485c06adb0 0x7f485c06d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:19.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.729+0000 7f387259c700 1 --2- 172.21.15.27:0/1333568988 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f385c004bf0 0x7f385c004fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:19.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.729+0000 7f486cff9700 1 -- 172.21.15.27:0/725998864 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4860089590 con 0x7f4870160880 2023-07-05T23:33:19.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.730+0000 7f486cff9700 1 --2- 172.21.15.27:0/725998864 >> [v2:172.21.15.162:6816/2096609978,v1:172.21.15.162:6817/2096609978] conn(0x7f485c074a80 0x7f485c076eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:19.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.730+0000 7f486cff9700 1 -- 172.21.15.27:0/725998864 --> [v2:172.21.15.162:6816/2096609978,v1:172.21.15.162:6817/2096609978] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f485c077580 con 0x7f485c074a80 2023-07-05T23:33:19.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.730+0000 7f486cff9700 1 -- 172.21.15.27:0/725998864 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f486008bbb0 con 0x7f4870160880 2023-07-05T23:33:19.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.730+0000 7f7dc7fff700 1 --2- 172.21.15.27:0/4213108578 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f7db406adb0 0x7f7db406d260 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7dc80b0af0 tx=0x7f7dc0009230 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:19.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.730+0000 7f7dc57fa700 1 -- 172.21.15.27:0/4213108578 <== osd.1 v2:172.21.15.27:6800/1579117455 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f7db4077500 con 0x7f7db4074a00 2023-07-05T23:33:19.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.729+0000 7f6fad3c1700 1 -- 172.21.15.27:0/2560678648 wait complete. 2023-07-05T23:33:19.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.730+0000 7f387259c700 1 -- 172.21.15.27:0/1333568988 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f385c0042c0 msgr2=0x7f385c00ba90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-05T23:33:19.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.730+0000 7f387259c700 1 --2- 172.21.15.27:0/1333568988 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f385c0042c0 0x7f385c00ba90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:19.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.730+0000 7f387259c700 1 -- 172.21.15.27:0/1333568988 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f385c0037f0 msgr2=0x7f385c003c60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-05T23:33:19.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.730+0000 7f387259c700 1 --2- 172.21.15.27:0/1333568988 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f385c0037f0 0x7f385c003c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:19.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.730+0000 7f387259c700 1 -- 172.21.15.27:0/1333568988 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f387406cdb0 con 0x7f385c004bf0 2023-07-05T23:33:19.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.730+0000 7f3872d9d700 1 -- 172.21.15.27:0/1333568988 reap_dead start 2023-07-05T23:33:19.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.730+0000 7f387259c700 1 --2- 172.21.15.27:0/1333568988 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f385c004bf0 0x7f385c004fe0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3864001a60 tx=0x7f385c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92577f9913988ee1 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:19.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.730+0000 7feff8c52700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feff4071370 0x7feff414d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:19.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.731+0000 7feff8c52700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feff40c1770 0x7feff40c6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:19.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.731+0000 7feff8c52700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feff41605d0 0x7feff40c5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:19.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.731+0000 7feff8c52700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff414cde0 con 0x7feff4071370 2023-07-05T23:33:19.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.731+0000 7feff8c52700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff414d360 con 0x7feff40c1770 2023-07-05T23:33:19.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.731+0000 7feff8c52700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feff40c7330 con 0x7feff41605d0 2023-07-05T23:33:19.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.731+0000 7feff259c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feff4071370 0x7feff414d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:19.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.731+0000 7feff259c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feff4071370 0x7feff414d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45306/0 (socket says 172.21.15.27:45306) 2023-07-05T23:33:19.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.731+0000 7feff259c700 1 -- 172.21.15.27:0/3317454114 learned_addr learned my addr 172.21.15.27:0/3317454114 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:19.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.731+0000 7feff1d9b700 1 --2- 172.21.15.27:0/3317454114 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feff40c1770 0x7feff40c6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:19.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.731+0000 7f486f7fe700 1 --2- 172.21.15.27:0/725998864 >> [v2:172.21.15.162:6816/2096609978,v1:172.21.15.162:6817/2096609978] conn(0x7f485c074a80 0x7f485c076eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:19.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.731+0000 7feff2d9d700 1 --2- 172.21.15.27:0/3317454114 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feff41605d0 0x7feff40c5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:19.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.730+0000 7effc17fa700 1 -- 172.21.15.27:0/2570314848 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7effbc00f3b0 con 0x7effc4159270 2023-07-05T23:33:19.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.730+0000 7effc17fa700 1 --2- 172.21.15.27:0/2570314848 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7effa806adb0 0x7effa806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:19.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.730+0000 7effc17fa700 1 -- 172.21.15.27:0/2570314848 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7effbc089a30 con 0x7effc4159270 2023-07-05T23:33:19.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.730+0000 7effc17fa700 1 --2- 172.21.15.27:0/2570314848 >> [v2:172.21.15.27:6812/3766536605,v1:172.21.15.27:6814/3766536605] conn(0x7effa8074a00 0x7effa8076e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:19.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.731+0000 7effc17fa700 1 -- 172.21.15.27:0/2570314848 --> [v2:172.21.15.27:6812/3766536605,v1:172.21.15.27:6814/3766536605] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7effa8077500 con 0x7effa8074a00 2023-07-05T23:33:19.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.731+0000 7effc8af7700 1 --2- 172.21.15.27:0/2570314848 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7effa806adb0 0x7effa806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:19.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.731+0000 7effc3fff700 1 --2- 172.21.15.27:0/2570314848 >> [v2:172.21.15.27:6812/3766536605,v1:172.21.15.27:6814/3766536605] conn(0x7effa8074a00 0x7effa8076e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:19.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.731+0000 7effc17fa700 1 -- 172.21.15.27:0/2570314848 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7effbc054860 con 0x7effc4159270 2023-07-05T23:33:19.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.732+0000 7effc3fff700 1 --2- 172.21.15.27:0/2570314848 >> [v2:172.21.15.27:6812/3766536605,v1:172.21.15.27:6814/3766536605] conn(0x7effa8074a00 0x7effa8076e30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:19.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.731+0000 7feff259c700 1 -- 172.21.15.27:0/3317454114 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feff41605d0 msgr2=0x7feff40c5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:19.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.731+0000 7feff259c700 1 --2- 172.21.15.27:0/3317454114 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feff41605d0 0x7feff40c5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:19.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.731+0000 7feff259c700 1 -- 172.21.15.27:0/3317454114 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feff40c1770 msgr2=0x7feff40c6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:19.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.731+0000 7feff259c700 1 --2- 172.21.15.27:0/3317454114 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feff40c1770 0x7feff40c6490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:19.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.731+0000 7feff259c700 1 -- 172.21.15.27:0/3317454114 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefec009b30 con 0x7feff4071370 2023-07-05T23:33:19.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.731+0000 7feff2d9d700 1 --2- 172.21.15.27:0/3317454114 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feff41605d0 0x7feff40c5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T23:33:19.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.732+0000 7f486ffff700 1 --2- 172.21.15.27:0/725998864 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f485c06adb0 0x7f485c06d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:19.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.730+0000 7f524e4fb700 1 -- start start 2023-07-05T23:33:19.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.732+0000 7f524e4fb700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5230004170 0x7f5248157b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:19.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.732+0000 7f524e4fb700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5248153cd0 0x7f524815a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:19.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.732+0000 7f524e4fb700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5248154140 0x7f524815aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:19.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.732+0000 7f524e4fb700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52480b2a30 con 0x7f5248154140 2023-07-05T23:33:19.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.732+0000 7f524e4fb700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52480b2c40 con 0x7f5248153cd0 2023-07-05T23:33:19.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.732+0000 7f524e4fb700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52480b2f20 con 0x7f5230004170 2023-07-05T23:33:19.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.732+0000 7effc8af7700 1 --2- 172.21.15.27:0/2570314848 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7effa806adb0 0x7effa806d260 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7effc40b3d10 tx=0x7effb800f040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:19.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.731+0000 7f6fad3c1700 1 Processor -- start 2023-07-05T23:33:19.786 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.732+0000 7f486f7fe700 1 --2- 172.21.15.27:0/725998864 >> [v2:172.21.15.162:6816/2096609978,v1:172.21.15.162:6817/2096609978] conn(0x7f485c074a80 0x7f485c076eb0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:19.786 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.732+0000 7f52477fe700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5248153cd0 0x7f524815a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:19.786 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.732+0000 7f524ca98700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5248154140 0x7f524815aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:19.786 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.732+0000 7f52477fe700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5248153cd0 0x7f524815a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.27:43258/0 (socket says 172.21.15.27:43258) 2023-07-05T23:33:19.787 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.732+0000 7f52477fe700 1 -- 172.21.15.27:0/3304934575 learned_addr learned my addr 172.21.15.27:0/3304934575 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:19.787 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.732+0000 7f5247fff700 1 --2- 172.21.15.27:0/3304934575 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5230004170 0x7f5248157b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:19.787 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.732+0000 7feff259c700 1 --2- 172.21.15.27:0/3317454114 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feff4071370 0x7feff414d7f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fefe800e810 tx=0x7fefe800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:19.787 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.732+0000 7f387159a700 1 -- 172.21.15.27:0/1333568988 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3864015b40 con 0x7f385c004bf0 2023-07-05T23:33:19.787 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.732+0000 7f387159a700 1 -- 172.21.15.27:0/1333568988 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3864015ca0 con 0x7f385c004bf0 2023-07-05T23:33:19.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.732+0000 7f5831eb4700 1 Processor -- start 2023-07-05T23:33:19.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.732+0000 7f387159a700 1 -- 172.21.15.27:0/1333568988 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3864018310 con 0x7f385c004bf0 2023-07-05T23:33:19.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.732+0000 7fefe2ffd700 1 -- 172.21.15.27:0/3317454114 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe800c070 con 0x7feff4071370 2023-07-05T23:33:19.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.732+0000 7fefe2ffd700 1 -- 172.21.15.27:0/3317454114 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefe8013610 con 0x7feff4071370 2023-07-05T23:33:19.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.733+0000 7feff8c52700 1 -- 172.21.15.27:0/3317454114 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feff414dd30 con 0x7feff4071370 2023-07-05T23:33:19.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.732+0000 7f52477fe700 1 -- 172.21.15.27:0/3304934575 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5230004170 msgr2=0x7f5248157b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:19.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.732+0000 7f52477fe700 1 --2- 172.21.15.27:0/3304934575 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5230004170 0x7f5248157b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:19.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.732+0000 7f52477fe700 1 -- 172.21.15.27:0/3304934575 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5248154140 msgr2=0x7f524815aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:19.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.732+0000 7f52477fe700 1 --2- 172.21.15.27:0/3304934575 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5248154140 0x7f524815aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:19.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.732+0000 7f52477fe700 1 -- 172.21.15.27:0/3304934575 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52480b3200 con 0x7f5248153cd0 2023-07-05T23:33:19.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.733+0000 7effc17fa700 1 -- 172.21.15.27:0/2570314848 <== osd.0 v2:172.21.15.27:6812/3766536605 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7effa8077500 con 0x7effa8074a00 2023-07-05T23:33:19.791 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.733+0000 7f486cff9700 1 -- 172.21.15.27:0/725998864 <== osd.7 v2:172.21.15.162:6816/2096609978 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f485c077580 con 0x7f485c074a80 2023-07-05T23:33:19.791 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.733+0000 7fefe2ffd700 1 -- 172.21.15.27:0/3317454114 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe80139c0 con 0x7feff4071370 2023-07-05T23:33:19.791 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.733+0000 7feff8c52700 1 -- 172.21.15.27:0/3317454114 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feff40c7050 con 0x7feff4071370 2023-07-05T23:33:19.791 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.733+0000 7f3878df3700 1 -- 172.21.15.27:0/1333568988 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f385c004bf0 msgr2=0x7f385c004fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:19.792 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.733+0000 7f3878df3700 1 --2- 172.21.15.27:0/1333568988 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f385c004bf0 0x7f385c004fe0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3864001a60 tx=0x7f385c005880 comp rx=0 tx=0).stop 2023-07-05T23:33:19.792 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.734+0000 7f3878df3700 1 -- 172.21.15.27:0/1333568988 shutdown_connections 2023-07-05T23:33:19.792 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.734+0000 7f3878df3700 1 --2- 172.21.15.27:0/1333568988 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f385c004bf0 0x7f385c004fe0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:19.792 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.734+0000 7f3878df3700 1 -- 172.21.15.27:0/1333568988 >> 172.21.15.27:0/1333568988 conn(0x7f38740cf7d0 msgr2=0x7f38740cb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:19.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.733+0000 7f5831eb4700 1 -- start start 2023-07-05T23:33:19.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.734+0000 7f5831eb4700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f582c0ccf90 0x7f582c0cd360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:19.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.734+0000 7f5831eb4700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f582c06a890 0x7f582c06acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:19.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.734+0000 7f5831eb4700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f582c0cd8a0 con 0x7f582c158850 2023-07-05T23:33:19.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.734+0000 7f5831eb4700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f582c15d1f0 con 0x7f582c0ccf90 2023-07-05T23:33:19.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.734+0000 7f5831eb4700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f582c15cc30 con 0x7f582c06a890 2023-07-05T23:33:19.794 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.734+0000 7f3878df3700 1 -- 172.21.15.27:0/1333568988 shutdown_connections 2023-07-05T23:33:19.794 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.734+0000 7f52477fe700 1 --2- 172.21.15.27:0/3304934575 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5248153cd0 0x7f524815a9b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f523000e6c0 tx=0x7f523c004790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:19.794 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.734+0000 7f486ffff700 1 --2- 172.21.15.27:0/725998864 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f485c06adb0 0x7f485c06d260 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4868009fd0 tx=0x7f4868016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:19.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.734+0000 7f582b7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f582c0ccf90 0x7f582c0cd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:19.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.734+0000 7f582b7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f582c0ccf90 0x7f582c0cd360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45322/0 (socket says 172.21.15.27:45322) 2023-07-05T23:33:19.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.734+0000 7f582b7fe700 1 -- 172.21.15.27:0/2707016823 learned_addr learned my addr 172.21.15.27:0/2707016823 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:19.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.735+0000 7f5244ff9700 1 -- 172.21.15.27:0/3304934575 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523c004220 con 0x7f5248153cd0 2023-07-05T23:33:19.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.735+0000 7f5244ff9700 1 -- 172.21.15.27:0/3304934575 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f523c0043a0 con 0x7f5248153cd0 2023-07-05T23:33:19.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.735+0000 7f5244ff9700 1 -- 172.21.15.27:0/3304934575 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523c011e50 con 0x7f5248153cd0 2023-07-05T23:33:19.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.735+0000 7f582bfff700 1 --2- 172.21.15.27:0/2707016823 >> v2:172.21.15.162:3300/0 conn(0x7f582c06a890 0x7f582c06acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:19.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.735+0000 7f582b7fe700 1 -- 172.21.15.27:0/2707016823 >> v2:172.21.15.162:3300/0 conn(0x7f582c06a890 msgr2=0x7f582c06acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:19.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.735+0000 7f582b7fe700 1 --2- 172.21.15.27:0/2707016823 >> v2:172.21.15.162:3300/0 conn(0x7f582c06a890 0x7f582c06acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:19.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.735+0000 7f582b7fe700 1 -- 172.21.15.27:0/2707016823 >> v1:172.21.15.162:6789/0 conn(0x7f582c158850 legacy=0x7f582c15c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:19.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.735+0000 7f582b7fe700 1 -- 172.21.15.27:0/2707016823 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f582c15cf10 con 0x7f582c0ccf90 2023-07-05T23:33:19.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.735+0000 7f524e4fb700 1 -- 172.21.15.27:0/3304934575 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52480b34e0 con 0x7f5248153cd0 2023-07-05T23:33:19.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.735+0000 7f524e4fb700 1 -- 172.21.15.27:0/3304934575 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5248158090 con 0x7f5248153cd0 2023-07-05T23:33:19.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.735+0000 7f582b7fe700 1 --2- 172.21.15.27:0/2707016823 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f582c0ccf90 0x7f582c0cd360 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f582c0cb9a0 tx=0x7f582400d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66cb8aefdef37d4 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:19.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.736+0000 7f524e4fb700 1 -- 172.21.15.27:0/3304934575 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f524815c2b0 con 0x7f5248153cd0 2023-07-05T23:33:19.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.734+0000 7f3878df3700 1 -- 172.21.15.27:0/1333568988 wait complete. 2023-07-05T23:33:19.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.736+0000 7f3878df3700 1 Processor -- start 2023-07-05T23:33:19.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.736+0000 7f3878df3700 1 -- start start 2023-07-05T23:33:19.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.736+0000 7fefe2ffd700 1 -- 172.21.15.27:0/3317454114 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fefe8013b20 con 0x7feff4071370 2023-07-05T23:33:19.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.737+0000 7fefe2ffd700 1 --2- 172.21.15.27:0/3317454114 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fefd406ad10 0x7fefd406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:19.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.737+0000 7fefe2ffd700 1 -- 172.21.15.27:0/3317454114 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fefe8089580 con 0x7feff4071370 2023-07-05T23:33:19.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.737+0000 7feff1d9b700 1 --2- 172.21.15.27:0/3317454114 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fefd406ad10 0x7fefd406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:19.800 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.738+0000 7f3878df3700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f385c004bf0 0x7f3874153750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:19.800 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.738+0000 7f3878df3700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38740c4b70 0x7f38740c4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:19.800 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.738+0000 7feff1d9b700 1 --2- 172.21.15.27:0/3317454114 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fefd406ad10 0x7fefd406d1c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7feff4071780 tx=0x7fefec009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:19.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.738+0000 7f582a7fc700 1 -- 172.21.15.27:0/2707016823 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5824010070 con 0x7f582c0ccf90 2023-07-05T23:33:19.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.738+0000 7f582a7fc700 1 -- 172.21.15.27:0/2707016823 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f582400db40 con 0x7f582c0ccf90 2023-07-05T23:33:19.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.738+0000 7f582a7fc700 1 -- 172.21.15.27:0/2707016823 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5824003a20 con 0x7f582c0ccf90 2023-07-05T23:33:19.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.738+0000 7f3878df3700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3874153f20 0x7f3874154390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:19.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.738+0000 7f3878df3700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3874153c90 con 0x7f38740c4b70 2023-07-05T23:33:19.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.738+0000 7f3878df3700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38740c5520 con 0x7f385c004bf0 2023-07-05T23:33:19.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.738+0000 7f3878df3700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3874155540 con 0x7f3874153f20 2023-07-05T23:33:19.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.738+0000 7f387259c700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f385c004bf0 0x7f3874153750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:19.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.738+0000 7f387259c700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f385c004bf0 0x7f3874153750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.27:43268/0 (socket says 172.21.15.27:43268) 2023-07-05T23:33:19.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.738+0000 7f387259c700 1 -- 172.21.15.27:0/1804739052 learned_addr learned my addr 172.21.15.27:0/1804739052 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:19.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.738+0000 7f3871d9b700 1 --2- 172.21.15.27:0/1804739052 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38740c4b70 0x7f38740c4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:19.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.737+0000 7f5244ff9700 1 -- 172.21.15.27:0/3304934575 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f523c022070 con 0x7f5248153cd0 2023-07-05T23:33:19.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.738+0000 7f5244ff9700 1 --2- 172.21.15.27:0/3304934575 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f523406ad30 0x7f523406d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:19.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.738+0000 7f5244ff9700 1 -- 172.21.15.27:0/3304934575 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f523c08a8e0 con 0x7f5248153cd0 2023-07-05T23:33:19.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.738+0000 7f5244ff9700 1 --2- 172.21.15.27:0/3304934575 >> [v2:172.21.15.27:6824/807520271,v1:172.21.15.27:6825/807520271] conn(0x7f5234074a00 0x7f5234076e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:19.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.738+0000 7f5244ff9700 1 -- 172.21.15.27:0/3304934575 --> [v2:172.21.15.27:6824/807520271,v1:172.21.15.27:6825/807520271] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5234077500 con 0x7f5234074a00 2023-07-05T23:33:19.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.738+0000 7f5244ff9700 1 -- 172.21.15.27:0/3304934575 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f523c08ad80 con 0x7f5248153cd0 2023-07-05T23:33:19.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.738+0000 7f524ca98700 1 --2- 172.21.15.27:0/3304934575 >> [v2:172.21.15.27:6824/807520271,v1:172.21.15.27:6825/807520271] conn(0x7f5234074a00 0x7f5234076e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:19.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.738+0000 7f387259c700 1 -- 172.21.15.27:0/1804739052 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3874153f20 msgr2=0x7f3874154390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:19.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.738+0000 7f387259c700 1 --2- 172.21.15.27:0/1804739052 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3874153f20 0x7f3874154390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:19.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.738+0000 7f387259c700 1 -- 172.21.15.27:0/1804739052 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38740c4b70 msgr2=0x7f38740c4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:19.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.738+0000 7f387259c700 1 --2- 172.21.15.27:0/1804739052 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38740c4b70 0x7f38740c4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:19.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.738+0000 7f387259c700 1 -- 172.21.15.27:0/1804739052 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3874154ca0 con 0x7f385c004bf0 2023-07-05T23:33:19.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.739+0000 7f5831eb4700 1 -- 172.21.15.27:0/2707016823 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f582c0ccf90 msgr2=0x7f582c0cd360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:19.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.739+0000 7f387259c700 1 --2- 172.21.15.27:0/1804739052 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f385c004bf0 0x7f3874153750 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f386401d3c0 tx=0x7f38640012d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:19.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.739+0000 7f3862ffd700 1 -- 172.21.15.27:0/1804739052 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3864015e10 con 0x7f385c004bf0 2023-07-05T23:33:19.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.739+0000 7f3862ffd700 1 -- 172.21.15.27:0/1804739052 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f386401d650 con 0x7f385c004bf0 2023-07-05T23:33:19.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.739+0000 7f3862ffd700 1 -- 172.21.15.27:0/1804739052 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386401da00 con 0x7f385c004bf0 2023-07-05T23:33:19.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.739+0000 7f524ca98700 1 --2- 172.21.15.27:0/3304934575 >> [v2:172.21.15.27:6824/807520271,v1:172.21.15.27:6825/807520271] conn(0x7f5234074a00 0x7f5234076e30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:19.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.739+0000 7f5831eb4700 1 --2- 172.21.15.27:0/2707016823 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f582c0ccf90 0x7f582c0cd360 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f582c0cb9a0 tx=0x7f582400d430 comp rx=0 tx=0).stop 2023-07-05T23:33:19.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.739+0000 7f3878df3700 1 -- 172.21.15.27:0/1804739052 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3874154f80 con 0x7f385c004bf0 2023-07-05T23:33:19.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.739+0000 7f3878df3700 1 -- 172.21.15.27:0/1804739052 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38740c26d0 con 0x7f385c004bf0 2023-07-05T23:33:19.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.740+0000 7f3878df3700 1 -- 172.21.15.27:0/1804739052 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3858000fc0 con 0x7f385c004bf0 2023-07-05T23:33:19.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.740+0000 7f5244ff9700 1 -- 172.21.15.27:0/3304934575 <== osd.2 v2:172.21.15.27:6824/807520271 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f5234077500 con 0x7f5234074a00 2023-07-05T23:33:19.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.741+0000 7feff8c52700 1 --2- 172.21.15.27:0/3317454114 >> [v2:172.21.15.162:6800/2111223016,v1:172.21.15.162:6801/2111223016] conn(0x7feff406cb70 0x7feff4150640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:19.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.741+0000 7feff8c52700 1 -- 172.21.15.27:0/3317454114 --> [v2:172.21.15.162:6800/2111223016,v1:172.21.15.162:6801/2111223016] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7feff40ce510 con 0x7feff406cb70 2023-07-05T23:33:19.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.740+0000 7f6fad3c1700 1 -- start start 2023-07-05T23:33:19.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.741+0000 7feff2d9d700 1 --2- 172.21.15.27:0/3317454114 >> [v2:172.21.15.162:6800/2111223016,v1:172.21.15.162:6801/2111223016] conn(0x7feff406cb70 0x7feff4150640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:19.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.741+0000 7f6fad3c1700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6fa80ca2a0 0x7f6fa80c4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:19.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.741+0000 7f6fad3c1700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6fa80ceaa0 0x7f6fa80c60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:19.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.741+0000 7f6fad3c1700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6fa81590e0 0x7f6fa80c65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:19.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.741+0000 7f6fad3c1700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa81475d0 con 0x7f6fa80ceaa0 2023-07-05T23:33:19.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.741+0000 7f6fad3c1700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa81478b0 con 0x7f6fa81590e0 2023-07-05T23:33:19.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.741+0000 7f6fad3c1700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa8147b90 con 0x7f6fa80ca2a0 2023-07-05T23:33:19.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.741+0000 7f6fa67fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6fa80ceaa0 0x7f6fa80c60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:19.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.741+0000 7f6fa67fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6fa80ceaa0 0x7f6fa80c60a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45344/0 (socket says 172.21.15.27:45344) 2023-07-05T23:33:19.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.741+0000 7f6fa67fc700 1 -- 172.21.15.27:0/1581723023 learned_addr learned my addr 172.21.15.27:0/1581723023 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:19.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.741+0000 7f6fa6ffd700 1 --2- 172.21.15.27:0/1581723023 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6fa80ca2a0 0x7f6fa80c4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:19.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.742+0000 7f6fa67fc700 1 -- 172.21.15.27:0/1581723023 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6fa80ca2a0 msgr2=0x7f6fa80c4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:19.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.742+0000 7f6fa67fc700 1 --2- 172.21.15.27:0/1581723023 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6fa80ca2a0 0x7f6fa80c4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:19.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.742+0000 7f6fa67fc700 1 -- 172.21.15.27:0/1581723023 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6fa81590e0 msgr2=0x7f6fa80c65e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-05T23:33:19.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.742+0000 7f6fa67fc700 1 --2- 172.21.15.27:0/1581723023 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6fa81590e0 0x7f6fa80c65e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:19.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.742+0000 7f6fa67fc700 1 -- 172.21.15.27:0/1581723023 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa000ab80 con 0x7f6fa80ceaa0 2023-07-05T23:33:19.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.742+0000 7f6fa67fc700 1 --2- 172.21.15.27:0/1581723023 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6fa80ceaa0 0x7f6fa80c60a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c00c780 tx=0x7f6f9c00ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:19.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.742+0000 7f6f8f7fe700 1 -- 172.21.15.27:0/1581723023 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f9c0070d0 con 0x7f6fa80ceaa0 2023-07-05T23:33:19.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.742+0000 7f6fad3c1700 1 -- 172.21.15.27:0/1581723023 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fa8147e70 con 0x7f6fa80ceaa0 2023-07-05T23:33:19.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.742+0000 7f6fad3c1700 1 -- 172.21.15.27:0/1581723023 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fa8149fe0 con 0x7f6fa80ceaa0 2023-07-05T23:33:19.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.742+0000 7f6f8f7fe700 1 -- 172.21.15.27:0/1581723023 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f9c007230 con 0x7f6fa80ceaa0 2023-07-05T23:33:19.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.742+0000 7f6f8f7fe700 1 -- 172.21.15.27:0/1581723023 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f9c0075a0 con 0x7f6fa80ceaa0 2023-07-05T23:33:19.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.742+0000 7f3862ffd700 1 -- 172.21.15.27:0/1804739052 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f386401db60 con 0x7f385c004bf0 2023-07-05T23:33:19.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.742+0000 7f3862ffd700 1 --2- 172.21.15.27:0/1804739052 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f385406ad10 0x7f385406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:19.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.743+0000 7f3862ffd700 1 -- 172.21.15.27:0/1804739052 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f386409c0f0 con 0x7f385c004bf0 2023-07-05T23:33:19.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.743+0000 7f3871d9b700 1 --2- 172.21.15.27:0/1804739052 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f385406ad10 0x7f385406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:19.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.743+0000 7f3862ffd700 1 --2- 172.21.15.27:0/1804739052 >> [v2:172.21.15.162:6808/2657688865,v1:172.21.15.162:6809/2657688865] conn(0x7f3854074960 0x7f3854076d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:19.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.743+0000 7f3862ffd700 1 -- 172.21.15.27:0/1804739052 --> [v2:172.21.15.162:6808/2657688865,v1:172.21.15.162:6809/2657688865] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3854077460 con 0x7f3854074960 2023-07-05T23:33:19.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.743+0000 7f3862ffd700 1 -- 172.21.15.27:0/1804739052 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f386409c540 con 0x7f385c004bf0 2023-07-05T23:33:19.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.743+0000 7f3872d9d700 1 --2- 172.21.15.27:0/1804739052 >> [v2:172.21.15.162:6808/2657688865,v1:172.21.15.162:6809/2657688865] conn(0x7f3854074960 0x7f3854076d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:19.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.743+0000 7f3871d9b700 1 --2- 172.21.15.27:0/1804739052 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f385406ad10 0x7f385406d1c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f387415f230 tx=0x7f38680090e0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:19.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.744+0000 7f3872d9d700 1 --2- 172.21.15.27:0/1804739052 >> [v2:172.21.15.162:6808/2657688865,v1:172.21.15.162:6809/2657688865] conn(0x7f3854074960 0x7f3854076d90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:19.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.744+0000 7f6fad3c1700 1 -- 172.21.15.27:0/1581723023 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6f88000fc0 con 0x7f6fa80ceaa0 2023-07-05T23:33:19.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.744+0000 7f6f8f7fe700 1 -- 172.21.15.27:0/1581723023 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6f9c007700 con 0x7f6fa80ceaa0 2023-07-05T23:33:19.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.744+0000 7f5247fff700 1 --2- 172.21.15.27:0/3304934575 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f523406ad30 0x7f523406d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:19.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.745+0000 7f6f8f7fe700 1 --2- 172.21.15.27:0/1581723023 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f6f9406ace0 0x7f6f9406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:19.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.745+0000 7f5831eb4700 1 -- 172.21.15.27:0/2707016823 shutdown_connections 2023-07-05T23:33:19.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.745+0000 7f5831eb4700 1 --2- 172.21.15.27:0/2707016823 >> v2:172.21.15.162:3300/0 conn(0x7f582c06a890 0x7f582c06acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:19.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.745+0000 7f5831eb4700 1 --2- 172.21.15.27:0/2707016823 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f582c0ccf90 0x7f582c0cd360 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:19.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.745+0000 7f5831eb4700 1 -- 172.21.15.27:0/2707016823 >> 172.21.15.27:0/2707016823 conn(0x7f582c0b1740 msgr2=0x7f582c06cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:19.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.745+0000 7f6f8f7fe700 1 -- 172.21.15.27:0/1581723023 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6f9c089460 con 0x7f6fa80ceaa0 2023-07-05T23:33:19.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.745+0000 7f5831eb4700 1 -- 172.21.15.27:0/2707016823 shutdown_connections 2023-07-05T23:33:19.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.745+0000 7f5831eb4700 1 -- 172.21.15.27:0/2707016823 wait complete. 2023-07-05T23:33:19.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.745+0000 7f6f8f7fe700 1 --2- 172.21.15.27:0/1581723023 >> [v2:172.21.15.162:6824/3102609008,v1:172.21.15.162:6825/3102609008] conn(0x7f6f94074930 0x7f6f94076d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:19.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.745+0000 7f6f8f7fe700 1 -- 172.21.15.27:0/1581723023 --> [v2:172.21.15.162:6824/3102609008,v1:172.21.15.162:6825/3102609008] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6f94077430 con 0x7f6f94074930 2023-07-05T23:33:19.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.745+0000 7f6f8f7fe700 1 -- 172.21.15.27:0/1581723023 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6f9c08bb20 con 0x7f6fa80ceaa0 2023-07-05T23:33:19.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.745+0000 7f6fa77fe700 1 --2- 172.21.15.27:0/1581723023 >> [v2:172.21.15.162:6824/3102609008,v1:172.21.15.162:6825/3102609008] conn(0x7f6f94074930 0x7f6f94076d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:19.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.745+0000 7f6fa6ffd700 1 --2- 172.21.15.27:0/1581723023 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f6f9406ace0 0x7f6f9406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:19.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.745+0000 7f5247fff700 1 --2- 172.21.15.27:0/3304934575 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f523406ad30 0x7f523406d1e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f52481e7060 tx=0x7f524000d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:19.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.746+0000 7f6fa77fe700 1 --2- 172.21.15.27:0/1581723023 >> [v2:172.21.15.162:6824/3102609008,v1:172.21.15.162:6825/3102609008] conn(0x7f6f94074930 0x7f6f94076d60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:19.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.746+0000 7f6fa6ffd700 1 --2- 172.21.15.27:0/1581723023 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f6f9406ace0 0x7f6f9406d190 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6f98009970 tx=0x7f6f98009110 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:19.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.746+0000 7f6f8f7fe700 1 -- 172.21.15.27:0/1581723023 <== osd.5 v2:172.21.15.162:6824/3102609008 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f6f94077430 con 0x7f6f94074930 2023-07-05T23:33:19.821 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.747+0000 7f5831eb4700 1 Processor -- start 2023-07-05T23:33:19.821 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.747+0000 7f5831eb4700 1 -- start start 2023-07-05T23:33:19.821 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.748+0000 7f5831eb4700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f582c06a890 0x7f582c0c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:19.821 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.748+0000 7f5831eb4700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f582c0ccf90 0x7f582c154ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:19.821 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.748+0000 7f5831eb4700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f582c158850 0x7f582c1551e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:19.821 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.748+0000 7f5831eb4700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f582c0c52d0 con 0x7f582c158850 2023-07-05T23:33:19.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.748+0000 7f5831eb4700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f582c156660 con 0x7f582c0ccf90 2023-07-05T23:33:19.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.748+0000 7f5831eb4700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f582c155810 con 0x7f582c06a890 2023-07-05T23:33:19.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.749+0000 7f582bfff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f582c158850 0x7f582c1551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:19.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.749+0000 7f582bfff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f582c158850 0x7f582c1551e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45356/0 (socket says 172.21.15.27:45356) 2023-07-05T23:33:19.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.749+0000 7f582b7fe700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f582c06a890 0x7f582c0c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:19.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.749+0000 7f582bfff700 1 -- 172.21.15.27:0/3046488365 learned_addr learned my addr 172.21.15.27:0/3046488365 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:19.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.749+0000 7f582affd700 1 --2- 172.21.15.27:0/3046488365 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f582c0ccf90 0x7f582c154ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:19.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.749+0000 7f582b7fe700 1 -- 172.21.15.27:0/3046488365 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f582c0ccf90 msgr2=0x7f582c154ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:19.823 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.749+0000 7f582b7fe700 1 --2- 172.21.15.27:0/3046488365 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f582c0ccf90 0x7f582c154ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:19.823 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.749+0000 7f582b7fe700 1 -- 172.21.15.27:0/3046488365 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f582c158850 msgr2=0x7f582c1551e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:19.823 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.749+0000 7f582b7fe700 1 --2- 172.21.15.27:0/3046488365 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f582c158850 0x7f582c1551e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:19.823 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.749+0000 7f582b7fe700 1 -- 172.21.15.27:0/3046488365 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f582400bd40 con 0x7f582c06a890 2023-07-05T23:33:19.823 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.749+0000 7f582b7fe700 1 --2- 172.21.15.27:0/3046488365 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f582c06a890 0x7f582c0c4d90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5824018000 tx=0x7f5824004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:19.823 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.749+0000 7f581bfff700 1 -- 172.21.15.27:0/3046488365 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582400b2b0 con 0x7f582c06a890 2023-07-05T23:33:19.823 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.750+0000 7f581bfff700 1 -- 172.21.15.27:0/3046488365 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f582400b430 con 0x7f582c06a890 2023-07-05T23:33:19.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.750+0000 7f581bfff700 1 -- 172.21.15.27:0/3046488365 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58240096c0 con 0x7f582c06a890 2023-07-05T23:33:19.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.750+0000 7f5831eb4700 1 -- 172.21.15.27:0/3046488365 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f582c155af0 con 0x7f582c06a890 2023-07-05T23:33:19.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.750+0000 7f5831eb4700 1 -- 172.21.15.27:0/3046488365 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f582c1562f0 con 0x7f582c06a890 2023-07-05T23:33:19.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.751+0000 7f5831eb4700 1 -- 172.21.15.27:0/3046488365 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f582c06a370 con 0x7f582c06a890 2023-07-05T23:33:19.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.751+0000 7feff2d9d700 1 --2- 172.21.15.27:0/3317454114 >> [v2:172.21.15.162:6800/2111223016,v1:172.21.15.162:6801/2111223016] conn(0x7feff406cb70 0x7feff4150640 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:19.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.751+0000 7f581bfff700 1 -- 172.21.15.27:0/3046488365 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5824009820 con 0x7f582c06a890 2023-07-05T23:33:19.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.752+0000 7f3862ffd700 1 -- 172.21.15.27:0/1804739052 <== osd.6 v2:172.21.15.162:6808/2657688865 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f3854077460 con 0x7f3854074960 2023-07-05T23:33:19.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.752+0000 7f581bfff700 1 --2- 172.21.15.27:0/3046488365 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f581006acb0 0x7f581006d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:19.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.752+0000 7f581bfff700 1 -- 172.21.15.27:0/3046488365 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f582408b2a0 con 0x7f582c06a890 2023-07-05T23:33:19.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.752+0000 7f581bfff700 1 --2- 172.21.15.27:0/3046488365 >> [v2:172.21.15.27:6808/2125656143,v1:172.21.15.27:6809/2125656143] conn(0x7f5810074900 0x7f5810076d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:19.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.752+0000 7f581bfff700 1 -- 172.21.15.27:0/3046488365 --> [v2:172.21.15.27:6808/2125656143,v1:172.21.15.27:6809/2125656143] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5810077400 con 0x7f5810074900 2023-07-05T23:33:19.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.752+0000 7f581bfff700 1 -- 172.21.15.27:0/3046488365 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f582408b610 con 0x7f582c06a890 2023-07-05T23:33:19.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.753+0000 7f582bfff700 1 --2- 172.21.15.27:0/3046488365 >> [v2:172.21.15.27:6808/2125656143,v1:172.21.15.27:6809/2125656143] conn(0x7f5810074900 0x7f5810076d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:19.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.753+0000 7f582affd700 1 --2- 172.21.15.27:0/3046488365 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f581006acb0 0x7f581006d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:19.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.753+0000 7f582bfff700 1 --2- 172.21.15.27:0/3046488365 >> [v2:172.21.15.27:6808/2125656143,v1:172.21.15.27:6809/2125656143] conn(0x7f5810074900 0x7f5810076d30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:19.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.754+0000 7f582affd700 1 --2- 172.21.15.27:0/3046488365 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f581006acb0 0x7f581006d160 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f582c154450 tx=0x7f58200090e0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:19.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.755+0000 7f581bfff700 1 -- 172.21.15.27:0/3046488365 <== osd.3 v2:172.21.15.27:6808/2125656143 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f5810077400 con 0x7f5810074900 2023-07-05T23:33:19.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.760+0000 7effcad5b700 1 -- 172.21.15.27:0/2570314848 --> [v2:172.21.15.27:6812/3766536605,v1:172.21.15.27:6814/3766536605] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7effc415c2b0 con 0x7effa8074a00 2023-07-05T23:33:19.828 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.763+0000 7f7dcec02700 1 -- 172.21.15.27:0/4213108578 --> [v2:172.21.15.27:6800/1579117455,v1:172.21.15.27:6801/1579117455] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7dc815c2b0 con 0x7f7db4074a00 2023-07-05T23:33:19.828 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.764+0000 7f7dc57fa700 1 -- 172.21.15.27:0/4213108578 <== osd.1 v2:172.21.15.27:6800/1579117455 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7dbc004030 con 0x7f7db4074a00 2023-07-05T23:33:19.828 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.764+0000 7f7dcec02700 1 -- 172.21.15.27:0/4213108578 >> [v2:172.21.15.27:6800/1579117455,v1:172.21.15.27:6801/1579117455] conn(0x7f7db4074a00 msgr2=0x7f7db4076e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:19.828 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.764+0000 7f7dcec02700 1 --2- 172.21.15.27:0/4213108578 >> [v2:172.21.15.27:6800/1579117455,v1:172.21.15.27:6801/1579117455] conn(0x7f7db4074a00 0x7f7db4076e30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:19.829 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.760+0000 7fefe2ffd700 1 -- 172.21.15.27:0/3317454114 <== osd.4 v2:172.21.15.162:6800/2111223016 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fefe4001850 con 0x7feff406cb70 2023-07-05T23:33:19.829 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.767+0000 7f48762e3700 1 -- 172.21.15.27:0/725998864 --> [v2:172.21.15.162:6816/2096609978,v1:172.21.15.162:6817/2096609978] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4850002d40 con 0x7f485c074a80 2023-07-05T23:33:19.829 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.767+0000 7f486cff9700 1 -- 172.21.15.27:0/725998864 <== osd.7 v2:172.21.15.162:6816/2096609978 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4850002d40 con 0x7f485c074a80 2023-07-05T23:33:19.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.769+0000 7f48762e3700 1 -- 172.21.15.27:0/725998864 >> [v2:172.21.15.162:6816/2096609978,v1:172.21.15.162:6817/2096609978] conn(0x7f485c074a80 msgr2=0x7f485c076eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:19.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.769+0000 7f48762e3700 1 --2- 172.21.15.27:0/725998864 >> [v2:172.21.15.162:6816/2096609978,v1:172.21.15.162:6817/2096609978] conn(0x7f485c074a80 0x7f485c076eb0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:19.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.769+0000 7f7dcec02700 1 -- 172.21.15.27:0/4213108578 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f7db406adb0 msgr2=0x7f7db406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:19.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.769+0000 7f7dcec02700 1 --2- 172.21.15.27:0/4213108578 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f7db406adb0 0x7f7db406d260 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7dc80b0af0 tx=0x7f7dc0009230 comp rx=0 tx=0).stop 2023-07-05T23:33:19.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.769+0000 7f7dcec02700 1 -- 172.21.15.27:0/4213108578 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7dc80b0d40 msgr2=0x7f7dc80c1650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:19.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.769+0000 7f7dcec02700 1 --2- 172.21.15.27:0/4213108578 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7dc80b0d40 0x7f7dc80c1650 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7db80011e0 tx=0x7f7db800cae0 comp rx=0 tx=0).stop 2023-07-05T23:33:19.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.769+0000 7f7dcd19f700 1 -- 172.21.15.27:0/4213108578 reap_dead start 2023-07-05T23:33:19.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.769+0000 7f7dcec02700 1 -- 172.21.15.27:0/4213108578 shutdown_connections 2023-07-05T23:33:19.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.769+0000 7f48762e3700 1 -- 172.21.15.27:0/725998864 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f485c06adb0 msgr2=0x7f485c06d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:19.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.769+0000 7f48762e3700 1 --2- 172.21.15.27:0/725998864 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f485c06adb0 0x7f485c06d260 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4868009fd0 tx=0x7f4868016000 comp rx=0 tx=0).stop 2023-07-05T23:33:19.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.769+0000 7f48762e3700 1 -- 172.21.15.27:0/725998864 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4870160880 msgr2=0x7f48701510b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:19.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.769+0000 7f48762e3700 1 --2- 172.21.15.27:0/725998864 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4870160880 0x7f48701510b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f486000b3e0 tx=0x7f486000b6f0 comp rx=0 tx=0).stop 2023-07-05T23:33:19.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.769+0000 7f4874880700 1 -- 172.21.15.27:0/725998864 reap_dead start 2023-07-05T23:33:19.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.769+0000 7f7dcec02700 1 -- 172.21.15.27:0/4213108578 >> 172.21.15.27:0/4213108578 conn(0x7f7dc80b0260 msgr2=0x7f7dc815a6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:19.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.769+0000 7f7dcec02700 1 -- 172.21.15.27:0/4213108578 shutdown_connections 2023-07-05T23:33:19.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.769+0000 7f7dcec02700 1 -- 172.21.15.27:0/4213108578 wait complete. 2023-07-05T23:33:19.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.770+0000 7f48762e3700 1 -- 172.21.15.27:0/725998864 shutdown_connections 2023-07-05T23:33:19.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.770+0000 7f48762e3700 1 -- 172.21.15.27:0/725998864 >> 172.21.15.27:0/725998864 conn(0x7f4870071620 msgr2=0x7f48700d20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:19.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.770+0000 7f48762e3700 1 -- 172.21.15.27:0/725998864 shutdown_connections 2023-07-05T23:33:19.834 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.770+0000 7f48762e3700 1 -- 172.21.15.27:0/725998864 wait complete. 2023-07-05T23:33:19.834 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.771+0000 7effc17fa700 1 -- 172.21.15.27:0/2570314848 <== osd.0 v2:172.21.15.27:6812/3766536605 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7effb0004230 con 0x7effa8074a00 2023-07-05T23:33:19.834 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.772+0000 7f524e4fb700 1 -- 172.21.15.27:0/3304934575 --> [v2:172.21.15.27:6824/807520271,v1:172.21.15.27:6825/807520271] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f524815bfd0 con 0x7f5234074a00 2023-07-05T23:33:19.834 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.773+0000 7f5244ff9700 1 -- 172.21.15.27:0/3304934575 <== osd.2 v2:172.21.15.27:6824/807520271 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5238001a00 con 0x7f5234074a00 2023-07-05T23:33:19.835 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.773+0000 7f6fad3c1700 1 -- 172.21.15.27:0/1581723023 --> [v2:172.21.15.162:6824/3102609008,v1:172.21.15.162:6825/3102609008] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6f88002d40 con 0x7f6f94074930 2023-07-05T23:33:19.835 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.773+0000 7f524e4fb700 1 -- 172.21.15.27:0/3304934575 >> [v2:172.21.15.27:6824/807520271,v1:172.21.15.27:6825/807520271] conn(0x7f5234074a00 msgr2=0x7f5234076e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:19.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.773+0000 7f524e4fb700 1 --2- 172.21.15.27:0/3304934575 >> [v2:172.21.15.27:6824/807520271,v1:172.21.15.27:6825/807520271] conn(0x7f5234074a00 0x7f5234076e30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:19.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.773+0000 7f524e4fb700 1 -- 172.21.15.27:0/3304934575 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f523406ad30 msgr2=0x7f523406d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:19.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.773+0000 7f524e4fb700 1 --2- 172.21.15.27:0/3304934575 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f523406ad30 0x7f523406d1e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f52481e7060 tx=0x7f524000d040 comp rx=0 tx=0).stop 2023-07-05T23:33:19.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.773+0000 7f524e4fb700 1 -- 172.21.15.27:0/3304934575 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5248153cd0 msgr2=0x7f524815a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:19.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.773+0000 7f524e4fb700 1 --2- 172.21.15.27:0/3304934575 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5248153cd0 0x7f524815a9b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f523000e6c0 tx=0x7f523c004790 comp rx=0 tx=0).stop 2023-07-05T23:33:19.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.774+0000 7f524ca98700 1 -- 172.21.15.27:0/3304934575 reap_dead start 2023-07-05T23:33:19.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.774+0000 7f524e4fb700 1 -- 172.21.15.27:0/3304934575 shutdown_connections 2023-07-05T23:33:19.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.774+0000 7f524e4fb700 1 -- 172.21.15.27:0/3304934575 >> 172.21.15.27:0/3304934575 conn(0x7f52480b0260 msgr2=0x7f5248159970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:19.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.774+0000 7f524e4fb700 1 -- 172.21.15.27:0/3304934575 shutdown_connections 2023-07-05T23:33:19.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.774+0000 7f524e4fb700 1 -- 172.21.15.27:0/3304934575 wait complete. 2023-07-05T23:33:19.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.775+0000 7f6f8f7fe700 1 -- 172.21.15.27:0/1581723023 <== osd.5 v2:172.21.15.162:6824/3102609008 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6f88002d40 con 0x7f6f94074930 2023-07-05T23:33:19.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.779+0000 7f6fad3c1700 1 -- 172.21.15.27:0/1581723023 >> [v2:172.21.15.162:6824/3102609008,v1:172.21.15.162:6825/3102609008] conn(0x7f6f94074930 msgr2=0x7f6f94076d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:19.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.779+0000 7f6fad3c1700 1 --2- 172.21.15.27:0/1581723023 >> [v2:172.21.15.162:6824/3102609008,v1:172.21.15.162:6825/3102609008] conn(0x7f6f94074930 0x7f6f94076d60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:19.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.779+0000 7f6fad3c1700 1 -- 172.21.15.27:0/1581723023 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f6f9406ace0 msgr2=0x7f6f9406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:19.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.779+0000 7f6fad3c1700 1 --2- 172.21.15.27:0/1581723023 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f6f9406ace0 0x7f6f9406d190 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6f98009970 tx=0x7f6f98009110 comp rx=0 tx=0).stop 2023-07-05T23:33:19.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.779+0000 7f6fad3c1700 1 -- 172.21.15.27:0/1581723023 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6fa80ceaa0 msgr2=0x7f6fa80c60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:19.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.779+0000 7f6fad3c1700 1 --2- 172.21.15.27:0/1581723023 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6fa80ceaa0 0x7f6fa80c60a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c00c780 tx=0x7f6f9c00ca90 comp rx=0 tx=0).stop 2023-07-05T23:33:19.839 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.779+0000 7f6fa77fe700 1 -- 172.21.15.27:0/1581723023 reap_dead start 2023-07-05T23:33:19.839 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.783+0000 7f6fad3c1700 1 -- 172.21.15.27:0/1581723023 shutdown_connections 2023-07-05T23:33:19.839 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.783+0000 7f6fad3c1700 1 -- 172.21.15.27:0/1581723023 >> 172.21.15.27:0/1581723023 conn(0x7f6fa806e260 msgr2=0x7f6fa8072990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:19.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.783+0000 7f6fad3c1700 1 -- 172.21.15.27:0/1581723023 shutdown_connections 2023-07-05T23:33:19.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.783+0000 7f6fad3c1700 1 -- 172.21.15.27:0/1581723023 wait complete. 2023-07-05T23:33:19.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.784+0000 7f3878df3700 1 -- 172.21.15.27:0/1804739052 --> [v2:172.21.15.162:6808/2657688865,v1:172.21.15.162:6809/2657688865] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3858002d40 con 0x7f3854074960 2023-07-05T23:33:19.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.785+0000 7f3862ffd700 1 -- 172.21.15.27:0/1804739052 <== osd.6 v2:172.21.15.162:6808/2657688865 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3858002d40 con 0x7f3854074960 2023-07-05T23:33:19.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.786+0000 7feff8c52700 1 -- 172.21.15.27:0/3317454114 --> [v2:172.21.15.162:6800/2111223016,v1:172.21.15.162:6801/2111223016] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7feff40cc5e0 con 0x7feff406cb70 2023-07-05T23:33:19.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.786+0000 7f3878df3700 1 -- 172.21.15.27:0/1804739052 >> [v2:172.21.15.162:6808/2657688865,v1:172.21.15.162:6809/2657688865] conn(0x7f3854074960 msgr2=0x7f3854076d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:19.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.786+0000 7f3878df3700 1 --2- 172.21.15.27:0/1804739052 >> [v2:172.21.15.162:6808/2657688865,v1:172.21.15.162:6809/2657688865] conn(0x7f3854074960 0x7f3854076d90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:19.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.786+0000 7f3878df3700 1 -- 172.21.15.27:0/1804739052 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f385406ad10 msgr2=0x7f385406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:19.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.786+0000 7f3878df3700 1 --2- 172.21.15.27:0/1804739052 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f385406ad10 0x7f385406d1c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f387415f230 tx=0x7f38680090e0 comp rx=0 tx=0).stop 2023-07-05T23:33:19.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.786+0000 7f3878df3700 1 -- 172.21.15.27:0/1804739052 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f385c004bf0 msgr2=0x7f3874153750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:19.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.786+0000 7f3878df3700 1 --2- 172.21.15.27:0/1804739052 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f385c004bf0 0x7f3874153750 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f386401d3c0 tx=0x7f38640012d0 comp rx=0 tx=0).stop 2023-07-05T23:33:19.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.786+0000 7f3872d9d700 1 -- 172.21.15.27:0/1804739052 reap_dead start 2023-07-05T23:33:19.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.787+0000 7f3878df3700 1 -- 172.21.15.27:0/1804739052 shutdown_connections 2023-07-05T23:33:19.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.787+0000 7f3878df3700 1 -- 172.21.15.27:0/1804739052 >> 172.21.15.27:0/1804739052 conn(0x7f38740cf7d0 msgr2=0x7f387415f280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:19.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.787+0000 7f5831eb4700 1 -- 172.21.15.27:0/3046488365 --> [v2:172.21.15.27:6808/2125656143,v1:172.21.15.27:6809/2125656143] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f582c06a090 con 0x7f5810074900 2023-07-05T23:33:19.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.787+0000 7effcad5b700 1 -- 172.21.15.27:0/2570314848 >> [v2:172.21.15.27:6812/3766536605,v1:172.21.15.27:6814/3766536605] conn(0x7effa8074a00 msgr2=0x7effa8076e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:19.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.787+0000 7effcad5b700 1 --2- 172.21.15.27:0/2570314848 >> [v2:172.21.15.27:6812/3766536605,v1:172.21.15.27:6814/3766536605] conn(0x7effa8074a00 0x7effa8076e30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:19.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.787+0000 7f3878df3700 1 -- 172.21.15.27:0/1804739052 shutdown_connections 2023-07-05T23:33:19.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.787+0000 7effcad5b700 1 -- 172.21.15.27:0/2570314848 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7effa806adb0 msgr2=0x7effa806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:19.845 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.787+0000 7effcad5b700 1 --2- 172.21.15.27:0/2570314848 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7effa806adb0 0x7effa806d260 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7effc40b3d10 tx=0x7effb800f040 comp rx=0 tx=0).stop 2023-07-05T23:33:19.845 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.787+0000 7effcad5b700 1 -- 172.21.15.27:0/2570314848 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7effc4159270 msgr2=0x7effc40b1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:19.845 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.787+0000 7effcad5b700 1 --2- 172.21.15.27:0/2570314848 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7effc4159270 0x7effc40b1f30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7effbc00b780 tx=0x7effbc00ba90 comp rx=0 tx=0).stop 2023-07-05T23:33:19.845 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.787+0000 7effc92f8700 1 -- 172.21.15.27:0/2570314848 reap_dead start 2023-07-05T23:33:19.845 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.787+0000 7effcad5b700 1 -- 172.21.15.27:0/2570314848 shutdown_connections 2023-07-05T23:33:19.845 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.787+0000 7effcad5b700 1 -- 172.21.15.27:0/2570314848 >> 172.21.15.27:0/2570314848 conn(0x7effc40b0260 msgr2=0x7effc41569b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:19.845 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.787+0000 7effcad5b700 1 -- 172.21.15.27:0/2570314848 shutdown_connections 2023-07-05T23:33:19.846 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.787+0000 7effcad5b700 1 -- 172.21.15.27:0/2570314848 wait complete. 2023-07-05T23:33:19.846 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.787+0000 7f581bfff700 1 -- 172.21.15.27:0/3046488365 <== osd.3 v2:172.21.15.27:6808/2125656143 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f581c009aa0 con 0x7f5810074900 2023-07-05T23:33:19.846 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.787+0000 7f3878df3700 1 -- 172.21.15.27:0/1804739052 wait complete. 2023-07-05T23:33:19.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.788+0000 7f5831eb4700 1 -- 172.21.15.27:0/3046488365 >> [v2:172.21.15.27:6808/2125656143,v1:172.21.15.27:6809/2125656143] conn(0x7f5810074900 msgr2=0x7f5810076d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:19.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.788+0000 7f5831eb4700 1 --2- 172.21.15.27:0/3046488365 >> [v2:172.21.15.27:6808/2125656143,v1:172.21.15.27:6809/2125656143] conn(0x7f5810074900 0x7f5810076d30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:19.847 INFO:teuthology.orchestra.run.smithi027.stdout:55834574859 2023-07-05T23:33:19.848 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-07-05T23:33:19.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.789+0000 7fefe2ffd700 1 -- 172.21.15.27:0/3317454114 <== osd.4 v2:172.21.15.162:6800/2111223016 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fefe4001c90 con 0x7feff406cb70 2023-07-05T23:33:19.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.789+0000 7feff8c52700 1 -- 172.21.15.27:0/3317454114 >> [v2:172.21.15.162:6800/2111223016,v1:172.21.15.162:6801/2111223016] conn(0x7feff406cb70 msgr2=0x7feff4150640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:19.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.789+0000 7feff8c52700 1 --2- 172.21.15.27:0/3317454114 >> [v2:172.21.15.162:6800/2111223016,v1:172.21.15.162:6801/2111223016] conn(0x7feff406cb70 0x7feff4150640 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:19.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.789+0000 7feff8c52700 1 -- 172.21.15.27:0/3317454114 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fefd406ad10 msgr2=0x7fefd406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:19.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.789+0000 7feff8c52700 1 --2- 172.21.15.27:0/3317454114 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fefd406ad10 0x7fefd406d1c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7feff4071780 tx=0x7fefec009000 comp rx=0 tx=0).stop 2023-07-05T23:33:19.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.789+0000 7feff8c52700 1 -- 172.21.15.27:0/3317454114 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feff4071370 msgr2=0x7feff414d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:19.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.789+0000 7feff8c52700 1 --2- 172.21.15.27:0/3317454114 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feff4071370 0x7feff414d7f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fefe800e810 tx=0x7fefe800eb20 comp rx=0 tx=0).stop 2023-07-05T23:33:19.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.789+0000 7feff2d9d700 1 -- 172.21.15.27:0/3317454114 reap_dead start 2023-07-05T23:33:19.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.790+0000 7f5831eb4700 1 -- 172.21.15.27:0/3046488365 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f581006acb0 msgr2=0x7f581006d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:19.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.790+0000 7f5831eb4700 1 --2- 172.21.15.27:0/3046488365 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f581006acb0 0x7f581006d160 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f582c154450 tx=0x7f58200090e0 comp rx=0 tx=0).stop 2023-07-05T23:33:19.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.790+0000 7f5831eb4700 1 -- 172.21.15.27:0/3046488365 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f582c06a890 msgr2=0x7f582c0c4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:19.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.790+0000 7f5831eb4700 1 --2- 172.21.15.27:0/3046488365 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f582c06a890 0x7f582c0c4d90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5824018000 tx=0x7f5824004ad0 comp rx=0 tx=0).stop 2023-07-05T23:33:19.851 INFO:teuthology.orchestra.run.smithi027.stdout:55834574859 2023-07-05T23:33:19.852 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-07-05T23:33:19.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.792+0000 7feff8c52700 1 -- 172.21.15.27:0/3317454114 shutdown_connections 2023-07-05T23:33:19.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.792+0000 7feff8c52700 1 -- 172.21.15.27:0/3317454114 >> 172.21.15.27:0/3317454114 conn(0x7feff40b0260 msgr2=0x7feff40afa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:19.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.792+0000 7feff8c52700 1 -- 172.21.15.27:0/3317454114 shutdown_connections 2023-07-05T23:33:19.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.792+0000 7feff8c52700 1 -- 172.21.15.27:0/3317454114 wait complete. 2023-07-05T23:33:19.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.793+0000 7f582bfff700 1 -- 172.21.15.27:0/3046488365 reap_dead start 2023-07-05T23:33:19.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.793+0000 7f5831eb4700 1 -- 172.21.15.27:0/3046488365 shutdown_connections 2023-07-05T23:33:19.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.793+0000 7f5831eb4700 1 -- 172.21.15.27:0/3046488365 >> 172.21.15.27:0/3046488365 conn(0x7f582c0b1740 msgr2=0x7f582c071030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:19.854 INFO:teuthology.orchestra.run.smithi027.stdout:55834574860 2023-07-05T23:33:19.855 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-07-05T23:33:19.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.798+0000 7f5831eb4700 1 -- 172.21.15.27:0/3046488365 shutdown_connections 2023-07-05T23:33:19.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:19.798+0000 7f5831eb4700 1 -- 172.21.15.27:0/3046488365 wait complete. 2023-07-05T23:33:19.856 INFO:teuthology.orchestra.run.smithi027.stdout:55834574859 2023-07-05T23:33:19.856 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-07-05T23:33:19.857 INFO:teuthology.orchestra.run.smithi027.stdout:55834574859 2023-07-05T23:33:19.857 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-07-05T23:33:19.858 INFO:teuthology.orchestra.run.smithi027.stdout:55834574860 2023-07-05T23:33:19.858 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-07-05T23:33:19.859 INFO:teuthology.orchestra.run.smithi027.stdout:55834574859 2023-07-05T23:33:19.860 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-07-05T23:33:19.860 INFO:teuthology.orchestra.run.smithi027.stdout:55834574859 2023-07-05T23:33:19.861 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-07-05T23:33:20.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.111+0000 7f47f4b45700 1 Processor -- start 2023-07-05T23:33:20.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.111+0000 7fc43ff96700 1 Processor -- start 2023-07-05T23:33:20.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.111+0000 7f47f4b45700 1 -- start start 2023-07-05T23:33:20.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.111+0000 7ffb37aed700 1 Processor -- start 2023-07-05T23:33:20.116 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.112+0000 7ffb37aed700 1 -- start start 2023-07-05T23:33:20.116 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.112+0000 7f2f14df7700 1 Processor -- start 2023-07-05T23:33:20.117 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.112+0000 7f47f4b45700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47f00b0d40 0x7f47f0159270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:20.117 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.112+0000 7f47f4b45700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f47f006c270 0x7f47f006c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:20.118 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.112+0000 7f47f4b45700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47f015bd30 con 0x7f47f00cc260 2023-07-05T23:33:20.118 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.112+0000 7f47f4b45700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47f01586a0 con 0x7f47f006c270 2023-07-05T23:33:20.118 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.113+0000 7f47f4b45700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47f015bfd0 con 0x7f47f00b0d40 2023-07-05T23:33:20.119 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.111+0000 7fc43ff96700 1 -- start start 2023-07-05T23:33:20.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.113+0000 7fc43ff96700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc438159270 0x7fc4380cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:20.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.113+0000 7fc43ff96700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc4380cba20 0x7fc4380cc260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:20.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.113+0000 7fc43ff96700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc43815bd30 con 0x7fc4380cc7a0 2023-07-05T23:33:20.121 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.113+0000 7fc43ff96700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4381586a0 con 0x7fc4380cba20 2023-07-05T23:33:20.121 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.113+0000 7fc43ff96700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4380cbe90 con 0x7fc438159270 2023-07-05T23:33:20.122 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.113+0000 7f47edd9b700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f47f00cc260 0x7f47f00cc6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:52532/0 (socket says 172.21.15.27:52532) 2023-07-05T23:33:20.122 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.113+0000 7f47edd9b700 1 -- 172.21.15.27:0/3434440045 learned_addr learned my addr 172.21.15.27:0/3434440045 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-07-05T23:33:20.122 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.113+0000 7f47ee59c700 1 --2- 172.21.15.27:0/3434440045 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47f00b0d40 0x7f47f0159270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:20.123 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.113+0000 7fc43d531700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc4380cba20 0x7fc4380cc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:20.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.113+0000 7f47eed9d700 1 --2- 172.21.15.27:0/3434440045 >> v2:172.21.15.162:3300/0 conn(0x7f47f006c270 0x7f47f006c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:20.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.113+0000 7ffb37aed700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ffb30160590 0x7ffb300cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:20.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.113+0000 7ffb37aed700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffb300c1800 0x7ffb3006c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:20.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.113+0000 7ffb37aed700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ffb3006cc60 0x7ffb30164200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:20.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.113+0000 7ffb37aed700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb3006c290 con 0x7ffb3006cc60 2023-07-05T23:33:20.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.113+0000 7ffb37aed700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb300ce330 con 0x7ffb30160590 2023-07-05T23:33:20.126 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.113+0000 7ffb37aed700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb300c1f70 con 0x7ffb300c1800 2023-07-05T23:33:20.126 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.114+0000 7f47ee59c700 1 -- 172.21.15.27:0/3434440045 >> v2:172.21.15.162:3300/0 conn(0x7f47f006c270 msgr2=0x7f47f006c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:20.127 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.114+0000 7f47ee59c700 1 --2- 172.21.15.27:0/3434440045 >> v2:172.21.15.162:3300/0 conn(0x7f47f006c270 0x7f47f006c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.127 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.114+0000 7f47ee59c700 1 -- 172.21.15.27:0/3434440045 >> v1:172.21.15.27:6789/0 conn(0x7f47f00cc260 legacy=0x7f47f00cc6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:20.127 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.114+0000 7f47ee59c700 1 -- 172.21.15.27:0/3434440045 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47f015c2b0 con 0x7f47f00b0d40 2023-07-05T23:33:20.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.114+0000 7fc43dd32700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc438159270 0x7fc4380cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:20.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.114+0000 7ffb35889700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ffb30160590 0x7ffb300cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:20.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.114+0000 7ffb35889700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ffb30160590 0x7ffb300cddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.27:43312/0 (socket says 172.21.15.27:43312) 2023-07-05T23:33:20.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.114+0000 7ffb35889700 1 -- 172.21.15.27:0/2525757775 learned_addr learned my addr 172.21.15.27:0/2525757775 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:20.130 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.114+0000 7fc43dd32700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc438159270 0x7fc4380cb4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.27:45406/0 (socket says 172.21.15.27:45406) 2023-07-05T23:33:20.130 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.114+0000 7fc43dd32700 1 -- 172.21.15.27:0/1091666980 learned_addr learned my addr 172.21.15.27:0/1091666980 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:20.131 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.114+0000 7f2f14df7700 1 -- start start 2023-07-05T23:33:20.131 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.114+0000 7ffb35889700 1 -- 172.21.15.27:0/2525757775 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffb300c1800 msgr2=0x7ffb3006c720 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-05T23:33:20.132 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.114+0000 7ffb35889700 1 --2- 172.21.15.27:0/2525757775 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffb300c1800 0x7ffb3006c720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.132 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.114+0000 7ffb35889700 1 -- 172.21.15.27:0/2525757775 >> v2:172.21.15.27:3300/0 conn(0x7ffb3006cc60 msgr2=0x7ffb30164200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:20.132 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.114+0000 7ffb35889700 1 --2- 172.21.15.27:0/2525757775 >> v2:172.21.15.27:3300/0 conn(0x7ffb3006cc60 0x7ffb30164200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.133 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.114+0000 7ffb35889700 1 -- 172.21.15.27:0/2525757775 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb300cc400 con 0x7ffb30160590 2023-07-05T23:33:20.133 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.114+0000 7f47ee59c700 1 --2- 172.21.15.27:0/3434440045 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47f00b0d40 0x7f47f0159270 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f47e0009840 tx=0x7f47e0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7def4a45da2f13a8 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:20.134 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.114+0000 7fc43d531700 1 -- 172.21.15.27:0/1091666980 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc438159270 msgr2=0x7fc4380cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:20.134 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.114+0000 7fc43d531700 1 --2- 172.21.15.27:0/1091666980 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc438159270 0x7fc4380cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.114+0000 7fc43d531700 1 -- 172.21.15.27:0/1091666980 >> v1:172.21.15.27:6789/0 conn(0x7fc4380cc7a0 legacy=0x7fc438069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:20.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.114+0000 7fc43d531700 1 -- 172.21.15.27:0/1091666980 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4380ccc00 con 0x7fc4380cba20 2023-07-05T23:33:20.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.114+0000 7fbd981a3700 1 Processor -- start 2023-07-05T23:33:20.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.114+0000 7f47ed59a700 1 -- 172.21.15.27:0/3434440045 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e0011830 con 0x7f47f00b0d40 2023-07-05T23:33:20.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.114+0000 7f47ed59a700 1 -- 172.21.15.27:0/3434440045 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47e0011990 con 0x7f47f00b0d40 2023-07-05T23:33:20.137 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.114+0000 7f47ed59a700 1 -- 172.21.15.27:0/3434440045 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e0011d20 con 0x7f47f00b0d40 2023-07-05T23:33:20.137 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.114+0000 7f6fa7a76700 1 Processor -- start 2023-07-05T23:33:20.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.115+0000 7ffb35889700 1 --2- 172.21.15.27:0/2525757775 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb30160590 0x7ffb300cddf0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ffb30071b10 tx=0x7ffb2c009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86b9dfee0f53da89 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:20.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.115+0000 7f47f4b45700 1 -- 172.21.15.27:0/3434440045 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47f00b0d40 msgr2=0x7f47f0159270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:20.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.115+0000 7f47f4b45700 1 --2- 172.21.15.27:0/3434440045 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47f00b0d40 0x7f47f0159270 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f47e0009840 tx=0x7f47e0009b50 comp rx=0 tx=0).stop 2023-07-05T23:33:20.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.115+0000 7f2f14df7700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2f100711f0 0x7f2f100ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:20.140 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.115+0000 7f2f14df7700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2f100caf60 0x7f2f10164be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:20.140 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.115+0000 7f2f14df7700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f100ced90 con 0x7f2f100cab90 2023-07-05T23:33:20.140 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.115+0000 7f2f14df7700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f10165120 con 0x7f2f100caf60 2023-07-05T23:33:20.140 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.115+0000 7f2f14df7700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1006b2b0 con 0x7f2f100711f0 2023-07-05T23:33:20.141 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.115+0000 7fc43d531700 1 --2- 172.21.15.27:0/1091666980 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4380cba20 0x7fc4380cc260 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc430009dc0 tx=0x7fc43000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2958a1234e142ad3 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:20.141 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.115+0000 7f6fa7a76700 1 -- start start 2023-07-05T23:33:20.142 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.116+0000 7ffb34887700 1 -- 172.21.15.27:0/2525757775 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c00b870 con 0x7ffb30160590 2023-07-05T23:33:20.142 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.116+0000 7ffb34887700 1 -- 172.21.15.27:0/2525757775 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb2c00b9d0 con 0x7ffb30160590 2023-07-05T23:33:20.142 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.116+0000 7ffb34887700 1 -- 172.21.15.27:0/2525757775 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c00bd60 con 0x7ffb30160590 2023-07-05T23:33:20.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.116+0000 7f2f0ed9d700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2f100caf60 0x7f2f10164be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:20.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.116+0000 7f2f0e59c700 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f2f100cab90 0x7f2f10070ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.27:33516/0 (socket says 172.21.15.27:33516) 2023-07-05T23:33:20.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.116+0000 7f2f0e59c700 1 -- 172.21.15.27:0/1754226642 learned_addr learned my addr 172.21.15.27:0/1754226642 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-07-05T23:33:20.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.116+0000 7f2f0dd9b700 1 --2- 172.21.15.27:0/1754226642 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2f100711f0 0x7f2f100ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:20.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.116+0000 7f6fa7a76700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f6fa0160590 0x7f6fa00cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:20.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.116+0000 7f6fa7a76700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6fa00c1800 0x7f6fa006c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:20.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.116+0000 7f6fa7a76700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fa006c290 con 0x7f6fa006cc60 2023-07-05T23:33:20.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.116+0000 7f6fa7a76700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fa00ce330 con 0x7f6fa0160590 2023-07-05T23:33:20.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.116+0000 7f6fa7a76700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fa00c1f70 con 0x7f6fa00c1800 2023-07-05T23:33:20.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.115+0000 7fbd981a3700 1 -- start start 2023-07-05T23:33:20.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.116+0000 7fbd981a3700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fbd900ccf90 0x7fbd900cd360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:20.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.116+0000 7fbd981a3700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fbd90158850 0x7fbd9015c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:20.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.116+0000 7f47f4b45700 1 -- 172.21.15.27:0/3434440045 shutdown_connections 2023-07-05T23:33:20.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.116+0000 7f47f4b45700 1 --2- 172.21.15.27:0/3434440045 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47f00b0d40 0x7f47f0159270 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.148 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.116+0000 7f47f4b45700 1 --2- 172.21.15.27:0/3434440045 >> v2:172.21.15.162:3300/0 conn(0x7f47f006c270 0x7f47f006c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.148 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.116+0000 7f47f4b45700 1 -- 172.21.15.27:0/3434440045 >> 172.21.15.27:0/3434440045 conn(0x7f47f00b0260 msgr2=0x7f47f00b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:20.149 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.116+0000 7f2f0ed9d700 1 -- 172.21.15.27:0/1754226642 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2f100711f0 msgr2=0x7f2f100ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:20.149 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.116+0000 7f2f0ed9d700 1 --2- 172.21.15.27:0/1754226642 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2f100711f0 0x7f2f100ce6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.149 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.116+0000 7f2f0ed9d700 1 -- 172.21.15.27:0/1754226642 >> v1:172.21.15.162:6789/0 conn(0x7f2f100cab90 legacy=0x7f2f10070ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:20.149 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.116+0000 7f2f0ed9d700 1 -- 172.21.15.27:0/1754226642 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f100cd250 con 0x7f2f100caf60 2023-07-05T23:33:20.150 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.116+0000 7fbd981a3700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd9015c720 0x7fbd9006a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:20.150 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.116+0000 7fbd981a3700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd9015d1f0 con 0x7fbd900ccf90 2023-07-05T23:33:20.151 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.116+0000 7fbd981a3700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd900cd8a0 con 0x7fbd90158850 2023-07-05T23:33:20.151 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.116+0000 7fbd981a3700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9015cc30 con 0x7fbd9015c720 2023-07-05T23:33:20.151 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.117+0000 7f2f0ed9d700 1 --2- 172.21.15.27:0/1754226642 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f100caf60 0x7f2f10164be0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2f08009d90 tx=0x7f2f0800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e6a0db9efaf7ccc server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:20.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.116+0000 7f6fa6013700 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f6fa006cc60 0x7f6fa0164200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.27:33524/0 (socket says 172.21.15.27:33524) 2023-07-05T23:33:20.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.116+0000 7f6fa6013700 1 -- 172.21.15.27:0/920184302 learned_addr learned my addr 172.21.15.27:0/920184302 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-07-05T23:33:20.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.116+0000 7f6fa5812700 1 --2- 172.21.15.27:0/920184302 >> v2:172.21.15.27:3300/0 conn(0x7f6fa0160590 0x7f6fa00cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:20.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.117+0000 7f6fa5011700 1 --2- 172.21.15.27:0/920184302 >> v2:172.21.15.162:3300/0 conn(0x7f6fa00c1800 0x7f6fa006c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:20.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.117+0000 7fbd9573e700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fbd90158850 0x7fbd9015c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:20.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.117+0000 7ffb37aed700 1 -- 172.21.15.27:0/2525757775 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb30160590 msgr2=0x7ffb300cddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:20.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.117+0000 7ffb37aed700 1 --2- 172.21.15.27:0/2525757775 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb30160590 0x7ffb300cddf0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ffb30071b10 tx=0x7ffb2c009bd0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.154 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.117+0000 7f47f4b45700 1 -- 172.21.15.27:0/3434440045 shutdown_connections 2023-07-05T23:33:20.155 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.117+0000 7f2f0d59a700 1 -- 172.21.15.27:0/1754226642 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0800e070 con 0x7f2f100caf60 2023-07-05T23:33:20.155 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.117+0000 7f2f0d59a700 1 -- 172.21.15.27:0/1754226642 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f0800bb20 con 0x7f2f100caf60 2023-07-05T23:33:20.155 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.117+0000 7f2f0d59a700 1 -- 172.21.15.27:0/1754226642 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f08012430 con 0x7f2f100caf60 2023-07-05T23:33:20.156 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.117+0000 7ffb37aed700 1 -- 172.21.15.27:0/2525757775 shutdown_connections 2023-07-05T23:33:20.156 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.117+0000 7ffb37aed700 1 --2- 172.21.15.27:0/2525757775 >> v2:172.21.15.27:3300/0 conn(0x7ffb3006cc60 0x7ffb30164200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.117+0000 7ffb37aed700 1 --2- 172.21.15.27:0/2525757775 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb30160590 0x7ffb300cddf0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.117+0000 7ffb37aed700 1 --2- 172.21.15.27:0/2525757775 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffb300c1800 0x7ffb3006c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.117+0000 7ffb37aed700 1 -- 172.21.15.27:0/2525757775 >> 172.21.15.27:0/2525757775 conn(0x7ffb300b0ef0 msgr2=0x7ffb300ce690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:20.158 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.117+0000 7f6fa5011700 1 -- 172.21.15.27:0/920184302 >> v2:172.21.15.27:3300/0 conn(0x7f6fa0160590 msgr2=0x7f6fa00cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:20.158 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.117+0000 7f6fa5011700 1 --2- 172.21.15.27:0/920184302 >> v2:172.21.15.27:3300/0 conn(0x7f6fa0160590 0x7f6fa00cddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.159 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.117+0000 7f6fa5011700 1 -- 172.21.15.27:0/920184302 >> v1:172.21.15.162:6789/0 conn(0x7f6fa006cc60 legacy=0x7f6fa0164200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:20.159 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.117+0000 7f6fa5011700 1 -- 172.21.15.27:0/920184302 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa00cc400 con 0x7f6fa00c1800 2023-07-05T23:33:20.159 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.117+0000 7fc43cd30700 1 -- 172.21.15.27:0/1091666980 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43000e070 con 0x7fc4380cba20 2023-07-05T23:33:20.160 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.117+0000 7fc43cd30700 1 -- 172.21.15.27:0/1091666980 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc43000baa0 con 0x7fc4380cba20 2023-07-05T23:33:20.160 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.117+0000 7fc43cd30700 1 -- 172.21.15.27:0/1091666980 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43000be50 con 0x7fc4380cba20 2023-07-05T23:33:20.161 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.117+0000 7ffb37aed700 1 -- 172.21.15.27:0/2525757775 shutdown_connections 2023-07-05T23:33:20.161 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.117+0000 7ffb37aed700 1 -- 172.21.15.27:0/2525757775 wait complete. 2023-07-05T23:33:20.162 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.117+0000 7fbd95f3f700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fbd900ccf90 0x7fbd900cd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:20.162 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.117+0000 7fbd9573e700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fbd90158850 0x7fbd9015c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.27:43332/0 (socket says 172.21.15.27:43332) 2023-07-05T23:33:20.162 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.117+0000 7fbd9573e700 1 -- 172.21.15.27:0/3216544123 learned_addr learned my addr 172.21.15.27:0/3216544123 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:20.163 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.117+0000 7fbd96740700 1 --2- 172.21.15.27:0/3216544123 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd9015c720 0x7fbd9006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:20.163 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.117+0000 7fbd96740700 1 -- 172.21.15.27:0/3216544123 >> v2:172.21.15.162:3300/0 conn(0x7fbd90158850 msgr2=0x7fbd9015c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:20.163 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.117+0000 7fbd96740700 1 --2- 172.21.15.27:0/3216544123 >> v2:172.21.15.162:3300/0 conn(0x7fbd90158850 0x7fbd9015c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.164 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.117+0000 7fbd96740700 1 -- 172.21.15.27:0/3216544123 >> v2:172.21.15.27:3300/0 conn(0x7fbd900ccf90 msgr2=0x7fbd900cd360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:20.164 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.117+0000 7fbd96740700 1 --2- 172.21.15.27:0/3216544123 >> v2:172.21.15.27:3300/0 conn(0x7fbd900ccf90 0x7fbd900cd360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.164 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.117+0000 7fbd96740700 1 -- 172.21.15.27:0/3216544123 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd9015cf10 con 0x7fbd9015c720 2023-07-05T23:33:20.164 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.118+0000 7fbd96740700 1 --2- 172.21.15.27:0/3216544123 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd9015c720 0x7fbd9006a890 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fbd900ccb10 tx=0x7fbd80009b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d5d8f3c9d596779 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:20.165 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.118+0000 7fc43ff96700 1 -- 172.21.15.27:0/1091666980 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4380cba20 msgr2=0x7fc4380cc260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:20.165 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.118+0000 7fc43ff96700 1 --2- 172.21.15.27:0/1091666980 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4380cba20 0x7fc4380cc260 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc430009dc0 tx=0x7fc43000b330 comp rx=0 tx=0).stop 2023-07-05T23:33:20.166 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.118+0000 7fc43ff96700 1 -- 172.21.15.27:0/1091666980 shutdown_connections 2023-07-05T23:33:20.166 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.118+0000 7fc43ff96700 1 --2- 172.21.15.27:0/1091666980 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc438159270 0x7fc4380cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.166 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.118+0000 7fc43ff96700 1 --2- 172.21.15.27:0/1091666980 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4380cba20 0x7fc4380cc260 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.167 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.118+0000 7fc43ff96700 1 -- 172.21.15.27:0/1091666980 >> 172.21.15.27:0/1091666980 conn(0x7fc4380b0260 msgr2=0x7fc4380b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:20.167 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.118+0000 7f2f14df7700 1 -- 172.21.15.27:0/1754226642 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f100caf60 msgr2=0x7f2f10164be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:20.167 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.118+0000 7f2f14df7700 1 --2- 172.21.15.27:0/1754226642 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f100caf60 0x7f2f10164be0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2f08009d90 tx=0x7f2f0800b330 comp rx=0 tx=0).stop 2023-07-05T23:33:20.168 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.118+0000 7f2f14df7700 1 -- 172.21.15.27:0/1754226642 shutdown_connections 2023-07-05T23:33:20.168 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.118+0000 7f2f14df7700 1 --2- 172.21.15.27:0/1754226642 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f100caf60 0x7f2f10164be0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.168 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.118+0000 7f2f14df7700 1 --2- 172.21.15.27:0/1754226642 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2f100711f0 0x7f2f100ce6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.169 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.118+0000 7f2f14df7700 1 -- 172.21.15.27:0/1754226642 >> 172.21.15.27:0/1754226642 conn(0x7f2f100b1740 msgr2=0x7f2f1006cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:20.169 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.119+0000 7f6fa5011700 1 --2- 172.21.15.27:0/920184302 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6fa00c1800 0x7f6fa006c720 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6fa006e7f0 tx=0x7f6f90009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a643d06bc343f94f server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:20.170 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.119+0000 7f6fa4810700 1 -- 172.21.15.27:0/920184302 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f90011830 con 0x7f6fa00c1800 2023-07-05T23:33:20.170 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.119+0000 7f6fa4810700 1 -- 172.21.15.27:0/920184302 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f90011990 con 0x7f6fa00c1800 2023-07-05T23:33:20.170 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.119+0000 7f6fa4810700 1 -- 172.21.15.27:0/920184302 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f90011d00 con 0x7f6fa00c1800 2023-07-05T23:33:20.171 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.119+0000 7ffb37aed700 1 Processor -- start 2023-07-05T23:33:20.171 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.118+0000 7f47f4b45700 1 -- 172.21.15.27:0/3434440045 wait complete. 2023-07-05T23:33:20.172 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.119+0000 7ffb37aed700 1 -- start start 2023-07-05T23:33:20.172 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.119+0000 7f47f4b45700 1 Processor -- start 2023-07-05T23:33:20.173 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.119+0000 7fc43ff96700 1 -- 172.21.15.27:0/1091666980 shutdown_connections 2023-07-05T23:33:20.174 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.120+0000 7ffb37aed700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffb3006cc60 0x7ffb301581e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:20.174 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.120+0000 7ffb37aed700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb300c1800 0x7ffb301fe6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:20.174 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.120+0000 7ffb37aed700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffb30160590 0x7ffb3015e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:20.175 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.120+0000 7ffb37aed700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb300cb360 con 0x7ffb3006cc60 2023-07-05T23:33:20.175 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.120+0000 7ffb37aed700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb300ca770 con 0x7ffb300c1800 2023-07-05T23:33:20.175 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.120+0000 7ffb37aed700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb300caa30 con 0x7ffb30160590 2023-07-05T23:33:20.175 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.121+0000 7ffb35889700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffb3006cc60 0x7ffb301581e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:20.176 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.121+0000 7ffb35889700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffb3006cc60 0x7ffb301581e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45400/0 (socket says 172.21.15.27:45400) 2023-07-05T23:33:20.176 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.121+0000 7ffb35889700 1 -- 172.21.15.27:0/2311224949 learned_addr learned my addr 172.21.15.27:0/2311224949 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:20.176 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.121+0000 7ffb3608a700 1 --2- 172.21.15.27:0/2311224949 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffb30160590 0x7ffb3015e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:20.176 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.121+0000 7ffb35088700 1 --2- 172.21.15.27:0/2311224949 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb300c1800 0x7ffb301fe6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:20.177 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.121+0000 7ffb35889700 1 -- 172.21.15.27:0/2311224949 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffb30160590 msgr2=0x7ffb3015e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:20.177 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.121+0000 7ffb35889700 1 --2- 172.21.15.27:0/2311224949 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffb30160590 0x7ffb3015e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.177 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.121+0000 7ffb35889700 1 -- 172.21.15.27:0/2311224949 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb300c1800 msgr2=0x7ffb301fe6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:20.177 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.121+0000 7ffb35889700 1 --2- 172.21.15.27:0/2311224949 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb300c1800 0x7ffb301fe6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.177 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.121+0000 7ffb35889700 1 -- 172.21.15.27:0/2311224949 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb2c009550 con 0x7ffb3006cc60 2023-07-05T23:33:20.178 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.119+0000 7fbd94f3d700 1 -- 172.21.15.27:0/3216544123 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd80011830 con 0x7fbd9015c720 2023-07-05T23:33:20.179 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.119+0000 7fbd94f3d700 1 -- 172.21.15.27:0/3216544123 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd80011990 con 0x7fbd9015c720 2023-07-05T23:33:20.179 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.119+0000 7fbd94f3d700 1 -- 172.21.15.27:0/3216544123 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd80011d00 con 0x7fbd9015c720 2023-07-05T23:33:20.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.120+0000 7fbd981a3700 1 -- 172.21.15.27:0/3216544123 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd9015c720 msgr2=0x7fbd9006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:20.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.120+0000 7fbd981a3700 1 --2- 172.21.15.27:0/3216544123 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd9015c720 0x7fbd9006a890 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fbd900ccb10 tx=0x7fbd80009b20 comp rx=0 tx=0).stop 2023-07-05T23:33:20.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.120+0000 7fbd981a3700 1 -- 172.21.15.27:0/3216544123 shutdown_connections 2023-07-05T23:33:20.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.120+0000 7fbd981a3700 1 --2- 172.21.15.27:0/3216544123 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd9015c720 0x7fbd9006a890 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.120+0000 7fbd981a3700 1 --2- 172.21.15.27:0/3216544123 >> v2:172.21.15.27:3300/0 conn(0x7fbd900ccf90 0x7fbd900cd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.120+0000 7fbd981a3700 1 --2- 172.21.15.27:0/3216544123 >> v2:172.21.15.162:3300/0 conn(0x7fbd90158850 0x7fbd9015c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.120+0000 7fbd981a3700 1 -- 172.21.15.27:0/3216544123 >> 172.21.15.27:0/3216544123 conn(0x7fbd900b1740 msgr2=0x7fbd9006cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:20.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.119+0000 7f47f4b45700 1 -- start start 2023-07-05T23:33:20.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.121+0000 7f47f4b45700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47f006c270 0x7f47f00c81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:20.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.121+0000 7f47f4b45700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47f00b0d40 0x7f47f01fe8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:20.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.121+0000 7f47f4b45700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f47f00cc260 0x7f47f00b1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:20.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.121+0000 7f47f4b45700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f00c5760 con 0x7f47f00cc260 2023-07-05T23:33:20.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.121+0000 7f47f4b45700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f01ff110 con 0x7f47f00b0d40 2023-07-05T23:33:20.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.121+0000 7f47f4b45700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47f01ff3f0 con 0x7f47f006c270 2023-07-05T23:33:20.183 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.121+0000 7f47eed9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f47f00cc260 0x7f47f00b1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:20.183 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.121+0000 7f47eed9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f47f00cc260 0x7f47f00b1560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45408/0 (socket says 172.21.15.27:45408) 2023-07-05T23:33:20.183 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.121+0000 7f47eed9d700 1 -- 172.21.15.27:0/1539545725 learned_addr learned my addr 172.21.15.27:0/1539545725 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:20.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.120+0000 7f6fa7a76700 1 -- 172.21.15.27:0/920184302 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6fa00c1800 msgr2=0x7f6fa006c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:20.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.120+0000 7f6fa7a76700 1 --2- 172.21.15.27:0/920184302 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6fa00c1800 0x7f6fa006c720 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6fa006e7f0 tx=0x7f6f90009b20 comp rx=0 tx=0).stop 2023-07-05T23:33:20.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.120+0000 7f6fa7a76700 1 -- 172.21.15.27:0/920184302 shutdown_connections 2023-07-05T23:33:20.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.120+0000 7f6fa7a76700 1 --2- 172.21.15.27:0/920184302 >> v2:172.21.15.27:3300/0 conn(0x7f6fa0160590 0x7f6fa00cddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.120+0000 7f6fa7a76700 1 --2- 172.21.15.27:0/920184302 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6fa00c1800 0x7f6fa006c720 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.120+0000 7f6fa7a76700 1 -- 172.21.15.27:0/920184302 >> 172.21.15.27:0/920184302 conn(0x7f6fa00b0ef0 msgr2=0x7f6fa00ce690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:20.185 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.121+0000 7f6fa7a76700 1 -- 172.21.15.27:0/920184302 shutdown_connections 2023-07-05T23:33:20.185 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.121+0000 7f6fa7a76700 1 -- 172.21.15.27:0/920184302 wait complete. 2023-07-05T23:33:20.185 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.119+0000 7fc43ff96700 1 -- 172.21.15.27:0/1091666980 wait complete. 2023-07-05T23:33:20.185 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.121+0000 7fc43ff96700 1 Processor -- start 2023-07-05T23:33:20.186 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.122+0000 7f47eed9d700 1 -- 172.21.15.27:0/1539545725 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47f006c270 msgr2=0x7f47f00c81d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-05T23:33:20.186 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.122+0000 7f2e37d38700 1 Processor -- start 2023-07-05T23:33:20.186 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.122+0000 7f47eed9d700 1 --2- 172.21.15.27:0/1539545725 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47f006c270 0x7f47f00c81d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.187 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.122+0000 7f47eed9d700 1 -- 172.21.15.27:0/1539545725 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47f00b0d40 msgr2=0x7f47f01fe8e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-05T23:33:20.187 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.122+0000 7f47eed9d700 1 --2- 172.21.15.27:0/1539545725 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47f00b0d40 0x7f47f01fe8e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.187 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.122+0000 7f47eed9d700 1 -- 172.21.15.27:0/1539545725 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e00094a0 con 0x7f47f00cc260 2023-07-05T23:33:20.187 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.122+0000 7ffb35889700 1 --2- 172.21.15.27:0/2311224949 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffb3006cc60 0x7ffb301581e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ffb300ce470 tx=0x7ffb2c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:20.188 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.122+0000 7ffb267fc700 1 -- 172.21.15.27:0/2311224949 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c004220 con 0x7ffb3006cc60 2023-07-05T23:33:20.188 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.122+0000 7ffb267fc700 1 -- 172.21.15.27:0/2311224949 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb2c004380 con 0x7ffb3006cc60 2023-07-05T23:33:20.188 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.122+0000 7ffb267fc700 1 -- 172.21.15.27:0/2311224949 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c0116f0 con 0x7ffb3006cc60 2023-07-05T23:33:20.188 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.122+0000 7f47eed9d700 1 --2- 172.21.15.27:0/1539545725 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f47f00cc260 0x7f47f00b1560 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f47e8007e40 tx=0x7f47e800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:20.189 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.122+0000 7f47deffd700 1 -- 172.21.15.27:0/1539545725 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e800eea0 con 0x7f47f00cc260 2023-07-05T23:33:20.189 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.122+0000 7fc43ff96700 1 -- start start 2023-07-05T23:33:20.189 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.122+0000 7f47deffd700 1 -- 172.21.15.27:0/1539545725 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47e8014420 con 0x7f47f00cc260 2023-07-05T23:33:20.189 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.122+0000 7f47deffd700 1 -- 172.21.15.27:0/1539545725 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e80147d0 con 0x7f47f00cc260 2023-07-05T23:33:20.190 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.122+0000 7f47f4b45700 1 -- 172.21.15.27:0/1539545725 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47f01ff6d0 con 0x7f47f00cc260 2023-07-05T23:33:20.190 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.121+0000 7f2f14df7700 1 -- 172.21.15.27:0/1754226642 shutdown_connections 2023-07-05T23:33:20.190 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.121+0000 7fbd981a3700 1 -- 172.21.15.27:0/3216544123 shutdown_connections 2023-07-05T23:33:20.191 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.121+0000 7fbd981a3700 1 -- 172.21.15.27:0/3216544123 wait complete. 2023-07-05T23:33:20.191 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.122+0000 7fbd981a3700 1 Processor -- start 2023-07-05T23:33:20.191 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.123+0000 7fbd981a3700 1 -- start start 2023-07-05T23:33:20.191 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.123+0000 7f6fa7a76700 1 Processor -- start 2023-07-05T23:33:20.192 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.122+0000 7ffb37aed700 1 -- 172.21.15.27:0/2311224949 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb300cad10 con 0x7ffb3006cc60 2023-07-05T23:33:20.192 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.122+0000 7ffb37aed700 1 -- 172.21.15.27:0/2311224949 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb30158720 con 0x7ffb3006cc60 2023-07-05T23:33:20.192 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.123+0000 7f2f14df7700 1 -- 172.21.15.27:0/1754226642 wait complete. 2023-07-05T23:33:20.193 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.124+0000 7fbd981a3700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbd900ccf90 0x7fbd900c4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:20.193 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.124+0000 7fbd981a3700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd90158850 0x7fbd900b3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:20.193 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.124+0000 7fbd981a3700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd9015c720 0x7fbd9014f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:20.193 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.124+0000 7fbd981a3700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9014ace0 con 0x7fbd900ccf90 2023-07-05T23:33:20.193 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.124+0000 7fbd981a3700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9014afc0 con 0x7fbd9015c720 2023-07-05T23:33:20.194 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.124+0000 7fbd981a3700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9014b2a0 con 0x7fbd90158850 2023-07-05T23:33:20.194 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.122+0000 7f47f4b45700 1 -- 172.21.15.27:0/1539545725 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47f01fee20 con 0x7f47f00cc260 2023-07-05T23:33:20.194 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.122+0000 7f2e37d38700 1 -- start start 2023-07-05T23:33:20.194 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.123+0000 7f2e37d38700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2e3015a1e0 0x7f2e300aec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:20.195 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.123+0000 7f2e37d38700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e3015d6a0 con 0x7f2e300cddd0 2023-07-05T23:33:20.195 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.123+0000 7f2e37d38700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e30159700 con 0x7f2e300ae6c0 2023-07-05T23:33:20.195 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.123+0000 7f2e37d38700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e300cdc80 con 0x7f2e3015a1e0 2023-07-05T23:33:20.195 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.124+0000 7f2e352d3700 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f2e300ae6c0 0x7f2e300714a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.27:33546/0 (socket says 172.21.15.27:33546) 2023-07-05T23:33:20.195 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.124+0000 7f2e352d3700 1 -- 172.21.15.27:0/3408843165 learned_addr learned my addr 172.21.15.27:0/3408843165 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-07-05T23:33:20.195 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.124+0000 7f2e34ad2700 1 -- 172.21.15.27:0/3408843165 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 753139448 0 0) 0x7f2e30159700 con 0x7f2e300ae6c0 2023-07-05T23:33:20.195 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.124+0000 7f2e34ad2700 1 -- 172.21.15.27:0/3408843165 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e1c0057c0 con 0x7f2e300ae6c0 2023-07-05T23:33:20.196 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.124+0000 7fbd96740700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd9015c720 0x7fbd9014f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:20.196 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.124+0000 7fbd96740700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd9015c720 0x7fbd9014f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.27:43356/0 (socket says 172.21.15.27:43356) 2023-07-05T23:33:20.196 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.124+0000 7fbd96740700 1 -- 172.21.15.27:0/2415314235 learned_addr learned my addr 172.21.15.27:0/2415314235 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:20.196 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.124+0000 7fbd9573e700 1 --2- 172.21.15.27:0/2415314235 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd90158850 0x7fbd900b3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:20.197 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.124+0000 7ffb37aed700 1 -- 172.21.15.27:0/2311224949 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb180052f0 con 0x7ffb3006cc60 2023-07-05T23:33:20.197 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.125+0000 7f2e362d5700 1 --2- 172.21.15.27:0/3408843165 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2e3015a1e0 0x7f2e300aec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:20.197 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.125+0000 7f2e34ad2700 1 -- 172.21.15.27:0/3408843165 <== mon.1 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2365152790 0 0) 0x7f2e1c0057c0 con 0x7f2e300ae6c0 2023-07-05T23:33:20.198 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.125+0000 7f2e34ad2700 1 -- 172.21.15.27:0/3408843165 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2e3015a1e0 msgr2=0x7f2e300aec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:20.198 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.125+0000 7f2e34ad2700 1 --2- 172.21.15.27:0/3408843165 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2e3015a1e0 0x7f2e300aec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.198 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.125+0000 7f2e34ad2700 1 -- 172.21.15.27:0/3408843165 >> v1:172.21.15.27:6789/0 conn(0x7f2e300cddd0 legacy=0x7f2e300ce1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:20.198 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.125+0000 7f2e34ad2700 1 -- 172.21.15.27:0/3408843165 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e301599e0 con 0x7f2e300ae6c0 2023-07-05T23:33:20.198 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.125+0000 7f2e34ad2700 1 -- 172.21.15.27:0/3408843165 <== mon.1 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1246168953 0 0) 0x7f2e200016b0 con 0x7f2e300ae6c0 2023-07-05T23:33:20.198 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.125+0000 7f2e34ad2700 1 -- 172.21.15.27:0/3408843165 >> v1:172.21.15.162:6789/0 conn(0x7f2e300ae6c0 legacy=0x7f2e300714a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:20.198 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.125+0000 7f2e34ad2700 1 --2- 172.21.15.27:0/3408843165 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2e1c005c10 0x7f2e1c006000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:20.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.125+0000 7f2e34ad2700 1 --2- 172.21.15.27:0/3408843165 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e1c006a60 0x7f2e1c006ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:20.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.125+0000 7f2e34ad2700 1 --2- 172.21.15.27:0/3408843165 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2e1c007410 0x7f2e1c00dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:20.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.125+0000 7f2e34ad2700 1 -- 172.21.15.27:0/3408843165 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1c00e2f0 con 0x7f2e1c007410 2023-07-05T23:33:20.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.125+0000 7f2e34ad2700 1 -- 172.21.15.27:0/3408843165 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1c00e460 con 0x7f2e1c006a60 2023-07-05T23:33:20.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.125+0000 7f2e34ad2700 1 -- 172.21.15.27:0/3408843165 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1c00e620 con 0x7f2e1c005c10 2023-07-05T23:33:20.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.125+0000 7f2f14df7700 1 Processor -- start 2023-07-05T23:33:20.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.125+0000 7f2e35ad4700 1 --2- 172.21.15.27:0/3408843165 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2e1c005c10 0x7f2e1c006000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:20.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.126+0000 7f2e352d3700 1 --2- 172.21.15.27:0/3408843165 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e1c006a60 0x7f2e1c006ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:20.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.126+0000 7fc43ff96700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4380cba20 0x7fc4380c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:20.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.126+0000 7fc43ff96700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc4380cc7a0 0x7fc4380c3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:20.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.126+0000 7fc43ff96700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc438159270 0x7fc438157c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:20.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.126+0000 7fc43ff96700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4380c3650 con 0x7fc4380cc7a0 2023-07-05T23:33:20.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.126+0000 7fc43ff96700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc438158190 con 0x7fc438159270 2023-07-05T23:33:20.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.126+0000 7fc43ff96700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4380c29d0 con 0x7fc4380cba20 2023-07-05T23:33:20.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.126+0000 7fbd96740700 1 -- 172.21.15.27:0/2415314235 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd90158850 msgr2=0x7fbd900b3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:20.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.126+0000 7fbd96740700 1 --2- 172.21.15.27:0/2415314235 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd90158850 0x7fbd900b3970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.126+0000 7fbd96740700 1 -- 172.21.15.27:0/2415314235 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbd900ccf90 msgr2=0x7fbd900c4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:20.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.126+0000 7fbd96740700 1 --2- 172.21.15.27:0/2415314235 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbd900ccf90 0x7fbd900c4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.126+0000 7fbd96740700 1 -- 172.21.15.27:0/2415314235 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd800094a0 con 0x7fbd9015c720 2023-07-05T23:33:20.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.125+0000 7f47f4b45700 1 -- 172.21.15.27:0/1539545725 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47f00cbf70 con 0x7f47f00cc260 2023-07-05T23:33:20.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.125+0000 7f47deffd700 1 -- 172.21.15.27:0/1539545725 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f47e8014930 con 0x7f47f00cc260 2023-07-05T23:33:20.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.126+0000 7fbd96740700 1 --2- 172.21.15.27:0/2415314235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd9015c720 0x7fbd9014f890 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbd800090b0 tx=0x7fbd80004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:20.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.126+0000 7f47deffd700 1 --2- 172.21.15.27:0/1539545725 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f47d006ace0 0x7f47d006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:20.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.126+0000 7f2e352d3700 1 -- 172.21.15.27:0/3408843165 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2e1c005c10 msgr2=0x7f2e1c006000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:20.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.126+0000 7f2e352d3700 1 --2- 172.21.15.27:0/3408843165 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2e1c005c10 0x7f2e1c006000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.126+0000 7fc43dd32700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4380cba20 0x7fc4380c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:20.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.126+0000 7fc43dd32700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4380cba20 0x7fc4380c82a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.27:45464/0 (socket says 172.21.15.27:45464) 2023-07-05T23:33:20.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.126+0000 7fc43dd32700 1 -- 172.21.15.27:0/2855529858 learned_addr learned my addr 172.21.15.27:0/2855529858 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:20.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.126+0000 7f2e352d3700 1 -- 172.21.15.27:0/3408843165 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2e1c007410 msgr2=0x7f2e1c00dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:20.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.126+0000 7f2e352d3700 1 --2- 172.21.15.27:0/3408843165 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2e1c007410 0x7f2e1c00dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.126+0000 7f2e352d3700 1 -- 172.21.15.27:0/3408843165 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e301599e0 con 0x7f2e1c006a60 2023-07-05T23:33:20.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.126+0000 7f47deffd700 1 -- 172.21.15.27:0/1539545725 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f47e808a050 con 0x7f47f00cc260 2023-07-05T23:33:20.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.126+0000 7f47ee59c700 1 --2- 172.21.15.27:0/1539545725 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f47d006ace0 0x7f47d006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:20.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.126+0000 7fbd867fc700 1 -- 172.21.15.27:0/2415314235 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd80004510 con 0x7fbd9015c720 2023-07-05T23:33:20.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.126+0000 7fbd867fc700 1 -- 172.21.15.27:0/2415314235 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd8001f070 con 0x7fbd9015c720 2023-07-05T23:33:20.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.126+0000 7fbd867fc700 1 -- 172.21.15.27:0/2415314235 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd800038e0 con 0x7fbd9015c720 2023-07-05T23:33:20.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.126+0000 7f2e35ad4700 1 --2- 172.21.15.27:0/3408843165 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2e1c005c10 0x7f2e1c006000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T23:33:20.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.126+0000 7fbd981a3700 1 -- 172.21.15.27:0/2415314235 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd9014b580 con 0x7fbd9015c720 2023-07-05T23:33:20.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.126+0000 7fc43e533700 1 --2- 172.21.15.27:0/2855529858 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc438159270 0x7fc438157c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:20.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.127+0000 7f2f14df7700 1 -- start start 2023-07-05T23:33:20.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.127+0000 7fbd981a3700 1 -- 172.21.15.27:0/2415314235 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd900b3eb0 con 0x7fbd9015c720 2023-07-05T23:33:20.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.126+0000 7f7fc3993700 1 Processor -- start 2023-07-05T23:33:20.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.127+0000 7f7fc3993700 1 -- start start 2023-07-05T23:33:20.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.127+0000 7fc43e533700 1 -- 172.21.15.27:0/2855529858 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4380cba20 msgr2=0x7fc4380c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:20.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.127+0000 7fc43e533700 1 --2- 172.21.15.27:0/2855529858 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4380cba20 0x7fc4380c82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.127+0000 7fc43e533700 1 -- 172.21.15.27:0/2855529858 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc4380cc7a0 msgr2=0x7fc4380c3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:20.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.127+0000 7fc43e533700 1 --2- 172.21.15.27:0/2855529858 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc4380cc7a0 0x7fc4380c3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.127+0000 7fc43e533700 1 -- 172.21.15.27:0/2855529858 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc430009a70 con 0x7fc438159270 2023-07-05T23:33:20.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.127+0000 7fc43e533700 1 --2- 172.21.15.27:0/2855529858 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc438159270 0x7fc438157c50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc42800c3e0 tx=0x7fc42800c6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:20.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.127+0000 7f47ee59c700 1 --2- 172.21.15.27:0/1539545725 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f47d006ace0 0x7f47d006d190 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f47e00090b0 tx=0x7f47e0008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:20.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.127+0000 7ffb267fc700 1 -- 172.21.15.27:0/2311224949 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ffb2c011850 con 0x7ffb3006cc60 2023-07-05T23:33:20.213 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.127+0000 7ffb267fc700 1 --2- 172.21.15.27:0/2311224949 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7ffb1406adb0 0x7ffb1406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:20.214 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.127+0000 7ffb267fc700 1 -- 172.21.15.27:0/2311224949 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ffb2c08a830 con 0x7ffb3006cc60 2023-07-05T23:33:20.214 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.127+0000 7ffb35088700 1 --2- 172.21.15.27:0/2311224949 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7ffb1406adb0 0x7ffb1406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:20.214 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.128+0000 7ffb35088700 1 --2- 172.21.15.27:0/2311224949 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7ffb1406adb0 0x7ffb1406d260 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ffb3006ca40 tx=0x7ffb20008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:20.215 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.128+0000 7f7fc3993700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7fbc06de30 0x7f7fbc069ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:20.215 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.128+0000 7f7fc3993700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fbc0cc260 con 0x7f7fbc0893f0 2023-07-05T23:33:20.215 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.128+0000 7f7fc3993700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fbc0cdf80 con 0x7f7fbc089940 2023-07-05T23:33:20.215 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.128+0000 7f7fc3993700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fbc169370 con 0x7f7fbc06de30 2023-07-05T23:33:20.215 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.129+0000 7f7fc172f700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7fbc06de30 0x7f7fbc069ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:20.215 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.129+0000 7f7fc172f700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7fbc06de30 0x7f7fbc069ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.27:45476/0 (socket says 172.21.15.27:45476) 2023-07-05T23:33:20.215 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.129+0000 7f7fc172f700 1 -- 172.21.15.27:0/2161902280 learned_addr learned my addr 172.21.15.27:0/2161902280 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:20.216 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.129+0000 7f7fc172f700 1 -- 172.21.15.27:0/2161902280 >> v1:172.21.15.162:6789/0 conn(0x7f7fbc089940 legacy=0x7f7fbc16d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:20.216 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.129+0000 7f7fc172f700 1 -- 172.21.15.27:0/2161902280 >> v1:172.21.15.27:6789/0 conn(0x7f7fbc0893f0 legacy=0x7f7fbc16c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:20.216 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.129+0000 7f7fc172f700 1 -- 172.21.15.27:0/2161902280 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fbc16d7f0 con 0x7f7fbc06de30 2023-07-05T23:33:20.216 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.130+0000 7f7fc172f700 1 --2- 172.21.15.27:0/2161902280 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7fbc06de30 0x7f7fbc069ef0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7fb8009920 tx=0x7f7fb8009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d750c7a79387da44 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:20.216 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.128+0000 7fbd981a3700 1 -- 172.21.15.27:0/2415314235 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd90073910 con 0x7fbd9015c720 2023-07-05T23:33:20.217 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.129+0000 7fbd867fc700 1 -- 172.21.15.27:0/2415314235 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbd80003a40 con 0x7fbd9015c720 2023-07-05T23:33:20.217 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.130+0000 7fbd867fc700 1 --2- 172.21.15.27:0/2415314235 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fbd7406ace0 0x7fbd7406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:20.217 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.130+0000 7fbd867fc700 1 -- 172.21.15.27:0/2415314235 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbd80021070 con 0x7fbd9015c720 2023-07-05T23:33:20.217 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.127+0000 7fc42e7fc700 1 -- 172.21.15.27:0/2855529858 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc428011790 con 0x7fc438159270 2023-07-05T23:33:20.217 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.128+0000 7fc43ff96700 1 -- 172.21.15.27:0/2855529858 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4380c2cb0 con 0x7fc438159270 2023-07-05T23:33:20.217 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.127+0000 7fc42e7fc700 1 -- 172.21.15.27:0/2855529858 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4280118f0 con 0x7fc438159270 2023-07-05T23:33:20.218 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.128+0000 7fc42e7fc700 1 -- 172.21.15.27:0/2855529858 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc428011ca0 con 0x7fc438159270 2023-07-05T23:33:20.218 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.128+0000 7fc43ff96700 1 -- 172.21.15.27:0/2855529858 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4380c3270 con 0x7fc438159270 2023-07-05T23:33:20.218 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.129+0000 7fc43ff96700 1 -- 172.21.15.27:0/2855529858 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4380c3fb0 con 0x7fc438159270 2023-07-05T23:33:20.218 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.130+0000 7fc42e7fc700 1 -- 172.21.15.27:0/2855529858 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc42801c460 con 0x7fc438159270 2023-07-05T23:33:20.218 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.130+0000 7fc42e7fc700 1 --2- 172.21.15.27:0/2855529858 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fc41c06adb0 0x7fc41c06d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:20.218 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.130+0000 7fc42e7fc700 1 -- 172.21.15.27:0/2855529858 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc428089430 con 0x7fc438159270 2023-07-05T23:33:20.219 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.128+0000 7f2f14df7700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2f100711f0 0x7f2f101617e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:20.219 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.128+0000 7f2f14df7700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2f100cab90 0x7f2f10069fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:20.219 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.128+0000 7f2f14df7700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f100caf60 0x7f2f1006a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:20.219 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.128+0000 7f2f14df7700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f10161d20 con 0x7f2f100711f0 2023-07-05T23:33:20.219 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.128+0000 7f2f14df7700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f100b4800 con 0x7f2f100caf60 2023-07-05T23:33:20.219 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.128+0000 7f2f14df7700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f101ea100 con 0x7f2f100cab90 2023-07-05T23:33:20.219 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.128+0000 7f2f0e59c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2f100711f0 0x7f2f101617e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:20.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.128+0000 7f2f0e59c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2f100711f0 0x7f2f101617e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45446/0 (socket says 172.21.15.27:45446) 2023-07-05T23:33:20.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.128+0000 7f2f0e59c700 1 -- 172.21.15.27:0/383013452 learned_addr learned my addr 172.21.15.27:0/383013452 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:20.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.128+0000 7f2f0dd9b700 1 --2- 172.21.15.27:0/383013452 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2f100cab90 0x7f2f10069fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:20.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.129+0000 7f2f0e59c700 1 -- 172.21.15.27:0/383013452 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2f100cab90 msgr2=0x7f2f10069fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:20.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.129+0000 7f2f0e59c700 1 --2- 172.21.15.27:0/383013452 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2f100cab90 0x7f2f10069fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.129+0000 7f2f0e59c700 1 -- 172.21.15.27:0/383013452 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f100caf60 msgr2=0x7f2f1006a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:20.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.129+0000 7f2f0e59c700 1 --2- 172.21.15.27:0/383013452 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f100caf60 0x7f2f1006a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.129+0000 7f2f0e59c700 1 -- 172.21.15.27:0/383013452 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f08009a70 con 0x7f2f100711f0 2023-07-05T23:33:20.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.129+0000 7f2f0e59c700 1 --2- 172.21.15.27:0/383013452 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2f100711f0 0x7f2f101617e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2f0000c430 tx=0x7f2f0000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:20.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.129+0000 7f2efeffd700 1 -- 172.21.15.27:0/383013452 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f00005d70 con 0x7f2f100711f0 2023-07-05T23:33:20.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.129+0000 7f2efeffd700 1 -- 172.21.15.27:0/383013452 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f000070d0 con 0x7f2f100711f0 2023-07-05T23:33:20.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.129+0000 7f2f14df7700 1 -- 172.21.15.27:0/383013452 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f101ea3e0 con 0x7f2f100711f0 2023-07-05T23:33:20.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.129+0000 7f2efeffd700 1 -- 172.21.15.27:0/383013452 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f00007460 con 0x7f2f100711f0 2023-07-05T23:33:20.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.129+0000 7f2f14df7700 1 -- 172.21.15.27:0/383013452 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f100b4ae0 con 0x7f2f100711f0 2023-07-05T23:33:20.222 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.129+0000 7f6fa7a76700 1 -- start start 2023-07-05T23:33:20.222 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.130+0000 7f6fa7a76700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6fa006cc60 0x7f6fa00b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:20.222 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.130+0000 7f6fa7a76700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6fa00c1800 0x7f6fa0157b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:20.222 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.130+0000 7f6fa7a76700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6fa0160590 0x7f6fa01580b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:20.222 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.130+0000 7f6fa7a76700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa00c9b90 con 0x7f6fa0160590 2023-07-05T23:33:20.222 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.130+0000 7f6fa7a76700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa00c8cc0 con 0x7f6fa00c1800 2023-07-05T23:33:20.222 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.130+0000 7f6fa7a76700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa00c8f10 con 0x7f6fa006cc60 2023-07-05T23:33:20.223 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.130+0000 7f2e352d3700 1 --2- 172.21.15.27:0/3408843165 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e1c006a60 0x7f2e1c006ed0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2e2000c2a0 tx=0x7f2e1c007a90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2563ac42d020cc6 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:20.223 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.130+0000 7fbd95f3f700 1 --2- 172.21.15.27:0/2415314235 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fbd7406ace0 0x7fbd7406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:20.224 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.131+0000 7fc43dd32700 1 --2- 172.21.15.27:0/2855529858 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fc41c06adb0 0x7fc41c06d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:20.224 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.131+0000 7f7fb3fff700 1 -- 172.21.15.27:0/2161902280 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb8004230 con 0x7f7fbc06de30 2023-07-05T23:33:20.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.131+0000 7f6fa5812700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6fa006cc60 0x7f6fa00b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:20.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.131+0000 7f6fa5812700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6fa006cc60 0x7f6fa00b34d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.27:45492/0 (socket says 172.21.15.27:45492) 2023-07-05T23:33:20.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.131+0000 7f6fa5812700 1 -- 172.21.15.27:0/506626690 learned_addr learned my addr 172.21.15.27:0/506626690 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:20.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.131+0000 7f7fb3fff700 1 -- 172.21.15.27:0/2161902280 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fb8004390 con 0x7f7fbc06de30 2023-07-05T23:33:20.226 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.131+0000 7f7fb3fff700 1 -- 172.21.15.27:0/2161902280 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb8009e70 con 0x7f7fbc06de30 2023-07-05T23:33:20.226 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.131+0000 7f6fa5011700 1 --2- 172.21.15.27:0/506626690 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6fa00c1800 0x7f6fa0157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:20.226 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.131+0000 7f6fa6013700 1 --2- 172.21.15.27:0/506626690 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6fa0160590 0x7f6fa01580b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:20.226 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.131+0000 7fc43dd32700 1 --2- 172.21.15.27:0/2855529858 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fc41c06adb0 0x7fc41c06d260 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc4340085a0 tx=0x7fc43400d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:20.227 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.131+0000 7f6fa5812700 1 -- 172.21.15.27:0/506626690 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6fa00c1800 msgr2=0x7f6fa0157b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:20.227 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.131+0000 7f6fa5812700 1 --2- 172.21.15.27:0/506626690 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6fa00c1800 0x7f6fa0157b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.227 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.131+0000 7f6fa5812700 1 -- 172.21.15.27:0/506626690 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6fa0160590 msgr2=0x7f6fa01580b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:20.227 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.131+0000 7f6fa5812700 1 --2- 172.21.15.27:0/506626690 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6fa0160590 0x7f6fa01580b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.227 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.131+0000 7f6fa5812700 1 -- 172.21.15.27:0/506626690 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f900094a0 con 0x7f6fa006cc60 2023-07-05T23:33:20.228 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.131+0000 7f2f14df7700 1 -- 172.21.15.27:0/383013452 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f101ea900 con 0x7f2f100711f0 2023-07-05T23:33:20.228 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.131+0000 7f6fa5812700 1 --2- 172.21.15.27:0/506626690 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6fa006cc60 0x7f6fa00b34d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c00e810 tx=0x7f6f9c00eb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:20.228 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.132+0000 7fbd95f3f700 1 --2- 172.21.15.27:0/2415314235 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fbd7406ace0 0x7fbd7406d190 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbd880070b0 tx=0x7fbd88007040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:20.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.132+0000 7f6f967fc700 1 -- 172.21.15.27:0/506626690 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f9c013610 con 0x7f6fa006cc60 2023-07-05T23:33:20.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.132+0000 7f6f967fc700 1 -- 172.21.15.27:0/506626690 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f9c013770 con 0x7f6fa006cc60 2023-07-05T23:33:20.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.132+0000 7f6fa7a76700 1 -- 172.21.15.27:0/506626690 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fa00c91f0 con 0x7f6fa006cc60 2023-07-05T23:33:20.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.132+0000 7f6f967fc700 1 -- 172.21.15.27:0/506626690 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f9c013b20 con 0x7f6fa006cc60 2023-07-05T23:33:20.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.132+0000 7f6fa7a76700 1 -- 172.21.15.27:0/506626690 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fa00c97b0 con 0x7f6fa006cc60 2023-07-05T23:33:20.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.132+0000 7f7fc3993700 1 -- 172.21.15.27:0/2161902280 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7fbc06de30 msgr2=0x7f7fbc069ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:20.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.132+0000 7f7fc3993700 1 --2- 172.21.15.27:0/2161902280 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7fbc06de30 0x7f7fbc069ef0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7fb8009920 tx=0x7f7fb8009c30 comp rx=0 tx=0).stop 2023-07-05T23:33:20.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.132+0000 7f7fc3993700 1 -- 172.21.15.27:0/2161902280 shutdown_connections 2023-07-05T23:33:20.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.132+0000 7f7fc3993700 1 --2- 172.21.15.27:0/2161902280 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7fbc06de30 0x7f7fbc069ef0 secure :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7fb8009920 tx=0x7f7fb8009c30 comp rx=0 tx=0).stop 2023-07-05T23:33:20.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.132+0000 7f7fc3993700 1 -- 172.21.15.27:0/2161902280 >> 172.21.15.27:0/2161902280 conn(0x7f7fbc0b0260 msgr2=0x7f7fbc0b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:20.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.132+0000 7f2efeffd700 1 -- 172.21.15.27:0/383013452 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2f000075c0 con 0x7f2f100711f0 2023-07-05T23:33:20.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.132+0000 7f2efeffd700 1 --2- 172.21.15.27:0/383013452 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f2ef006ad30 0x7f2ef006d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:20.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.132+0000 7f2efeffd700 1 -- 172.21.15.27:0/383013452 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2f00088a70 con 0x7f2f100711f0 2023-07-05T23:33:20.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.132+0000 7f2f0dd9b700 1 --2- 172.21.15.27:0/383013452 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f2ef006ad30 0x7f2ef006d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:20.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.133+0000 7f7fc3993700 1 -- 172.21.15.27:0/2161902280 shutdown_connections 2023-07-05T23:33:20.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.133+0000 7f7fc3993700 1 -- 172.21.15.27:0/2161902280 wait complete. 2023-07-05T23:33:20.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.133+0000 7f2f0dd9b700 1 --2- 172.21.15.27:0/383013452 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f2ef006ad30 0x7f2ef006d1e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2f1006ada0 tx=0x7f2f04008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:20.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.134+0000 7f6f967fc700 1 -- 172.21.15.27:0/506626690 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6f9c013c80 con 0x7f6fa006cc60 2023-07-05T23:33:20.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.134+0000 7f7fc3993700 1 Processor -- start 2023-07-05T23:33:20.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.134+0000 7f7fc3993700 1 -- start start 2023-07-05T23:33:20.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.134+0000 7f6f967fc700 1 --2- 172.21.15.27:0/506626690 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f6f8406ace0 0x7f6f8406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:20.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.135+0000 7f6f967fc700 1 -- 172.21.15.27:0/506626690 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6f9c089470 con 0x7f6fa006cc60 2023-07-05T23:33:20.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.135+0000 7f6fa5011700 1 --2- 172.21.15.27:0/506626690 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f6f8406ace0 0x7f6f8406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:20.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.135+0000 7f7fc3993700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fbc0893f0 0x7f7fbc0ca9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:20.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.135+0000 7f7fc3993700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7fbc089940 0x7f7fbc06cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:20.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.135+0000 7f7fc3993700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7fbc06d320 0x7f7fbc203540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:20.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.135+0000 7f7fc3993700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fbc0c6830 con 0x7f7fbc06d320 2023-07-05T23:33:20.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.135+0000 7f7fc3993700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fbc06d7c0 con 0x7f7fbc0893f0 2023-07-05T23:33:20.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.135+0000 7f7fc3993700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fbc0caee0 con 0x7f7fbc089940 2023-07-05T23:33:20.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.135+0000 7f6fa5011700 1 --2- 172.21.15.27:0/506626690 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f6f8406ace0 0x7f6f8406d190 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6f90000c00 tx=0x7f6f9001c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:20.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.135+0000 7f7fc172f700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fbc0893f0 0x7f7fbc0ca9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:20.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.135+0000 7f7fc1f30700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7fbc06d320 0x7f7fbc203540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:20.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.135+0000 7f7fc0f2e700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7fbc089940 0x7f7fbc06cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:20.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.135+0000 7f7fc172f700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fbc0893f0 0x7f7fbc0ca9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.27:43404/0 (socket says 172.21.15.27:43404) 2023-07-05T23:33:20.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.135+0000 7f7fc172f700 1 -- 172.21.15.27:0/2743461301 learned_addr learned my addr 172.21.15.27:0/2743461301 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:20.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.135+0000 7f2e34ad2700 1 -- 172.21.15.27:0/3408843165 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e20007c80 con 0x7f2e1c006a60 2023-07-05T23:33:20.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.136+0000 7f7fc1f30700 1 -- 172.21.15.27:0/2743461301 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7fbc089940 msgr2=0x7f7fbc06cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:20.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.136+0000 7f7fc1f30700 1 --2- 172.21.15.27:0/2743461301 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7fbc089940 0x7f7fbc06cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.136+0000 7f7fc1f30700 1 -- 172.21.15.27:0/2743461301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fbc0893f0 msgr2=0x7f7fbc0ca9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:20.239 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.136+0000 7f7fc1f30700 1 --2- 172.21.15.27:0/2743461301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fbc0893f0 0x7f7fbc0ca9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.239 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.136+0000 7f7fc1f30700 1 -- 172.21.15.27:0/2743461301 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb8009550 con 0x7f7fbc06d320 2023-07-05T23:33:20.239 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.136+0000 7f7fc0f2e700 1 --2- 172.21.15.27:0/2743461301 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7fbc089940 0x7f7fbc06cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T23:33:20.239 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.136+0000 7f7fc172f700 1 --2- 172.21.15.27:0/2743461301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fbc0893f0 0x7f7fbc0ca9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T23:33:20.239 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.136+0000 7f7fc1f30700 1 --2- 172.21.15.27:0/2743461301 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7fbc06d320 0x7f7fbc203540 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7fb400caa0 tx=0x7f7fb400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:20.239 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.136+0000 7fbd867fc700 1 -- 172.21.15.27:0/2415314235 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbd80055c20 con 0x7fbd9015c720 2023-07-05T23:33:20.240 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.137+0000 7ffb267fc700 1 -- 172.21.15.27:0/2311224949 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ffb2c055660 con 0x7ffb3006cc60 2023-07-05T23:33:20.240 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.138+0000 7f6fa7a76700 1 -- 172.21.15.27:0/506626690 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fa00c9cd0 con 0x7f6fa006cc60 2023-07-05T23:33:20.241 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.140+0000 7f2e34ad2700 1 -- 172.21.15.27:0/3408843165 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e2000ce60 con 0x7f2e1c006a60 2023-07-05T23:33:20.241 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.140+0000 7f2e34ad2700 1 -- 172.21.15.27:0/3408843165 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e20005ba0 con 0x7f2e1c006a60 2023-07-05T23:33:20.241 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.140+0000 7fc42e7fc700 1 -- 172.21.15.27:0/2855529858 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc428057c60 con 0x7fc438159270 2023-07-05T23:33:20.242 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.141+0000 7f2e37d38700 1 -- 172.21.15.27:0/3408843165 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e1c006a60 msgr2=0x7f2e1c006ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:20.242 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.141+0000 7f2e37d38700 1 --2- 172.21.15.27:0/3408843165 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e1c006a60 0x7f2e1c006ed0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2e2000c2a0 tx=0x7f2e1c007a90 comp rx=0 tx=0).stop 2023-07-05T23:33:20.242 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.141+0000 7f2e362d5700 1 -- 172.21.15.27:0/3408843165 reap_dead start 2023-07-05T23:33:20.242 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.141+0000 7f2e37d38700 1 -- 172.21.15.27:0/3408843165 shutdown_connections 2023-07-05T23:33:20.242 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.141+0000 7f2e37d38700 1 -- 172.21.15.27:0/3408843165 >> 172.21.15.27:0/3408843165 conn(0x7f2e3006d4a0 msgr2=0x7f2e3006d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:20.242 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.141+0000 7f2e37d38700 1 -- 172.21.15.27:0/3408843165 shutdown_connections 2023-07-05T23:33:20.242 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.141+0000 7f2e37d38700 1 -- 172.21.15.27:0/3408843165 wait complete. 2023-07-05T23:33:20.243 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.141+0000 7f47deffd700 1 -- 172.21.15.27:0/1539545725 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f47e8054d70 con 0x7f47f00cc260 2023-07-05T23:33:20.243 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.143+0000 7f2e37d38700 1 Processor -- start 2023-07-05T23:33:20.243 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.143+0000 7f2e37d38700 1 -- start start 2023-07-05T23:33:20.243 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.144+0000 7f2e37d38700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2e1c006a60 0x7f2e300c6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:20.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.144+0000 7f6f967fc700 1 -- 172.21.15.27:0/506626690 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6fa00c9cd0 con 0x7f6fa006cc60 2023-07-05T23:33:20.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.144+0000 7f2e37d38700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e30144b40 0x7f2e3015bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:20.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.144+0000 7f2e37d38700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2e30153d90 0x7f2e30154200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:20.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.144+0000 7f2e37d38700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e30154740 con 0x7f2e30153d90 2023-07-05T23:33:20.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.144+0000 7f2e37d38700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e300af9a0 con 0x7f2e30144b40 2023-07-05T23:33:20.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.144+0000 7f2e37d38700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e300c6dd0 con 0x7f2e1c006a60 2023-07-05T23:33:20.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.144+0000 7f2e362d5700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2e30153d90 0x7f2e30154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:20.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.144+0000 7f2e362d5700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2e30153d90 0x7f2e30154200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45472/0 (socket says 172.21.15.27:45472) 2023-07-05T23:33:20.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.144+0000 7f2e362d5700 1 -- 172.21.15.27:0/1054309608 learned_addr learned my addr 172.21.15.27:0/1054309608 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:20.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.144+0000 7f2e35ad4700 1 --2- 172.21.15.27:0/1054309608 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2e1c006a60 0x7f2e300c6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:20.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.144+0000 7f2e352d3700 1 --2- 172.21.15.27:0/1054309608 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e30144b40 0x7f2e3015bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:20.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.144+0000 7f2e362d5700 1 -- 172.21.15.27:0/1054309608 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2e1c006a60 msgr2=0x7f2e300c6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:20.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.144+0000 7f2e362d5700 1 --2- 172.21.15.27:0/1054309608 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2e1c006a60 0x7f2e300c6890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.144+0000 7f2e362d5700 1 -- 172.21.15.27:0/1054309608 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e30144b40 msgr2=0x7f2e3015bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:20.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.144+0000 7f2e362d5700 1 --2- 172.21.15.27:0/1054309608 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e30144b40 0x7f2e3015bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.144+0000 7f2e362d5700 1 -- 172.21.15.27:0/1054309608 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e300aead0 con 0x7f2e30153d90 2023-07-05T23:33:20.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.144+0000 7f2e35ad4700 1 --2- 172.21.15.27:0/1054309608 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2e1c006a60 0x7f2e300c6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T23:33:20.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.144+0000 7f2e352d3700 1 --2- 172.21.15.27:0/1054309608 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e30144b40 0x7f2e3015bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T23:33:20.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.145+0000 7f2e362d5700 1 --2- 172.21.15.27:0/1054309608 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2e30153d90 0x7f2e30154200 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2e3006fda0 tx=0x7f2e28007e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:20.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.146+0000 7f7fb1ffb700 1 -- 172.21.15.27:0/2743461301 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb4003c00 con 0x7f7fbc06d320 2023-07-05T23:33:20.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.147+0000 7f7fb1ffb700 1 -- 172.21.15.27:0/2743461301 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fb4003d60 con 0x7f7fbc06d320 2023-07-05T23:33:20.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.147+0000 7f7fb1ffb700 1 -- 172.21.15.27:0/2743461301 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb400a9c0 con 0x7f7fbc06d320 2023-07-05T23:33:20.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.147+0000 7f7fc3993700 1 -- 172.21.15.27:0/2743461301 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fbc2042a0 con 0x7f7fbc06d320 2023-07-05T23:33:20.249 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.147+0000 7f7fc3993700 1 -- 172.21.15.27:0/2743461301 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fbc204b20 con 0x7f7fbc06d320 2023-07-05T23:33:20.249 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.147+0000 7f2efeffd700 1 -- 172.21.15.27:0/383013452 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2f101ea900 con 0x7f2f100711f0 2023-07-05T23:33:20.249 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.147+0000 7f2e267fc700 1 -- 172.21.15.27:0/1054309608 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e2800e9b0 con 0x7f2e30153d90 2023-07-05T23:33:20.249 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.147+0000 7f2e267fc700 1 -- 172.21.15.27:0/1054309608 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e2800eb30 con 0x7f2e30153d90 2023-07-05T23:33:20.250 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.147+0000 7f2e267fc700 1 -- 172.21.15.27:0/1054309608 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e2800eee0 con 0x7f2e30153d90 2023-07-05T23:33:20.250 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.148+0000 7f2e37d38700 1 -- 172.21.15.27:0/1054309608 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e301520d0 con 0x7f2e30153d90 2023-07-05T23:33:20.250 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.148+0000 7f2e37d38700 1 -- 172.21.15.27:0/1054309608 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e300af070 con 0x7f2e30153d90 2023-07-05T23:33:20.250 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.149+0000 7f2e37d38700 1 -- 172.21.15.27:0/1054309608 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e30073910 con 0x7f2e30153d90 2023-07-05T23:33:20.250 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.150+0000 7f2e267fc700 1 -- 172.21.15.27:0/1054309608 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2e2801e460 con 0x7f2e30153d90 2023-07-05T23:33:20.250 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.151+0000 7f2e267fc700 1 --2- 172.21.15.27:0/1054309608 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f2e1406ace0 0x7f2e1406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:20.250 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.151+0000 7f2e267fc700 1 -- 172.21.15.27:0/1054309608 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2e28089910 con 0x7f2e30153d90 2023-07-05T23:33:20.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.151+0000 7f2e35ad4700 1 --2- 172.21.15.27:0/1054309608 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f2e1406ace0 0x7f2e1406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:20.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.152+0000 7f2e35ad4700 1 --2- 172.21.15.27:0/1054309608 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f2e1406ace0 0x7f2e1406d190 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c001290 tx=0x7f2e2c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:20.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.160+0000 7f2e267fc700 1 -- 172.21.15.27:0/1054309608 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2e28054630 con 0x7f2e30153d90 2023-07-05T23:33:20.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.162+0000 7f7fb1ffb700 1 -- 172.21.15.27:0/2743461301 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7fb400ab20 con 0x7f7fbc06d320 2023-07-05T23:33:20.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.162+0000 7f7fb1ffb700 1 --2- 172.21.15.27:0/2743461301 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f7fa006adb0 0x7f7fa006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:20.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.163+0000 7f7fb1ffb700 1 -- 172.21.15.27:0/2743461301 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7fb40895a0 con 0x7f7fbc06d320 2023-07-05T23:33:20.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.163+0000 7f7fc3993700 1 -- 172.21.15.27:0/2743461301 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fbc0ce3f0 con 0x7f7fbc06d320 2023-07-05T23:33:20.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.163+0000 7f7fc172f700 1 --2- 172.21.15.27:0/2743461301 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f7fa006adb0 0x7f7fa006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:20.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.173+0000 7f7fb1ffb700 1 -- 172.21.15.27:0/2743461301 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7fbc0ce3f0 con 0x7f7fbc06d320 2023-07-05T23:33:20.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.174+0000 7f7fc172f700 1 --2- 172.21.15.27:0/2743461301 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f7fa006adb0 0x7f7fa006d260 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7fb8009fd0 tx=0x7f7fb8008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:20.557 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.555+0000 7fc43ff96700 1 -- 172.21.15.27:0/2855529858 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fc4380c3790 con 0x7fc438159270 2023-07-05T23:33:20.558 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.556+0000 7fc42e7fc700 1 -- 172.21.15.27:0/2855529858 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc4380c3790 con 0x7fc438159270 2023-07-05T23:33:20.558 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.557+0000 7fbd981a3700 1 -- 172.21.15.27:0/2415314235 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbd9006d480 con 0x7fbd9015c720 2023-07-05T23:33:20.559 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.557+0000 7f47f4b45700 1 -- 172.21.15.27:0/1539545725 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f47f0073910 con 0x7f47f00cc260 2023-07-05T23:33:20.559 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.557+0000 7ffb37aed700 1 -- 172.21.15.27:0/2311224949 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ffb180055a0 con 0x7ffb3006cc60 2023-07-05T23:33:20.559 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.557+0000 7ffb267fc700 1 -- 172.21.15.27:0/2311224949 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ffb2c058c80 con 0x7ffb3006cc60 2023-07-05T23:33:20.559 INFO:teuthology.orchestra.run.smithi027.stdout:55834574858 2023-07-05T23:33:20.560 INFO:teuthology.orchestra.run.smithi027.stdout:55834574858 2023-07-05T23:33:20.561 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.559+0000 7fbd867fc700 1 -- 172.21.15.27:0/2415314235 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbd80059240 con 0x7fbd9015c720 2023-07-05T23:33:20.562 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.560+0000 7ffb37aed700 1 -- 172.21.15.27:0/2311224949 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7ffb1406adb0 msgr2=0x7ffb1406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:20.562 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.560+0000 7ffb37aed700 1 --2- 172.21.15.27:0/2311224949 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7ffb1406adb0 0x7ffb1406d260 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ffb3006ca40 tx=0x7ffb20008040 comp rx=0 tx=0).stop 2023-07-05T23:33:20.562 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.560+0000 7ffb37aed700 1 -- 172.21.15.27:0/2311224949 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffb3006cc60 msgr2=0x7ffb301581e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:20.562 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.560+0000 7ffb37aed700 1 --2- 172.21.15.27:0/2311224949 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffb3006cc60 0x7ffb301581e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ffb300ce470 tx=0x7ffb2c004750 comp rx=0 tx=0).stop 2023-07-05T23:33:20.563 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.561+0000 7fc43ff96700 1 -- 172.21.15.27:0/2855529858 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fc41c06adb0 msgr2=0x7fc41c06d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:20.563 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.561+0000 7fc43ff96700 1 --2- 172.21.15.27:0/2855529858 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fc41c06adb0 0x7fc41c06d260 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc4340085a0 tx=0x7fc43400d040 comp rx=0 tx=0).stop 2023-07-05T23:33:20.563 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.561+0000 7fc43ff96700 1 -- 172.21.15.27:0/2855529858 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc438159270 msgr2=0x7fc438157c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:20.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.561+0000 7fc43ff96700 1 --2- 172.21.15.27:0/2855529858 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc438159270 0x7fc438157c50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc42800c3e0 tx=0x7fc42800c6f0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.561+0000 7f6fa7a76700 1 -- 172.21.15.27:0/506626690 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6fa00c9cd0 con 0x7f6fa006cc60 2023-07-05T23:33:20.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.561+0000 7fc43ff96700 1 -- 172.21.15.27:0/2855529858 shutdown_connections 2023-07-05T23:33:20.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.561+0000 7fc43ff96700 1 --2- 172.21.15.27:0/2855529858 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc438159270 0x7fc438157c50 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.561+0000 7fc43ff96700 1 --2- 172.21.15.27:0/2855529858 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fc41c06adb0 0x7fc41c06d260 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.561+0000 7fc43ff96700 1 --2- 172.21.15.27:0/2855529858 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4380cba20 0x7fc4380c82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.561+0000 7fc43ff96700 1 --2- 172.21.15.27:0/2855529858 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc4380cc7a0 0x7fc4380c3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.561+0000 7fc43ff96700 1 -- 172.21.15.27:0/2855529858 >> 172.21.15.27:0/2855529858 conn(0x7fc4380b0260 msgr2=0x7fc43806d060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:20.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.561+0000 7fc43ff96700 1 -- 172.21.15.27:0/2855529858 shutdown_connections 2023-07-05T23:33:20.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.561+0000 7fc43ff96700 1 -- 172.21.15.27:0/2855529858 wait complete. 2023-07-05T23:33:20.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.562+0000 7ffb37aed700 1 -- 172.21.15.27:0/2311224949 shutdown_connections 2023-07-05T23:33:20.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.562+0000 7ffb37aed700 1 --2- 172.21.15.27:0/2311224949 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7ffb1406adb0 0x7ffb1406d260 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.562+0000 7ffb37aed700 1 --2- 172.21.15.27:0/2311224949 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffb30160590 0x7ffb3015e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.562+0000 7ffb37aed700 1 --2- 172.21.15.27:0/2311224949 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffb3006cc60 0x7ffb301581e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.562+0000 7ffb37aed700 1 --2- 172.21.15.27:0/2311224949 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb300c1800 0x7ffb301fe6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.562+0000 7ffb37aed700 1 -- 172.21.15.27:0/2311224949 >> 172.21.15.27:0/2311224949 conn(0x7ffb300b0ef0 msgr2=0x7ffb300b3a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:20.567 INFO:teuthology.orchestra.run.smithi027.stdout:55834574859 2023-07-05T23:33:20.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.562+0000 7f6f967fc700 1 -- 172.21.15.27:0/506626690 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6fa00c9cd0 con 0x7f6fa006cc60 2023-07-05T23:33:20.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.562+0000 7f47deffd700 1 -- 172.21.15.27:0/1539545725 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f47e8058390 con 0x7f47f00cc260 2023-07-05T23:33:20.569 INFO:teuthology.orchestra.run.smithi027.stdout:55834574858 2023-07-05T23:33:20.569 INFO:teuthology.orchestra.run.smithi027.stdout:55834574858 2023-07-05T23:33:20.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.562+0000 7f2f14df7700 1 -- 172.21.15.27:0/383013452 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f2f101ea900 con 0x7f2f100711f0 2023-07-05T23:33:20.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.563+0000 7ffb37aed700 1 -- 172.21.15.27:0/2311224949 shutdown_connections 2023-07-05T23:33:20.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.563+0000 7ffb37aed700 1 -- 172.21.15.27:0/2311224949 wait complete. 2023-07-05T23:33:20.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.563+0000 7f2efeffd700 1 -- 172.21.15.27:0/383013452 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2f00017020 con 0x7f2f100711f0 2023-07-05T23:33:20.571 INFO:teuthology.orchestra.run.smithi027.stdout:55834574859 2023-07-05T23:33:20.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.565+0000 7f6fa7a76700 1 -- 172.21.15.27:0/506626690 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f6f8406ace0 msgr2=0x7f6f8406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:20.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.565+0000 7f6fa7a76700 1 --2- 172.21.15.27:0/506626690 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f6f8406ace0 0x7f6f8406d190 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6f90000c00 tx=0x7f6f9001c040 comp rx=0 tx=0).stop 2023-07-05T23:33:20.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.565+0000 7f6fa7a76700 1 -- 172.21.15.27:0/506626690 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6fa006cc60 msgr2=0x7f6fa00b34d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:20.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.565+0000 7f6fa7a76700 1 --2- 172.21.15.27:0/506626690 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6fa006cc60 0x7f6fa00b34d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c00e810 tx=0x7f6f9c00eb20 comp rx=0 tx=0).stop 2023-07-05T23:33:20.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.565+0000 7f2e37d38700 1 -- 172.21.15.27:0/1054309608 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2e300afae0 con 0x7f2e30153d90 2023-07-05T23:33:20.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.565+0000 7f6fa7a76700 1 -- 172.21.15.27:0/506626690 shutdown_connections 2023-07-05T23:33:20.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.565+0000 7f6fa7a76700 1 --2- 172.21.15.27:0/506626690 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f6f8406ace0 0x7f6f8406d190 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.565+0000 7f6fa7a76700 1 --2- 172.21.15.27:0/506626690 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6fa0160590 0x7f6fa01580b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.565+0000 7f6fa7a76700 1 --2- 172.21.15.27:0/506626690 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6fa006cc60 0x7f6fa00b34d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.565+0000 7f6fa7a76700 1 --2- 172.21.15.27:0/506626690 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6fa00c1800 0x7f6fa0157b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.565+0000 7f6fa7a76700 1 -- 172.21.15.27:0/506626690 >> 172.21.15.27:0/506626690 conn(0x7f6fa00b0ef0 msgr2=0x7f6fa00af970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:20.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.565+0000 7f6fa7a76700 1 -- 172.21.15.27:0/506626690 shutdown_connections 2023-07-05T23:33:20.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.565+0000 7f47f4b45700 1 -- 172.21.15.27:0/1539545725 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f47d006ace0 msgr2=0x7f47d006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:20.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.565+0000 7f47f4b45700 1 --2- 172.21.15.27:0/1539545725 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f47d006ace0 0x7f47d006d190 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f47e00090b0 tx=0x7f47e0008030 comp rx=0 tx=0).stop 2023-07-05T23:33:20.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.565+0000 7f47f4b45700 1 -- 172.21.15.27:0/1539545725 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f47f00cc260 msgr2=0x7f47f00b1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:20.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.565+0000 7f47f4b45700 1 --2- 172.21.15.27:0/1539545725 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f47f00cc260 0x7f47f00b1560 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f47e8007e40 tx=0x7f47e800e3c0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.566+0000 7f47f4b45700 1 -- 172.21.15.27:0/1539545725 shutdown_connections 2023-07-05T23:33:20.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.566+0000 7f47f4b45700 1 --2- 172.21.15.27:0/1539545725 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f47d006ace0 0x7f47d006d190 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.566+0000 7f47f4b45700 1 --2- 172.21.15.27:0/1539545725 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f47f00cc260 0x7f47f00b1560 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.566+0000 7f47f4b45700 1 --2- 172.21.15.27:0/1539545725 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47f006c270 0x7f47f00c81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.566+0000 7f47f4b45700 1 --2- 172.21.15.27:0/1539545725 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47f00b0d40 0x7f47f01fe8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.566+0000 7f47f4b45700 1 -- 172.21.15.27:0/1539545725 >> 172.21.15.27:0/1539545725 conn(0x7f47f00b0260 msgr2=0x7f47f00af980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:20.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.566+0000 7f47f4b45700 1 -- 172.21.15.27:0/1539545725 shutdown_connections 2023-07-05T23:33:20.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.566+0000 7f47f4b45700 1 -- 172.21.15.27:0/1539545725 wait complete. 2023-07-05T23:33:20.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.567+0000 7f2f14df7700 1 -- 172.21.15.27:0/383013452 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f2ef006ad30 msgr2=0x7f2ef006d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:20.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.567+0000 7f2f14df7700 1 --2- 172.21.15.27:0/383013452 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f2ef006ad30 0x7f2ef006d1e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2f1006ada0 tx=0x7f2f04008040 comp rx=0 tx=0).stop 2023-07-05T23:33:20.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.567+0000 7f2f14df7700 1 -- 172.21.15.27:0/383013452 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2f100711f0 msgr2=0x7f2f101617e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:20.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.567+0000 7f2f14df7700 1 --2- 172.21.15.27:0/383013452 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2f100711f0 0x7f2f101617e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2f0000c430 tx=0x7f2f0000c7f0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.568+0000 7f6fa7a76700 1 -- 172.21.15.27:0/506626690 wait complete. 2023-07-05T23:33:20.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.568+0000 7fbd981a3700 1 -- 172.21.15.27:0/2415314235 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fbd7406ace0 msgr2=0x7fbd7406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:20.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.568+0000 7fbd981a3700 1 --2- 172.21.15.27:0/2415314235 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fbd7406ace0 0x7fbd7406d190 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbd880070b0 tx=0x7fbd88007040 comp rx=0 tx=0).stop 2023-07-05T23:33:20.579 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.568+0000 7fbd981a3700 1 -- 172.21.15.27:0/2415314235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd9015c720 msgr2=0x7fbd9014f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:20.579 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.568+0000 7fbd981a3700 1 --2- 172.21.15.27:0/2415314235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd9015c720 0x7fbd9014f890 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbd800090b0 tx=0x7fbd80004750 comp rx=0 tx=0).stop 2023-07-05T23:33:20.579 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.568+0000 7fbd981a3700 1 -- 172.21.15.27:0/2415314235 shutdown_connections 2023-07-05T23:33:20.579 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.568+0000 7fbd981a3700 1 --2- 172.21.15.27:0/2415314235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd9015c720 0x7fbd9014f890 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.579 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.568+0000 7fbd981a3700 1 --2- 172.21.15.27:0/2415314235 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fbd7406ace0 0x7fbd7406d190 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.579 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.568+0000 7fbd981a3700 1 --2- 172.21.15.27:0/2415314235 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbd900ccf90 0x7fbd900c4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.579 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.568+0000 7fbd981a3700 1 --2- 172.21.15.27:0/2415314235 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd90158850 0x7fbd900b3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.580 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.568+0000 7fbd981a3700 1 -- 172.21.15.27:0/2415314235 >> 172.21.15.27:0/2415314235 conn(0x7fbd900b1740 msgr2=0x7fbd9014c920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:20.580 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.570+0000 7f2f14df7700 1 -- 172.21.15.27:0/383013452 shutdown_connections 2023-07-05T23:33:20.580 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.570+0000 7f2f14df7700 1 --2- 172.21.15.27:0/383013452 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f100caf60 0x7f2f1006a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.580 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.570+0000 7f2f14df7700 1 --2- 172.21.15.27:0/383013452 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f2ef006ad30 0x7f2ef006d1e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.581 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.570+0000 7f2f14df7700 1 --2- 172.21.15.27:0/383013452 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2f100711f0 0x7f2f101617e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.581 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.570+0000 7f2f14df7700 1 --2- 172.21.15.27:0/383013452 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2f100cab90 0x7f2f10069fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.581 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.570+0000 7f2f14df7700 1 -- 172.21.15.27:0/383013452 >> 172.21.15.27:0/383013452 conn(0x7f2f100b1740 msgr2=0x7f2f10162480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:20.581 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.570+0000 7f2f14df7700 1 -- 172.21.15.27:0/383013452 shutdown_connections 2023-07-05T23:33:20.581 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.570+0000 7f2f14df7700 1 -- 172.21.15.27:0/383013452 wait complete. 2023-07-05T23:33:20.582 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.574+0000 7fbd981a3700 1 -- 172.21.15.27:0/2415314235 shutdown_connections 2023-07-05T23:33:20.582 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.574+0000 7fbd981a3700 1 -- 172.21.15.27:0/2415314235 wait complete. 2023-07-05T23:33:20.582 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.576+0000 7f2e267fc700 1 -- 172.21.15.27:0/1054309608 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2e28057c50 con 0x7f2e30153d90 2023-07-05T23:33:20.587 INFO:teuthology.orchestra.run.smithi027.stdout:55834574858 2023-07-05T23:33:20.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.582+0000 7f7fc3993700 1 -- 172.21.15.27:0/2743461301 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f7fbc0ce3f0 con 0x7f7fbc06d320 2023-07-05T23:33:20.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.583+0000 7f7fb1ffb700 1 -- 172.21.15.27:0/2743461301 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7fbc0ce3f0 con 0x7f7fbc06d320 2023-07-05T23:33:20.589 INFO:teuthology.orchestra.run.smithi027.stdout:55834574858 2023-07-05T23:33:20.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.585+0000 7f2e37d38700 1 -- 172.21.15.27:0/1054309608 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f2e1406ace0 msgr2=0x7f2e1406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:20.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.585+0000 7f2e37d38700 1 --2- 172.21.15.27:0/1054309608 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f2e1406ace0 0x7f2e1406d190 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c001290 tx=0x7f2e2c009040 comp rx=0 tx=0).stop 2023-07-05T23:33:20.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.585+0000 7f2e37d38700 1 -- 172.21.15.27:0/1054309608 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2e30153d90 msgr2=0x7f2e30154200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:20.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.585+0000 7f2e37d38700 1 --2- 172.21.15.27:0/1054309608 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2e30153d90 0x7f2e30154200 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2e3006fda0 tx=0x7f2e28007e70 comp rx=0 tx=0).stop 2023-07-05T23:33:20.591 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.587+0000 7f7fc3993700 1 -- 172.21.15.27:0/2743461301 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f7fa006adb0 msgr2=0x7f7fa006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:20.591 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.587+0000 7f7fc3993700 1 --2- 172.21.15.27:0/2743461301 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f7fa006adb0 0x7f7fa006d260 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7fb8009fd0 tx=0x7f7fb8008030 comp rx=0 tx=0).stop 2023-07-05T23:33:20.592 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.587+0000 7f7fc3993700 1 -- 172.21.15.27:0/2743461301 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7fbc06d320 msgr2=0x7f7fbc203540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:20.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.587+0000 7f7fc3993700 1 --2- 172.21.15.27:0/2743461301 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7fbc06d320 0x7f7fbc203540 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7fb400caa0 tx=0x7f7fb400cdb0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.587+0000 7f7fc3993700 1 -- 172.21.15.27:0/2743461301 shutdown_connections 2023-07-05T23:33:20.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.587+0000 7f7fc3993700 1 --2- 172.21.15.27:0/2743461301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fbc0893f0 0x7f7fbc0ca9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.587+0000 7f7fc3993700 1 --2- 172.21.15.27:0/2743461301 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f7fa006adb0 0x7f7fa006d260 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.587+0000 7f7fc3993700 1 --2- 172.21.15.27:0/2743461301 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7fbc06d320 0x7f7fbc203540 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.587+0000 7f7fc3993700 1 --2- 172.21.15.27:0/2743461301 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7fbc089940 0x7f7fbc06cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.588+0000 7f7fc3993700 1 -- 172.21.15.27:0/2743461301 >> 172.21.15.27:0/2743461301 conn(0x7f7fbc0b0260 msgr2=0x7f7fbc15e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:20.595 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.5 2023-07-05T23:33:20.597 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.1 2023-07-05T23:33:20.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.589+0000 7f2e37d38700 1 -- 172.21.15.27:0/1054309608 shutdown_connections 2023-07-05T23:33:20.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.589+0000 7f2e37d38700 1 --2- 172.21.15.27:0/1054309608 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f2e1406ace0 0x7f2e1406d190 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.589+0000 7f2e37d38700 1 --2- 172.21.15.27:0/1054309608 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2e30153d90 0x7f2e30154200 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.589+0000 7f2e37d38700 1 --2- 172.21.15.27:0/1054309608 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2e1c006a60 0x7f2e300c6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.589+0000 7f2e37d38700 1 --2- 172.21.15.27:0/1054309608 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e30144b40 0x7f2e3015bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:20.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.589+0000 7f2e37d38700 1 -- 172.21.15.27:0/1054309608 >> 172.21.15.27:0/1054309608 conn(0x7f2e3006d4a0 msgr2=0x7f2e30158540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:20.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.589+0000 7f7fc3993700 1 -- 172.21.15.27:0/2743461301 shutdown_connections 2023-07-05T23:33:20.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.589+0000 7f2e37d38700 1 -- 172.21.15.27:0/1054309608 shutdown_connections 2023-07-05T23:33:20.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.589+0000 7f2e37d38700 1 -- 172.21.15.27:0/1054309608 wait complete. 2023-07-05T23:33:20.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:20.589+0000 7f7fc3993700 1 -- 172.21.15.27:0/2743461301 wait complete. 2023-07-05T23:33:20.602 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.6 2023-07-05T23:33:20.603 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.0 2023-07-05T23:33:20.604 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574859 for osd.4 2023-07-05T23:33:20.605 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574859 for osd.2 2023-07-05T23:33:20.607 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.3 2023-07-05T23:33:20.609 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.7 2023-07-05T23:33:21.560 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:33:21.564 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:33:21.597 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-07-05T23:33:21.598 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-07-05T23:33:21.602 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-07-05T23:33:21.604 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-07-05T23:33:21.604 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-07-05T23:33:21.605 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-07-05T23:33:21.608 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-07-05T23:33:21.609 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-07-05T23:33:21.845 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.836+0000 7f8031c7c700 1 Processor -- start 2023-07-05T23:33:21.846 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.836+0000 7f8031c7c700 1 -- start start 2023-07-05T23:33:21.846 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.837+0000 7f8031c7c700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f802c0cd830 0x7f802c160340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:21.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.837+0000 7f8031c7c700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f802c1610a0 con 0x7f802c15c570 2023-07-05T23:33:21.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.837+0000 7f8031c7c700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f802c15da90 con 0x7f802c160880 2023-07-05T23:33:21.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.837+0000 7f8031c7c700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f802c15d670 con 0x7f802c0cd830 2023-07-05T23:33:21.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.837+0000 7f802affd700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f802c0cd830 0x7f802c160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:21.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.837+0000 7f802bfff700 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f802c160880 0x7f802c0d0bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.27:33618/0 (socket says 172.21.15.27:33618) 2023-07-05T23:33:21.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.837+0000 7f802affd700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f802c0cd830 0x7f802c160340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.27:43420/0 (socket says 172.21.15.27:43420) 2023-07-05T23:33:21.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.837+0000 7f802bfff700 1 -- 172.21.15.27:0/3997775769 learned_addr learned my addr 172.21.15.27:0/3997775769 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-07-05T23:33:21.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.838+0000 7f802affd700 1 -- 172.21.15.27:0/3997775769 >> v1:172.21.15.162:6789/0 conn(0x7f802c160880 legacy=0x7f802c0d0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:21.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.838+0000 7f802affd700 1 -- 172.21.15.27:0/3997775769 >> v1:172.21.15.27:6789/0 conn(0x7f802c15c570 legacy=0x7f802c0cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:21.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.838+0000 7f802affd700 1 -- 172.21.15.27:0/3997775769 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f802c15ccd0 con 0x7f802c0cd830 2023-07-05T23:33:21.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.838+0000 7f3cdbc64700 1 Processor -- start 2023-07-05T23:33:21.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.838+0000 7f3cdbc64700 1 -- start start 2023-07-05T23:33:21.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.838+0000 7f5409a4f700 1 Processor -- start 2023-07-05T23:33:21.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.838+0000 7f5409a4f700 1 -- start start 2023-07-05T23:33:21.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.839+0000 7f802affd700 1 --2- 172.21.15.27:0/3997775769 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f802c0cd830 0x7f802c160340 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f801c009840 tx=0x7f801c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25a3961e171b6894 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:21.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.839+0000 7fa02e2d7700 1 Processor -- start 2023-07-05T23:33:21.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.840+0000 7f3cdbc64700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f3cd406e3d0 0x7f3cd4158f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:21.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.840+0000 7f3cdbc64700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cd415cd80 con 0x7f3cd4069ef0 2023-07-05T23:33:21.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.840+0000 7f3cdbc64700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cd415bfe0 con 0x7f3cd40cc970 2023-07-05T23:33:21.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.840+0000 7f3cdbc64700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cd40cce40 con 0x7f3cd406e3d0 2023-07-05T23:33:21.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.840+0000 7f3cda201700 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f3cd40cc970 0x7f3cd406c270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.27:33630/0 (socket says 172.21.15.27:33630) 2023-07-05T23:33:21.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.840+0000 7f3cda201700 1 -- 172.21.15.27:0/1805981913 learned_addr learned my addr 172.21.15.27:0/1805981913 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-07-05T23:33:21.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.840+0000 7fb213ada700 1 Processor -- start 2023-07-05T23:33:21.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.840+0000 7f3cd89fe700 1 -- 172.21.15.27:0/1805981913 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 440004847 0 0) 0x7f3cd415bfe0 con 0x7f3cd40cc970 2023-07-05T23:33:21.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.840+0000 7f3cd89fe700 1 -- 172.21.15.27:0/1805981913 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3cc00035b0 con 0x7f3cd40cc970 2023-07-05T23:33:21.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.839+0000 7f5409a4f700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f54040c18c0 0x7f540406a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:21.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.839+0000 7f5409a4f700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f54040cb350 0x7f54040cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:21.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.839+0000 7f5409a4f700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f540406d280 con 0x7f54041605d0 2023-07-05T23:33:21.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.839+0000 7f5409a4f700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54041648e0 con 0x7f54040c18c0 2023-07-05T23:33:21.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.839+0000 7f5409a4f700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54040cbd10 con 0x7f54040cb350 2023-07-05T23:33:21.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.839+0000 7f802a7fc700 1 -- 172.21.15.27:0/3997775769 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801c011830 con 0x7f802c0cd830 2023-07-05T23:33:21.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.839+0000 7f802a7fc700 1 -- 172.21.15.27:0/3997775769 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f801c011990 con 0x7f802c0cd830 2023-07-05T23:33:21.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.839+0000 7f802a7fc700 1 -- 172.21.15.27:0/3997775769 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801c011d00 con 0x7f802c0cd830 2023-07-05T23:33:21.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.841+0000 7f5402ffd700 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f54041605d0 0x7f54041641d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.27:33622/0 (socket says 172.21.15.27:33622) 2023-07-05T23:33:21.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.841+0000 7f5402ffd700 1 -- 172.21.15.27:0/4079068186 learned_addr learned my addr 172.21.15.27:0/4079068186 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-07-05T23:33:21.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.841+0000 7f54037fe700 1 --2- 172.21.15.27:0/4079068186 >> v2:172.21.15.162:3300/0 conn(0x7f54040cb350 0x7f54040cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:21.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.841+0000 7f8031c7c700 1 -- 172.21.15.27:0/3997775769 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f802c0cd830 msgr2=0x7f802c160340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:21.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.841+0000 7f8031c7c700 1 --2- 172.21.15.27:0/3997775769 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f802c0cd830 0x7f802c160340 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f801c009840 tx=0x7f801c009b50 comp rx=0 tx=0).stop 2023-07-05T23:33:21.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.841+0000 7fb213ada700 1 -- start start 2023-07-05T23:33:21.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.841+0000 7f5401ffb700 1 -- 172.21.15.27:0/4079068186 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3127615946 0 0) 0x7f540406d280 con 0x7f54041605d0 2023-07-05T23:33:21.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.841+0000 7f5401ffb700 1 -- 172.21.15.27:0/4079068186 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53ec0035b0 con 0x7f54041605d0 2023-07-05T23:33:21.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.841+0000 7f54027fc700 1 --2- 172.21.15.27:0/4079068186 >> v2:172.21.15.27:3300/0 conn(0x7f54040c18c0 0x7f540406a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:21.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.842+0000 7f8031c7c700 1 -- 172.21.15.27:0/3997775769 shutdown_connections 2023-07-05T23:33:21.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.842+0000 7f8031c7c700 1 --2- 172.21.15.27:0/3997775769 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f802c0cd830 0x7f802c160340 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:21.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.842+0000 7f8031c7c700 1 -- 172.21.15.27:0/3997775769 >> 172.21.15.27:0/3997775769 conn(0x7f802c071620 msgr2=0x7f802c0719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:21.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.842+0000 7f8031c7c700 1 -- 172.21.15.27:0/3997775769 shutdown_connections 2023-07-05T23:33:21.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.840+0000 7fa02e2d7700 1 -- start start 2023-07-05T23:33:21.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.841+0000 7fa02e2d7700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa0280cbbf0 0x7fa0280cc260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:21.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.841+0000 7fa02e2d7700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa0280cc7a0 0x7fa02806c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:21.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.841+0000 7fa02e2d7700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa02815bd30 con 0x7fa028159270 2023-07-05T23:33:21.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.841+0000 7fa02e2d7700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0281586a0 con 0x7fa0280cbbf0 2023-07-05T23:33:21.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.841+0000 7fa02e2d7700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa028159640 con 0x7fa0280cc7a0 2023-07-05T23:33:21.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.842+0000 7fa0277fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa0280cbbf0 0x7fa0280cc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:21.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.842+0000 7fa0277fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa0280cbbf0 0x7fa0280cc260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45504/0 (socket says 172.21.15.27:45504) 2023-07-05T23:33:21.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.842+0000 7fa0277fe700 1 -- 172.21.15.27:0/3298532065 learned_addr learned my addr 172.21.15.27:0/3298532065 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:21.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.841+0000 7f3cd89fe700 1 -- 172.21.15.27:0/1805981913 <== mon.1 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1395035681 0 0) 0x7f3cc00035b0 con 0x7f3cd40cc970 2023-07-05T23:33:21.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.841+0000 7f3cd89fe700 1 -- 172.21.15.27:0/1805981913 >> v2:172.21.15.27:3300/0 conn(0x7f3cd406e3d0 msgr2=0x7f3cd4158f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:21.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.841+0000 7f3cd89fe700 1 --2- 172.21.15.27:0/1805981913 >> v2:172.21.15.27:3300/0 conn(0x7f3cd406e3d0 0x7f3cd4158f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:21.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.841+0000 7f3cd89fe700 1 -- 172.21.15.27:0/1805981913 >> v1:172.21.15.27:6789/0 conn(0x7f3cd4069ef0 legacy=0x7f3cd40cc260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:21.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.841+0000 7f3cd89fe700 1 -- 172.21.15.27:0/1805981913 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd415f150 con 0x7f3cd40cc970 2023-07-05T23:33:21.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.841+0000 7f3cd89fe700 1 -- 172.21.15.27:0/1805981913 <== mon.1 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1246168953 0 0) 0x7f3ccc0019f0 con 0x7f3cd40cc970 2023-07-05T23:33:21.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.841+0000 7f3cd89fe700 1 -- 172.21.15.27:0/1805981913 >> v1:172.21.15.162:6789/0 conn(0x7f3cd40cc970 legacy=0x7f3cd406c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:21.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.841+0000 7f3cd89fe700 1 --2- 172.21.15.27:0/1805981913 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3cc0003a00 0x7f3cc0003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:21.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.841+0000 7f3cd89fe700 1 --2- 172.21.15.27:0/1805981913 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3cc0004850 0x7f3cc0004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:21.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.841+0000 7f3cd89fe700 1 --2- 172.21.15.27:0/1805981913 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3cc0005320 0x7f3cc000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:21.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.841+0000 7f3cd89fe700 1 -- 172.21.15.27:0/1805981913 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc000c1a0 con 0x7f3cc0003a00 2023-07-05T23:33:21.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.841+0000 7f3cd89fe700 1 -- 172.21.15.27:0/1805981913 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc000c310 con 0x7f3cc0005320 2023-07-05T23:33:21.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.841+0000 7f3cd89fe700 1 -- 172.21.15.27:0/1805981913 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc000c4d0 con 0x7f3cc0004850 2023-07-05T23:33:21.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.842+0000 7f3cda201700 1 --2- 172.21.15.27:0/1805981913 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3cc0005320 0x7f3cc000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:21.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.842+0000 7f3cda201700 1 -- 172.21.15.27:0/1805981913 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3cc0004850 msgr2=0x7f3cc0004cc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-05T23:33:21.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.842+0000 7f3cda201700 1 --2- 172.21.15.27:0/1805981913 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3cc0004850 0x7f3cc0004cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:21.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.842+0000 7f3cda201700 1 -- 172.21.15.27:0/1805981913 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3cc0003a00 msgr2=0x7f3cc0003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:21.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.842+0000 7f3cda201700 1 --2- 172.21.15.27:0/1805981913 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3cc0003a00 0x7f3cc0003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:21.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.842+0000 7f3cda201700 1 -- 172.21.15.27:0/1805981913 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd415f150 con 0x7f3cc0005320 2023-07-05T23:33:21.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.842+0000 7f3cda201700 1 -- 172.21.15.27:0/1805981913 reap_dead start 2023-07-05T23:33:21.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.842+0000 7fb213ada700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb20c06b910 0x7fb20c16b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:21.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.842+0000 7fb213ada700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb20c0b4dc0 con 0x7fb20c0d0e70 2023-07-05T23:33:21.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.842+0000 7fb213ada700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb20c0b50a0 con 0x7fb20c1607f0 2023-07-05T23:33:21.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.842+0000 7fb213ada700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb20c0b5380 con 0x7fb20c06b910 2023-07-05T23:33:21.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.842+0000 7f54037fe700 1 -- 172.21.15.27:0/4079068186 >> v2:172.21.15.27:3300/0 conn(0x7f54040c18c0 msgr2=0x7f540406a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:21.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.842+0000 7f54037fe700 1 --2- 172.21.15.27:0/4079068186 >> v2:172.21.15.27:3300/0 conn(0x7f54040c18c0 0x7f540406a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:21.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.842+0000 7f54037fe700 1 -- 172.21.15.27:0/4079068186 >> v1:172.21.15.162:6789/0 conn(0x7f54041605d0 legacy=0x7f54041641d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:21.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.842+0000 7f54037fe700 1 -- 172.21.15.27:0/4079068186 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54040cdd50 con 0x7f54040cb350 2023-07-05T23:33:21.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.842+0000 7fa02c874700 1 --2- 172.21.15.27:0/3298532065 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa0280cc7a0 0x7fa02806c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:21.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.843+0000 7f3cda201700 1 --2- 172.21.15.27:0/1805981913 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3cc0005320 0x7f3cc000ba10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3cd4071730 tx=0x7f3cc0005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=983973ce66e08ce1 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:21.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.843+0000 7f54037fe700 1 --2- 172.21.15.27:0/4079068186 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54040cb350 0x7f54040cb7d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f54040cca60 tx=0x7f53f8009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3dce223a594e228 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:21.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.843+0000 7fb211075700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fb20c0d0e70 0x7fb20c06b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:52678/0 (socket says 172.21.15.27:52678) 2023-07-05T23:33:21.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.843+0000 7fb211075700 1 -- 172.21.15.27:0/3196534515 learned_addr learned my addr 172.21.15.27:0/3196534515 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-07-05T23:33:21.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.843+0000 7f5401ffb700 1 -- 172.21.15.27:0/4079068186 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f8011830 con 0x7f54040cb350 2023-07-05T23:33:21.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.843+0000 7fa0277fe700 1 -- 172.21.15.27:0/3298532065 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa0280cc7a0 msgr2=0x7fa02806c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:21.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.843+0000 7fa0277fe700 1 --2- 172.21.15.27:0/3298532065 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa0280cc7a0 0x7fa02806c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:21.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.843+0000 7fa0277fe700 1 -- 172.21.15.27:0/3298532065 >> v1:172.21.15.27:6789/0 conn(0x7fa028159270 legacy=0x7fa0280cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:21.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.843+0000 7fa0277fe700 1 -- 172.21.15.27:0/3298532065 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0280ccbe0 con 0x7fa0280cbbf0 2023-07-05T23:33:21.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.843+0000 7f5401ffb700 1 -- 172.21.15.27:0/4079068186 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53f8011990 con 0x7f54040cb350 2023-07-05T23:33:21.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.843+0000 7f5401ffb700 1 -- 172.21.15.27:0/4079068186 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f8011d20 con 0x7f54040cb350 2023-07-05T23:33:21.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.843+0000 7fa0277fe700 1 --2- 172.21.15.27:0/3298532065 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa0280cbbf0 0x7fa0280cc260 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa0180088f0 tx=0x7fa01800d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f903deecf6358912 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:21.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.843+0000 7f3cd89fe700 1 -- 172.21.15.27:0/1805981913 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ccc00a340 con 0x7f3cc0005320 2023-07-05T23:33:21.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.843+0000 7f3cd89fe700 1 -- 172.21.15.27:0/1805981913 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ccc012620 con 0x7f3cc0005320 2023-07-05T23:33:21.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.843+0000 7f3cd89fe700 1 -- 172.21.15.27:0/1805981913 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ccc0129d0 con 0x7f3cc0005320 2023-07-05T23:33:21.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.842+0000 7f8031c7c700 1 -- 172.21.15.27:0/3997775769 wait complete. 2023-07-05T23:33:21.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.844+0000 7f3cdbc64700 1 -- 172.21.15.27:0/1805981913 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3cc0005320 msgr2=0x7f3cc000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:21.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.844+0000 7f3cdbc64700 1 --2- 172.21.15.27:0/1805981913 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3cc0005320 0x7f3cc000ba10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3cd4071730 tx=0x7f3cc0005880 comp rx=0 tx=0).stop 2023-07-05T23:33:21.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.844+0000 7f8031c7c700 1 Processor -- start 2023-07-05T23:33:21.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.844+0000 7fb212077700 1 --2- 172.21.15.27:0/3196534515 >> v2:172.21.15.162:3300/0 conn(0x7fb20c06b910 0x7fb20c16b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:21.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.844+0000 7fa026ffd700 1 -- 172.21.15.27:0/3298532065 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa018010070 con 0x7fa0280cbbf0 2023-07-05T23:33:21.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.844+0000 7f3cdbc64700 1 -- 172.21.15.27:0/1805981913 shutdown_connections 2023-07-05T23:33:21.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.844+0000 7f3cdbc64700 1 --2- 172.21.15.27:0/1805981913 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3cc0005320 0x7f3cc000ba10 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:21.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.844+0000 7f3cdbc64700 1 -- 172.21.15.27:0/1805981913 >> 172.21.15.27:0/1805981913 conn(0x7f3cd40b0ef0 msgr2=0x7f3cd40ce690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:21.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.844+0000 7f5409a4f700 1 -- 172.21.15.27:0/4079068186 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54040cb350 msgr2=0x7f54040cb7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:21.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.844+0000 7f5409a4f700 1 --2- 172.21.15.27:0/4079068186 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54040cb350 0x7f54040cb7d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f54040cca60 tx=0x7f53f8009b20 comp rx=0 tx=0).stop 2023-07-05T23:33:21.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.844+0000 7fa026ffd700 1 -- 172.21.15.27:0/3298532065 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa01800d990 con 0x7fa0280cbbf0 2023-07-05T23:33:21.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.844+0000 7fa026ffd700 1 -- 172.21.15.27:0/3298532065 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa01800dd20 con 0x7fa0280cbbf0 2023-07-05T23:33:21.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.844+0000 7f2905a3d700 1 Processor -- start 2023-07-05T23:33:21.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.844+0000 7f8031c7c700 1 -- start start 2023-07-05T23:33:21.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.844+0000 7f2905a3d700 1 -- start start 2023-07-05T23:33:21.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.845+0000 7fabf6e52700 1 Processor -- start 2023-07-05T23:33:21.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.845+0000 7fb212077700 1 -- 172.21.15.27:0/3196534515 >> v1:172.21.15.162:6789/0 conn(0x7fb20c1607f0 legacy=0x7fb20c0b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:21.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.845+0000 7fb212077700 1 -- 172.21.15.27:0/3196534515 >> v1:172.21.15.27:6789/0 conn(0x7fb20c0d0e70 legacy=0x7fb20c06b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:21.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.845+0000 7fb212077700 1 -- 172.21.15.27:0/3196534515 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb20c0b67a0 con 0x7fb20c06b910 2023-07-05T23:33:21.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.845+0000 7fa02e2d7700 1 -- 172.21.15.27:0/3298532065 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa0280cbbf0 msgr2=0x7fa0280cc260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:21.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.845+0000 7fa02e2d7700 1 --2- 172.21.15.27:0/3298532065 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa0280cbbf0 0x7fa0280cc260 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa0180088f0 tx=0x7fa01800d330 comp rx=0 tx=0).stop 2023-07-05T23:33:21.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.846+0000 7fa02e2d7700 1 -- 172.21.15.27:0/3298532065 shutdown_connections 2023-07-05T23:33:21.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.846+0000 7fa02e2d7700 1 --2- 172.21.15.27:0/3298532065 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa0280cc7a0 0x7fa02806c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:21.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.846+0000 7fa02e2d7700 1 --2- 172.21.15.27:0/3298532065 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa0280cbbf0 0x7fa0280cc260 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:21.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.846+0000 7fa02e2d7700 1 -- 172.21.15.27:0/3298532065 >> 172.21.15.27:0/3298532065 conn(0x7fa0280b0260 msgr2=0x7fa0280b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:21.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.846+0000 7f8031c7c700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f802c0cd830 0x7f802c0c65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:21.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.846+0000 7f8031c7c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f802c15c570 0x7f802c0b3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:21.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.846+0000 7f8031c7c700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f802c160880 0x7f802c0b63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:21.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.846+0000 7f8031c7c700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f802c15b6b0 con 0x7f802c15c570 2023-07-05T23:33:21.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.846+0000 7f8031c7c700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f802c0c9430 con 0x7f802c0cd830 2023-07-05T23:33:21.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.846+0000 7f8031c7c700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f802c0b8460 con 0x7f802c160880 2023-07-05T23:33:21.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.846+0000 7fa02e2d7700 1 -- 172.21.15.27:0/3298532065 shutdown_connections 2023-07-05T23:33:21.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.845+0000 7fabf6e52700 1 -- start start 2023-07-05T23:33:21.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.846+0000 7fa02e2d7700 1 -- 172.21.15.27:0/3298532065 wait complete. 2023-07-05T23:33:21.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.845+0000 7f5409a4f700 1 -- 172.21.15.27:0/4079068186 shutdown_connections 2023-07-05T23:33:21.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.845+0000 7f5409a4f700 1 --2- 172.21.15.27:0/4079068186 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54040cb350 0x7f54040cb7d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:21.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.845+0000 7f5409a4f700 1 --2- 172.21.15.27:0/4079068186 >> v2:172.21.15.27:3300/0 conn(0x7f54040c18c0 0x7f540406a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:21.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.845+0000 7f5409a4f700 1 -- 172.21.15.27:0/4079068186 >> 172.21.15.27:0/4079068186 conn(0x7f54040b0260 msgr2=0x7f54040b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:21.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.846+0000 7f5409a4f700 1 -- 172.21.15.27:0/4079068186 shutdown_connections 2023-07-05T23:33:21.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.846+0000 7f5409a4f700 1 -- 172.21.15.27:0/4079068186 wait complete. 2023-07-05T23:33:21.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.846+0000 7fb212077700 1 --2- 172.21.15.27:0/3196534515 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb20c06b910 0x7fb20c16b4f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb204009dc0 tx=0x7fb20400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4bbcfb18991f72de server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:21.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.846+0000 7f802b7fe700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f802c0cd830 0x7f802c0c65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:21.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.846+0000 7f802bfff700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f802c160880 0x7f802c0b63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:21.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.846+0000 7f2905a3d700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f29000b0d40 0x7f2900159270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:21.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.846+0000 7f2905a3d700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29000cc970 0x7f29000cb980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:21.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.846+0000 7f2905a3d700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f290015bd30 con 0x7f29000cb4e0 2023-07-05T23:33:21.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.846+0000 7f2905a3d700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29001586a0 con 0x7f29000b0d40 2023-07-05T23:33:21.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.846+0000 7f2905a3d700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29000cbec0 con 0x7f29000cc970 2023-07-05T23:33:21.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.846+0000 7f3cdbc64700 1 -- 172.21.15.27:0/1805981913 shutdown_connections 2023-07-05T23:33:21.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.846+0000 7f802b7fe700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f802c0cd830 0x7f802c0c65e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.27:43454/0 (socket says 172.21.15.27:43454) 2023-07-05T23:33:21.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.846+0000 7f802b7fe700 1 -- 172.21.15.27:0/4099667787 learned_addr learned my addr 172.21.15.27:0/4099667787 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:21.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.846+0000 7f802affd700 1 --2- 172.21.15.27:0/4099667787 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f802c15c570 0x7f802c0b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:21.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.846+0000 7f28ff7fe700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29000cc970 0x7f29000cb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:21.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.846+0000 7f28ff7fe700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29000cc970 0x7f29000cb980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.27:45558/0 (socket says 172.21.15.27:45558) 2023-07-05T23:33:21.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.846+0000 7f28ff7fe700 1 -- 172.21.15.27:0/824345358 learned_addr learned my addr 172.21.15.27:0/824345358 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:21.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.847+0000 7f802affd700 1 -- 172.21.15.27:0/4099667787 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f802c160880 msgr2=0x7f802c0b63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:21.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.847+0000 7f802affd700 1 --2- 172.21.15.27:0/4099667787 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f802c160880 0x7f802c0b63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:21.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.847+0000 7f802affd700 1 -- 172.21.15.27:0/4099667787 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f802c0cd830 msgr2=0x7f802c0c65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:21.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.847+0000 7f802affd700 1 --2- 172.21.15.27:0/4099667787 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f802c0cd830 0x7f802c0c65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:21.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.847+0000 7f802affd700 1 -- 172.21.15.27:0/4099667787 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f801c0094a0 con 0x7f802c15c570 2023-07-05T23:33:21.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.847+0000 7f802affd700 1 --2- 172.21.15.27:0/4099667787 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f802c15c570 0x7f802c0b3880 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f801c016000 tx=0x7f801c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:21.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.847+0000 7f28ff7fe700 1 -- 172.21.15.27:0/824345358 >> v2:172.21.15.162:3300/0 conn(0x7f29000b0d40 msgr2=0x7f2900159270 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-05T23:33:21.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.847+0000 7f28ff7fe700 1 --2- 172.21.15.27:0/824345358 >> v2:172.21.15.162:3300/0 conn(0x7f29000b0d40 0x7f2900159270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:21.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.847+0000 7f28ff7fe700 1 -- 172.21.15.27:0/824345358 >> v1:172.21.15.27:6789/0 conn(0x7f29000cb4e0 legacy=0x7f29000cc260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:21.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.847+0000 7f28ff7fe700 1 -- 172.21.15.27:0/824345358 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f290015bfd0 con 0x7f29000cc970 2023-07-05T23:33:21.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.847+0000 7f28ff7fe700 1 --2- 172.21.15.27:0/824345358 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29000cc970 0x7f29000cb980 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f28f8009e50 tx=0x7f28f800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8478f098ae15e902 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:21.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.847+0000 7f8013fff700 1 -- 172.21.15.27:0/4099667787 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801c0036a0 con 0x7f802c15c570 2023-07-05T23:33:21.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.848+0000 7f8013fff700 1 -- 172.21.15.27:0/4099667787 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f801c01f070 con 0x7f802c15c570 2023-07-05T23:33:21.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.848+0000 7f8013fff700 1 -- 172.21.15.27:0/4099667787 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801c003a40 con 0x7f802c15c570 2023-07-05T23:33:21.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.848+0000 7f5409a4f700 1 Processor -- start 2023-07-05T23:33:21.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.848+0000 7fa02e2d7700 1 Processor -- start 2023-07-05T23:33:21.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.848+0000 7fa02e2d7700 1 -- start start 2023-07-05T23:33:21.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.846+0000 7f3cdbc64700 1 -- 172.21.15.27:0/1805981913 wait complete. 2023-07-05T23:33:21.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.848+0000 7f3cdbc64700 1 Processor -- start 2023-07-05T23:33:21.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.848+0000 7f5409a4f700 1 -- start start 2023-07-05T23:33:21.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.849+0000 7f5409a4f700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54040cb350 0x7f54041eaa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:21.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.849+0000 7f5409a4f700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54041605d0 0x7f54040c41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:21.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.849+0000 7f5409a4f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f54041ec4f0 0x7f54040c2d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:21.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.849+0000 7f5409a4f700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54040c1ca0 con 0x7f54041ec4f0 2023-07-05T23:33:21.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.849+0000 7f5409a4f700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54040c1f80 con 0x7f54041605d0 2023-07-05T23:33:21.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.849+0000 7f5409a4f700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54040c2260 con 0x7f54040cb350 2023-07-05T23:33:21.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.849+0000 7f5402ffd700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54040cb350 0x7f54041eaa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:21.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.848+0000 7f8031c7c700 1 -- 172.21.15.27:0/4099667787 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f802c0b8740 con 0x7f802c15c570 2023-07-05T23:33:21.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.848+0000 7f8031c7c700 1 -- 172.21.15.27:0/4099667787 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f802c0c6b20 con 0x7f802c15c570 2023-07-05T23:33:21.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.849+0000 7fa02e2d7700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa0280cbbf0 0x7fa028143930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:21.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.849+0000 7fa02e2d7700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa0280cc7a0 0x7fa0280c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:21.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.849+0000 7fa02e2d7700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa028159270 0x7fa0280c7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:21.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.848+0000 7f3cdbc64700 1 -- start start 2023-07-05T23:33:21.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.849+0000 7f3cdbc64700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3cc0005320 0x7f3cd415d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:21.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.849+0000 7f3cdbc64700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3cd415e0d0 0x7f3cd41fe190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:21.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.849+0000 7f3cdbc64700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3cd40c3e00 0x7f3cd415a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:21.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.849+0000 7f3cdbc64700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd40c3970 con 0x7f3cd40c3e00 2023-07-05T23:33:21.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.849+0000 7f3cdbc64700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd40c3360 con 0x7f3cd415e0d0 2023-07-05T23:33:21.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.849+0000 7f3cdbc64700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd415e820 con 0x7f3cc0005320 2023-07-05T23:33:21.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.849+0000 7f3cda201700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3cd40c3e00 0x7f3cd415a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:21.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.849+0000 7f3cd9a00700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3cc0005320 0x7f3cd415d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:21.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.849+0000 7f3cd9a00700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3cc0005320 0x7f3cd415d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.27:45568/0 (socket says 172.21.15.27:45568) 2023-07-05T23:33:21.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.849+0000 7f3cd9a00700 1 -- 172.21.15.27:0/1491887486 learned_addr learned my addr 172.21.15.27:0/1491887486 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:21.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.848+0000 7fabf6e52700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fabf015c1e0 0x7fabf015c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:21.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.848+0000 7fabf6e52700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fabf006a890 0x7fabf006ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:21.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.848+0000 7fabf6e52700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabf015cc30 con 0x7fabf0158850 2023-07-05T23:33:21.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.848+0000 7fabf6e52700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabf015d1f0 con 0x7fabf006a890 2023-07-05T23:33:21.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.848+0000 7fabf6e52700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabf00662a0 con 0x7fabf015c1e0 2023-07-05T23:33:21.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.848+0000 7fabf53ef700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fabf006a890 0x7fabf006ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:21.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.849+0000 7fabf53ef700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fabf006a890 0x7fabf006ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.27:43468/0 (socket says 172.21.15.27:43468) 2023-07-05T23:33:21.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.849+0000 7fabf53ef700 1 -- 172.21.15.27:0/1515870473 learned_addr learned my addr 172.21.15.27:0/1515870473 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:21.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.849+0000 7fabf53ef700 1 -- 172.21.15.27:0/1515870473 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fabf015c1e0 msgr2=0x7fabf015c650 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-05T23:33:21.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.849+0000 7fabf53ef700 1 --2- 172.21.15.27:0/1515870473 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fabf015c1e0 0x7fabf015c650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:21.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.849+0000 7fabf53ef700 1 -- 172.21.15.27:0/1515870473 >> v1:172.21.15.27:6789/0 conn(0x7fabf0158850 legacy=0x7fabf0065b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:21.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.849+0000 7fabf53ef700 1 -- 172.21.15.27:0/1515870473 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf015cf10 con 0x7fabf006a890 2023-07-05T23:33:21.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.850+0000 7f5402ffd700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54040cb350 0x7f54041eaa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.27:45574/0 (socket says 172.21.15.27:45574) 2023-07-05T23:33:21.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.850+0000 7f5402ffd700 1 -- 172.21.15.27:0/3540776349 learned_addr learned my addr 172.21.15.27:0/3540776349 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:21.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.850+0000 7f54037fe700 1 --2- 172.21.15.27:0/3540776349 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f54041ec4f0 0x7f54040c2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:21.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.850+0000 7f54027fc700 1 --2- 172.21.15.27:0/3540776349 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54041605d0 0x7f54040c41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:21.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.850+0000 7f5402ffd700 1 -- 172.21.15.27:0/3540776349 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54041605d0 msgr2=0x7f54040c41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:21.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.850+0000 7f5402ffd700 1 --2- 172.21.15.27:0/3540776349 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54041605d0 0x7f54040c41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:21.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.850+0000 7f5402ffd700 1 -- 172.21.15.27:0/3540776349 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f54041ec4f0 msgr2=0x7f54040c2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:21.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.850+0000 7f5402ffd700 1 --2- 172.21.15.27:0/3540776349 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f54041ec4f0 0x7f54040c2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:21.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.850+0000 7f5402ffd700 1 -- 172.21.15.27:0/3540776349 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f80094a0 con 0x7f54040cb350 2023-07-05T23:33:21.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.849+0000 7fa02e2d7700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0281436e0 con 0x7fa0280cc7a0 2023-07-05T23:33:21.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.849+0000 7fa02e2d7700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa028155250 con 0x7fa028159270 2023-07-05T23:33:21.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.849+0000 7fa02e2d7700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0280c8420 con 0x7fa0280cbbf0 2023-07-05T23:33:21.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.850+0000 7fa027fff700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa0280cbbf0 0x7fa028143930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:21.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.850+0000 7fa027fff700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa0280cbbf0 0x7fa028143930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.27:45572/0 (socket says 172.21.15.27:45572) 2023-07-05T23:33:21.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.850+0000 7fa027fff700 1 -- 172.21.15.27:0/1026835029 learned_addr learned my addr 172.21.15.27:0/1026835029 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:21.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.850+0000 7fa02c874700 1 --2- 172.21.15.27:0/1026835029 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa028159270 0x7fa0280c7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:21.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.850+0000 7fb210874700 1 -- 172.21.15.27:0/3196534515 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb20400e070 con 0x7fb20c06b910 2023-07-05T23:33:21.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.850+0000 7f28fdffb700 1 -- 172.21.15.27:0/824345358 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f800e070 con 0x7f29000cc970 2023-07-05T23:33:21.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.850+0000 7f28fdffb700 1 -- 172.21.15.27:0/824345358 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28f800b9c0 con 0x7f29000cc970 2023-07-05T23:33:21.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.850+0000 7f28fdffb700 1 -- 172.21.15.27:0/824345358 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f800bd70 con 0x7f29000cc970 2023-07-05T23:33:21.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.850+0000 7f3cd9a00700 1 -- 172.21.15.27:0/1491887486 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3cd415e0d0 msgr2=0x7f3cd41fe190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:21.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.850+0000 7f3cd9a00700 1 --2- 172.21.15.27:0/1491887486 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3cd415e0d0 0x7f3cd41fe190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:21.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.850+0000 7f3cd9a00700 1 -- 172.21.15.27:0/1491887486 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3cd40c3e00 msgr2=0x7f3cd415a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:21.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.850+0000 7f3cd9a00700 1 --2- 172.21.15.27:0/1491887486 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3cd40c3e00 0x7f3cd415a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:21.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.850+0000 7f3cd9a00700 1 -- 172.21.15.27:0/1491887486 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd40c3600 con 0x7f3cc0005320 2023-07-05T23:33:21.916 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.850+0000 7f3cd9a00700 1 --2- 172.21.15.27:0/1491887486 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3cc0005320 0x7f3cd415d6d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3cd000b4d0 tx=0x7f3cd000b7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:21.916 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.850+0000 7fabf53ef700 1 --2- 172.21.15.27:0/1515870473 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fabf006a890 0x7fabf006ad10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fabe8014a30 tx=0x7fabe8014d40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e192e5b9602e84f server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:21.916 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.850+0000 7f8031c7c700 1 -- 172.21.15.27:0/4099667787 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f802c0b88d0 con 0x7f802c15c570 2023-07-05T23:33:21.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.850+0000 7fa027fff700 1 -- 172.21.15.27:0/1026835029 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa028159270 msgr2=0x7fa0280c7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:21.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.850+0000 7fa027fff700 1 --2- 172.21.15.27:0/1026835029 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa028159270 0x7fa0280c7ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:21.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.850+0000 7fa027fff700 1 -- 172.21.15.27:0/1026835029 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa0280cc7a0 msgr2=0x7fa0280c5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:21.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.850+0000 7fa027fff700 1 --2- 172.21.15.27:0/1026835029 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa0280cc7a0 0x7fa0280c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:21.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.850+0000 7fa027fff700 1 -- 172.21.15.27:0/1026835029 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0180085d0 con 0x7fa0280cbbf0 2023-07-05T23:33:21.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.850+0000 7fa02c874700 1 --2- 172.21.15.27:0/1026835029 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa028159270 0x7fa0280c7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T23:33:21.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.850+0000 7fabef7fe700 1 -- 172.21.15.27:0/1515870473 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe8003c20 con 0x7fabf006a890 2023-07-05T23:33:21.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.850+0000 7fabef7fe700 1 -- 172.21.15.27:0/1515870473 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabe8029070 con 0x7fabf006a890 2023-07-05T23:33:21.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.850+0000 7fabef7fe700 1 -- 172.21.15.27:0/1515870473 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe800f1c0 con 0x7fabf006a890 2023-07-05T23:33:21.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.850+0000 7f3cca7fc700 1 -- 172.21.15.27:0/1491887486 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd0011830 con 0x7f3cc0005320 2023-07-05T23:33:21.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.850+0000 7f3cca7fc700 1 -- 172.21.15.27:0/1491887486 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cd0011990 con 0x7f3cc0005320 2023-07-05T23:33:21.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.850+0000 7f3cca7fc700 1 -- 172.21.15.27:0/1491887486 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd0011d40 con 0x7f3cc0005320 2023-07-05T23:33:21.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.850+0000 7f5402ffd700 1 --2- 172.21.15.27:0/3540776349 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54040cb350 0x7f54041eaa20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f53fc00cbc0 tx=0x7f53fc00ced0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:21.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.851+0000 7fa027fff700 1 --2- 172.21.15.27:0/1026835029 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa0280cbbf0 0x7fa028143930 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa01c00b4a0 tx=0x7fa01c00b7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:21.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.851+0000 7f53ebfff700 1 -- 172.21.15.27:0/3540776349 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53fc00aaa0 con 0x7f54040cb350 2023-07-05T23:33:21.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.851+0000 7f53ebfff700 1 -- 172.21.15.27:0/3540776349 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53fc00ac00 con 0x7f54040cb350 2023-07-05T23:33:21.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.851+0000 7f53ebfff700 1 -- 172.21.15.27:0/3540776349 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53fc012400 con 0x7f54040cb350 2023-07-05T23:33:21.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.851+0000 7f3cdbc64700 1 -- 172.21.15.27:0/1491887486 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cd415e540 con 0x7f3cc0005320 2023-07-05T23:33:21.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.852+0000 7f3cdbc64700 1 -- 172.21.15.27:0/1491887486 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cd415eb00 con 0x7f3cc0005320 2023-07-05T23:33:21.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.851+0000 7fa024ff9700 1 -- 172.21.15.27:0/1026835029 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa01c011830 con 0x7fa0280cbbf0 2023-07-05T23:33:21.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.851+0000 7fa024ff9700 1 -- 172.21.15.27:0/1026835029 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa01c0119b0 con 0x7fa0280cbbf0 2023-07-05T23:33:21.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.851+0000 7fa024ff9700 1 -- 172.21.15.27:0/1026835029 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa01c011d60 con 0x7fa0280cbbf0 2023-07-05T23:33:21.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.851+0000 7fa02e2d7700 1 -- 172.21.15.27:0/1026835029 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0280c8680 con 0x7fa0280cbbf0 2023-07-05T23:33:21.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.851+0000 7fa02e2d7700 1 -- 172.21.15.27:0/1026835029 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa028154c00 con 0x7fa0280cbbf0 2023-07-05T23:33:21.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.851+0000 7fb210874700 1 -- 172.21.15.27:0/3196534515 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb20400bad0 con 0x7fb20c06b910 2023-07-05T23:33:21.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.851+0000 7fb210874700 1 -- 172.21.15.27:0/3196534515 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb20400be60 con 0x7fb20c06b910 2023-07-05T23:33:21.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.852+0000 7fb213ada700 1 -- 172.21.15.27:0/3196534515 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb20c06b910 msgr2=0x7fb20c16b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:21.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.852+0000 7fb213ada700 1 --2- 172.21.15.27:0/3196534515 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb20c06b910 0x7fb20c16b4f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb204009dc0 tx=0x7fb20400b330 comp rx=0 tx=0).stop 2023-07-05T23:33:21.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.852+0000 7fb213ada700 1 -- 172.21.15.27:0/3196534515 shutdown_connections 2023-07-05T23:33:21.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.852+0000 7fb213ada700 1 --2- 172.21.15.27:0/3196534515 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb20c06b910 0x7fb20c16b4f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:21.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.852+0000 7fb213ada700 1 -- 172.21.15.27:0/3196534515 >> 172.21.15.27:0/3196534515 conn(0x7fb20c0d2b60 msgr2=0x7fb20c0d2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:21.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.852+0000 7f5409a4f700 1 -- 172.21.15.27:0/3540776349 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54040c2540 con 0x7f54040cb350 2023-07-05T23:33:21.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.852+0000 7f5409a4f700 1 -- 172.21.15.27:0/3540776349 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54041eaf60 con 0x7f54040cb350 2023-07-05T23:33:21.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.851+0000 7f2905a3d700 1 -- 172.21.15.27:0/824345358 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29000cc970 msgr2=0x7f29000cb980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:21.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.851+0000 7f2905a3d700 1 --2- 172.21.15.27:0/824345358 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29000cc970 0x7f29000cb980 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f28f8009e50 tx=0x7f28f800b330 comp rx=0 tx=0).stop 2023-07-05T23:33:21.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.851+0000 7f2905a3d700 1 -- 172.21.15.27:0/824345358 shutdown_connections 2023-07-05T23:33:21.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.852+0000 7f2905a3d700 1 --2- 172.21.15.27:0/824345358 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29000cc970 0x7f29000cb980 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:21.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.852+0000 7f2905a3d700 1 --2- 172.21.15.27:0/824345358 >> v2:172.21.15.162:3300/0 conn(0x7f29000b0d40 0x7f2900159270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:21.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.852+0000 7f2905a3d700 1 -- 172.21.15.27:0/824345358 >> 172.21.15.27:0/824345358 conn(0x7f29000b0260 msgr2=0x7f29000b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:21.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.853+0000 7f2905a3d700 1 -- 172.21.15.27:0/824345358 shutdown_connections 2023-07-05T23:33:21.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.851+0000 7fabf6e52700 1 -- 172.21.15.27:0/1515870473 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fabf006a890 msgr2=0x7fabf006ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:21.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.851+0000 7fabf6e52700 1 --2- 172.21.15.27:0/1515870473 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fabf006a890 0x7fabf006ad10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fabe8014a30 tx=0x7fabe8014d40 comp rx=0 tx=0).stop 2023-07-05T23:33:21.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.851+0000 7fabf6e52700 1 -- 172.21.15.27:0/1515870473 shutdown_connections 2023-07-05T23:33:21.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.851+0000 7fabf6e52700 1 --2- 172.21.15.27:0/1515870473 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fabf006a890 0x7fabf006ad10 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:21.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.851+0000 7fabf6e52700 1 --2- 172.21.15.27:0/1515870473 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fabf015c1e0 0x7fabf015c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:21.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.851+0000 7fabf6e52700 1 -- 172.21.15.27:0/1515870473 >> 172.21.15.27:0/1515870473 conn(0x7fabf00b1740 msgr2=0x7fabf006cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:21.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.853+0000 7fabf6e52700 1 -- 172.21.15.27:0/1515870473 shutdown_connections 2023-07-05T23:33:21.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.853+0000 7fa02e2d7700 1 -- 172.21.15.27:0/1026835029 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa028073910 con 0x7fa0280cbbf0 2023-07-05T23:33:21.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.854+0000 7fb213ada700 1 -- 172.21.15.27:0/3196534515 shutdown_connections 2023-07-05T23:33:21.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.853+0000 7f8013fff700 1 -- 172.21.15.27:0/4099667787 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f801c003ba0 con 0x7f802c15c570 2023-07-05T23:33:21.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.854+0000 7f8013fff700 1 --2- 172.21.15.27:0/4099667787 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f801806ad10 0x7f801806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:21.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.854+0000 7f8013fff700 1 -- 172.21.15.27:0/4099667787 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f801c021070 con 0x7f802c15c570 2023-07-05T23:33:21.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.854+0000 7f802b7fe700 1 --2- 172.21.15.27:0/4099667787 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f801806ad10 0x7f801806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:21.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.854+0000 7fb213ada700 1 -- 172.21.15.27:0/3196534515 wait complete. 2023-07-05T23:33:21.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.853+0000 7f2905a3d700 1 -- 172.21.15.27:0/824345358 wait complete. 2023-07-05T23:33:21.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.854+0000 7f2905a3d700 1 Processor -- start 2023-07-05T23:33:21.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.854+0000 7f3cdbc64700 1 -- 172.21.15.27:0/1491887486 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cd40c3c50 con 0x7f3cc0005320 2023-07-05T23:33:21.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.853+0000 7fabf6e52700 1 -- 172.21.15.27:0/1515870473 wait complete. 2023-07-05T23:33:21.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.855+0000 7fabf6e52700 1 Processor -- start 2023-07-05T23:33:21.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.856+0000 7fb213ada700 1 Processor -- start 2023-07-05T23:33:21.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.855+0000 7f2905a3d700 1 -- start start 2023-07-05T23:33:21.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.856+0000 7f2905a3d700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29000b0d40 0x7f29001fe9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:21.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.856+0000 7f2905a3d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f29000cb4e0 0x7f29001553d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:21.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.856+0000 7f2905a3d700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29000cc970 0x7f29000c2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:21.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.856+0000 7f2905a3d700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29000c7340 con 0x7f29000cb4e0 2023-07-05T23:33:21.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.856+0000 7f2905a3d700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2900155910 con 0x7f29000b0d40 2023-07-05T23:33:21.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.856+0000 7f2905a3d700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29000c6730 con 0x7f29000cc970 2023-07-05T23:33:21.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.856+0000 7f802b7fe700 1 --2- 172.21.15.27:0/4099667787 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f801806ad10 0x7f801806d1c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8020007fd0 tx=0x7f8020009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:21.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.856+0000 7fb213ada700 1 -- start start 2023-07-05T23:33:21.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.856+0000 7f28feffd700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29000b0d40 0x7f29001fe9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:21.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.856+0000 7f28fe7fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f29000cb4e0 0x7f29001553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:21.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.856+0000 7f28feffd700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29000b0d40 0x7f29001fe9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.27:43490/0 (socket says 172.21.15.27:43490) 2023-07-05T23:33:21.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.856+0000 7f28feffd700 1 -- 172.21.15.27:0/543518463 learned_addr learned my addr 172.21.15.27:0/543518463 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:21.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.856+0000 7fa024ff9700 1 -- 172.21.15.27:0/1026835029 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa01c01a400 con 0x7fa0280cbbf0 2023-07-05T23:33:21.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.857+0000 7fa024ff9700 1 --2- 172.21.15.27:0/1026835029 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fa01406adb0 0x7fa01406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:21.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.857+0000 7fa024ff9700 1 -- 172.21.15.27:0/1026835029 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa01c089cf0 con 0x7fa0280cbbf0 2023-07-05T23:33:21.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.857+0000 7fb213ada700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb20c06b910 0x7fb20c1e9e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:21.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.857+0000 7fb213ada700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb20c0d0e70 0x7fb20c1ec680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:21.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.857+0000 7fb213ada700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb20c1607f0 0x7fb20c159760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:21.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.857+0000 7fb213ada700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb20c1ecbc0 con 0x7fb20c1607f0 2023-07-05T23:33:21.937 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.857+0000 7fb213ada700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb20c1ece40 con 0x7fb20c06b910 2023-07-05T23:33:21.937 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.857+0000 7fb213ada700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb20c0cae90 con 0x7fb20c0d0e70 2023-07-05T23:33:21.937 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.857+0000 7fb211876700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb20c06b910 0x7fb20c1e9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:21.937 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.857+0000 7fb211876700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb20c06b910 0x7fb20c1e9e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.27:43502/0 (socket says 172.21.15.27:43502) 2023-07-05T23:33:21.937 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.857+0000 7fb211876700 1 -- 172.21.15.27:0/1675121943 learned_addr learned my addr 172.21.15.27:0/1675121943 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:21.937 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.857+0000 7fb212077700 1 --2- 172.21.15.27:0/1675121943 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb20c1607f0 0x7fb20c159760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:21.938 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.856+0000 7f28ff7fe700 1 --2- 172.21.15.27:0/543518463 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29000cc970 0x7f29000c2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:21.938 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.857+0000 7f28feffd700 1 -- 172.21.15.27:0/543518463 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29000cc970 msgr2=0x7f29000c2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:21.938 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.857+0000 7f28feffd700 1 --2- 172.21.15.27:0/543518463 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29000cc970 0x7f29000c2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:21.938 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.857+0000 7f28feffd700 1 -- 172.21.15.27:0/543518463 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f29000cb4e0 msgr2=0x7f29001553d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:21.938 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.857+0000 7f28feffd700 1 --2- 172.21.15.27:0/543518463 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f29000cb4e0 0x7f29001553d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:21.938 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.857+0000 7f28feffd700 1 -- 172.21.15.27:0/543518463 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28f8009b30 con 0x7f29000b0d40 2023-07-05T23:33:21.938 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.857+0000 7f28feffd700 1 --2- 172.21.15.27:0/543518463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29000b0d40 0x7f29001fe9d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f28f000b550 tx=0x7f28f000b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:21.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.857+0000 7f3cca7fc700 1 -- 172.21.15.27:0/1491887486 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3cd001a400 con 0x7f3cc0005320 2023-07-05T23:33:21.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.857+0000 7f3cca7fc700 1 --2- 172.21.15.27:0/1491887486 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f3cb806adb0 0x7f3cb806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:21.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.855+0000 7fabf6e52700 1 -- start start 2023-07-05T23:33:21.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.857+0000 7fabf6e52700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fabf006a890 0x7fabf00afed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:21.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.857+0000 7fabf6e52700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fabf0158850 0x7fabf00c4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:21.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.857+0000 7fabf6e52700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fabf015c1e0 0x7fabf00c53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:21.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.857+0000 7fabf6e52700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf0159cc0 con 0x7fabf0158850 2023-07-05T23:33:21.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.857+0000 7fabf6e52700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf00c59c0 con 0x7fabf006a890 2023-07-05T23:33:21.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.857+0000 7fabf6e52700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabf00c5ca0 con 0x7fabf015c1e0 2023-07-05T23:33:21.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.857+0000 7fabf53ef700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fabf015c1e0 0x7fabf00c53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:21.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.857+0000 7fabf53ef700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fabf015c1e0 0x7fabf00c53b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.27:45598/0 (socket says 172.21.15.27:45598) 2023-07-05T23:33:21.941 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.857+0000 7fabf53ef700 1 -- 172.21.15.27:0/1290743327 learned_addr learned my addr 172.21.15.27:0/1290743327 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:21.941 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.857+0000 7fabeffff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fabf0158850 0x7fabf00c4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:21.941 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.857+0000 7fabf4bee700 1 --2- 172.21.15.27:0/1290743327 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fabf006a890 0x7fabf00afed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:21.941 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.857+0000 7fabf53ef700 1 -- 172.21.15.27:0/1290743327 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fabf006a890 msgr2=0x7fabf00afed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:21.941 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.857+0000 7fabf53ef700 1 --2- 172.21.15.27:0/1290743327 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fabf006a890 0x7fabf00afed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:21.941 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.857+0000 7fabf53ef700 1 -- 172.21.15.27:0/1290743327 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fabf0158850 msgr2=0x7fabf00c4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:21.942 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.857+0000 7fabf53ef700 1 --2- 172.21.15.27:0/1290743327 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fabf0158850 0x7fabf00c4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:21.942 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.857+0000 7fabf53ef700 1 -- 172.21.15.27:0/1290743327 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe8014660 con 0x7fabf015c1e0 2023-07-05T23:33:21.942 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.858+0000 7f3cca7fc700 1 -- 172.21.15.27:0/1491887486 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3cd0089a00 con 0x7f3cc0005320 2023-07-05T23:33:21.942 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.858+0000 7f3cd91ff700 1 --2- 172.21.15.27:0/1491887486 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f3cb806adb0 0x7f3cb806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:21.943 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.858+0000 7fabf53ef700 1 --2- 172.21.15.27:0/1290743327 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fabf015c1e0 0x7fabf00c53b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fabf0066b70 tx=0x7fabe8004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:21.943 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.858+0000 7f28e7fff700 1 -- 172.21.15.27:0/543518463 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f0011830 con 0x7f29000b0d40 2023-07-05T23:33:21.943 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.858+0000 7f28e7fff700 1 -- 172.21.15.27:0/543518463 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28f0011990 con 0x7f29000b0d40 2023-07-05T23:33:21.944 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.858+0000 7f28e7fff700 1 -- 172.21.15.27:0/543518463 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f0011d40 con 0x7f29000b0d40 2023-07-05T23:33:21.944 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.858+0000 7f2905a3d700 1 -- 172.21.15.27:0/543518463 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29000c6a10 con 0x7f29000b0d40 2023-07-05T23:33:21.944 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.858+0000 7f2905a3d700 1 -- 172.21.15.27:0/543518463 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29000c6fd0 con 0x7f29000b0d40 2023-07-05T23:33:21.944 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.859+0000 7f5409a4f700 1 -- 172.21.15.27:0/3540776349 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5404073910 con 0x7f54040cb350 2023-07-05T23:33:21.945 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.858+0000 7fb211075700 1 --2- 172.21.15.27:0/1675121943 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb20c0d0e70 0x7fb20c1ec680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:21.945 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.858+0000 7fb212077700 1 -- 172.21.15.27:0/1675121943 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb20c0d0e70 msgr2=0x7fb20c1ec680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:21.945 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.858+0000 7fb212077700 1 --2- 172.21.15.27:0/1675121943 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb20c0d0e70 0x7fb20c1ec680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:21.945 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.858+0000 7fb212077700 1 -- 172.21.15.27:0/1675121943 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb20c06b910 msgr2=0x7fb20c1e9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:21.945 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.858+0000 7fb212077700 1 --2- 172.21.15.27:0/1675121943 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb20c06b910 0x7fb20c1e9e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:21.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.858+0000 7fb212077700 1 -- 172.21.15.27:0/1675121943 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb204009a70 con 0x7fb20c1607f0 2023-07-05T23:33:21.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.858+0000 7fb212077700 1 --2- 172.21.15.27:0/1675121943 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb20c1607f0 0x7fb20c159760 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb204014000 tx=0x7fb204004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:21.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.859+0000 7f3cd91ff700 1 --2- 172.21.15.27:0/1491887486 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f3cb806adb0 0x7f3cb806d260 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3cc4007fd0 tx=0x7f3cc4007a20 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:21.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.859+0000 7fa0277fe700 1 --2- 172.21.15.27:0/1026835029 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fa01406adb0 0x7fa01406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:21.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.859+0000 7f2905a3d700 1 -- 172.21.15.27:0/543518463 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28e00052f0 con 0x7f29000b0d40 2023-07-05T23:33:21.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.859+0000 7fabed7fa700 1 -- 172.21.15.27:0/1290743327 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe8014190 con 0x7fabf015c1e0 2023-07-05T23:33:21.948 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.859+0000 7fabf6e52700 1 -- 172.21.15.27:0/1290743327 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabf0159f10 con 0x7fabf015c1e0 2023-07-05T23:33:21.948 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.859+0000 7fa024ff9700 1 -- 172.21.15.27:0/1026835029 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa01c054b20 con 0x7fa0280cbbf0 2023-07-05T23:33:21.949 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.860+0000 7f8013fff700 1 -- 172.21.15.27:0/4099667787 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f801c056260 con 0x7f802c15c570 2023-07-05T23:33:21.949 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.859+0000 7fb2027fc700 1 -- 172.21.15.27:0/1675121943 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2040048a0 con 0x7fb20c1607f0 2023-07-05T23:33:21.949 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.859+0000 7fabf6e52700 1 -- 172.21.15.27:0/1290743327 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabf00c2d00 con 0x7fabf015c1e0 2023-07-05T23:33:21.950 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.860+0000 7fb2027fc700 1 -- 172.21.15.27:0/1675121943 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb204012450 con 0x7fb20c1607f0 2023-07-05T23:33:21.950 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.860+0000 7fb2027fc700 1 -- 172.21.15.27:0/1675121943 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb204012800 con 0x7fb20c1607f0 2023-07-05T23:33:21.950 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.860+0000 7fb213ada700 1 -- 172.21.15.27:0/1675121943 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb20c0cb170 con 0x7fb20c1607f0 2023-07-05T23:33:21.950 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.860+0000 7fb213ada700 1 -- 172.21.15.27:0/1675121943 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb20c159ca0 con 0x7fb20c1607f0 2023-07-05T23:33:21.951 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.861+0000 7fa0277fe700 1 --2- 172.21.15.27:0/1026835029 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fa01406adb0 0x7fa01406d260 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa0180088f0 tx=0x7fa018014000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:21.951 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.861+0000 7f53ebfff700 1 -- 172.21.15.27:0/3540776349 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f53fc01b3b0 con 0x7f54040cb350 2023-07-05T23:33:21.951 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.861+0000 7fabf6e52700 1 -- 172.21.15.27:0/1290743327 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabf015a430 con 0x7fabf015c1e0 2023-07-05T23:33:21.952 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.861+0000 7f259753e700 1 Processor -- start 2023-07-05T23:33:21.952 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.861+0000 7f28e7fff700 1 -- 172.21.15.27:0/543518463 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f28f001a400 con 0x7f29000b0d40 2023-07-05T23:33:21.953 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.861+0000 7f53ebfff700 1 --2- 172.21.15.27:0/3540776349 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f53f006ace0 0x7f53f006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:21.953 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.862+0000 7f28e7fff700 1 --2- 172.21.15.27:0/543518463 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f28e806ae90 0x7f28e806d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:21.953 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.862+0000 7fb213ada700 1 -- 172.21.15.27:0/1675121943 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb20c0cb690 con 0x7fb20c1607f0 2023-07-05T23:33:21.954 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.861+0000 7f259753e700 1 -- start start 2023-07-05T23:33:21.954 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.862+0000 7f28e7fff700 1 -- 172.21.15.27:0/543518463 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f28f0089cc0 con 0x7f29000b0d40 2023-07-05T23:33:21.954 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.862+0000 7f54027fc700 1 --2- 172.21.15.27:0/3540776349 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f53f006ace0 0x7f53f006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:21.955 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.862+0000 7f54027fc700 1 --2- 172.21.15.27:0/3540776349 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f53f006ace0 0x7f53f006d190 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f54040cd920 tx=0x7f53f4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:21.955 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.863+0000 7f28fe7fc700 1 --2- 172.21.15.27:0/543518463 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f28e806ae90 0x7f28e806d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:21.956 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.863+0000 7f259753e700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f25901605d0 0x7f25900ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:21.956 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.863+0000 7f259753e700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2590164d40 0x7f25900ce360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:21.956 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.863+0000 7f259753e700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25900cc680 con 0x7f25901609a0 2023-07-05T23:33:21.956 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.863+0000 7f259753e700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25900ce8a0 con 0x7f25901605d0 2023-07-05T23:33:21.956 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.863+0000 7f259753e700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f259006c7f0 con 0x7f2590164d40 2023-07-05T23:33:21.957 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.863+0000 7fb2027fc700 1 -- 172.21.15.27:0/1675121943 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb204012960 con 0x7fb20c1607f0 2023-07-05T23:33:21.957 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.863+0000 7f28fe7fc700 1 --2- 172.21.15.27:0/543518463 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f28e806ae90 0x7f28e806d340 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2900165040 tx=0x7f28f4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:21.958 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.863+0000 7f2595adb700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f25901609a0 0x7f259006e100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:52748/0 (socket says 172.21.15.27:52748) 2023-07-05T23:33:21.958 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.863+0000 7f25952da700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f25901605d0 0x7f25900ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:21.958 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.863+0000 7f2595adb700 1 -- 172.21.15.27:0/3573969391 learned_addr learned my addr 172.21.15.27:0/3573969391 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-07-05T23:33:21.958 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.863+0000 7f2594ad9700 1 --2- 172.21.15.27:0/3573969391 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2590164d40 0x7f25900ce360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:21.958 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.863+0000 7f25952da700 1 -- 172.21.15.27:0/3573969391 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2590164d40 msgr2=0x7f25900ce360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:21.958 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.863+0000 7f25952da700 1 --2- 172.21.15.27:0/3573969391 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2590164d40 0x7f25900ce360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:21.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.864+0000 7f25952da700 1 -- 172.21.15.27:0/3573969391 >> v1:172.21.15.27:6789/0 conn(0x7f25901609a0 legacy=0x7f259006e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:21.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.864+0000 7f25952da700 1 -- 172.21.15.27:0/3573969391 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f259006cad0 con 0x7f25901605d0 2023-07-05T23:33:21.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.864+0000 7f2594ad9700 1 --2- 172.21.15.27:0/3573969391 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2590164d40 0x7f25900ce360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T23:33:21.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.864+0000 7fb2027fc700 1 --2- 172.21.15.27:0/1675121943 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fb1f006ad30 0x7fb1f006d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:21.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.864+0000 7f25952da700 1 --2- 172.21.15.27:0/3573969391 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25901605d0 0x7f25900ccaf0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2580009840 tx=0x7f2580009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35a541201218ed93 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:21.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.864+0000 7fb2027fc700 1 -- 172.21.15.27:0/1675121943 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb20408bd50 con 0x7fb20c1607f0 2023-07-05T23:33:21.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.864+0000 7fb211876700 1 --2- 172.21.15.27:0/1675121943 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fb1f006ad30 0x7fb1f006d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:21.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.864+0000 7fb211876700 1 --2- 172.21.15.27:0/1675121943 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fb1f006ad30 0x7fb1f006d1e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb208001b20 tx=0x7fb208009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:21.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.864+0000 7fabed7fa700 1 -- 172.21.15.27:0/1290743327 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabe800f1c0 con 0x7fabf015c1e0 2023-07-05T23:33:21.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.864+0000 7fabed7fa700 1 -- 172.21.15.27:0/1290743327 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe800f570 con 0x7fabf015c1e0 2023-07-05T23:33:21.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.864+0000 7f53ebfff700 1 -- 172.21.15.27:0/3540776349 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f53fc05c380 con 0x7f54040cb350 2023-07-05T23:33:21.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.865+0000 7f2587fff700 1 -- 172.21.15.27:0/3573969391 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2580011830 con 0x7f25901605d0 2023-07-05T23:33:21.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.865+0000 7f3cca7fc700 1 -- 172.21.15.27:0/1491887486 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3cd00547a0 con 0x7f3cc0005320 2023-07-05T23:33:21.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.865+0000 7f2587fff700 1 -- 172.21.15.27:0/3573969391 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2580011990 con 0x7f25901605d0 2023-07-05T23:33:21.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.865+0000 7f2587fff700 1 -- 172.21.15.27:0/3573969391 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2580011d00 con 0x7f25901605d0 2023-07-05T23:33:21.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.865+0000 7f28e7fff700 1 -- 172.21.15.27:0/543518463 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f28f0054b60 con 0x7f29000b0d40 2023-07-05T23:33:21.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.866+0000 7f259753e700 1 -- 172.21.15.27:0/3573969391 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25901605d0 msgr2=0x7f25900ccaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:21.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.866+0000 7f259753e700 1 --2- 172.21.15.27:0/3573969391 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25901605d0 0x7f25900ccaf0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2580009840 tx=0x7f2580009b50 comp rx=0 tx=0).stop 2023-07-05T23:33:21.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.866+0000 7f259753e700 1 -- 172.21.15.27:0/3573969391 shutdown_connections 2023-07-05T23:33:21.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.866+0000 7f259753e700 1 --2- 172.21.15.27:0/3573969391 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25901605d0 0x7f25900ccaf0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:21.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.866+0000 7f259753e700 1 --2- 172.21.15.27:0/3573969391 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2590164d40 0x7f25900ce360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:21.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.866+0000 7f259753e700 1 -- 172.21.15.27:0/3573969391 >> 172.21.15.27:0/3573969391 conn(0x7f25900cf7d0 msgr2=0x7f25900cb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:21.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.866+0000 7f259753e700 1 -- 172.21.15.27:0/3573969391 shutdown_connections 2023-07-05T23:33:21.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.866+0000 7f259753e700 1 -- 172.21.15.27:0/3573969391 wait complete. 2023-07-05T23:33:21.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.868+0000 7f259753e700 1 Processor -- start 2023-07-05T23:33:21.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.869+0000 7f53ebfff700 1 -- 172.21.15.27:0/3540776349 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f53fc054700 con 0x7f54040cb350 2023-07-05T23:33:21.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.868+0000 7f259753e700 1 -- start start 2023-07-05T23:33:21.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.869+0000 7f259753e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f25901605d0 0x7f259015b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:21.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.869+0000 7f259753e700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f25901609a0 0x7f2590161f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:21.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.869+0000 7f259753e700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f259015ea50 0x7f259015eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:21.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.870+0000 7f259753e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f259015ba00 con 0x7f25901605d0 2023-07-05T23:33:21.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.870+0000 7f259753e700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25901f6fe0 con 0x7f259015ea50 2023-07-05T23:33:21.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.870+0000 7f259753e700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2590160ef0 con 0x7f25901609a0 2023-07-05T23:33:21.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.870+0000 7f2595adb700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f259015ea50 0x7f259015eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:21.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.870+0000 7f2594ad9700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f25901609a0 0x7f2590161f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:21.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.870+0000 7f25952da700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f25901605d0 0x7f259015b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:21.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.870+0000 7f2595adb700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f259015ea50 0x7f259015eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.27:43526/0 (socket says 172.21.15.27:43526) 2023-07-05T23:33:21.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.870+0000 7f2595adb700 1 -- 172.21.15.27:0/4237389773 learned_addr learned my addr 172.21.15.27:0/4237389773 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:21.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.870+0000 7f2595adb700 1 -- 172.21.15.27:0/4237389773 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f25901609a0 msgr2=0x7f2590161f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:21.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.870+0000 7f2595adb700 1 --2- 172.21.15.27:0/4237389773 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f25901609a0 0x7f2590161f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:21.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.870+0000 7f2595adb700 1 -- 172.21.15.27:0/4237389773 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f25901605d0 msgr2=0x7f259015b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:21.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.870+0000 7f2595adb700 1 --2- 172.21.15.27:0/4237389773 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f25901605d0 0x7f259015b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:21.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.870+0000 7f2595adb700 1 -- 172.21.15.27:0/4237389773 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25800094a0 con 0x7f259015ea50 2023-07-05T23:33:21.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.871+0000 7f2595adb700 1 --2- 172.21.15.27:0/4237389773 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f259015ea50 0x7f259015eed0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f258800cbc0 tx=0x7f258800ced0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:21.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.871+0000 7f2585ffb700 1 -- 172.21.15.27:0/4237389773 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f258800a9e0 con 0x7f259015ea50 2023-07-05T23:33:21.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.871+0000 7f2585ffb700 1 -- 172.21.15.27:0/4237389773 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f258800ab40 con 0x7f259015ea50 2023-07-05T23:33:21.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.871+0000 7f2585ffb700 1 -- 172.21.15.27:0/4237389773 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2588012400 con 0x7f259015ea50 2023-07-05T23:33:21.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.871+0000 7fb2027fc700 1 -- 172.21.15.27:0/1675121943 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb204056c80 con 0x7fb20c1607f0 2023-07-05T23:33:21.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.872+0000 7f259753e700 1 -- 172.21.15.27:0/4237389773 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25901611d0 con 0x7f259015ea50 2023-07-05T23:33:21.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.872+0000 7f259753e700 1 -- 172.21.15.27:0/4237389773 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2590161790 con 0x7f259015ea50 2023-07-05T23:33:21.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.873+0000 7f259753e700 1 -- 172.21.15.27:0/4237389773 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2590073910 con 0x7f259015ea50 2023-07-05T23:33:21.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.874+0000 7f2585ffb700 1 -- 172.21.15.27:0/4237389773 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f258801b3b0 con 0x7f259015ea50 2023-07-05T23:33:21.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.874+0000 7f2585ffb700 1 --2- 172.21.15.27:0/4237389773 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f257406ace0 0x7f257406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:21.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.874+0000 7f2585ffb700 1 -- 172.21.15.27:0/4237389773 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f25880892a0 con 0x7f259015ea50 2023-07-05T23:33:21.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.876+0000 7f25952da700 1 --2- 172.21.15.27:0/4237389773 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f257406ace0 0x7f257406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:21.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.876+0000 7f25952da700 1 --2- 172.21.15.27:0/4237389773 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f257406ace0 0x7f257406d190 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f25800090b0 tx=0x7f2580008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:21.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.879+0000 7f2585ffb700 1 -- 172.21.15.27:0/4237389773 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2588054110 con 0x7f259015ea50 2023-07-05T23:33:21.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.878+0000 7fabed7fa700 1 -- 172.21.15.27:0/1290743327 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fabe8009070 con 0x7fabf015c1e0 2023-07-05T23:33:21.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.878+0000 7fabed7fa700 1 --2- 172.21.15.27:0/1290743327 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fabd406ace0 0x7fabd406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:21.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.878+0000 7fabed7fa700 1 -- 172.21.15.27:0/1290743327 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fabe809c370 con 0x7fabf015c1e0 2023-07-05T23:33:21.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.879+0000 7fabed7fa700 1 -- 172.21.15.27:0/1290743327 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fabe809c860 con 0x7fabf015c1e0 2023-07-05T23:33:21.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.881+0000 7fabf4bee700 1 --2- 172.21.15.27:0/1290743327 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fabd406ace0 0x7fabd406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:21.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:21.894+0000 7fabf4bee700 1 --2- 172.21.15.27:0/1290743327 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fabd406ace0 0x7fabd406d190 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fabe400a7b0 tx=0x7fabe4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:22.262 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.260+0000 7f2905a3d700 1 -- 172.21.15.27:0/543518463 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f28e0005870 con 0x7f29000b0d40 2023-07-05T23:33:22.262 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.260+0000 7f28e7fff700 1 -- 172.21.15.27:0/543518463 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f28f0015020 con 0x7f29000b0d40 2023-07-05T23:33:22.265 INFO:teuthology.orchestra.run.smithi027.stdout:55834574861 2023-07-05T23:33:22.265 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.264+0000 7f2905a3d700 1 -- 172.21.15.27:0/543518463 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f28e806ae90 msgr2=0x7f28e806d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:22.266 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.264+0000 7f2905a3d700 1 --2- 172.21.15.27:0/543518463 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f28e806ae90 0x7f28e806d340 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2900165040 tx=0x7f28f4009040 comp rx=0 tx=0).stop 2023-07-05T23:33:22.266 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.264+0000 7f2905a3d700 1 -- 172.21.15.27:0/543518463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29000b0d40 msgr2=0x7f29001fe9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:22.266 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.264+0000 7f2905a3d700 1 --2- 172.21.15.27:0/543518463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29000b0d40 0x7f29001fe9d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f28f000b550 tx=0x7f28f000b910 comp rx=0 tx=0).stop 2023-07-05T23:33:22.266 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.264+0000 7f2905a3d700 1 -- 172.21.15.27:0/543518463 shutdown_connections 2023-07-05T23:33:22.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.264+0000 7f2905a3d700 1 --2- 172.21.15.27:0/543518463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29000b0d40 0x7f29001fe9d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:22.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.264+0000 7f2905a3d700 1 --2- 172.21.15.27:0/543518463 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f28e806ae90 0x7f28e806d340 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:22.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.264+0000 7f2905a3d700 1 --2- 172.21.15.27:0/543518463 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29000cc970 0x7f29000c2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:22.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.264+0000 7f2905a3d700 1 --2- 172.21.15.27:0/543518463 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f29000cb4e0 0x7f29001553d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:22.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.264+0000 7f2905a3d700 1 -- 172.21.15.27:0/543518463 >> 172.21.15.27:0/543518463 conn(0x7f29000b0260 msgr2=0x7f29000ce690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:22.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.265+0000 7f2905a3d700 1 -- 172.21.15.27:0/543518463 shutdown_connections 2023-07-05T23:33:22.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.265+0000 7f2905a3d700 1 -- 172.21.15.27:0/543518463 wait complete. 2023-07-05T23:33:22.270 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.268+0000 7f8031c7c700 1 -- 172.21.15.27:0/4099667787 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f802c0b85a0 con 0x7f802c15c570 2023-07-05T23:33:22.270 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.268+0000 7fa02e2d7700 1 -- 172.21.15.27:0/1026835029 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fa02806c730 con 0x7fa0280cbbf0 2023-07-05T23:33:22.271 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.269+0000 7fa024ff9700 1 -- 172.21.15.27:0/1026835029 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa01c058140 con 0x7fa0280cbbf0 2023-07-05T23:33:22.271 INFO:teuthology.orchestra.run.smithi027.stdout:55834574860 2023-07-05T23:33:22.274 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.272+0000 7f8013fff700 1 -- 172.21.15.27:0/4099667787 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f801c02b020 con 0x7f802c15c570 2023-07-05T23:33:22.274 INFO:teuthology.orchestra.run.smithi027.stdout:55834574860 2023-07-05T23:33:22.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.277+0000 7f8031c7c700 1 -- 172.21.15.27:0/4099667787 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f801806ad10 msgr2=0x7f801806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:22.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.277+0000 7f8031c7c700 1 --2- 172.21.15.27:0/4099667787 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f801806ad10 0x7f801806d1c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8020007fd0 tx=0x7f8020009040 comp rx=0 tx=0).stop 2023-07-05T23:33:22.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.277+0000 7f8031c7c700 1 -- 172.21.15.27:0/4099667787 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f802c15c570 msgr2=0x7f802c0b3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:22.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.277+0000 7f8031c7c700 1 --2- 172.21.15.27:0/4099667787 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f802c15c570 0x7f802c0b3880 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f801c016000 tx=0x7f801c004750 comp rx=0 tx=0).stop 2023-07-05T23:33:22.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.277+0000 7fa02e2d7700 1 -- 172.21.15.27:0/1026835029 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fa01406adb0 msgr2=0x7fa01406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:22.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.277+0000 7fa02e2d7700 1 --2- 172.21.15.27:0/1026835029 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fa01406adb0 0x7fa01406d260 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa0180088f0 tx=0x7fa018014000 comp rx=0 tx=0).stop 2023-07-05T23:33:22.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.277+0000 7fa02e2d7700 1 -- 172.21.15.27:0/1026835029 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa0280cbbf0 msgr2=0x7fa028143930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:22.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.277+0000 7fa02e2d7700 1 --2- 172.21.15.27:0/1026835029 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa0280cbbf0 0x7fa028143930 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa01c00b4a0 tx=0x7fa01c00b7b0 comp rx=0 tx=0).stop 2023-07-05T23:33:22.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.277+0000 7f8031c7c700 1 -- 172.21.15.27:0/4099667787 shutdown_connections 2023-07-05T23:33:22.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.277+0000 7f8031c7c700 1 --2- 172.21.15.27:0/4099667787 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f802c0cd830 0x7f802c0c65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:22.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.277+0000 7f8031c7c700 1 --2- 172.21.15.27:0/4099667787 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f801806ad10 0x7f801806d1c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:22.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.277+0000 7f8031c7c700 1 --2- 172.21.15.27:0/4099667787 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f802c160880 0x7f802c0b63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:22.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.277+0000 7f8031c7c700 1 --2- 172.21.15.27:0/4099667787 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f802c15c570 0x7f802c0b3880 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:22.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.277+0000 7f8031c7c700 1 -- 172.21.15.27:0/4099667787 >> 172.21.15.27:0/4099667787 conn(0x7f802c071620 msgr2=0x7f802c15e8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:22.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.279+0000 7fa02e2d7700 1 -- 172.21.15.27:0/1026835029 shutdown_connections 2023-07-05T23:33:22.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.279+0000 7fa02e2d7700 1 --2- 172.21.15.27:0/1026835029 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa028159270 0x7fa0280c7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:22.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.279+0000 7fa02e2d7700 1 --2- 172.21.15.27:0/1026835029 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fa01406adb0 0x7fa01406d260 secure :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa0180088f0 tx=0x7fa018014000 comp rx=0 tx=0).stop 2023-07-05T23:33:22.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.279+0000 7fa02e2d7700 1 --2- 172.21.15.27:0/1026835029 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa0280cbbf0 0x7fa028143930 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:22.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.279+0000 7fa02e2d7700 1 --2- 172.21.15.27:0/1026835029 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa0280cc7a0 0x7fa0280c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:22.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.279+0000 7fa02e2d7700 1 -- 172.21.15.27:0/1026835029 >> 172.21.15.27:0/1026835029 conn(0x7fa0280b0260 msgr2=0x7fa02806cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:22.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.281+0000 7fa02e2d7700 1 -- 172.21.15.27:0/1026835029 shutdown_connections 2023-07-05T23:33:22.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.281+0000 7f5409a4f700 1 -- 172.21.15.27:0/3540776349 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f54040c23a0 con 0x7f54040cb350 2023-07-05T23:33:22.284 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.281+0000 7f53ebfff700 1 -- 172.21.15.27:0/3540776349 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f54040c23a0 con 0x7f54040cb350 2023-07-05T23:33:22.284 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.281+0000 7f3cdbc64700 1 -- 172.21.15.27:0/1491887486 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3cd40c3790 con 0x7f3cc0005320 2023-07-05T23:33:22.285 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.284+0000 7fa02e2d7700 1 -- 172.21.15.27:0/1026835029 wait complete. 2023-07-05T23:33:22.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.284+0000 7f3cca7fc700 1 -- 172.21.15.27:0/1491887486 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3cd0015020 con 0x7f3cc0005320 2023-07-05T23:33:22.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.284+0000 7fb213ada700 1 -- 172.21.15.27:0/1675121943 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb20c0cb690 con 0x7fb20c1607f0 2023-07-05T23:33:22.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.284+0000 7fb2027fc700 1 -- 172.21.15.27:0/1675121943 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb20c0cb690 con 0x7fb20c1607f0 2023-07-05T23:33:22.286 INFO:teuthology.orchestra.run.smithi027.stdout:55834574861 2023-07-05T23:33:22.288 INFO:teuthology.orchestra.run.smithi027.stdout:55834574860 2023-07-05T23:33:22.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.285+0000 7f8031c7c700 1 -- 172.21.15.27:0/4099667787 shutdown_connections 2023-07-05T23:33:22.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.285+0000 7f8031c7c700 1 -- 172.21.15.27:0/4099667787 wait complete. 2023-07-05T23:33:22.289 INFO:teuthology.orchestra.run.smithi027.stdout:55834574860 2023-07-05T23:33:22.290 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574861 for osd.4 2023-07-05T23:33:22.290 DEBUG:teuthology.parallel:result is None 2023-07-05T23:33:22.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.288+0000 7f5409a4f700 1 -- 172.21.15.27:0/3540776349 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f53f006ace0 msgr2=0x7f53f006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:22.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.288+0000 7f5409a4f700 1 --2- 172.21.15.27:0/3540776349 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f53f006ace0 0x7f53f006d190 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f54040cd920 tx=0x7f53f4008040 comp rx=0 tx=0).stop 2023-07-05T23:33:22.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.288+0000 7f5409a4f700 1 -- 172.21.15.27:0/3540776349 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54040cb350 msgr2=0x7f54041eaa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:22.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.288+0000 7f5409a4f700 1 --2- 172.21.15.27:0/3540776349 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54040cb350 0x7f54041eaa20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f53fc00cbc0 tx=0x7f53fc00ced0 comp rx=0 tx=0).stop 2023-07-05T23:33:22.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.288+0000 7f5409a4f700 1 -- 172.21.15.27:0/3540776349 shutdown_connections 2023-07-05T23:33:22.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.288+0000 7f5409a4f700 1 --2- 172.21.15.27:0/3540776349 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f53f006ace0 0x7f53f006d190 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:22.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.288+0000 7f5409a4f700 1 --2- 172.21.15.27:0/3540776349 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f54041ec4f0 0x7f54040c2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:22.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.288+0000 7f5409a4f700 1 --2- 172.21.15.27:0/3540776349 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54040cb350 0x7f54041eaa20 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:22.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.288+0000 7f5409a4f700 1 --2- 172.21.15.27:0/3540776349 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54041605d0 0x7f54040c41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:22.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.288+0000 7f5409a4f700 1 -- 172.21.15.27:0/3540776349 >> 172.21.15.27:0/3540776349 conn(0x7f54040b0260 msgr2=0x7f54040ae960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:22.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.288+0000 7f5409a4f700 1 -- 172.21.15.27:0/3540776349 shutdown_connections 2023-07-05T23:33:22.293 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.288+0000 7fb213ada700 1 -- 172.21.15.27:0/1675121943 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fb1f006ad30 msgr2=0x7fb1f006d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:22.293 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.288+0000 7fb213ada700 1 --2- 172.21.15.27:0/1675121943 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fb1f006ad30 0x7fb1f006d1e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb208001b20 tx=0x7fb208009040 comp rx=0 tx=0).stop 2023-07-05T23:33:22.293 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.288+0000 7fb213ada700 1 -- 172.21.15.27:0/1675121943 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb20c1607f0 msgr2=0x7fb20c159760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:22.293 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.288+0000 7fb213ada700 1 --2- 172.21.15.27:0/1675121943 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb20c1607f0 0x7fb20c159760 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb204014000 tx=0x7fb204004ad0 comp rx=0 tx=0).stop 2023-07-05T23:33:22.294 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.288+0000 7f5409a4f700 1 -- 172.21.15.27:0/3540776349 wait complete. 2023-07-05T23:33:22.294 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.289+0000 7f3cdbc64700 1 -- 172.21.15.27:0/1491887486 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f3cb806adb0 msgr2=0x7f3cb806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:22.294 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.289+0000 7f3cdbc64700 1 --2- 172.21.15.27:0/1491887486 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f3cb806adb0 0x7f3cb806d260 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3cc4007fd0 tx=0x7f3cc4007a20 comp rx=0 tx=0).stop 2023-07-05T23:33:22.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.289+0000 7f3cdbc64700 1 -- 172.21.15.27:0/1491887486 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3cc0005320 msgr2=0x7f3cd415d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:22.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.289+0000 7f3cdbc64700 1 --2- 172.21.15.27:0/1491887486 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3cc0005320 0x7f3cd415d6d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3cd000b4d0 tx=0x7f3cd000b7e0 comp rx=0 tx=0).stop 2023-07-05T23:33:22.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.289+0000 7f3cdbc64700 1 -- 172.21.15.27:0/1491887486 shutdown_connections 2023-07-05T23:33:22.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.289+0000 7f3cdbc64700 1 --2- 172.21.15.27:0/1491887486 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f3cb806adb0 0x7f3cb806d260 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:22.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.289+0000 7f3cdbc64700 1 --2- 172.21.15.27:0/1491887486 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3cd40c3e00 0x7f3cd415a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:22.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.289+0000 7f3cdbc64700 1 --2- 172.21.15.27:0/1491887486 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3cc0005320 0x7f3cd415d6d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:22.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.289+0000 7f3cdbc64700 1 --2- 172.21.15.27:0/1491887486 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3cd415e0d0 0x7f3cd41fe190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:22.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.289+0000 7f3cdbc64700 1 -- 172.21.15.27:0/1491887486 >> 172.21.15.27:0/1491887486 conn(0x7f3cd40b0ef0 msgr2=0x7f3cd406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:22.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.289+0000 7f3cdbc64700 1 -- 172.21.15.27:0/1491887486 shutdown_connections 2023-07-05T23:33:22.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.289+0000 7f3cdbc64700 1 -- 172.21.15.27:0/1491887486 wait complete. 2023-07-05T23:33:22.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.285+0000 7fabf6e52700 1 -- 172.21.15.27:0/1290743327 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fabf015a430 con 0x7fabf015c1e0 2023-07-05T23:33:22.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.295+0000 7fb213ada700 1 -- 172.21.15.27:0/1675121943 shutdown_connections 2023-07-05T23:33:22.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.295+0000 7fb213ada700 1 --2- 172.21.15.27:0/1675121943 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb20c06b910 0x7fb20c1e9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:22.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.295+0000 7fb213ada700 1 --2- 172.21.15.27:0/1675121943 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fb1f006ad30 0x7fb1f006d1e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:22.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.295+0000 7fb213ada700 1 --2- 172.21.15.27:0/1675121943 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb20c1607f0 0x7fb20c159760 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:22.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.295+0000 7fb213ada700 1 --2- 172.21.15.27:0/1675121943 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb20c0d0e70 0x7fb20c1ec680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:22.298 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.295+0000 7fb213ada700 1 -- 172.21.15.27:0/1675121943 >> 172.21.15.27:0/1675121943 conn(0x7fb20c0d2b60 msgr2=0x7fb20c0b6cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:22.299 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.297+0000 7fabed7fa700 1 -- 172.21.15.27:0/1290743327 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fabf015a430 con 0x7fabf015c1e0 2023-07-05T23:33:22.300 INFO:teuthology.orchestra.run.smithi027.stdout:55834574860 2023-07-05T23:33:22.301 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.300+0000 7fb213ada700 1 -- 172.21.15.27:0/1675121943 shutdown_connections 2023-07-05T23:33:22.302 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.300+0000 7fb213ada700 1 -- 172.21.15.27:0/1675121943 wait complete. 2023-07-05T23:33:22.306 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574860 for osd.6 2023-07-05T23:33:22.306 DEBUG:teuthology.parallel:result is None 2023-07-05T23:33:22.307 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.305+0000 7f259753e700 1 -- 172.21.15.27:0/4237389773 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f259006f110 con 0x7f259015ea50 2023-07-05T23:33:22.307 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.306+0000 7f2585ffb700 1 -- 172.21.15.27:0/4237389773 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2588057730 con 0x7f259015ea50 2023-07-05T23:33:22.311 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.307+0000 7fabf6e52700 1 -- 172.21.15.27:0/1290743327 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fabd406ace0 msgr2=0x7fabd406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:22.311 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.307+0000 7fabf6e52700 1 --2- 172.21.15.27:0/1290743327 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fabd406ace0 0x7fabd406d190 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fabe400a7b0 tx=0x7fabe4008040 comp rx=0 tx=0).stop 2023-07-05T23:33:22.311 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.307+0000 7fabf6e52700 1 -- 172.21.15.27:0/1290743327 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fabf015c1e0 msgr2=0x7fabf00c53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:22.312 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.307+0000 7fabf6e52700 1 --2- 172.21.15.27:0/1290743327 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fabf015c1e0 0x7fabf00c53b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fabf0066b70 tx=0x7fabe8004ad0 comp rx=0 tx=0).stop 2023-07-05T23:33:22.312 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.307+0000 7fabf6e52700 1 -- 172.21.15.27:0/1290743327 shutdown_connections 2023-07-05T23:33:22.312 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.307+0000 7fabf6e52700 1 --2- 172.21.15.27:0/1290743327 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fabf006a890 0x7fabf00afed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:22.312 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.307+0000 7fabf6e52700 1 --2- 172.21.15.27:0/1290743327 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fabd406ace0 0x7fabd406d190 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:22.312 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.307+0000 7fabf6e52700 1 --2- 172.21.15.27:0/1290743327 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fabf015c1e0 0x7fabf00c53b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:22.312 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.307+0000 7fabf6e52700 1 --2- 172.21.15.27:0/1290743327 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fabf0158850 0x7fabf00c4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:22.312 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.307+0000 7fabf6e52700 1 -- 172.21.15.27:0/1290743327 >> 172.21.15.27:0/1290743327 conn(0x7fabf00b1740 msgr2=0x7fabf006df10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:22.313 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.309+0000 7fabf6e52700 1 -- 172.21.15.27:0/1290743327 shutdown_connections 2023-07-05T23:33:22.313 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.309+0000 7fabf6e52700 1 -- 172.21.15.27:0/1290743327 wait complete. 2023-07-05T23:33:22.313 INFO:teuthology.orchestra.run.smithi027.stdout:55834574860 2023-07-05T23:33:22.313 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574860 for osd.5 2023-07-05T23:33:22.314 DEBUG:teuthology.parallel:result is None 2023-07-05T23:33:22.315 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.309+0000 7f259753e700 1 -- 172.21.15.27:0/4237389773 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f257406ace0 msgr2=0x7f257406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:22.315 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.309+0000 7f259753e700 1 --2- 172.21.15.27:0/4237389773 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f257406ace0 0x7f257406d190 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f25800090b0 tx=0x7f2580008030 comp rx=0 tx=0).stop 2023-07-05T23:33:22.315 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.309+0000 7f259753e700 1 -- 172.21.15.27:0/4237389773 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f259015ea50 msgr2=0x7f259015eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:22.315 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.309+0000 7f259753e700 1 --2- 172.21.15.27:0/4237389773 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f259015ea50 0x7f259015eed0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f258800cbc0 tx=0x7f258800ced0 comp rx=0 tx=0).stop 2023-07-05T23:33:22.315 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.310+0000 7f259753e700 1 -- 172.21.15.27:0/4237389773 shutdown_connections 2023-07-05T23:33:22.315 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.310+0000 7f259753e700 1 --2- 172.21.15.27:0/4237389773 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f259015ea50 0x7f259015eed0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:22.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.310+0000 7f259753e700 1 --2- 172.21.15.27:0/4237389773 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f257406ace0 0x7f257406d190 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:22.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.310+0000 7f259753e700 1 --2- 172.21.15.27:0/4237389773 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f25901605d0 0x7f259015b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:22.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.310+0000 7f259753e700 1 --2- 172.21.15.27:0/4237389773 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f25901609a0 0x7f2590161f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:22.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.310+0000 7f259753e700 1 -- 172.21.15.27:0/4237389773 >> 172.21.15.27:0/4237389773 conn(0x7f25900cf7d0 msgr2=0x7f25900b2620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:22.317 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574861 for osd.2 2023-07-05T23:33:22.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.310+0000 7f259753e700 1 -- 172.21.15.27:0/4237389773 shutdown_connections 2023-07-05T23:33:22.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.310+0000 7f259753e700 1 -- 172.21.15.27:0/4237389773 wait complete. 2023-07-05T23:33:22.318 DEBUG:teuthology.parallel:result is None 2023-07-05T23:33:22.318 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574860 for osd.1 2023-07-05T23:33:22.319 DEBUG:teuthology.parallel:result is None 2023-07-05T23:33:22.320 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574860 for osd.0 2023-07-05T23:33:22.320 DEBUG:teuthology.parallel:result is None 2023-07-05T23:33:22.326 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574860 for osd.3 2023-07-05T23:33:22.327 DEBUG:teuthology.parallel:result is None 2023-07-05T23:33:22.327 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574860 for osd.7 2023-07-05T23:33:22.328 DEBUG:teuthology.parallel:result is None 2023-07-05T23:33:22.328 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-07-05T23:33:22.328 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-05T23:33:22.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.489+0000 7f4b7dae8700 1 Processor -- start 2023-07-05T23:33:22.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.489+0000 7f4b7dae8700 1 -- start start 2023-07-05T23:33:22.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.490+0000 7f4b7dae8700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4b780aed30 0x7f4b78160580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:22.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.490+0000 7f4b7dae8700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b780cee80 con 0x7f4b780cc1d0 2023-07-05T23:33:22.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.490+0000 7f4b7dae8700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b780cf100 con 0x7f4b78156880 2023-07-05T23:33:22.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.490+0000 7f4b7dae8700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b780cf3e0 con 0x7f4b780aed30 2023-07-05T23:33:22.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.490+0000 7f4b76ffd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4b780aed30 0x7f4b78160580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:22.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.490+0000 7f4b76ffd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4b780aed30 0x7f4b78160580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45598/0 (socket says 172.21.15.27:45598) 2023-07-05T23:33:22.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.490+0000 7f4b77fff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f4b780cc1d0 0x7f4b7815cb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:52766/0 (socket says 172.21.15.27:52766) 2023-07-05T23:33:22.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.490+0000 7f4b76ffd700 1 -- 172.21.15.27:0/1767160794 learned_addr learned my addr 172.21.15.27:0/1767160794 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:22.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.491+0000 7f4b76ffd700 1 -- 172.21.15.27:0/1767160794 >> v1:172.21.15.162:6789/0 conn(0x7f4b78156880 legacy=0x7f4b78069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:22.497 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.491+0000 7f4b76ffd700 1 -- 172.21.15.27:0/1767160794 >> v1:172.21.15.27:6789/0 conn(0x7f4b780cc1d0 legacy=0x7f4b7815cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:22.497 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.491+0000 7f4b76ffd700 1 -- 172.21.15.27:0/1767160794 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b780cd390 con 0x7f4b780aed30 2023-07-05T23:33:22.497 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.491+0000 7f4b76ffd700 1 --2- 172.21.15.27:0/1767160794 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4b780aed30 0x7f4b78160580 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4b680098f0 tx=0x7f4b68009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c41b35a49c5408b2 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:22.497 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.491+0000 7f4b767fc700 1 -- 172.21.15.27:0/1767160794 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b6800b8a0 con 0x7f4b780aed30 2023-07-05T23:33:22.497 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.491+0000 7f4b767fc700 1 -- 172.21.15.27:0/1767160794 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b6800ba00 con 0x7f4b780aed30 2023-07-05T23:33:22.497 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.491+0000 7f4b767fc700 1 -- 172.21.15.27:0/1767160794 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b6800bd90 con 0x7f4b780aed30 2023-07-05T23:33:22.497 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.492+0000 7f4b7dae8700 1 -- 172.21.15.27:0/1767160794 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4b780aed30 msgr2=0x7f4b78160580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:22.497 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.492+0000 7f4b7dae8700 1 --2- 172.21.15.27:0/1767160794 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4b780aed30 0x7f4b78160580 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4b680098f0 tx=0x7f4b68009c00 comp rx=0 tx=0).stop 2023-07-05T23:33:22.498 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.492+0000 7f4b7dae8700 1 -- 172.21.15.27:0/1767160794 shutdown_connections 2023-07-05T23:33:22.498 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.492+0000 7f4b7dae8700 1 --2- 172.21.15.27:0/1767160794 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4b780aed30 0x7f4b78160580 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:22.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.492+0000 7f4b7dae8700 1 -- 172.21.15.27:0/1767160794 >> 172.21.15.27:0/1767160794 conn(0x7f4b7806d4a0 msgr2=0x7f4b7806d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:22.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.492+0000 7f4b7dae8700 1 -- 172.21.15.27:0/1767160794 shutdown_connections 2023-07-05T23:33:22.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.492+0000 7f4b7dae8700 1 -- 172.21.15.27:0/1767160794 wait complete. 2023-07-05T23:33:22.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.493+0000 7f4b7dae8700 1 Processor -- start 2023-07-05T23:33:22.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.493+0000 7f4b7dae8700 1 -- start start 2023-07-05T23:33:22.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.494+0000 7f4b7dae8700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b780aed30 0x7f4b781557d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:22.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.494+0000 7f4b7dae8700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4b780cc1d0 0x7f4b78155100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:22.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.494+0000 7f4b7dae8700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b78156880 0x7f4b780c32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:22.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.494+0000 7f4b7dae8700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b780c47c0 con 0x7f4b780cc1d0 2023-07-05T23:33:22.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.494+0000 7f4b7dae8700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b78155640 con 0x7f4b78156880 2023-07-05T23:33:22.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.494+0000 7f4b7dae8700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b780c3b40 con 0x7f4b780aed30 2023-07-05T23:33:22.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.494+0000 7f4b76ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4b780cc1d0 0x7f4b78155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:22.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.494+0000 7f4b76ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4b780cc1d0 0x7f4b78155100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45604/0 (socket says 172.21.15.27:45604) 2023-07-05T23:33:22.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.494+0000 7f4b76ffd700 1 -- 172.21.15.27:0/3456568425 learned_addr learned my addr 172.21.15.27:0/3456568425 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:22.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.494+0000 7f4b77fff700 1 --2- 172.21.15.27:0/3456568425 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b78156880 0x7f4b780c32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:22.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.494+0000 7f4b76ffd700 1 -- 172.21.15.27:0/3456568425 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b780aed30 msgr2=0x7f4b781557d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:22.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.494+0000 7f4b76ffd700 1 --2- 172.21.15.27:0/3456568425 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b780aed30 0x7f4b781557d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:22.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.494+0000 7f4b76ffd700 1 -- 172.21.15.27:0/3456568425 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b78156880 msgr2=0x7f4b780c32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:22.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.494+0000 7f4b76ffd700 1 --2- 172.21.15.27:0/3456568425 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b78156880 0x7f4b780c32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:22.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.494+0000 7f4b76ffd700 1 -- 172.21.15.27:0/3456568425 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b68009550 con 0x7f4b780cc1d0 2023-07-05T23:33:22.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.494+0000 7f4b77fff700 1 --2- 172.21.15.27:0/3456568425 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b78156880 0x7f4b780c32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T23:33:22.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.494+0000 7f4b76ffd700 1 --2- 172.21.15.27:0/3456568425 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4b780cc1d0 0x7f4b78155100 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4b68000c00 tx=0x7f4b68004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:22.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.494+0000 7f4b6ffff700 1 -- 172.21.15.27:0/3456568425 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b68004570 con 0x7f4b780cc1d0 2023-07-05T23:33:22.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.494+0000 7f4b6ffff700 1 -- 172.21.15.27:0/3456568425 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b6801f070 con 0x7f4b780cc1d0 2023-07-05T23:33:22.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.494+0000 7f4b7dae8700 1 -- 172.21.15.27:0/3456568425 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b780c3e20 con 0x7f4b780cc1d0 2023-07-05T23:33:22.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.495+0000 7f4b6ffff700 1 -- 172.21.15.27:0/3456568425 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b680038a0 con 0x7f4b780cc1d0 2023-07-05T23:33:22.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.495+0000 7f4b7dae8700 1 -- 172.21.15.27:0/3456568425 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b780c43e0 con 0x7f4b780cc1d0 2023-07-05T23:33:22.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.495+0000 7f4b7dae8700 1 -- 172.21.15.27:0/3456568425 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b78073910 con 0x7f4b780cc1d0 2023-07-05T23:33:22.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.496+0000 7f4b6ffff700 1 -- 172.21.15.27:0/3456568425 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4b68021030 con 0x7f4b780cc1d0 2023-07-05T23:33:22.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.496+0000 7f4b6ffff700 1 --2- 172.21.15.27:0/3456568425 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f4b5806ace0 0x7f4b5806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:22.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.497+0000 7f4b6ffff700 1 -- 172.21.15.27:0/3456568425 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4b6808ac40 con 0x7f4b780cc1d0 2023-07-05T23:33:22.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.497+0000 7f4b777fe700 1 --2- 172.21.15.27:0/3456568425 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f4b5806ace0 0x7f4b5806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:22.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.497+0000 7f4b777fe700 1 --2- 172.21.15.27:0/3456568425 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f4b5806ace0 0x7f4b5806d190 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4b60000f60 tx=0x7f4b60007a40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:22.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.501+0000 7f4b6ffff700 1 -- 172.21.15.27:0/3456568425 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4b68055a90 con 0x7f4b780cc1d0 2023-07-05T23:33:22.698 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.695+0000 7f4b7dae8700 1 -- 172.21.15.27:0/3456568425 --> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4b780cd950 con 0x7f4b5806ace0 2023-07-05T23:33:22.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.706+0000 7f4b6ffff700 1 -- 172.21.15.27:0/3456568425 <== mgr.4105 v2:172.21.15.162:6832/3790028097 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367328 (secure 0 0 0) 0x7f4b60005080 con 0x7f4b5806ace0 2023-07-05T23:33:22.713 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:33:22.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.709+0000 7f4b7dae8700 1 -- 172.21.15.27:0/3456568425 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f4b5806ace0 msgr2=0x7f4b5806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:22.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.709+0000 7f4b7dae8700 1 --2- 172.21.15.27:0/3456568425 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f4b5806ace0 0x7f4b5806d190 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4b60000f60 tx=0x7f4b60007a40 comp rx=0 tx=0).stop 2023-07-05T23:33:22.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.709+0000 7f4b7dae8700 1 -- 172.21.15.27:0/3456568425 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4b780cc1d0 msgr2=0x7f4b78155100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:22.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.709+0000 7f4b7dae8700 1 --2- 172.21.15.27:0/3456568425 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4b780cc1d0 0x7f4b78155100 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4b68000c00 tx=0x7f4b68004750 comp rx=0 tx=0).stop 2023-07-05T23:33:22.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.709+0000 7f4b7dae8700 1 -- 172.21.15.27:0/3456568425 shutdown_connections 2023-07-05T23:33:22.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.709+0000 7f4b7dae8700 1 --2- 172.21.15.27:0/3456568425 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b78156880 0x7f4b780c32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:22.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.709+0000 7f4b7dae8700 1 --2- 172.21.15.27:0/3456568425 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f4b5806ace0 0x7f4b5806d190 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:22.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.709+0000 7f4b7dae8700 1 --2- 172.21.15.27:0/3456568425 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b780aed30 0x7f4b781557d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:22.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.709+0000 7f4b7dae8700 1 --2- 172.21.15.27:0/3456568425 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4b780cc1d0 0x7f4b78155100 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:22.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.709+0000 7f4b7dae8700 1 -- 172.21.15.27:0/3456568425 >> 172.21.15.27:0/3456568425 conn(0x7f4b7806d4a0 msgr2=0x7f4b7806b0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:22.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.710+0000 7f4b7dae8700 1 -- 172.21.15.27:0/3456568425 shutdown_connections 2023-07-05T23:33:22.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.710+0000 7f4b7dae8700 1 -- 172.21.15.27:0/3456568425 wait complete. 2023-07-05T23:33:22.718 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2023-07-05T23:33:22.724 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2023-07-05T23:33:21.576375+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219208,"kb_used_data":3592,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755512,"statfs":{"total":773094113280,"available":772869644288,"internally_reserved":0,"allocated":3678208,"data_stored":2186496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003670"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781415+0000","last_change":"2023-07-05T23:32:53.342316+0000","last_active":"2023-07-05T23:32:57.781415+0000","last_peered":"2023-07-05T23:32:57.781415+0000","last_clean":"2023-07-05T23:32:57.781415+0000","last_became_active":"2023-07-05T23:32:53.342061+0000","last_became_peered":"2023-07-05T23:32:53.342061+0000","last_unstale":"2023-07-05T23:32:57.781415+0000","last_undegraded":"2023-07-05T23:32:57.781415+0000","last_fullsized":"2023-07-05T23:32:57.781415+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:38:35.161436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779776+0000","last_change":"2023-07-05T23:32:53.343107+0000","last_active":"2023-07-05T23:32:57.779776+0000","last_peered":"2023-07-05T23:32:57.779776+0000","last_clean":"2023-07-05T23:32:57.779776+0000","last_became_active":"2023-07-05T23:32:53.342843+0000","last_became_peered":"2023-07-05T23:32:53.342843+0000","last_unstale":"2023-07-05T23:32:57.779776+0000","last_undegraded":"2023-07-05T23:32:57.779776+0000","last_fullsized":"2023-07-05T23:32:57.779776+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:20:57.393702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.783279+0000","last_change":"2023-07-05T23:32:53.339304+0000","last_active":"2023-07-05T23:32:57.783279+0000","last_peered":"2023-07-05T23:32:57.783279+0000","last_clean":"2023-07-05T23:32:57.783279+0000","last_became_active":"2023-07-05T23:32:53.338973+0000","last_became_peered":"2023-07-05T23:32:53.338973+0000","last_unstale":"2023-07-05T23:32:57.783279+0000","last_undegraded":"2023-07-05T23:32:57.783279+0000","last_fullsized":"2023-07-05T23:32:57.783279+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:10:47.650972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781305+0000","last_change":"2023-07-05T23:32:53.334788+0000","last_active":"2023-07-05T23:32:57.781305+0000","last_peered":"2023-07-05T23:32:57.781305+0000","last_clean":"2023-07-05T23:32:57.781305+0000","last_became_active":"2023-07-05T23:32:53.334473+0000","last_became_peered":"2023-07-05T23:32:53.334473+0000","last_unstale":"2023-07-05T23:32:57.781305+0000","last_undegraded":"2023-07-05T23:32:57.781305+0000","last_fullsized":"2023-07-05T23:32:57.781305+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:41:19.407762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780497+0000","last_change":"2023-07-05T23:32:53.346034+0000","last_active":"2023-07-05T23:32:57.780497+0000","last_peered":"2023-07-05T23:32:57.780497+0000","last_clean":"2023-07-05T23:32:57.780497+0000","last_became_active":"2023-07-05T23:32:53.345743+0000","last_became_peered":"2023-07-05T23:32:53.345743+0000","last_unstale":"2023-07-05T23:32:57.780497+0000","last_undegraded":"2023-07-05T23:32:57.780497+0000","last_fullsized":"2023-07-05T23:32:57.780497+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:07:52.872003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.782814+0000","last_change":"2023-07-05T23:32:53.335744+0000","last_active":"2023-07-05T23:32:57.782814+0000","last_peered":"2023-07-05T23:32:57.782814+0000","last_clean":"2023-07-05T23:32:57.782814+0000","last_became_active":"2023-07-05T23:32:53.335456+0000","last_became_peered":"2023-07-05T23:32:53.335456+0000","last_unstale":"2023-07-05T23:32:57.782814+0000","last_undegraded":"2023-07-05T23:32:57.782814+0000","last_fullsized":"2023-07-05T23:32:57.782814+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:32:51.547111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781403+0000","last_change":"2023-07-05T23:32:53.341154+0000","last_active":"2023-07-05T23:32:57.781403+0000","last_peered":"2023-07-05T23:32:57.781403+0000","last_clean":"2023-07-05T23:32:57.781403+0000","last_became_active":"2023-07-05T23:32:53.340639+0000","last_became_peered":"2023-07-05T23:32:53.340639+0000","last_unstale":"2023-07-05T23:32:57.781403+0000","last_undegraded":"2023-07-05T23:32:57.781403+0000","last_fullsized":"2023-07-05T23:32:57.781403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:20:29.661027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.778451+0000","last_change":"2023-07-05T23:32:53.336514+0000","last_active":"2023-07-05T23:32:57.778451+0000","last_peered":"2023-07-05T23:32:57.778451+0000","last_clean":"2023-07-05T23:32:57.778451+0000","last_became_active":"2023-07-05T23:32:53.336216+0000","last_became_peered":"2023-07-05T23:32:53.336216+0000","last_unstale":"2023-07-05T23:32:57.778451+0000","last_undegraded":"2023-07-05T23:32:57.778451+0000","last_fullsized":"2023-07-05T23:32:57.778451+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:15:41.388811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781197+0000","last_change":"2023-07-05T23:32:53.348265+0000","last_active":"2023-07-05T23:32:57.781197+0000","last_peered":"2023-07-05T23:32:57.781197+0000","last_clean":"2023-07-05T23:32:57.781197+0000","last_became_active":"2023-07-05T23:32:53.347948+0000","last_became_peered":"2023-07-05T23:32:53.347948+0000","last_unstale":"2023-07-05T23:32:57.781197+0000","last_undegraded":"2023-07-05T23:32:57.781197+0000","last_fullsized":"2023-07-05T23:32:57.781197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:36:17.743168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780020+0000","last_change":"2023-07-05T23:32:53.330422+0000","last_active":"2023-07-05T23:32:57.780020+0000","last_peered":"2023-07-05T23:32:57.780020+0000","last_clean":"2023-07-05T23:32:57.780020+0000","last_became_active":"2023-07-05T23:32:53.330135+0000","last_became_peered":"2023-07-05T23:32:53.330135+0000","last_unstale":"2023-07-05T23:32:57.780020+0000","last_undegraded":"2023-07-05T23:32:57.780020+0000","last_fullsized":"2023-07-05T23:32:57.780020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:51:41.704756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.783413+0000","last_change":"2023-07-05T23:32:53.341815+0000","last_active":"2023-07-05T23:32:57.783413+0000","last_peered":"2023-07-05T23:32:57.783413+0000","last_clean":"2023-07-05T23:32:57.783413+0000","last_became_active":"2023-07-05T23:32:53.341526+0000","last_became_peered":"2023-07-05T23:32:53.341526+0000","last_unstale":"2023-07-05T23:32:57.783413+0000","last_undegraded":"2023-07-05T23:32:57.783413+0000","last_fullsized":"2023-07-05T23:32:57.783413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:32:19.839362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780813+0000","last_change":"2023-07-05T23:32:53.337552+0000","last_active":"2023-07-05T23:32:57.780813+0000","last_peered":"2023-07-05T23:32:57.780813+0000","last_clean":"2023-07-05T23:32:57.780813+0000","last_became_active":"2023-07-05T23:32:53.337279+0000","last_became_peered":"2023-07-05T23:32:53.337279+0000","last_unstale":"2023-07-05T23:32:57.780813+0000","last_undegraded":"2023-07-05T23:32:57.780813+0000","last_fullsized":"2023-07-05T23:32:57.780813+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:02:45.623527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780599+0000","last_change":"2023-07-05T23:32:53.336366+0000","last_active":"2023-07-05T23:32:57.780599+0000","last_peered":"2023-07-05T23:32:57.780599+0000","last_clean":"2023-07-05T23:32:57.780599+0000","last_became_active":"2023-07-05T23:32:53.336083+0000","last_became_peered":"2023-07-05T23:32:53.336083+0000","last_unstale":"2023-07-05T23:32:57.780599+0000","last_undegraded":"2023-07-05T23:32:57.780599+0000","last_fullsized":"2023-07-05T23:32:57.780599+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:38:52.290400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779072+0000","last_change":"2023-07-05T23:32:53.328235+0000","last_active":"2023-07-05T23:32:57.779072+0000","last_peered":"2023-07-05T23:32:57.779072+0000","last_clean":"2023-07-05T23:32:57.779072+0000","last_became_active":"2023-07-05T23:32:53.327918+0000","last_became_peered":"2023-07-05T23:32:53.327918+0000","last_unstale":"2023-07-05T23:32:57.779072+0000","last_undegraded":"2023-07-05T23:32:57.779072+0000","last_fullsized":"2023-07-05T23:32:57.779072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:17:18.286061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780570+0000","last_change":"2023-07-05T23:32:53.340929+0000","last_active":"2023-07-05T23:32:57.780570+0000","last_peered":"2023-07-05T23:32:57.780570+0000","last_clean":"2023-07-05T23:32:57.780570+0000","last_became_active":"2023-07-05T23:32:53.340246+0000","last_became_peered":"2023-07-05T23:32:53.340246+0000","last_unstale":"2023-07-05T23:32:57.780570+0000","last_undegraded":"2023-07-05T23:32:57.780570+0000","last_fullsized":"2023-07-05T23:32:57.780570+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:40:46.792647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.782427+0000","last_change":"2023-07-05T23:32:53.336278+0000","last_active":"2023-07-05T23:32:57.782427+0000","last_peered":"2023-07-05T23:32:57.782427+0000","last_clean":"2023-07-05T23:32:57.782427+0000","last_became_active":"2023-07-05T23:32:53.336006+0000","last_became_peered":"2023-07-05T23:32:53.336006+0000","last_unstale":"2023-07-05T23:32:57.782427+0000","last_undegraded":"2023-07-05T23:32:57.782427+0000","last_fullsized":"2023-07-05T23:32:57.782427+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:22:27.347492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781279+0000","last_change":"2023-07-05T23:32:53.346115+0000","last_active":"2023-07-05T23:32:57.781279+0000","last_peered":"2023-07-05T23:32:57.781279+0000","last_clean":"2023-07-05T23:32:57.781279+0000","last_became_active":"2023-07-05T23:32:53.345848+0000","last_became_peered":"2023-07-05T23:32:53.345848+0000","last_unstale":"2023-07-05T23:32:57.781279+0000","last_undegraded":"2023-07-05T23:32:57.781279+0000","last_fullsized":"2023-07-05T23:32:57.781279+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:25:19.741667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.782779+0000","last_change":"2023-07-05T23:32:53.339001+0000","last_active":"2023-07-05T23:32:57.782779+0000","last_peered":"2023-07-05T23:32:57.782779+0000","last_clean":"2023-07-05T23:32:57.782779+0000","last_became_active":"2023-07-05T23:32:53.335535+0000","last_became_peered":"2023-07-05T23:32:53.335535+0000","last_unstale":"2023-07-05T23:32:57.782779+0000","last_undegraded":"2023-07-05T23:32:57.782779+0000","last_fullsized":"2023-07-05T23:32:57.782779+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:52:25.342366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781210+0000","last_change":"2023-07-05T23:32:53.338403+0000","last_active":"2023-07-05T23:32:57.781210+0000","last_peered":"2023-07-05T23:32:57.781210+0000","last_clean":"2023-07-05T23:32:57.781210+0000","last_became_active":"2023-07-05T23:32:53.338095+0000","last_became_peered":"2023-07-05T23:32:53.338095+0000","last_unstale":"2023-07-05T23:32:57.781210+0000","last_undegraded":"2023-07-05T23:32:57.781210+0000","last_fullsized":"2023-07-05T23:32:57.781210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:53:30.928953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.783844+0000","last_change":"2023-07-05T23:32:53.341961+0000","last_active":"2023-07-05T23:32:57.783844+0000","last_peered":"2023-07-05T23:32:57.783844+0000","last_clean":"2023-07-05T23:32:57.783844+0000","last_became_active":"2023-07-05T23:32:53.341783+0000","last_became_peered":"2023-07-05T23:32:53.341783+0000","last_unstale":"2023-07-05T23:32:57.783844+0000","last_undegraded":"2023-07-05T23:32:57.783844+0000","last_fullsized":"2023-07-05T23:32:57.783844+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:11:32.403021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780722+0000","last_change":"2023-07-05T23:32:53.348405+0000","last_active":"2023-07-05T23:32:57.780722+0000","last_peered":"2023-07-05T23:32:57.780722+0000","last_clean":"2023-07-05T23:32:57.780722+0000","last_became_active":"2023-07-05T23:32:53.348108+0000","last_became_peered":"2023-07-05T23:32:53.348108+0000","last_unstale":"2023-07-05T23:32:57.780722+0000","last_undegraded":"2023-07-05T23:32:57.780722+0000","last_fullsized":"2023-07-05T23:32:57.780722+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:36:17.743168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781700+0000","last_change":"2023-07-05T23:32:53.340963+0000","last_active":"2023-07-05T23:32:57.781700+0000","last_peered":"2023-07-05T23:32:57.781700+0000","last_clean":"2023-07-05T23:32:57.781700+0000","last_became_active":"2023-07-05T23:32:53.340698+0000","last_became_peered":"2023-07-05T23:32:53.340698+0000","last_unstale":"2023-07-05T23:32:57.781700+0000","last_undegraded":"2023-07-05T23:32:57.781700+0000","last_fullsized":"2023-07-05T23:32:57.781700+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:19:10.358522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781287+0000","last_change":"2023-07-05T23:32:53.345981+0000","last_active":"2023-07-05T23:32:57.781287+0000","last_peered":"2023-07-05T23:32:57.781287+0000","last_clean":"2023-07-05T23:32:57.781287+0000","last_became_active":"2023-07-05T23:32:53.345403+0000","last_became_peered":"2023-07-05T23:32:53.345403+0000","last_unstale":"2023-07-05T23:32:57.781287+0000","last_undegraded":"2023-07-05T23:32:57.781287+0000","last_fullsized":"2023-07-05T23:32:57.781287+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:00:21.148640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780634+0000","last_change":"2023-07-05T23:32:53.348335+0000","last_active":"2023-07-05T23:32:57.780634+0000","last_peered":"2023-07-05T23:32:57.780634+0000","last_clean":"2023-07-05T23:32:57.780634+0000","last_became_active":"2023-07-05T23:32:53.348053+0000","last_became_peered":"2023-07-05T23:32:53.348053+0000","last_unstale":"2023-07-05T23:32:57.780634+0000","last_undegraded":"2023-07-05T23:32:57.780634+0000","last_fullsized":"2023-07-05T23:32:57.780634+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:21:31.956439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.777146+0000","last_change":"2023-07-05T23:32:53.339227+0000","last_active":"2023-07-05T23:32:57.777146+0000","last_peered":"2023-07-05T23:32:57.777146+0000","last_clean":"2023-07-05T23:32:57.777146+0000","last_became_active":"2023-07-05T23:32:53.338935+0000","last_became_peered":"2023-07-05T23:32:53.338935+0000","last_unstale":"2023-07-05T23:32:57.777146+0000","last_undegraded":"2023-07-05T23:32:57.777146+0000","last_fullsized":"2023-07-05T23:32:57.777146+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:27:27.060118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.777271+0000","last_change":"2023-07-05T23:32:53.342191+0000","last_active":"2023-07-05T23:32:57.777271+0000","last_peered":"2023-07-05T23:32:57.777271+0000","last_clean":"2023-07-05T23:32:57.777271+0000","last_became_active":"2023-07-05T23:32:53.341948+0000","last_became_peered":"2023-07-05T23:32:53.341948+0000","last_unstale":"2023-07-05T23:32:57.777271+0000","last_undegraded":"2023-07-05T23:32:57.777271+0000","last_fullsized":"2023-07-05T23:32:57.777271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:38:13.889745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779405+0000","last_change":"2023-07-05T23:32:53.336623+0000","last_active":"2023-07-05T23:32:57.779405+0000","last_peered":"2023-07-05T23:32:57.779405+0000","last_clean":"2023-07-05T23:32:57.779405+0000","last_became_active":"2023-07-05T23:32:53.335857+0000","last_became_peered":"2023-07-05T23:32:53.335857+0000","last_unstale":"2023-07-05T23:32:57.779405+0000","last_undegraded":"2023-07-05T23:32:57.779405+0000","last_fullsized":"2023-07-05T23:32:57.779405+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:17:20.092941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.784100+0000","last_change":"2023-07-05T23:32:57.365825+0000","last_active":"2023-07-05T23:32:57.784100+0000","last_peered":"2023-07-05T23:32:57.784100+0000","last_clean":"2023-07-05T23:32:57.784100+0000","last_became_active":"2023-07-05T23:32:57.365409+0000","last_became_peered":"2023-07-05T23:32:57.365409+0000","last_unstale":"2023-07-05T23:32:57.784100+0000","last_undegraded":"2023-07-05T23:32:57.784100+0000","last_fullsized":"2023-07-05T23:32:57.784100+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:47:37.647980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.782903+0000","last_change":"2023-07-05T23:32:52.901348+0000","last_active":"2023-07-05T23:32:57.782903+0000","last_peered":"2023-07-05T23:32:57.782903+0000","last_clean":"2023-07-05T23:32:57.782903+0000","last_became_active":"2023-07-05T23:32:52.901080+0000","last_became_peered":"2023-07-05T23:32:52.901080+0000","last_unstale":"2023-07-05T23:32:57.782903+0000","last_undegraded":"2023-07-05T23:32:57.782903+0000","last_fullsized":"2023-07-05T23:32:57.782903+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:11:28.344067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780698+0000","last_change":"2023-07-05T23:32:53.339739+0000","last_active":"2023-07-05T23:32:57.780698+0000","last_peered":"2023-07-05T23:32:57.780698+0000","last_clean":"2023-07-05T23:32:57.780698+0000","last_became_active":"2023-07-05T23:32:53.339464+0000","last_became_peered":"2023-07-05T23:32:53.339464+0000","last_unstale":"2023-07-05T23:32:57.780698+0000","last_undegraded":"2023-07-05T23:32:57.780698+0000","last_fullsized":"2023-07-05T23:32:57.780698+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:17:18.286061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780977+0000","last_change":"2023-07-05T23:32:57.354002+0000","last_active":"2023-07-05T23:32:57.780977+0000","last_peered":"2023-07-05T23:32:57.780977+0000","last_clean":"2023-07-05T23:32:57.780977+0000","last_became_active":"2023-07-05T23:32:57.353465+0000","last_became_peered":"2023-07-05T23:32:57.353465+0000","last_unstale":"2023-07-05T23:32:57.780977+0000","last_undegraded":"2023-07-05T23:32:57.780977+0000","last_fullsized":"2023-07-05T23:32:57.780977+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:22:44.688998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.776277+0000","last_change":"2023-07-05T23:32:52.909685+0000","last_active":"2023-07-05T23:32:57.776277+0000","last_peered":"2023-07-05T23:32:57.776277+0000","last_clean":"2023-07-05T23:32:57.776277+0000","last_became_active":"2023-07-05T23:32:52.909347+0000","last_became_peered":"2023-07-05T23:32:52.909347+0000","last_unstale":"2023-07-05T23:32:57.776277+0000","last_undegraded":"2023-07-05T23:32:57.776277+0000","last_fullsized":"2023-07-05T23:32:57.776277+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:00:03.115621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780890+0000","last_change":"2023-07-05T23:32:53.339219+0000","last_active":"2023-07-05T23:32:57.780890+0000","last_peered":"2023-07-05T23:32:57.780890+0000","last_clean":"2023-07-05T23:32:57.780890+0000","last_became_active":"2023-07-05T23:32:53.338825+0000","last_became_peered":"2023-07-05T23:32:53.338825+0000","last_unstale":"2023-07-05T23:32:57.780890+0000","last_undegraded":"2023-07-05T23:32:57.780890+0000","last_fullsized":"2023-07-05T23:32:57.780890+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:15:41.388811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781104+0000","last_change":"2023-07-05T23:32:57.359406+0000","last_active":"2023-07-05T23:32:57.781104+0000","last_peered":"2023-07-05T23:32:57.781104+0000","last_clean":"2023-07-05T23:32:57.781104+0000","last_became_active":"2023-07-05T23:32:57.358965+0000","last_became_peered":"2023-07-05T23:32:57.358965+0000","last_unstale":"2023-07-05T23:32:57.781104+0000","last_undegraded":"2023-07-05T23:32:57.781104+0000","last_fullsized":"2023-07-05T23:32:57.781104+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:21:35.396133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780223+0000","last_change":"2023-07-05T23:32:52.909226+0000","last_active":"2023-07-05T23:32:57.780223+0000","last_peered":"2023-07-05T23:32:57.780223+0000","last_clean":"2023-07-05T23:32:57.780223+0000","last_became_active":"2023-07-05T23:32:52.908756+0000","last_became_peered":"2023-07-05T23:32:52.908756+0000","last_unstale":"2023-07-05T23:32:57.780223+0000","last_undegraded":"2023-07-05T23:32:57.780223+0000","last_fullsized":"2023-07-05T23:32:57.780223+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:19:37.582219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781082+0000","last_change":"2023-07-05T23:32:53.337872+0000","last_active":"2023-07-05T23:32:57.781082+0000","last_peered":"2023-07-05T23:32:57.781082+0000","last_clean":"2023-07-05T23:32:57.781082+0000","last_became_active":"2023-07-05T23:32:53.337480+0000","last_became_peered":"2023-07-05T23:32:53.337480+0000","last_unstale":"2023-07-05T23:32:57.781082+0000","last_undegraded":"2023-07-05T23:32:57.781082+0000","last_fullsized":"2023-07-05T23:32:57.781082+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:01:53.561649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780601+0000","last_change":"2023-07-05T23:32:57.356296+0000","last_active":"2023-07-05T23:32:57.780601+0000","last_peered":"2023-07-05T23:32:57.780601+0000","last_clean":"2023-07-05T23:32:57.780601+0000","last_became_active":"2023-07-05T23:32:57.355940+0000","last_became_peered":"2023-07-05T23:32:57.355940+0000","last_unstale":"2023-07-05T23:32:57.780601+0000","last_undegraded":"2023-07-05T23:32:57.780601+0000","last_fullsized":"2023-07-05T23:32:57.780601+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:44:10.928501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781337+0000","last_change":"2023-07-05T23:32:52.904533+0000","last_active":"2023-07-05T23:32:57.781337+0000","last_peered":"2023-07-05T23:32:57.781337+0000","last_clean":"2023-07-05T23:32:57.781337+0000","last_became_active":"2023-07-05T23:32:52.904140+0000","last_became_peered":"2023-07-05T23:32:52.904140+0000","last_unstale":"2023-07-05T23:32:57.781337+0000","last_undegraded":"2023-07-05T23:32:57.781337+0000","last_fullsized":"2023-07-05T23:32:57.781337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:13:04.590957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780100+0000","last_change":"2023-07-05T23:32:53.338517+0000","last_active":"2023-07-05T23:32:57.780100+0000","last_peered":"2023-07-05T23:32:57.780100+0000","last_clean":"2023-07-05T23:32:57.780100+0000","last_became_active":"2023-07-05T23:32:53.338248+0000","last_became_peered":"2023-07-05T23:32:53.338248+0000","last_unstale":"2023-07-05T23:32:57.780100+0000","last_undegraded":"2023-07-05T23:32:57.780100+0000","last_fullsized":"2023-07-05T23:32:57.780100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:38:13.889745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780227+0000","last_change":"2023-07-05T23:32:57.357483+0000","last_active":"2023-07-05T23:32:57.780227+0000","last_peered":"2023-07-05T23:32:57.780227+0000","last_clean":"2023-07-05T23:32:57.780227+0000","last_became_active":"2023-07-05T23:32:57.357039+0000","last_became_peered":"2023-07-05T23:32:57.357039+0000","last_unstale":"2023-07-05T23:32:57.780227+0000","last_undegraded":"2023-07-05T23:32:57.780227+0000","last_fullsized":"2023-07-05T23:32:57.780227+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:07:56.311696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780139+0000","last_change":"2023-07-05T23:32:52.900665+0000","last_active":"2023-07-05T23:32:57.780139+0000","last_peered":"2023-07-05T23:32:57.780139+0000","last_clean":"2023-07-05T23:32:57.780139+0000","last_became_active":"2023-07-05T23:32:52.900352+0000","last_became_peered":"2023-07-05T23:32:52.900352+0000","last_unstale":"2023-07-05T23:32:57.780139+0000","last_undegraded":"2023-07-05T23:32:57.780139+0000","last_fullsized":"2023-07-05T23:32:57.780139+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:43:30.790838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781414+0000","last_change":"2023-07-05T23:32:53.346621+0000","last_active":"2023-07-05T23:32:57.781414+0000","last_peered":"2023-07-05T23:32:57.781414+0000","last_clean":"2023-07-05T23:32:57.781414+0000","last_became_active":"2023-07-05T23:32:53.346373+0000","last_became_peered":"2023-07-05T23:32:53.346373+0000","last_unstale":"2023-07-05T23:32:57.781414+0000","last_undegraded":"2023-07-05T23:32:57.781414+0000","last_fullsized":"2023-07-05T23:32:57.781414+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:22:27.347492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781066+0000","last_change":"2023-07-05T23:32:57.365669+0000","last_active":"2023-07-05T23:32:57.781066+0000","last_peered":"2023-07-05T23:32:57.781066+0000","last_clean":"2023-07-05T23:32:57.781066+0000","last_became_active":"2023-07-05T23:32:57.365200+0000","last_became_peered":"2023-07-05T23:32:57.365200+0000","last_unstale":"2023-07-05T23:32:57.781066+0000","last_undegraded":"2023-07-05T23:32:57.781066+0000","last_fullsized":"2023-07-05T23:32:57.781066+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:51:45.144450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781045+0000","last_change":"2023-07-05T23:32:52.913055+0000","last_active":"2023-07-05T23:32:57.781045+0000","last_peered":"2023-07-05T23:32:57.781045+0000","last_clean":"2023-07-05T23:32:57.781045+0000","last_became_active":"2023-07-05T23:32:52.912749+0000","last_became_peered":"2023-07-05T23:32:52.912749+0000","last_unstale":"2023-07-05T23:32:57.781045+0000","last_undegraded":"2023-07-05T23:32:57.781045+0000","last_fullsized":"2023-07-05T23:32:57.781045+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:13:04.590957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.776668+0000","last_change":"2023-07-05T23:32:53.339331+0000","last_active":"2023-07-05T23:32:57.776668+0000","last_peered":"2023-07-05T23:32:57.776668+0000","last_clean":"2023-07-05T23:32:57.776668+0000","last_became_active":"2023-07-05T23:32:53.339001+0000","last_became_peered":"2023-07-05T23:32:53.339001+0000","last_unstale":"2023-07-05T23:32:57.776668+0000","last_undegraded":"2023-07-05T23:32:57.776668+0000","last_fullsized":"2023-07-05T23:32:57.776668+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:51:56.888322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.776408+0000","last_change":"2023-07-05T23:32:57.354307+0000","last_active":"2023-07-05T23:32:57.776408+0000","last_peered":"2023-07-05T23:32:57.776408+0000","last_clean":"2023-07-05T23:32:57.776408+0000","last_became_active":"2023-07-05T23:32:57.353848+0000","last_became_peered":"2023-07-05T23:32:57.353848+0000","last_unstale":"2023-07-05T23:32:57.776408+0000","last_undegraded":"2023-07-05T23:32:57.776408+0000","last_fullsized":"2023-07-05T23:32:57.776408+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:34:23.584285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'9","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:33:03.186592+0000","last_change":"2023-07-05T23:32:52.904627+0000","last_active":"2023-07-05T23:33:03.186592+0000","last_peered":"2023-07-05T23:33:03.186592+0000","last_clean":"2023-07-05T23:33:03.186592+0000","last_became_active":"2023-07-05T23:32:52.904318+0000","last_became_peered":"2023-07-05T23:32:52.904318+0000","last_unstale":"2023-07-05T23:33:03.186592+0000","last_undegraded":"2023-07-05T23:33:03.186592+0000","last_fullsized":"2023-07-05T23:33:03.186592+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:19:32.514981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.783509+0000","last_change":"2023-07-05T23:32:53.339884+0000","last_active":"2023-07-05T23:32:57.783509+0000","last_peered":"2023-07-05T23:32:57.783509+0000","last_clean":"2023-07-05T23:32:57.783509+0000","last_became_active":"2023-07-05T23:32:53.339583+0000","last_became_peered":"2023-07-05T23:32:53.339583+0000","last_unstale":"2023-07-05T23:32:57.783509+0000","last_undegraded":"2023-07-05T23:32:57.783509+0000","last_fullsized":"2023-07-05T23:32:57.783509+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:24:46.698746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779739+0000","last_change":"2023-07-05T23:32:57.365703+0000","last_active":"2023-07-05T23:32:57.779739+0000","last_peered":"2023-07-05T23:32:57.779739+0000","last_clean":"2023-07-05T23:32:57.779739+0000","last_became_active":"2023-07-05T23:32:57.365204+0000","last_became_peered":"2023-07-05T23:32:57.365204+0000","last_unstale":"2023-07-05T23:32:57.779739+0000","last_undegraded":"2023-07-05T23:32:57.779739+0000","last_fullsized":"2023-07-05T23:32:57.779739+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:20:33.100720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780561+0000","last_change":"2023-07-05T23:32:52.908276+0000","last_active":"2023-07-05T23:32:57.780561+0000","last_peered":"2023-07-05T23:32:57.780561+0000","last_clean":"2023-07-05T23:32:57.780561+0000","last_became_active":"2023-07-05T23:32:52.907970+0000","last_became_peered":"2023-07-05T23:32:52.907970+0000","last_unstale":"2023-07-05T23:32:57.780561+0000","last_undegraded":"2023-07-05T23:32:57.780561+0000","last_fullsized":"2023-07-05T23:32:57.780561+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:15:40.384473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780360+0000","last_change":"2023-07-05T23:32:53.340093+0000","last_active":"2023-07-05T23:32:57.780360+0000","last_peered":"2023-07-05T23:32:57.780360+0000","last_clean":"2023-07-05T23:32:57.780360+0000","last_became_active":"2023-07-05T23:32:53.339827+0000","last_became_peered":"2023-07-05T23:32:53.339827+0000","last_unstale":"2023-07-05T23:32:57.780360+0000","last_undegraded":"2023-07-05T23:32:57.780360+0000","last_fullsized":"2023-07-05T23:32:57.780360+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:19:10.358522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780060+0000","last_change":"2023-07-05T23:32:57.354664+0000","last_active":"2023-07-05T23:32:57.780060+0000","last_peered":"2023-07-05T23:32:57.780060+0000","last_clean":"2023-07-05T23:32:57.780060+0000","last_became_active":"2023-07-05T23:32:57.354235+0000","last_became_peered":"2023-07-05T23:32:57.354235+0000","last_unstale":"2023-07-05T23:32:57.780060+0000","last_undegraded":"2023-07-05T23:32:57.780060+0000","last_fullsized":"2023-07-05T23:32:57.780060+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:13:09.034988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781505+0000","last_change":"2023-07-05T23:32:52.900677+0000","last_active":"2023-07-05T23:32:57.781505+0000","last_peered":"2023-07-05T23:32:57.781505+0000","last_clean":"2023-07-05T23:32:57.781505+0000","last_became_active":"2023-07-05T23:32:52.900387+0000","last_became_peered":"2023-07-05T23:32:52.900387+0000","last_unstale":"2023-07-05T23:32:57.781505+0000","last_undegraded":"2023-07-05T23:32:57.781505+0000","last_fullsized":"2023-07-05T23:32:57.781505+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:19:37.582219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779376+0000","last_change":"2023-07-05T23:32:53.335865+0000","last_active":"2023-07-05T23:32:57.779376+0000","last_peered":"2023-07-05T23:32:57.779376+0000","last_clean":"2023-07-05T23:32:57.779376+0000","last_became_active":"2023-07-05T23:32:53.335513+0000","last_became_peered":"2023-07-05T23:32:53.335513+0000","last_unstale":"2023-07-05T23:32:57.779376+0000","last_undegraded":"2023-07-05T23:32:57.779376+0000","last_fullsized":"2023-07-05T23:32:57.779376+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:19:10.358522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780865+0000","last_change":"2023-07-05T23:32:57.362840+0000","last_active":"2023-07-05T23:32:57.780865+0000","last_peered":"2023-07-05T23:32:57.780865+0000","last_clean":"2023-07-05T23:32:57.780865+0000","last_became_active":"2023-07-05T23:32:57.362407+0000","last_became_peered":"2023-07-05T23:32:57.362407+0000","last_unstale":"2023-07-05T23:32:57.780865+0000","last_undegraded":"2023-07-05T23:32:57.780865+0000","last_fullsized":"2023-07-05T23:32:57.780865+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:20:33.100720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781326+0000","last_change":"2023-07-05T23:32:52.905899+0000","last_active":"2023-07-05T23:32:57.781326+0000","last_peered":"2023-07-05T23:32:57.781326+0000","last_clean":"2023-07-05T23:32:57.781326+0000","last_became_active":"2023-07-05T23:32:52.905595+0000","last_became_peered":"2023-07-05T23:32:52.905595+0000","last_unstale":"2023-07-05T23:32:57.781326+0000","last_undegraded":"2023-07-05T23:32:57.781326+0000","last_fullsized":"2023-07-05T23:32:57.781326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:17:19.088603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780958+0000","last_change":"2023-07-05T23:32:53.342284+0000","last_active":"2023-07-05T23:32:57.780958+0000","last_peered":"2023-07-05T23:32:57.780958+0000","last_clean":"2023-07-05T23:32:57.780958+0000","last_became_active":"2023-07-05T23:32:53.342033+0000","last_became_peered":"2023-07-05T23:32:53.342033+0000","last_unstale":"2023-07-05T23:32:57.780958+0000","last_undegraded":"2023-07-05T23:32:57.780958+0000","last_fullsized":"2023-07-05T23:32:57.780958+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:27:27.060118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779740+0000","last_change":"2023-07-05T23:32:57.360505+0000","last_active":"2023-07-05T23:32:57.779740+0000","last_peered":"2023-07-05T23:32:57.779740+0000","last_clean":"2023-07-05T23:32:57.779740+0000","last_became_active":"2023-07-05T23:32:57.359532+0000","last_became_peered":"2023-07-05T23:32:57.359532+0000","last_unstale":"2023-07-05T23:32:57.779740+0000","last_undegraded":"2023-07-05T23:32:57.779740+0000","last_fullsized":"2023-07-05T23:32:57.779740+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:44:00.668654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780375+0000","last_change":"2023-07-05T23:32:52.903656+0000","last_active":"2023-07-05T23:32:57.780375+0000","last_peered":"2023-07-05T23:32:57.780375+0000","last_clean":"2023-07-05T23:32:57.780375+0000","last_became_active":"2023-07-05T23:32:52.903419+0000","last_became_peered":"2023-07-05T23:32:52.903419+0000","last_unstale":"2023-07-05T23:32:57.780375+0000","last_undegraded":"2023-07-05T23:32:57.780375+0000","last_fullsized":"2023-07-05T23:32:57.780375+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:38:34.157098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780921+0000","last_change":"2023-07-05T23:32:53.341509+0000","last_active":"2023-07-05T23:32:57.780921+0000","last_peered":"2023-07-05T23:32:57.780921+0000","last_clean":"2023-07-05T23:32:57.780921+0000","last_became_active":"2023-07-05T23:32:53.341162+0000","last_became_peered":"2023-07-05T23:32:53.341162+0000","last_unstale":"2023-07-05T23:32:57.780921+0000","last_undegraded":"2023-07-05T23:32:57.780921+0000","last_fullsized":"2023-07-05T23:32:57.780921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:43:57.228961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781521+0000","last_change":"2023-07-05T23:32:57.358009+0000","last_active":"2023-07-05T23:32:57.781521+0000","last_peered":"2023-07-05T23:32:57.781521+0000","last_clean":"2023-07-05T23:32:57.781521+0000","last_became_active":"2023-07-05T23:32:57.357082+0000","last_became_peered":"2023-07-05T23:32:57.357082+0000","last_unstale":"2023-07-05T23:32:57.781521+0000","last_undegraded":"2023-07-05T23:32:57.781521+0000","last_fullsized":"2023-07-05T23:32:57.781521+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:44:00.668654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781205+0000","last_change":"2023-07-05T23:32:52.907916+0000","last_active":"2023-07-05T23:32:57.781205+0000","last_peered":"2023-07-05T23:32:57.781205+0000","last_clean":"2023-07-05T23:32:57.781205+0000","last_became_active":"2023-07-05T23:32:52.907397+0000","last_became_peered":"2023-07-05T23:32:52.907397+0000","last_unstale":"2023-07-05T23:32:57.781205+0000","last_undegraded":"2023-07-05T23:32:57.781205+0000","last_fullsized":"2023-07-05T23:32:57.781205+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:19:37.582219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.778327+0000","last_change":"2023-07-05T23:32:53.334487+0000","last_active":"2023-07-05T23:32:57.778327+0000","last_peered":"2023-07-05T23:32:57.778327+0000","last_clean":"2023-07-05T23:32:57.778327+0000","last_became_active":"2023-07-05T23:32:53.333978+0000","last_became_peered":"2023-07-05T23:32:53.333978+0000","last_unstale":"2023-07-05T23:32:57.778327+0000","last_undegraded":"2023-07-05T23:32:57.778327+0000","last_fullsized":"2023-07-05T23:32:57.778327+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:40:46.792647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780055+0000","last_change":"2023-07-05T23:32:57.362413+0000","last_active":"2023-07-05T23:32:57.780055+0000","last_peered":"2023-07-05T23:32:57.780055+0000","last_clean":"2023-07-05T23:32:57.780055+0000","last_became_active":"2023-07-05T23:32:57.361892+0000","last_became_peered":"2023-07-05T23:32:57.361892+0000","last_unstale":"2023-07-05T23:32:57.780055+0000","last_undegraded":"2023-07-05T23:32:57.780055+0000","last_fullsized":"2023-07-05T23:32:57.780055+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:36:17.176610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781017+0000","last_change":"2023-07-05T23:32:52.908261+0000","last_active":"2023-07-05T23:32:57.781017+0000","last_peered":"2023-07-05T23:32:57.781017+0000","last_clean":"2023-07-05T23:32:57.781017+0000","last_became_active":"2023-07-05T23:32:52.907975+0000","last_became_peered":"2023-07-05T23:32:52.907975+0000","last_unstale":"2023-07-05T23:32:57.781017+0000","last_undegraded":"2023-07-05T23:32:57.781017+0000","last_fullsized":"2023-07-05T23:32:57.781017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:38:12.885407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.782750+0000","last_change":"2023-07-05T23:32:53.339917+0000","last_active":"2023-07-05T23:32:57.782750+0000","last_peered":"2023-07-05T23:32:57.782750+0000","last_clean":"2023-07-05T23:32:57.782750+0000","last_became_active":"2023-07-05T23:32:53.339543+0000","last_became_peered":"2023-07-05T23:32:53.339543+0000","last_unstale":"2023-07-05T23:32:57.782750+0000","last_undegraded":"2023-07-05T23:32:57.782750+0000","last_fullsized":"2023-07-05T23:32:57.782750+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:52:59.154723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780459+0000","last_change":"2023-07-05T23:32:57.361110+0000","last_active":"2023-07-05T23:32:57.780459+0000","last_peered":"2023-07-05T23:32:57.780459+0000","last_clean":"2023-07-05T23:32:57.780459+0000","last_became_active":"2023-07-05T23:32:57.360614+0000","last_became_peered":"2023-07-05T23:32:57.360614+0000","last_unstale":"2023-07-05T23:32:57.780459+0000","last_undegraded":"2023-07-05T23:32:57.780459+0000","last_fullsized":"2023-07-05T23:32:57.780459+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:20:27.254800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781378+0000","last_change":"2023-07-05T23:32:52.907840+0000","last_active":"2023-07-05T23:32:57.781378+0000","last_peered":"2023-07-05T23:32:57.781378+0000","last_clean":"2023-07-05T23:32:57.781378+0000","last_became_active":"2023-07-05T23:32:52.907441+0000","last_became_peered":"2023-07-05T23:32:52.907441+0000","last_unstale":"2023-07-05T23:32:57.781378+0000","last_undegraded":"2023-07-05T23:32:57.781378+0000","last_fullsized":"2023-07-05T23:32:57.781378+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:17:17.281723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.782067+0000","last_change":"2023-07-05T23:32:53.343984+0000","last_active":"2023-07-05T23:32:57.782067+0000","last_peered":"2023-07-05T23:32:57.782067+0000","last_clean":"2023-07-05T23:32:57.782067+0000","last_became_active":"2023-07-05T23:32:53.343566+0000","last_became_peered":"2023-07-05T23:32:53.343566+0000","last_unstale":"2023-07-05T23:32:57.782067+0000","last_undegraded":"2023-07-05T23:32:57.782067+0000","last_fullsized":"2023-07-05T23:32:57.782067+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:37:24.930328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779979+0000","last_change":"2023-07-05T23:32:57.356615+0000","last_active":"2023-07-05T23:32:57.779979+0000","last_peered":"2023-07-05T23:32:57.779979+0000","last_clean":"2023-07-05T23:32:57.779979+0000","last_became_active":"2023-07-05T23:32:57.356091+0000","last_became_peered":"2023-07-05T23:32:57.356091+0000","last_unstale":"2023-07-05T23:32:57.779979+0000","last_undegraded":"2023-07-05T23:32:57.779979+0000","last_fullsized":"2023-07-05T23:32:57.779979+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:10:06.378615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.778881+0000","last_change":"2023-07-05T23:32:52.906210+0000","last_active":"2023-07-05T23:32:57.778881+0000","last_peered":"2023-07-05T23:32:57.778881+0000","last_clean":"2023-07-05T23:32:57.778881+0000","last_became_active":"2023-07-05T23:32:52.905988+0000","last_became_peered":"2023-07-05T23:32:52.905988+0000","last_unstale":"2023-07-05T23:32:57.778881+0000","last_undegraded":"2023-07-05T23:32:57.778881+0000","last_fullsized":"2023-07-05T23:32:57.778881+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:21:30.952101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780176+0000","last_change":"2023-07-05T23:32:53.339662+0000","last_active":"2023-07-05T23:32:57.780176+0000","last_peered":"2023-07-05T23:32:57.780176+0000","last_clean":"2023-07-05T23:32:57.780176+0000","last_became_active":"2023-07-05T23:32:53.339382+0000","last_became_peered":"2023-07-05T23:32:53.339382+0000","last_unstale":"2023-07-05T23:32:57.780176+0000","last_undegraded":"2023-07-05T23:32:57.780176+0000","last_fullsized":"2023-07-05T23:32:57.780176+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:02:13.839378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781483+0000","last_change":"2023-07-05T23:32:57.354958+0000","last_active":"2023-07-05T23:32:57.781483+0000","last_peered":"2023-07-05T23:32:57.781483+0000","last_clean":"2023-07-05T23:32:57.781483+0000","last_became_active":"2023-07-05T23:32:57.354576+0000","last_became_peered":"2023-07-05T23:32:57.354576+0000","last_unstale":"2023-07-05T23:32:57.781483+0000","last_undegraded":"2023-07-05T23:32:57.781483+0000","last_fullsized":"2023-07-05T23:32:57.781483+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:44:10.928501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779954+0000","last_change":"2023-07-05T23:32:52.906470+0000","last_active":"2023-07-05T23:32:57.779954+0000","last_peered":"2023-07-05T23:32:57.779954+0000","last_clean":"2023-07-05T23:32:57.779954+0000","last_became_active":"2023-07-05T23:32:52.906187+0000","last_became_peered":"2023-07-05T23:32:52.906187+0000","last_unstale":"2023-07-05T23:32:57.779954+0000","last_undegraded":"2023-07-05T23:32:57.779954+0000","last_fullsized":"2023-07-05T23:32:57.779954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:25:18.737329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.783687+0000","last_change":"2023-07-05T23:32:53.344178+0000","last_active":"2023-07-05T23:32:57.783687+0000","last_peered":"2023-07-05T23:32:57.783687+0000","last_clean":"2023-07-05T23:32:57.783687+0000","last_became_active":"2023-07-05T23:32:53.343393+0000","last_became_peered":"2023-07-05T23:32:53.343393+0000","last_unstale":"2023-07-05T23:32:57.783687+0000","last_undegraded":"2023-07-05T23:32:57.783687+0000","last_fullsized":"2023-07-05T23:32:57.783687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:01:16.732067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.776877+0000","last_change":"2023-07-05T23:32:57.362812+0000","last_active":"2023-07-05T23:32:57.776877+0000","last_peered":"2023-07-05T23:32:57.776877+0000","last_clean":"2023-07-05T23:32:57.776877+0000","last_became_active":"2023-07-05T23:32:57.362431+0000","last_became_peered":"2023-07-05T23:32:57.362431+0000","last_unstale":"2023-07-05T23:32:57.776877+0000","last_undegraded":"2023-07-05T23:32:57.776877+0000","last_fullsized":"2023-07-05T23:32:57.776877+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:24:35.809378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780786+0000","last_change":"2023-07-05T23:32:52.908272+0000","last_active":"2023-07-05T23:32:57.780786+0000","last_peered":"2023-07-05T23:32:57.780786+0000","last_clean":"2023-07-05T23:32:57.780786+0000","last_became_active":"2023-07-05T23:32:52.907983+0000","last_became_peered":"2023-07-05T23:32:52.907983+0000","last_unstale":"2023-07-05T23:32:57.780786+0000","last_undegraded":"2023-07-05T23:32:57.780786+0000","last_fullsized":"2023-07-05T23:32:57.780786+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:28:38.558463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.783118+0000","last_change":"2023-07-05T23:32:53.339766+0000","last_active":"2023-07-05T23:32:57.783118+0000","last_peered":"2023-07-05T23:32:57.783118+0000","last_clean":"2023-07-05T23:32:57.783118+0000","last_became_active":"2023-07-05T23:32:53.338903+0000","last_became_peered":"2023-07-05T23:32:53.338903+0000","last_unstale":"2023-07-05T23:32:57.783118+0000","last_undegraded":"2023-07-05T23:32:57.783118+0000","last_fullsized":"2023-07-05T23:32:57.783118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:32:24.944898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780131+0000","last_change":"2023-07-05T23:32:57.357001+0000","last_active":"2023-07-05T23:32:57.780131+0000","last_peered":"2023-07-05T23:32:57.780131+0000","last_clean":"2023-07-05T23:32:57.780131+0000","last_became_active":"2023-07-05T23:32:57.356611+0000","last_became_peered":"2023-07-05T23:32:57.356611+0000","last_unstale":"2023-07-05T23:32:57.780131+0000","last_undegraded":"2023-07-05T23:32:57.780131+0000","last_fullsized":"2023-07-05T23:32:57.780131+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:00:24.588333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.782328+0000","last_change":"2023-07-05T23:32:52.907064+0000","last_active":"2023-07-05T23:32:57.782328+0000","last_peered":"2023-07-05T23:32:57.782328+0000","last_clean":"2023-07-05T23:32:57.782328+0000","last_became_active":"2023-07-05T23:32:52.906779+0000","last_became_peered":"2023-07-05T23:32:52.906779+0000","last_unstale":"2023-07-05T23:32:57.782328+0000","last_undegraded":"2023-07-05T23:32:57.782328+0000","last_fullsized":"2023-07-05T23:32:57.782328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:15:22.364630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.782950+0000","last_change":"2023-07-05T23:32:53.341824+0000","last_active":"2023-07-05T23:32:57.782950+0000","last_peered":"2023-07-05T23:32:57.782950+0000","last_clean":"2023-07-05T23:32:57.782950+0000","last_became_active":"2023-07-05T23:32:53.339869+0000","last_became_peered":"2023-07-05T23:32:53.339869+0000","last_unstale":"2023-07-05T23:32:57.782950+0000","last_undegraded":"2023-07-05T23:32:57.782950+0000","last_fullsized":"2023-07-05T23:32:57.782950+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:24:31.034513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.783115+0000","last_change":"2023-07-05T23:32:57.363813+0000","last_active":"2023-07-05T23:32:57.783115+0000","last_peered":"2023-07-05T23:32:57.783115+0000","last_clean":"2023-07-05T23:32:57.783115+0000","last_became_active":"2023-07-05T23:32:57.363409+0000","last_became_peered":"2023-07-05T23:32:57.363409+0000","last_unstale":"2023-07-05T23:32:57.783115+0000","last_undegraded":"2023-07-05T23:32:57.783115+0000","last_fullsized":"2023-07-05T23:32:57.783115+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:28:02.584137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779951+0000","last_change":"2023-07-05T23:32:52.910057+0000","last_active":"2023-07-05T23:32:57.779951+0000","last_peered":"2023-07-05T23:32:57.779951+0000","last_clean":"2023-07-05T23:32:57.779951+0000","last_became_active":"2023-07-05T23:32:52.909169+0000","last_became_peered":"2023-07-05T23:32:52.909169+0000","last_unstale":"2023-07-05T23:32:57.779951+0000","last_undegraded":"2023-07-05T23:32:57.779951+0000","last_fullsized":"2023-07-05T23:32:57.779951+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:36:16.738830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.777230+0000","last_change":"2023-07-05T23:32:53.342851+0000","last_active":"2023-07-05T23:32:57.777230+0000","last_peered":"2023-07-05T23:32:57.777230+0000","last_clean":"2023-07-05T23:32:57.777230+0000","last_became_active":"2023-07-05T23:32:53.342420+0000","last_became_peered":"2023-07-05T23:32:53.342420+0000","last_unstale":"2023-07-05T23:32:57.777230+0000","last_undegraded":"2023-07-05T23:32:57.777230+0000","last_fullsized":"2023-07-05T23:32:57.777230+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:36:17.743168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780080+0000","last_change":"2023-07-05T23:32:57.358997+0000","last_active":"2023-07-05T23:32:57.780080+0000","last_peered":"2023-07-05T23:32:57.780080+0000","last_clean":"2023-07-05T23:32:57.780080+0000","last_became_active":"2023-07-05T23:32:57.358647+0000","last_became_peered":"2023-07-05T23:32:57.358647+0000","last_unstale":"2023-07-05T23:32:57.780080+0000","last_undegraded":"2023-07-05T23:32:57.780080+0000","last_fullsized":"2023-07-05T23:32:57.780080+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:34:23.584285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.777274+0000","last_change":"2023-07-05T23:32:47.790871+0000","last_active":"2023-07-05T23:32:57.777274+0000","last_peered":"2023-07-05T23:32:57.777274+0000","last_clean":"2023-07-05T23:32:57.777274+0000","last_became_active":"2023-07-05T23:32:47.790546+0000","last_became_peered":"2023-07-05T23:32:47.790546+0000","last_unstale":"2023-07-05T23:32:57.777274+0000","last_undegraded":"2023-07-05T23:32:57.777274+0000","last_fullsized":"2023-07-05T23:32:57.777274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_clean_scrub_stamp":"2023-07-05T23:32:46.741565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:12:59.454577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779269+0000","last_change":"2023-07-05T23:32:52.912985+0000","last_active":"2023-07-05T23:32:57.779269+0000","last_peered":"2023-07-05T23:32:57.779269+0000","last_clean":"2023-07-05T23:32:57.779269+0000","last_became_active":"2023-07-05T23:32:52.912682+0000","last_became_peered":"2023-07-05T23:32:52.912682+0000","last_unstale":"2023-07-05T23:32:57.779269+0000","last_undegraded":"2023-07-05T23:32:57.779269+0000","last_fullsized":"2023-07-05T23:32:57.779269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:38:12.885407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.776539+0000","last_change":"2023-07-05T23:32:53.335398+0000","last_active":"2023-07-05T23:32:57.776539+0000","last_peered":"2023-07-05T23:32:57.776539+0000","last_clean":"2023-07-05T23:32:57.776539+0000","last_became_active":"2023-07-05T23:32:53.335073+0000","last_became_peered":"2023-07-05T23:32:53.335073+0000","last_unstale":"2023-07-05T23:32:57.776539+0000","last_undegraded":"2023-07-05T23:32:57.776539+0000","last_fullsized":"2023-07-05T23:32:57.776539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:16:05.844225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780381+0000","last_change":"2023-07-05T23:32:57.368301+0000","last_active":"2023-07-05T23:32:57.780381+0000","last_peered":"2023-07-05T23:32:57.780381+0000","last_clean":"2023-07-05T23:32:57.780381+0000","last_became_active":"2023-07-05T23:32:57.368030+0000","last_became_peered":"2023-07-05T23:32:57.368030+0000","last_unstale":"2023-07-05T23:32:57.780381+0000","last_undegraded":"2023-07-05T23:32:57.780381+0000","last_fullsized":"2023-07-05T23:32:57.780381+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:16:09.283919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.778814+0000","last_change":"2023-07-05T23:32:47.762370+0000","last_active":"2023-07-05T23:32:57.778814+0000","last_peered":"2023-07-05T23:32:57.778814+0000","last_clean":"2023-07-05T23:32:57.778814+0000","last_became_active":"2023-07-05T23:32:47.761996+0000","last_became_peered":"2023-07-05T23:32:47.761996+0000","last_unstale":"2023-07-05T23:32:57.778814+0000","last_undegraded":"2023-07-05T23:32:57.778814+0000","last_fullsized":"2023-07-05T23:32:57.778814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_clean_scrub_stamp":"2023-07-05T23:32:46.741565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:27:20.919400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.783445+0000","last_change":"2023-07-05T23:32:52.904472+0000","last_active":"2023-07-05T23:32:57.783445+0000","last_peered":"2023-07-05T23:32:57.783445+0000","last_clean":"2023-07-05T23:32:57.783445+0000","last_became_active":"2023-07-05T23:32:52.904202+0000","last_became_peered":"2023-07-05T23:32:52.904202+0000","last_unstale":"2023-07-05T23:32:57.783445+0000","last_undegraded":"2023-07-05T23:32:57.783445+0000","last_fullsized":"2023-07-05T23:32:57.783445+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:14:11.507519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.776981+0000","last_change":"2023-07-05T23:32:53.341847+0000","last_active":"2023-07-05T23:32:57.776981+0000","last_peered":"2023-07-05T23:32:57.776981+0000","last_clean":"2023-07-05T23:32:57.776981+0000","last_became_active":"2023-07-05T23:32:53.338626+0000","last_became_peered":"2023-07-05T23:32:53.338626+0000","last_unstale":"2023-07-05T23:32:57.776981+0000","last_undegraded":"2023-07-05T23:32:57.776981+0000","last_fullsized":"2023-07-05T23:32:57.776981+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:07:52.872003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780950+0000","last_change":"2023-07-05T23:32:57.356351+0000","last_active":"2023-07-05T23:32:57.780950+0000","last_peered":"2023-07-05T23:32:57.780950+0000","last_clean":"2023-07-05T23:32:57.780950+0000","last_became_active":"2023-07-05T23:32:57.355882+0000","last_became_peered":"2023-07-05T23:32:57.355882+0000","last_unstale":"2023-07-05T23:32:57.780950+0000","last_undegraded":"2023-07-05T23:32:57.780950+0000","last_fullsized":"2023-07-05T23:32:57.780950+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:22:43.105654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780220+0000","last_change":"2023-07-05T23:32:47.979611+0000","last_active":"2023-07-05T23:32:57.780220+0000","last_peered":"2023-07-05T23:32:57.780220+0000","last_clean":"2023-07-05T23:32:57.780220+0000","last_became_active":"2023-07-05T23:32:47.979348+0000","last_became_peered":"2023-07-05T23:32:47.979348+0000","last_unstale":"2023-07-05T23:32:57.780220+0000","last_undegraded":"2023-07-05T23:32:57.780220+0000","last_fullsized":"2023-07-05T23:32:57.780220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_clean_scrub_stamp":"2023-07-05T23:32:46.741565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:28:01.280864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.776456+0000","last_change":"2023-07-05T23:32:52.907652+0000","last_active":"2023-07-05T23:32:57.776456+0000","last_peered":"2023-07-05T23:32:57.776456+0000","last_clean":"2023-07-05T23:32:57.776456+0000","last_became_active":"2023-07-05T23:32:52.907307+0000","last_became_peered":"2023-07-05T23:32:52.907307+0000","last_unstale":"2023-07-05T23:32:57.776456+0000","last_undegraded":"2023-07-05T23:32:57.776456+0000","last_fullsized":"2023-07-05T23:32:57.776456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:02:12.835040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.777189+0000","last_change":"2023-07-05T23:32:53.338185+0000","last_active":"2023-07-05T23:32:57.777189+0000","last_peered":"2023-07-05T23:32:57.777189+0000","last_clean":"2023-07-05T23:32:57.777189+0000","last_became_active":"2023-07-05T23:32:53.337896+0000","last_became_peered":"2023-07-05T23:32:53.337896+0000","last_unstale":"2023-07-05T23:32:57.777189+0000","last_undegraded":"2023-07-05T23:32:57.777189+0000","last_fullsized":"2023-07-05T23:32:57.777189+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:21:31.956439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780653+0000","last_change":"2023-07-05T23:32:57.355885+0000","last_active":"2023-07-05T23:32:57.780653+0000","last_peered":"2023-07-05T23:32:57.780653+0000","last_clean":"2023-07-05T23:32:57.780653+0000","last_became_active":"2023-07-05T23:32:57.355475+0000","last_became_peered":"2023-07-05T23:32:57.355475+0000","last_unstale":"2023-07-05T23:32:57.780653+0000","last_undegraded":"2023-07-05T23:32:57.780653+0000","last_fullsized":"2023-07-05T23:32:57.780653+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:27:30.499811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779129+0000","last_change":"2023-07-05T23:32:47.761727+0000","last_active":"2023-07-05T23:32:57.779129+0000","last_peered":"2023-07-05T23:32:57.779129+0000","last_clean":"2023-07-05T23:32:57.779129+0000","last_became_active":"2023-07-05T23:32:47.761392+0000","last_became_peered":"2023-07-05T23:32:47.761392+0000","last_unstale":"2023-07-05T23:32:57.779129+0000","last_undegraded":"2023-07-05T23:32:57.779129+0000","last_fullsized":"2023-07-05T23:32:57.779129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_clean_scrub_stamp":"2023-07-05T23:32:46.741565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:36:11.602450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":183,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780467+0000","last_change":"2023-07-05T23:32:42.737690+0000","last_active":"2023-07-05T23:32:57.780467+0000","last_peered":"2023-07-05T23:32:57.780467+0000","last_clean":"2023-07-05T23:32:57.780467+0000","last_became_active":"2023-07-05T23:32:42.736736+0000","last_became_peered":"2023-07-05T23:32:42.736736+0000","last_unstale":"2023-07-05T23:32:57.780467+0000","last_undegraded":"2023-07-05T23:32:57.780467+0000","last_fullsized":"2023-07-05T23:32:57.780467+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:41.674741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:41.674741+0000","last_clean_scrub_stamp":"2023-07-05T23:32:41.674741+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:58:57.987862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779842+0000","last_change":"2023-07-05T23:32:52.912999+0000","last_active":"2023-07-05T23:32:57.779842+0000","last_peered":"2023-07-05T23:32:57.779842+0000","last_clean":"2023-07-05T23:32:57.779842+0000","last_became_active":"2023-07-05T23:32:52.912684+0000","last_became_peered":"2023-07-05T23:32:52.912684+0000","last_unstale":"2023-07-05T23:32:57.779842+0000","last_undegraded":"2023-07-05T23:32:57.779842+0000","last_fullsized":"2023-07-05T23:32:57.779842+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:21:30.952101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780509+0000","last_change":"2023-07-05T23:32:53.344142+0000","last_active":"2023-07-05T23:32:57.780509+0000","last_peered":"2023-07-05T23:32:57.780509+0000","last_clean":"2023-07-05T23:32:57.780509+0000","last_became_active":"2023-07-05T23:32:53.343848+0000","last_became_peered":"2023-07-05T23:32:53.343848+0000","last_unstale":"2023-07-05T23:32:57.780509+0000","last_undegraded":"2023-07-05T23:32:57.780509+0000","last_fullsized":"2023-07-05T23:32:57.780509+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:20:35.381998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780142+0000","last_change":"2023-07-05T23:32:57.366415+0000","last_active":"2023-07-05T23:32:57.780142+0000","last_peered":"2023-07-05T23:32:57.780142+0000","last_clean":"2023-07-05T23:32:57.780142+0000","last_became_active":"2023-07-05T23:32:57.365013+0000","last_became_peered":"2023-07-05T23:32:57.365013+0000","last_unstale":"2023-07-05T23:32:57.780142+0000","last_undegraded":"2023-07-05T23:32:57.780142+0000","last_fullsized":"2023-07-05T23:32:57.780142+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:15:26.808661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780785+0000","last_change":"2023-07-05T23:32:47.767600+0000","last_active":"2023-07-05T23:32:57.780785+0000","last_peered":"2023-07-05T23:32:57.780785+0000","last_clean":"2023-07-05T23:32:57.780785+0000","last_became_active":"2023-07-05T23:32:47.767297+0000","last_became_peered":"2023-07-05T23:32:47.767297+0000","last_unstale":"2023-07-05T23:32:57.780785+0000","last_undegraded":"2023-07-05T23:32:57.780785+0000","last_fullsized":"2023-07-05T23:32:57.780785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_clean_scrub_stamp":"2023-07-05T23:32:46.741565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:25:13.600949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780399+0000","last_change":"2023-07-05T23:32:52.906517+0000","last_active":"2023-07-05T23:32:57.780399+0000","last_peered":"2023-07-05T23:32:57.780399+0000","last_clean":"2023-07-05T23:32:57.780399+0000","last_became_active":"2023-07-05T23:32:52.906204+0000","last_became_peered":"2023-07-05T23:32:52.906204+0000","last_unstale":"2023-07-05T23:32:57.780399+0000","last_undegraded":"2023-07-05T23:32:57.780399+0000","last_fullsized":"2023-07-05T23:32:57.780399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:24:31.365347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780712+0000","last_change":"2023-07-05T23:32:53.340334+0000","last_active":"2023-07-05T23:32:57.780712+0000","last_peered":"2023-07-05T23:32:57.780712+0000","last_clean":"2023-07-05T23:32:57.780712+0000","last_became_active":"2023-07-05T23:32:53.340061+0000","last_became_peered":"2023-07-05T23:32:53.340061+0000","last_unstale":"2023-07-05T23:32:57.780712+0000","last_undegraded":"2023-07-05T23:32:57.780712+0000","last_fullsized":"2023-07-05T23:32:57.780712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:59:09.195404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781199+0000","last_change":"2023-07-05T23:32:57.362424+0000","last_active":"2023-07-05T23:32:57.781199+0000","last_peered":"2023-07-05T23:32:57.781199+0000","last_clean":"2023-07-05T23:32:57.781199+0000","last_became_active":"2023-07-05T23:32:57.361941+0000","last_became_peered":"2023-07-05T23:32:57.361941+0000","last_unstale":"2023-07-05T23:32:57.781199+0000","last_undegraded":"2023-07-05T23:32:57.781199+0000","last_fullsized":"2023-07-05T23:32:57.781199+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:22:39.370920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781202+0000","last_change":"2023-07-05T23:32:47.790754+0000","last_active":"2023-07-05T23:32:57.781202+0000","last_peered":"2023-07-05T23:32:57.781202+0000","last_clean":"2023-07-05T23:32:57.781202+0000","last_became_active":"2023-07-05T23:32:47.790408+0000","last_became_peered":"2023-07-05T23:32:47.790408+0000","last_unstale":"2023-07-05T23:32:57.781202+0000","last_undegraded":"2023-07-05T23:32:57.781202+0000","last_fullsized":"2023-07-05T23:32:57.781202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_clean_scrub_stamp":"2023-07-05T23:32:46.741565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:19:04.217804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.777239+0000","last_change":"2023-07-05T23:32:52.908711+0000","last_active":"2023-07-05T23:32:57.777239+0000","last_peered":"2023-07-05T23:32:57.777239+0000","last_clean":"2023-07-05T23:32:57.777239+0000","last_became_active":"2023-07-05T23:32:52.908379+0000","last_became_peered":"2023-07-05T23:32:52.908379+0000","last_unstale":"2023-07-05T23:32:57.777239+0000","last_undegraded":"2023-07-05T23:32:57.777239+0000","last_fullsized":"2023-07-05T23:32:57.777239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:25:18.737329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780378+0000","last_change":"2023-07-05T23:32:53.331042+0000","last_active":"2023-07-05T23:32:57.780378+0000","last_peered":"2023-07-05T23:32:57.780378+0000","last_clean":"2023-07-05T23:32:57.780378+0000","last_became_active":"2023-07-05T23:32:53.330771+0000","last_became_peered":"2023-07-05T23:32:53.330771+0000","last_unstale":"2023-07-05T23:32:57.780378+0000","last_undegraded":"2023-07-05T23:32:57.780378+0000","last_fullsized":"2023-07-05T23:32:57.780378+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:51:56.888322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.782732+0000","last_change":"2023-07-05T23:32:57.357223+0000","last_active":"2023-07-05T23:32:57.782732+0000","last_peered":"2023-07-05T23:32:57.782732+0000","last_clean":"2023-07-05T23:32:57.782732+0000","last_became_active":"2023-07-05T23:32:57.356797+0000","last_became_peered":"2023-07-05T23:32:57.356797+0000","last_unstale":"2023-07-05T23:32:57.782732+0000","last_undegraded":"2023-07-05T23:32:57.782732+0000","last_fullsized":"2023-07-05T23:32:57.782732+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:49:42.024861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780991+0000","last_change":"2023-07-05T23:32:52.906030+0000","last_active":"2023-07-05T23:32:57.780991+0000","last_peered":"2023-07-05T23:32:57.780991+0000","last_clean":"2023-07-05T23:32:57.780991+0000","last_became_active":"2023-07-05T23:32:52.905704+0000","last_became_peered":"2023-07-05T23:32:52.905704+0000","last_unstale":"2023-07-05T23:32:57.780991+0000","last_undegraded":"2023-07-05T23:32:57.780991+0000","last_fullsized":"2023-07-05T23:32:57.780991+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:20:56.389364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.776986+0000","last_change":"2023-07-05T23:32:47.769126+0000","last_active":"2023-07-05T23:32:57.776986+0000","last_peered":"2023-07-05T23:32:57.776986+0000","last_clean":"2023-07-05T23:32:57.776986+0000","last_became_active":"2023-07-05T23:32:47.768844+0000","last_became_peered":"2023-07-05T23:32:47.768844+0000","last_unstale":"2023-07-05T23:32:57.776986+0000","last_undegraded":"2023-07-05T23:32:57.776986+0000","last_fullsized":"2023-07-05T23:32:57.776986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_clean_scrub_stamp":"2023-07-05T23:32:46.741565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:59:03.054686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779815+0000","last_change":"2023-07-05T23:32:53.335749+0000","last_active":"2023-07-05T23:32:57.779815+0000","last_peered":"2023-07-05T23:32:57.779815+0000","last_clean":"2023-07-05T23:32:57.779815+0000","last_became_active":"2023-07-05T23:32:53.335506+0000","last_became_peered":"2023-07-05T23:32:53.335506+0000","last_unstale":"2023-07-05T23:32:57.779815+0000","last_undegraded":"2023-07-05T23:32:57.779815+0000","last_fullsized":"2023-07-05T23:32:57.779815+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:27:27.060118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779649+0000","last_change":"2023-07-05T23:32:57.362654+0000","last_active":"2023-07-05T23:32:57.779649+0000","last_peered":"2023-07-05T23:32:57.779649+0000","last_clean":"2023-07-05T23:32:57.779649+0000","last_became_active":"2023-07-05T23:32:57.362112+0000","last_became_peered":"2023-07-05T23:32:57.362112+0000","last_unstale":"2023-07-05T23:32:57.779649+0000","last_undegraded":"2023-07-05T23:32:57.779649+0000","last_fullsized":"2023-07-05T23:32:57.779649+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:40:50.232341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780887+0000","last_change":"2023-07-05T23:32:47.769537+0000","last_active":"2023-07-05T23:32:57.780887+0000","last_peered":"2023-07-05T23:32:57.780887+0000","last_clean":"2023-07-05T23:32:57.780887+0000","last_became_active":"2023-07-05T23:32:47.769141+0000","last_became_peered":"2023-07-05T23:32:47.769141+0000","last_unstale":"2023-07-05T23:32:57.780887+0000","last_undegraded":"2023-07-05T23:32:57.780887+0000","last_fullsized":"2023-07-05T23:32:57.780887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_clean_scrub_stamp":"2023-07-05T23:32:46.741565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:48:48.465852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"28'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780818+0000","last_change":"2023-07-05T23:32:52.905759+0000","last_active":"2023-07-05T23:32:57.780818+0000","last_peered":"2023-07-05T23:32:57.780818+0000","last_clean":"2023-07-05T23:32:57.780818+0000","last_became_active":"2023-07-05T23:32:52.905451+0000","last_became_peered":"2023-07-05T23:32:52.905451+0000","last_unstale":"2023-07-05T23:32:57.780818+0000","last_undegraded":"2023-07-05T23:32:57.780818+0000","last_fullsized":"2023-07-05T23:32:57.780818+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:40:45.788309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.782350+0000","last_change":"2023-07-05T23:32:53.332443+0000","last_active":"2023-07-05T23:32:57.782350+0000","last_peered":"2023-07-05T23:32:57.782350+0000","last_clean":"2023-07-05T23:32:57.782350+0000","last_became_active":"2023-07-05T23:32:53.332159+0000","last_became_peered":"2023-07-05T23:32:53.332159+0000","last_unstale":"2023-07-05T23:32:57.782350+0000","last_undegraded":"2023-07-05T23:32:57.782350+0000","last_fullsized":"2023-07-05T23:32:57.782350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:43:31.795176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.777051+0000","last_change":"2023-07-05T23:32:57.363998+0000","last_active":"2023-07-05T23:32:57.777051+0000","last_peered":"2023-07-05T23:32:57.777051+0000","last_clean":"2023-07-05T23:32:57.777051+0000","last_became_active":"2023-07-05T23:32:57.363620+0000","last_became_peered":"2023-07-05T23:32:57.363620+0000","last_unstale":"2023-07-05T23:32:57.777051+0000","last_undegraded":"2023-07-05T23:32:57.777051+0000","last_fullsized":"2023-07-05T23:32:57.777051+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:40:50.232341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780355+0000","last_change":"2023-07-05T23:32:52.908550+0000","last_active":"2023-07-05T23:32:57.780355+0000","last_peered":"2023-07-05T23:32:57.780355+0000","last_clean":"2023-07-05T23:32:57.780355+0000","last_became_active":"2023-07-05T23:32:52.908111+0000","last_became_peered":"2023-07-05T23:32:52.908111+0000","last_unstale":"2023-07-05T23:32:57.780355+0000","last_undegraded":"2023-07-05T23:32:57.780355+0000","last_fullsized":"2023-07-05T23:32:57.780355+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:03:19.819620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781012+0000","last_change":"2023-07-05T23:32:53.340098+0000","last_active":"2023-07-05T23:32:57.781012+0000","last_peered":"2023-07-05T23:32:57.781012+0000","last_clean":"2023-07-05T23:32:57.781012+0000","last_became_active":"2023-07-05T23:32:53.339686+0000","last_became_peered":"2023-07-05T23:32:53.339686+0000","last_unstale":"2023-07-05T23:32:57.781012+0000","last_undegraded":"2023-07-05T23:32:57.781012+0000","last_fullsized":"2023-07-05T23:32:57.781012+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:23:39.749927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781965+0000","last_change":"2023-07-05T23:32:57.356309+0000","last_active":"2023-07-05T23:32:57.781965+0000","last_peered":"2023-07-05T23:32:57.781965+0000","last_clean":"2023-07-05T23:32:57.781965+0000","last_became_active":"2023-07-05T23:32:57.355910+0000","last_became_peered":"2023-07-05T23:32:57.355910+0000","last_unstale":"2023-07-05T23:32:57.781965+0000","last_undegraded":"2023-07-05T23:32:57.781965+0000","last_fullsized":"2023-07-05T23:32:57.781965+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:21:00.833395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779153+0000","last_change":"2023-07-05T23:32:52.899481+0000","last_active":"2023-07-05T23:32:57.779153+0000","last_peered":"2023-07-05T23:32:57.779153+0000","last_clean":"2023-07-05T23:32:57.779153+0000","last_became_active":"2023-07-05T23:32:52.899159+0000","last_became_peered":"2023-07-05T23:32:52.899159+0000","last_unstale":"2023-07-05T23:32:57.779153+0000","last_undegraded":"2023-07-05T23:32:57.779153+0000","last_fullsized":"2023-07-05T23:32:57.779153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:25:18.737329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.782590+0000","last_change":"2023-07-05T23:32:53.343643+0000","last_active":"2023-07-05T23:32:57.782590+0000","last_peered":"2023-07-05T23:32:57.782590+0000","last_clean":"2023-07-05T23:32:57.782590+0000","last_became_active":"2023-07-05T23:32:53.343262+0000","last_became_peered":"2023-07-05T23:32:53.343262+0000","last_unstale":"2023-07-05T23:32:57.782590+0000","last_undegraded":"2023-07-05T23:32:57.782590+0000","last_fullsized":"2023-07-05T23:32:57.782590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:22:31.213068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779248+0000","last_change":"2023-07-05T23:32:57.365478+0000","last_active":"2023-07-05T23:32:57.779248+0000","last_peered":"2023-07-05T23:32:57.779248+0000","last_clean":"2023-07-05T23:32:57.779248+0000","last_became_active":"2023-07-05T23:32:57.365087+0000","last_became_peered":"2023-07-05T23:32:57.365087+0000","last_unstale":"2023-07-05T23:32:57.779248+0000","last_undegraded":"2023-07-05T23:32:57.779248+0000","last_fullsized":"2023-07-05T23:32:57.779248+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:13:09.034988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779268+0000","last_change":"2023-07-05T23:32:52.902806+0000","last_active":"2023-07-05T23:32:57.779268+0000","last_peered":"2023-07-05T23:32:57.779268+0000","last_clean":"2023-07-05T23:32:57.779268+0000","last_became_active":"2023-07-05T23:32:52.901689+0000","last_became_peered":"2023-07-05T23:32:52.901689+0000","last_unstale":"2023-07-05T23:32:57.779268+0000","last_undegraded":"2023-07-05T23:32:57.779268+0000","last_fullsized":"2023-07-05T23:32:57.779268+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:19:37.582219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.782489+0000","last_change":"2023-07-05T23:32:53.346776+0000","last_active":"2023-07-05T23:32:57.782489+0000","last_peered":"2023-07-05T23:32:57.782489+0000","last_clean":"2023-07-05T23:32:57.782489+0000","last_became_active":"2023-07-05T23:32:53.346553+0000","last_became_peered":"2023-07-05T23:32:53.346553+0000","last_unstale":"2023-07-05T23:32:57.782489+0000","last_undegraded":"2023-07-05T23:32:57.782489+0000","last_fullsized":"2023-07-05T23:32:57.782489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:21:03.950759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.782335+0000","last_change":"2023-07-05T23:32:57.353173+0000","last_active":"2023-07-05T23:32:57.782335+0000","last_peered":"2023-07-05T23:32:57.782335+0000","last_clean":"2023-07-05T23:32:57.782335+0000","last_became_active":"2023-07-05T23:32:57.352716+0000","last_became_peered":"2023-07-05T23:32:57.352716+0000","last_unstale":"2023-07-05T23:32:57.782335+0000","last_undegraded":"2023-07-05T23:32:57.782335+0000","last_fullsized":"2023-07-05T23:32:57.782335+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:00:24.588333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780499+0000","last_change":"2023-07-05T23:32:52.906954+0000","last_active":"2023-07-05T23:32:57.780499+0000","last_peered":"2023-07-05T23:32:57.780499+0000","last_clean":"2023-07-05T23:32:57.780499+0000","last_became_active":"2023-07-05T23:32:52.906688+0000","last_became_peered":"2023-07-05T23:32:52.906688+0000","last_unstale":"2023-07-05T23:32:57.780499+0000","last_undegraded":"2023-07-05T23:32:57.780499+0000","last_fullsized":"2023-07-05T23:32:57.780499+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:17:19.088603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781851+0000","last_change":"2023-07-05T23:32:53.348210+0000","last_active":"2023-07-05T23:32:57.781851+0000","last_peered":"2023-07-05T23:32:57.781851+0000","last_clean":"2023-07-05T23:32:57.781851+0000","last_became_active":"2023-07-05T23:32:53.346652+0000","last_became_peered":"2023-07-05T23:32:53.346652+0000","last_unstale":"2023-07-05T23:32:57.781851+0000","last_undegraded":"2023-07-05T23:32:57.781851+0000","last_fullsized":"2023-07-05T23:32:57.781851+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:15:23.368968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.776688+0000","last_change":"2023-07-05T23:32:57.357185+0000","last_active":"2023-07-05T23:32:57.776688+0000","last_peered":"2023-07-05T23:32:57.776688+0000","last_clean":"2023-07-05T23:32:57.776688+0000","last_became_active":"2023-07-05T23:32:57.356637+0000","last_became_peered":"2023-07-05T23:32:57.356637+0000","last_unstale":"2023-07-05T23:32:57.776688+0000","last_undegraded":"2023-07-05T23:32:57.776688+0000","last_fullsized":"2023-07-05T23:32:57.776688+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:03:24.263651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781492+0000","last_change":"2023-07-05T23:32:52.904412+0000","last_active":"2023-07-05T23:32:57.781492+0000","last_peered":"2023-07-05T23:32:57.781492+0000","last_clean":"2023-07-05T23:32:57.781492+0000","last_became_active":"2023-07-05T23:32:52.903823+0000","last_became_peered":"2023-07-05T23:32:52.903823+0000","last_unstale":"2023-07-05T23:32:57.781492+0000","last_undegraded":"2023-07-05T23:32:57.781492+0000","last_fullsized":"2023-07-05T23:32:57.781492+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:38:12.885407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.782622+0000","last_change":"2023-07-05T23:32:53.342800+0000","last_active":"2023-07-05T23:32:57.782622+0000","last_peered":"2023-07-05T23:32:57.782622+0000","last_clean":"2023-07-05T23:32:57.782622+0000","last_became_active":"2023-07-05T23:32:53.339863+0000","last_became_peered":"2023-07-05T23:32:53.339863+0000","last_unstale":"2023-07-05T23:32:57.782622+0000","last_undegraded":"2023-07-05T23:32:57.782622+0000","last_fullsized":"2023-07-05T23:32:57.782622+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:23:04.385250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780633+0000","last_change":"2023-07-05T23:32:53.337066+0000","last_active":"2023-07-05T23:32:57.780633+0000","last_peered":"2023-07-05T23:32:57.780633+0000","last_clean":"2023-07-05T23:32:57.780633+0000","last_became_active":"2023-07-05T23:32:53.336759+0000","last_became_peered":"2023-07-05T23:32:53.336759+0000","last_unstale":"2023-07-05T23:32:57.780633+0000","last_undegraded":"2023-07-05T23:32:57.780633+0000","last_fullsized":"2023-07-05T23:32:57.780633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:37:57.921126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781993+0000","last_change":"2023-07-05T23:32:53.346160+0000","last_active":"2023-07-05T23:32:57.781993+0000","last_peered":"2023-07-05T23:32:57.781993+0000","last_clean":"2023-07-05T23:32:57.781993+0000","last_became_active":"2023-07-05T23:32:53.345711+0000","last_became_peered":"2023-07-05T23:32:53.345711+0000","last_unstale":"2023-07-05T23:32:57.781993+0000","last_undegraded":"2023-07-05T23:32:57.781993+0000","last_fullsized":"2023-07-05T23:32:57.781993+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:43:31.795176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.783058+0000","last_change":"2023-07-05T23:32:53.339729+0000","last_active":"2023-07-05T23:32:57.783058+0000","last_peered":"2023-07-05T23:32:57.783058+0000","last_clean":"2023-07-05T23:32:57.783058+0000","last_became_active":"2023-07-05T23:32:53.339431+0000","last_became_peered":"2023-07-05T23:32:53.339431+0000","last_unstale":"2023-07-05T23:32:57.783058+0000","last_undegraded":"2023-07-05T23:32:57.783058+0000","last_fullsized":"2023-07-05T23:32:57.783058+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:37:45.661547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779811+0000","last_change":"2023-07-05T23:32:53.335512+0000","last_active":"2023-07-05T23:32:57.779811+0000","last_peered":"2023-07-05T23:32:57.779811+0000","last_clean":"2023-07-05T23:32:57.779811+0000","last_became_active":"2023-07-05T23:32:53.335181+0000","last_became_peered":"2023-07-05T23:32:53.335181+0000","last_unstale":"2023-07-05T23:32:57.779811+0000","last_undegraded":"2023-07-05T23:32:57.779811+0000","last_fullsized":"2023-07-05T23:32:57.779811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:15:41.388811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.777103+0000","last_change":"2023-07-05T23:32:53.338171+0000","last_active":"2023-07-05T23:32:57.777103+0000","last_peered":"2023-07-05T23:32:57.777103+0000","last_clean":"2023-07-05T23:32:57.777103+0000","last_became_active":"2023-07-05T23:32:53.337835+0000","last_became_peered":"2023-07-05T23:32:53.337835+0000","last_unstale":"2023-07-05T23:32:57.777103+0000","last_undegraded":"2023-07-05T23:32:57.777103+0000","last_fullsized":"2023-07-05T23:32:57.777103+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:15:41.388811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574860,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":904,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":925696,"data_stored":718950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574860,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":303104,"data_stored":124572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]}]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":303104,"data_stored":124572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574860,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":901120,"data_stored":715522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574861,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":303104,"data_stored":124572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574860,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":307200,"data_stored":124662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0469999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.1779999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1020000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":323584,"data_stored":128422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":311296,"data_stored":125224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2430000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-05T23:33:22.733 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-05T23:33:22.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.888+0000 7f7ae9dec700 1 Processor -- start 2023-07-05T23:33:22.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.888+0000 7f7ae9dec700 1 -- start start 2023-07-05T23:33:22.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.889+0000 7f7ae9dec700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f7ae415cb60 0x7f7ae415cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:22.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.889+0000 7f7ae9dec700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7ae415d700 0x7f7ae406e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:22.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.889+0000 7f7ae9dec700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ae406f220 con 0x7f7ae40caea0 2023-07-05T23:33:22.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.889+0000 7f7ae9dec700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ae40c9e60 con 0x7f7ae415cb60 2023-07-05T23:33:22.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.889+0000 7f7ae9dec700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ae415d470 con 0x7f7ae415d700 2023-07-05T23:33:22.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.889+0000 7f7ae37fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f7ae415cb60 0x7f7ae415cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:22.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.889+0000 7f7ae37fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f7ae415cb60 0x7f7ae415cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45610/0 (socket says 172.21.15.27:45610) 2023-07-05T23:33:22.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.889+0000 7f7ae37fe700 1 -- 172.21.15.27:0/2982174769 learned_addr learned my addr 172.21.15.27:0/2982174769 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:22.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.889+0000 7f7ae3fff700 1 --1- 172.21.15.27:0/2982174769 >> v1:172.21.15.27:6789/0 conn(0x7f7ae40caea0 0x7f7ae40ccb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:52780/0 (socket says 172.21.15.27:52780) 2023-07-05T23:33:22.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.889+0000 7f7ae37fe700 1 -- 172.21.15.27:0/2982174769 >> v2:172.21.15.162:3300/0 conn(0x7f7ae415d700 msgr2=0x7f7ae406e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:22.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.889+0000 7f7ae2ffd700 1 --2- 172.21.15.27:0/2982174769 >> v2:172.21.15.162:3300/0 conn(0x7f7ae415d700 0x7f7ae406e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:22.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.889+0000 7f7ae37fe700 1 --2- 172.21.15.27:0/2982174769 >> v2:172.21.15.162:3300/0 conn(0x7f7ae415d700 0x7f7ae406e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:22.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.889+0000 7f7ae37fe700 1 -- 172.21.15.27:0/2982174769 >> v1:172.21.15.27:6789/0 conn(0x7f7ae40caea0 legacy=0x7f7ae40ccb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:22.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.889+0000 7f7ae37fe700 1 -- 172.21.15.27:0/2982174769 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ae40ca0e0 con 0x7f7ae415cb60 2023-07-05T23:33:22.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.889+0000 7f7ae2ffd700 1 --2- 172.21.15.27:0/2982174769 >> v2:172.21.15.162:3300/0 conn(0x7f7ae415d700 0x7f7ae406e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T23:33:22.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.890+0000 7f7ae37fe700 1 --2- 172.21.15.27:0/2982174769 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ae415cb60 0x7f7ae415cf30 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7ad400bb90 tx=0x7f7ad400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ce45a623442e743 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:22.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.890+0000 7f7ae27fc700 1 -- 172.21.15.27:0/2982174769 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad400dd10 con 0x7f7ae415cb60 2023-07-05T23:33:22.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.890+0000 7f7ae27fc700 1 -- 172.21.15.27:0/2982174769 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ad400de70 con 0x7f7ae415cb60 2023-07-05T23:33:22.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.890+0000 7f7ae27fc700 1 -- 172.21.15.27:0/2982174769 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad4010670 con 0x7f7ae415cb60 2023-07-05T23:33:22.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.890+0000 7f7ae9dec700 1 -- 172.21.15.27:0/2982174769 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ae415cb60 msgr2=0x7f7ae415cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:22.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.890+0000 7f7ae9dec700 1 --2- 172.21.15.27:0/2982174769 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ae415cb60 0x7f7ae415cf30 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7ad400bb90 tx=0x7f7ad400bea0 comp rx=0 tx=0).stop 2023-07-05T23:33:22.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.890+0000 7f7ae9dec700 1 -- 172.21.15.27:0/2982174769 shutdown_connections 2023-07-05T23:33:22.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.890+0000 7f7ae9dec700 1 --2- 172.21.15.27:0/2982174769 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ae415cb60 0x7f7ae415cf30 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:22.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.890+0000 7f7ae9dec700 1 --2- 172.21.15.27:0/2982174769 >> v2:172.21.15.162:3300/0 conn(0x7f7ae415d700 0x7f7ae406e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:22.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.890+0000 7f7ae9dec700 1 -- 172.21.15.27:0/2982174769 >> 172.21.15.27:0/2982174769 conn(0x7f7ae40b1740 msgr2=0x7f7ae406cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:22.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.890+0000 7f7ae9dec700 1 -- 172.21.15.27:0/2982174769 shutdown_connections 2023-07-05T23:33:22.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.890+0000 7f7ae9dec700 1 -- 172.21.15.27:0/2982174769 wait complete. 2023-07-05T23:33:22.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.892+0000 7f7ae9dec700 1 Processor -- start 2023-07-05T23:33:22.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.892+0000 7f7ae9dec700 1 -- start start 2023-07-05T23:33:22.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.892+0000 7f7ae9dec700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ae40caea0 0x7f7ae40acf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:22.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.892+0000 7f7ae9dec700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ae415cb60 0x7f7ae4154070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:22.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.892+0000 7f7ae9dec700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7ae415d700 0x7f7ae40ac320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:22.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.892+0000 7f7ae9dec700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae40adb90 con 0x7f7ae40caea0 2023-07-05T23:33:22.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.892+0000 7f7ae9dec700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae40ab8d0 con 0x7f7ae415cb60 2023-07-05T23:33:22.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.892+0000 7f7ae9dec700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae40abe90 con 0x7f7ae415d700 2023-07-05T23:33:22.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.893+0000 7f7ae37fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ae40caea0 0x7f7ae40acf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:22.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.893+0000 7f7ae37fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ae40caea0 0x7f7ae40acf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45616/0 (socket says 172.21.15.27:45616) 2023-07-05T23:33:22.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.893+0000 7f7ae37fe700 1 -- 172.21.15.27:0/2372711577 learned_addr learned my addr 172.21.15.27:0/2372711577 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:22.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.893+0000 7f7ae2ffd700 1 --2- 172.21.15.27:0/2372711577 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ae415cb60 0x7f7ae4154070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:22.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.893+0000 7f7ae37fe700 1 -- 172.21.15.27:0/2372711577 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7ae415d700 msgr2=0x7f7ae40ac320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:22.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.893+0000 7f7ae37fe700 1 --2- 172.21.15.27:0/2372711577 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7ae415d700 0x7f7ae40ac320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:22.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.893+0000 7f7ae37fe700 1 -- 172.21.15.27:0/2372711577 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ae415cb60 msgr2=0x7f7ae4154070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:22.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.893+0000 7f7ae37fe700 1 --2- 172.21.15.27:0/2372711577 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ae415cb60 0x7f7ae4154070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:22.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.893+0000 7f7ae37fe700 1 -- 172.21.15.27:0/2372711577 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ad400b7f0 con 0x7f7ae40caea0 2023-07-05T23:33:22.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.893+0000 7f7ae37fe700 1 --2- 172.21.15.27:0/2372711577 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ae40caea0 0x7f7ae40acf60 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7ae4066b70 tx=0x7f7ad4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:22.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.893+0000 7f7acbfff700 1 -- 172.21.15.27:0/2372711577 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad4003da0 con 0x7f7ae40caea0 2023-07-05T23:33:22.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.893+0000 7f7acbfff700 1 -- 172.21.15.27:0/2372711577 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ad4010470 con 0x7f7ae40caea0 2023-07-05T23:33:22.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.893+0000 7f7acbfff700 1 -- 172.21.15.27:0/2372711577 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad4010820 con 0x7f7ae40caea0 2023-07-05T23:33:22.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.893+0000 7f7ae9dec700 1 -- 172.21.15.27:0/2372711577 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ae41587d0 con 0x7f7ae40caea0 2023-07-05T23:33:22.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.893+0000 7f7ae9dec700 1 -- 172.21.15.27:0/2372711577 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ae40ad680 con 0x7f7ae40caea0 2023-07-05T23:33:22.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.894+0000 7f7ae9dec700 1 -- 172.21.15.27:0/2372711577 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ae4073910 con 0x7f7ae40caea0 2023-07-05T23:33:22.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.895+0000 7f7acbfff700 1 -- 172.21.15.27:0/2372711577 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7ad4019400 con 0x7f7ae40caea0 2023-07-05T23:33:22.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.895+0000 7f7acbfff700 1 --2- 172.21.15.27:0/2372711577 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f7ad006ace0 0x7f7ad006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:22.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.895+0000 7f7acbfff700 1 -- 172.21.15.27:0/2372711577 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7ad408af10 con 0x7f7ae40caea0 2023-07-05T23:33:22.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.895+0000 7f7ae2ffd700 1 --2- 172.21.15.27:0/2372711577 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f7ad006ace0 0x7f7ad006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:22.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.896+0000 7f7ae2ffd700 1 --2- 172.21.15.27:0/2372711577 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f7ad006ace0 0x7f7ad006d190 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7ad8006fd0 tx=0x7f7ad8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:22.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:22.900+0000 7f7acbfff700 1 -- 172.21.15.27:0/2372711577 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7ad4055e10 con 0x7f7ae40caea0 2023-07-05T23:33:23.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.094+0000 7f7ae9dec700 1 -- 172.21.15.27:0/2372711577 --> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7ae40ca6a0 con 0x7f7ad006ace0 2023-07-05T23:33:23.106 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.104+0000 7f7acbfff700 1 -- 172.21.15.27:0/2372711577 <== mgr.4105 v2:172.21.15.162:6832/3790028097 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367328 (secure 0 0 0) 0x7f7ad800c040 con 0x7f7ad006ace0 2023-07-05T23:33:23.110 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:33:23.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.108+0000 7f7ae9dec700 1 -- 172.21.15.27:0/2372711577 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f7ad006ace0 msgr2=0x7f7ad006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:23.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.108+0000 7f7ae9dec700 1 --2- 172.21.15.27:0/2372711577 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f7ad006ace0 0x7f7ad006d190 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7ad8006fd0 tx=0x7f7ad8008040 comp rx=0 tx=0).stop 2023-07-05T23:33:23.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.108+0000 7f7ae9dec700 1 -- 172.21.15.27:0/2372711577 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ae40caea0 msgr2=0x7f7ae40acf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:23.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.108+0000 7f7ae9dec700 1 --2- 172.21.15.27:0/2372711577 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ae40caea0 0x7f7ae40acf60 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7ae4066b70 tx=0x7f7ad4004750 comp rx=0 tx=0).stop 2023-07-05T23:33:23.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.108+0000 7f7ae9dec700 1 -- 172.21.15.27:0/2372711577 shutdown_connections 2023-07-05T23:33:23.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.108+0000 7f7ae9dec700 1 --2- 172.21.15.27:0/2372711577 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f7ad006ace0 0x7f7ad006d190 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:23.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.108+0000 7f7ae9dec700 1 --2- 172.21.15.27:0/2372711577 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7ae415d700 0x7f7ae40ac320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:23.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.108+0000 7f7ae9dec700 1 --2- 172.21.15.27:0/2372711577 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ae40caea0 0x7f7ae40acf60 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:23.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.108+0000 7f7ae9dec700 1 --2- 172.21.15.27:0/2372711577 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ae415cb60 0x7f7ae4154070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:23.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.108+0000 7f7ae9dec700 1 -- 172.21.15.27:0/2372711577 >> 172.21.15.27:0/2372711577 conn(0x7f7ae40b1740 msgr2=0x7f7ae40cb300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:23.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.108+0000 7f7ae9dec700 1 -- 172.21.15.27:0/2372711577 shutdown_connections 2023-07-05T23:33:23.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.108+0000 7f7ae9dec700 1 -- 172.21.15.27:0/2372711577 wait complete. 2023-07-05T23:33:23.113 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2023-07-05T23:33:23.122 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2023-07-05T23:33:21.576375+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219208,"kb_used_data":3592,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755512,"statfs":{"total":773094113280,"available":772869644288,"internally_reserved":0,"allocated":3678208,"data_stored":2186496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003670"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781415+0000","last_change":"2023-07-05T23:32:53.342316+0000","last_active":"2023-07-05T23:32:57.781415+0000","last_peered":"2023-07-05T23:32:57.781415+0000","last_clean":"2023-07-05T23:32:57.781415+0000","last_became_active":"2023-07-05T23:32:53.342061+0000","last_became_peered":"2023-07-05T23:32:53.342061+0000","last_unstale":"2023-07-05T23:32:57.781415+0000","last_undegraded":"2023-07-05T23:32:57.781415+0000","last_fullsized":"2023-07-05T23:32:57.781415+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:38:35.161436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779776+0000","last_change":"2023-07-05T23:32:53.343107+0000","last_active":"2023-07-05T23:32:57.779776+0000","last_peered":"2023-07-05T23:32:57.779776+0000","last_clean":"2023-07-05T23:32:57.779776+0000","last_became_active":"2023-07-05T23:32:53.342843+0000","last_became_peered":"2023-07-05T23:32:53.342843+0000","last_unstale":"2023-07-05T23:32:57.779776+0000","last_undegraded":"2023-07-05T23:32:57.779776+0000","last_fullsized":"2023-07-05T23:32:57.779776+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:20:57.393702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.783279+0000","last_change":"2023-07-05T23:32:53.339304+0000","last_active":"2023-07-05T23:32:57.783279+0000","last_peered":"2023-07-05T23:32:57.783279+0000","last_clean":"2023-07-05T23:32:57.783279+0000","last_became_active":"2023-07-05T23:32:53.338973+0000","last_became_peered":"2023-07-05T23:32:53.338973+0000","last_unstale":"2023-07-05T23:32:57.783279+0000","last_undegraded":"2023-07-05T23:32:57.783279+0000","last_fullsized":"2023-07-05T23:32:57.783279+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:10:47.650972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781305+0000","last_change":"2023-07-05T23:32:53.334788+0000","last_active":"2023-07-05T23:32:57.781305+0000","last_peered":"2023-07-05T23:32:57.781305+0000","last_clean":"2023-07-05T23:32:57.781305+0000","last_became_active":"2023-07-05T23:32:53.334473+0000","last_became_peered":"2023-07-05T23:32:53.334473+0000","last_unstale":"2023-07-05T23:32:57.781305+0000","last_undegraded":"2023-07-05T23:32:57.781305+0000","last_fullsized":"2023-07-05T23:32:57.781305+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:41:19.407762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780497+0000","last_change":"2023-07-05T23:32:53.346034+0000","last_active":"2023-07-05T23:32:57.780497+0000","last_peered":"2023-07-05T23:32:57.780497+0000","last_clean":"2023-07-05T23:32:57.780497+0000","last_became_active":"2023-07-05T23:32:53.345743+0000","last_became_peered":"2023-07-05T23:32:53.345743+0000","last_unstale":"2023-07-05T23:32:57.780497+0000","last_undegraded":"2023-07-05T23:32:57.780497+0000","last_fullsized":"2023-07-05T23:32:57.780497+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:07:52.872003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.782814+0000","last_change":"2023-07-05T23:32:53.335744+0000","last_active":"2023-07-05T23:32:57.782814+0000","last_peered":"2023-07-05T23:32:57.782814+0000","last_clean":"2023-07-05T23:32:57.782814+0000","last_became_active":"2023-07-05T23:32:53.335456+0000","last_became_peered":"2023-07-05T23:32:53.335456+0000","last_unstale":"2023-07-05T23:32:57.782814+0000","last_undegraded":"2023-07-05T23:32:57.782814+0000","last_fullsized":"2023-07-05T23:32:57.782814+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:32:51.547111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781403+0000","last_change":"2023-07-05T23:32:53.341154+0000","last_active":"2023-07-05T23:32:57.781403+0000","last_peered":"2023-07-05T23:32:57.781403+0000","last_clean":"2023-07-05T23:32:57.781403+0000","last_became_active":"2023-07-05T23:32:53.340639+0000","last_became_peered":"2023-07-05T23:32:53.340639+0000","last_unstale":"2023-07-05T23:32:57.781403+0000","last_undegraded":"2023-07-05T23:32:57.781403+0000","last_fullsized":"2023-07-05T23:32:57.781403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:20:29.661027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.778451+0000","last_change":"2023-07-05T23:32:53.336514+0000","last_active":"2023-07-05T23:32:57.778451+0000","last_peered":"2023-07-05T23:32:57.778451+0000","last_clean":"2023-07-05T23:32:57.778451+0000","last_became_active":"2023-07-05T23:32:53.336216+0000","last_became_peered":"2023-07-05T23:32:53.336216+0000","last_unstale":"2023-07-05T23:32:57.778451+0000","last_undegraded":"2023-07-05T23:32:57.778451+0000","last_fullsized":"2023-07-05T23:32:57.778451+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:15:41.388811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781197+0000","last_change":"2023-07-05T23:32:53.348265+0000","last_active":"2023-07-05T23:32:57.781197+0000","last_peered":"2023-07-05T23:32:57.781197+0000","last_clean":"2023-07-05T23:32:57.781197+0000","last_became_active":"2023-07-05T23:32:53.347948+0000","last_became_peered":"2023-07-05T23:32:53.347948+0000","last_unstale":"2023-07-05T23:32:57.781197+0000","last_undegraded":"2023-07-05T23:32:57.781197+0000","last_fullsized":"2023-07-05T23:32:57.781197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:36:17.743168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780020+0000","last_change":"2023-07-05T23:32:53.330422+0000","last_active":"2023-07-05T23:32:57.780020+0000","last_peered":"2023-07-05T23:32:57.780020+0000","last_clean":"2023-07-05T23:32:57.780020+0000","last_became_active":"2023-07-05T23:32:53.330135+0000","last_became_peered":"2023-07-05T23:32:53.330135+0000","last_unstale":"2023-07-05T23:32:57.780020+0000","last_undegraded":"2023-07-05T23:32:57.780020+0000","last_fullsized":"2023-07-05T23:32:57.780020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:51:41.704756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.783413+0000","last_change":"2023-07-05T23:32:53.341815+0000","last_active":"2023-07-05T23:32:57.783413+0000","last_peered":"2023-07-05T23:32:57.783413+0000","last_clean":"2023-07-05T23:32:57.783413+0000","last_became_active":"2023-07-05T23:32:53.341526+0000","last_became_peered":"2023-07-05T23:32:53.341526+0000","last_unstale":"2023-07-05T23:32:57.783413+0000","last_undegraded":"2023-07-05T23:32:57.783413+0000","last_fullsized":"2023-07-05T23:32:57.783413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:32:19.839362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780813+0000","last_change":"2023-07-05T23:32:53.337552+0000","last_active":"2023-07-05T23:32:57.780813+0000","last_peered":"2023-07-05T23:32:57.780813+0000","last_clean":"2023-07-05T23:32:57.780813+0000","last_became_active":"2023-07-05T23:32:53.337279+0000","last_became_peered":"2023-07-05T23:32:53.337279+0000","last_unstale":"2023-07-05T23:32:57.780813+0000","last_undegraded":"2023-07-05T23:32:57.780813+0000","last_fullsized":"2023-07-05T23:32:57.780813+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:02:45.623527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780599+0000","last_change":"2023-07-05T23:32:53.336366+0000","last_active":"2023-07-05T23:32:57.780599+0000","last_peered":"2023-07-05T23:32:57.780599+0000","last_clean":"2023-07-05T23:32:57.780599+0000","last_became_active":"2023-07-05T23:32:53.336083+0000","last_became_peered":"2023-07-05T23:32:53.336083+0000","last_unstale":"2023-07-05T23:32:57.780599+0000","last_undegraded":"2023-07-05T23:32:57.780599+0000","last_fullsized":"2023-07-05T23:32:57.780599+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:38:52.290400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779072+0000","last_change":"2023-07-05T23:32:53.328235+0000","last_active":"2023-07-05T23:32:57.779072+0000","last_peered":"2023-07-05T23:32:57.779072+0000","last_clean":"2023-07-05T23:32:57.779072+0000","last_became_active":"2023-07-05T23:32:53.327918+0000","last_became_peered":"2023-07-05T23:32:53.327918+0000","last_unstale":"2023-07-05T23:32:57.779072+0000","last_undegraded":"2023-07-05T23:32:57.779072+0000","last_fullsized":"2023-07-05T23:32:57.779072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:17:18.286061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780570+0000","last_change":"2023-07-05T23:32:53.340929+0000","last_active":"2023-07-05T23:32:57.780570+0000","last_peered":"2023-07-05T23:32:57.780570+0000","last_clean":"2023-07-05T23:32:57.780570+0000","last_became_active":"2023-07-05T23:32:53.340246+0000","last_became_peered":"2023-07-05T23:32:53.340246+0000","last_unstale":"2023-07-05T23:32:57.780570+0000","last_undegraded":"2023-07-05T23:32:57.780570+0000","last_fullsized":"2023-07-05T23:32:57.780570+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:40:46.792647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.782427+0000","last_change":"2023-07-05T23:32:53.336278+0000","last_active":"2023-07-05T23:32:57.782427+0000","last_peered":"2023-07-05T23:32:57.782427+0000","last_clean":"2023-07-05T23:32:57.782427+0000","last_became_active":"2023-07-05T23:32:53.336006+0000","last_became_peered":"2023-07-05T23:32:53.336006+0000","last_unstale":"2023-07-05T23:32:57.782427+0000","last_undegraded":"2023-07-05T23:32:57.782427+0000","last_fullsized":"2023-07-05T23:32:57.782427+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:22:27.347492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781279+0000","last_change":"2023-07-05T23:32:53.346115+0000","last_active":"2023-07-05T23:32:57.781279+0000","last_peered":"2023-07-05T23:32:57.781279+0000","last_clean":"2023-07-05T23:32:57.781279+0000","last_became_active":"2023-07-05T23:32:53.345848+0000","last_became_peered":"2023-07-05T23:32:53.345848+0000","last_unstale":"2023-07-05T23:32:57.781279+0000","last_undegraded":"2023-07-05T23:32:57.781279+0000","last_fullsized":"2023-07-05T23:32:57.781279+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:25:19.741667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.782779+0000","last_change":"2023-07-05T23:32:53.339001+0000","last_active":"2023-07-05T23:32:57.782779+0000","last_peered":"2023-07-05T23:32:57.782779+0000","last_clean":"2023-07-05T23:32:57.782779+0000","last_became_active":"2023-07-05T23:32:53.335535+0000","last_became_peered":"2023-07-05T23:32:53.335535+0000","last_unstale":"2023-07-05T23:32:57.782779+0000","last_undegraded":"2023-07-05T23:32:57.782779+0000","last_fullsized":"2023-07-05T23:32:57.782779+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:52:25.342366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781210+0000","last_change":"2023-07-05T23:32:53.338403+0000","last_active":"2023-07-05T23:32:57.781210+0000","last_peered":"2023-07-05T23:32:57.781210+0000","last_clean":"2023-07-05T23:32:57.781210+0000","last_became_active":"2023-07-05T23:32:53.338095+0000","last_became_peered":"2023-07-05T23:32:53.338095+0000","last_unstale":"2023-07-05T23:32:57.781210+0000","last_undegraded":"2023-07-05T23:32:57.781210+0000","last_fullsized":"2023-07-05T23:32:57.781210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:53:30.928953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.783844+0000","last_change":"2023-07-05T23:32:53.341961+0000","last_active":"2023-07-05T23:32:57.783844+0000","last_peered":"2023-07-05T23:32:57.783844+0000","last_clean":"2023-07-05T23:32:57.783844+0000","last_became_active":"2023-07-05T23:32:53.341783+0000","last_became_peered":"2023-07-05T23:32:53.341783+0000","last_unstale":"2023-07-05T23:32:57.783844+0000","last_undegraded":"2023-07-05T23:32:57.783844+0000","last_fullsized":"2023-07-05T23:32:57.783844+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:11:32.403021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780722+0000","last_change":"2023-07-05T23:32:53.348405+0000","last_active":"2023-07-05T23:32:57.780722+0000","last_peered":"2023-07-05T23:32:57.780722+0000","last_clean":"2023-07-05T23:32:57.780722+0000","last_became_active":"2023-07-05T23:32:53.348108+0000","last_became_peered":"2023-07-05T23:32:53.348108+0000","last_unstale":"2023-07-05T23:32:57.780722+0000","last_undegraded":"2023-07-05T23:32:57.780722+0000","last_fullsized":"2023-07-05T23:32:57.780722+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:36:17.743168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781700+0000","last_change":"2023-07-05T23:32:53.340963+0000","last_active":"2023-07-05T23:32:57.781700+0000","last_peered":"2023-07-05T23:32:57.781700+0000","last_clean":"2023-07-05T23:32:57.781700+0000","last_became_active":"2023-07-05T23:32:53.340698+0000","last_became_peered":"2023-07-05T23:32:53.340698+0000","last_unstale":"2023-07-05T23:32:57.781700+0000","last_undegraded":"2023-07-05T23:32:57.781700+0000","last_fullsized":"2023-07-05T23:32:57.781700+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:19:10.358522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781287+0000","last_change":"2023-07-05T23:32:53.345981+0000","last_active":"2023-07-05T23:32:57.781287+0000","last_peered":"2023-07-05T23:32:57.781287+0000","last_clean":"2023-07-05T23:32:57.781287+0000","last_became_active":"2023-07-05T23:32:53.345403+0000","last_became_peered":"2023-07-05T23:32:53.345403+0000","last_unstale":"2023-07-05T23:32:57.781287+0000","last_undegraded":"2023-07-05T23:32:57.781287+0000","last_fullsized":"2023-07-05T23:32:57.781287+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:00:21.148640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780634+0000","last_change":"2023-07-05T23:32:53.348335+0000","last_active":"2023-07-05T23:32:57.780634+0000","last_peered":"2023-07-05T23:32:57.780634+0000","last_clean":"2023-07-05T23:32:57.780634+0000","last_became_active":"2023-07-05T23:32:53.348053+0000","last_became_peered":"2023-07-05T23:32:53.348053+0000","last_unstale":"2023-07-05T23:32:57.780634+0000","last_undegraded":"2023-07-05T23:32:57.780634+0000","last_fullsized":"2023-07-05T23:32:57.780634+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:21:31.956439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.777146+0000","last_change":"2023-07-05T23:32:53.339227+0000","last_active":"2023-07-05T23:32:57.777146+0000","last_peered":"2023-07-05T23:32:57.777146+0000","last_clean":"2023-07-05T23:32:57.777146+0000","last_became_active":"2023-07-05T23:32:53.338935+0000","last_became_peered":"2023-07-05T23:32:53.338935+0000","last_unstale":"2023-07-05T23:32:57.777146+0000","last_undegraded":"2023-07-05T23:32:57.777146+0000","last_fullsized":"2023-07-05T23:32:57.777146+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:27:27.060118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.777271+0000","last_change":"2023-07-05T23:32:53.342191+0000","last_active":"2023-07-05T23:32:57.777271+0000","last_peered":"2023-07-05T23:32:57.777271+0000","last_clean":"2023-07-05T23:32:57.777271+0000","last_became_active":"2023-07-05T23:32:53.341948+0000","last_became_peered":"2023-07-05T23:32:53.341948+0000","last_unstale":"2023-07-05T23:32:57.777271+0000","last_undegraded":"2023-07-05T23:32:57.777271+0000","last_fullsized":"2023-07-05T23:32:57.777271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:38:13.889745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779405+0000","last_change":"2023-07-05T23:32:53.336623+0000","last_active":"2023-07-05T23:32:57.779405+0000","last_peered":"2023-07-05T23:32:57.779405+0000","last_clean":"2023-07-05T23:32:57.779405+0000","last_became_active":"2023-07-05T23:32:53.335857+0000","last_became_peered":"2023-07-05T23:32:53.335857+0000","last_unstale":"2023-07-05T23:32:57.779405+0000","last_undegraded":"2023-07-05T23:32:57.779405+0000","last_fullsized":"2023-07-05T23:32:57.779405+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:17:20.092941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.784100+0000","last_change":"2023-07-05T23:32:57.365825+0000","last_active":"2023-07-05T23:32:57.784100+0000","last_peered":"2023-07-05T23:32:57.784100+0000","last_clean":"2023-07-05T23:32:57.784100+0000","last_became_active":"2023-07-05T23:32:57.365409+0000","last_became_peered":"2023-07-05T23:32:57.365409+0000","last_unstale":"2023-07-05T23:32:57.784100+0000","last_undegraded":"2023-07-05T23:32:57.784100+0000","last_fullsized":"2023-07-05T23:32:57.784100+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:47:37.647980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.782903+0000","last_change":"2023-07-05T23:32:52.901348+0000","last_active":"2023-07-05T23:32:57.782903+0000","last_peered":"2023-07-05T23:32:57.782903+0000","last_clean":"2023-07-05T23:32:57.782903+0000","last_became_active":"2023-07-05T23:32:52.901080+0000","last_became_peered":"2023-07-05T23:32:52.901080+0000","last_unstale":"2023-07-05T23:32:57.782903+0000","last_undegraded":"2023-07-05T23:32:57.782903+0000","last_fullsized":"2023-07-05T23:32:57.782903+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:11:28.344067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780698+0000","last_change":"2023-07-05T23:32:53.339739+0000","last_active":"2023-07-05T23:32:57.780698+0000","last_peered":"2023-07-05T23:32:57.780698+0000","last_clean":"2023-07-05T23:32:57.780698+0000","last_became_active":"2023-07-05T23:32:53.339464+0000","last_became_peered":"2023-07-05T23:32:53.339464+0000","last_unstale":"2023-07-05T23:32:57.780698+0000","last_undegraded":"2023-07-05T23:32:57.780698+0000","last_fullsized":"2023-07-05T23:32:57.780698+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:17:18.286061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780977+0000","last_change":"2023-07-05T23:32:57.354002+0000","last_active":"2023-07-05T23:32:57.780977+0000","last_peered":"2023-07-05T23:32:57.780977+0000","last_clean":"2023-07-05T23:32:57.780977+0000","last_became_active":"2023-07-05T23:32:57.353465+0000","last_became_peered":"2023-07-05T23:32:57.353465+0000","last_unstale":"2023-07-05T23:32:57.780977+0000","last_undegraded":"2023-07-05T23:32:57.780977+0000","last_fullsized":"2023-07-05T23:32:57.780977+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:22:44.688998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.776277+0000","last_change":"2023-07-05T23:32:52.909685+0000","last_active":"2023-07-05T23:32:57.776277+0000","last_peered":"2023-07-05T23:32:57.776277+0000","last_clean":"2023-07-05T23:32:57.776277+0000","last_became_active":"2023-07-05T23:32:52.909347+0000","last_became_peered":"2023-07-05T23:32:52.909347+0000","last_unstale":"2023-07-05T23:32:57.776277+0000","last_undegraded":"2023-07-05T23:32:57.776277+0000","last_fullsized":"2023-07-05T23:32:57.776277+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:00:03.115621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780890+0000","last_change":"2023-07-05T23:32:53.339219+0000","last_active":"2023-07-05T23:32:57.780890+0000","last_peered":"2023-07-05T23:32:57.780890+0000","last_clean":"2023-07-05T23:32:57.780890+0000","last_became_active":"2023-07-05T23:32:53.338825+0000","last_became_peered":"2023-07-05T23:32:53.338825+0000","last_unstale":"2023-07-05T23:32:57.780890+0000","last_undegraded":"2023-07-05T23:32:57.780890+0000","last_fullsized":"2023-07-05T23:32:57.780890+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:15:41.388811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781104+0000","last_change":"2023-07-05T23:32:57.359406+0000","last_active":"2023-07-05T23:32:57.781104+0000","last_peered":"2023-07-05T23:32:57.781104+0000","last_clean":"2023-07-05T23:32:57.781104+0000","last_became_active":"2023-07-05T23:32:57.358965+0000","last_became_peered":"2023-07-05T23:32:57.358965+0000","last_unstale":"2023-07-05T23:32:57.781104+0000","last_undegraded":"2023-07-05T23:32:57.781104+0000","last_fullsized":"2023-07-05T23:32:57.781104+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:21:35.396133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780223+0000","last_change":"2023-07-05T23:32:52.909226+0000","last_active":"2023-07-05T23:32:57.780223+0000","last_peered":"2023-07-05T23:32:57.780223+0000","last_clean":"2023-07-05T23:32:57.780223+0000","last_became_active":"2023-07-05T23:32:52.908756+0000","last_became_peered":"2023-07-05T23:32:52.908756+0000","last_unstale":"2023-07-05T23:32:57.780223+0000","last_undegraded":"2023-07-05T23:32:57.780223+0000","last_fullsized":"2023-07-05T23:32:57.780223+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:19:37.582219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781082+0000","last_change":"2023-07-05T23:32:53.337872+0000","last_active":"2023-07-05T23:32:57.781082+0000","last_peered":"2023-07-05T23:32:57.781082+0000","last_clean":"2023-07-05T23:32:57.781082+0000","last_became_active":"2023-07-05T23:32:53.337480+0000","last_became_peered":"2023-07-05T23:32:53.337480+0000","last_unstale":"2023-07-05T23:32:57.781082+0000","last_undegraded":"2023-07-05T23:32:57.781082+0000","last_fullsized":"2023-07-05T23:32:57.781082+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:01:53.561649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780601+0000","last_change":"2023-07-05T23:32:57.356296+0000","last_active":"2023-07-05T23:32:57.780601+0000","last_peered":"2023-07-05T23:32:57.780601+0000","last_clean":"2023-07-05T23:32:57.780601+0000","last_became_active":"2023-07-05T23:32:57.355940+0000","last_became_peered":"2023-07-05T23:32:57.355940+0000","last_unstale":"2023-07-05T23:32:57.780601+0000","last_undegraded":"2023-07-05T23:32:57.780601+0000","last_fullsized":"2023-07-05T23:32:57.780601+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:44:10.928501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781337+0000","last_change":"2023-07-05T23:32:52.904533+0000","last_active":"2023-07-05T23:32:57.781337+0000","last_peered":"2023-07-05T23:32:57.781337+0000","last_clean":"2023-07-05T23:32:57.781337+0000","last_became_active":"2023-07-05T23:32:52.904140+0000","last_became_peered":"2023-07-05T23:32:52.904140+0000","last_unstale":"2023-07-05T23:32:57.781337+0000","last_undegraded":"2023-07-05T23:32:57.781337+0000","last_fullsized":"2023-07-05T23:32:57.781337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:13:04.590957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780100+0000","last_change":"2023-07-05T23:32:53.338517+0000","last_active":"2023-07-05T23:32:57.780100+0000","last_peered":"2023-07-05T23:32:57.780100+0000","last_clean":"2023-07-05T23:32:57.780100+0000","last_became_active":"2023-07-05T23:32:53.338248+0000","last_became_peered":"2023-07-05T23:32:53.338248+0000","last_unstale":"2023-07-05T23:32:57.780100+0000","last_undegraded":"2023-07-05T23:32:57.780100+0000","last_fullsized":"2023-07-05T23:32:57.780100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:38:13.889745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780227+0000","last_change":"2023-07-05T23:32:57.357483+0000","last_active":"2023-07-05T23:32:57.780227+0000","last_peered":"2023-07-05T23:32:57.780227+0000","last_clean":"2023-07-05T23:32:57.780227+0000","last_became_active":"2023-07-05T23:32:57.357039+0000","last_became_peered":"2023-07-05T23:32:57.357039+0000","last_unstale":"2023-07-05T23:32:57.780227+0000","last_undegraded":"2023-07-05T23:32:57.780227+0000","last_fullsized":"2023-07-05T23:32:57.780227+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:07:56.311696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780139+0000","last_change":"2023-07-05T23:32:52.900665+0000","last_active":"2023-07-05T23:32:57.780139+0000","last_peered":"2023-07-05T23:32:57.780139+0000","last_clean":"2023-07-05T23:32:57.780139+0000","last_became_active":"2023-07-05T23:32:52.900352+0000","last_became_peered":"2023-07-05T23:32:52.900352+0000","last_unstale":"2023-07-05T23:32:57.780139+0000","last_undegraded":"2023-07-05T23:32:57.780139+0000","last_fullsized":"2023-07-05T23:32:57.780139+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:43:30.790838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781414+0000","last_change":"2023-07-05T23:32:53.346621+0000","last_active":"2023-07-05T23:32:57.781414+0000","last_peered":"2023-07-05T23:32:57.781414+0000","last_clean":"2023-07-05T23:32:57.781414+0000","last_became_active":"2023-07-05T23:32:53.346373+0000","last_became_peered":"2023-07-05T23:32:53.346373+0000","last_unstale":"2023-07-05T23:32:57.781414+0000","last_undegraded":"2023-07-05T23:32:57.781414+0000","last_fullsized":"2023-07-05T23:32:57.781414+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:22:27.347492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781066+0000","last_change":"2023-07-05T23:32:57.365669+0000","last_active":"2023-07-05T23:32:57.781066+0000","last_peered":"2023-07-05T23:32:57.781066+0000","last_clean":"2023-07-05T23:32:57.781066+0000","last_became_active":"2023-07-05T23:32:57.365200+0000","last_became_peered":"2023-07-05T23:32:57.365200+0000","last_unstale":"2023-07-05T23:32:57.781066+0000","last_undegraded":"2023-07-05T23:32:57.781066+0000","last_fullsized":"2023-07-05T23:32:57.781066+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:51:45.144450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781045+0000","last_change":"2023-07-05T23:32:52.913055+0000","last_active":"2023-07-05T23:32:57.781045+0000","last_peered":"2023-07-05T23:32:57.781045+0000","last_clean":"2023-07-05T23:32:57.781045+0000","last_became_active":"2023-07-05T23:32:52.912749+0000","last_became_peered":"2023-07-05T23:32:52.912749+0000","last_unstale":"2023-07-05T23:32:57.781045+0000","last_undegraded":"2023-07-05T23:32:57.781045+0000","last_fullsized":"2023-07-05T23:32:57.781045+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:13:04.590957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.776668+0000","last_change":"2023-07-05T23:32:53.339331+0000","last_active":"2023-07-05T23:32:57.776668+0000","last_peered":"2023-07-05T23:32:57.776668+0000","last_clean":"2023-07-05T23:32:57.776668+0000","last_became_active":"2023-07-05T23:32:53.339001+0000","last_became_peered":"2023-07-05T23:32:53.339001+0000","last_unstale":"2023-07-05T23:32:57.776668+0000","last_undegraded":"2023-07-05T23:32:57.776668+0000","last_fullsized":"2023-07-05T23:32:57.776668+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:51:56.888322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.776408+0000","last_change":"2023-07-05T23:32:57.354307+0000","last_active":"2023-07-05T23:32:57.776408+0000","last_peered":"2023-07-05T23:32:57.776408+0000","last_clean":"2023-07-05T23:32:57.776408+0000","last_became_active":"2023-07-05T23:32:57.353848+0000","last_became_peered":"2023-07-05T23:32:57.353848+0000","last_unstale":"2023-07-05T23:32:57.776408+0000","last_undegraded":"2023-07-05T23:32:57.776408+0000","last_fullsized":"2023-07-05T23:32:57.776408+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:34:23.584285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'9","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:33:03.186592+0000","last_change":"2023-07-05T23:32:52.904627+0000","last_active":"2023-07-05T23:33:03.186592+0000","last_peered":"2023-07-05T23:33:03.186592+0000","last_clean":"2023-07-05T23:33:03.186592+0000","last_became_active":"2023-07-05T23:32:52.904318+0000","last_became_peered":"2023-07-05T23:32:52.904318+0000","last_unstale":"2023-07-05T23:33:03.186592+0000","last_undegraded":"2023-07-05T23:33:03.186592+0000","last_fullsized":"2023-07-05T23:33:03.186592+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:19:32.514981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.783509+0000","last_change":"2023-07-05T23:32:53.339884+0000","last_active":"2023-07-05T23:32:57.783509+0000","last_peered":"2023-07-05T23:32:57.783509+0000","last_clean":"2023-07-05T23:32:57.783509+0000","last_became_active":"2023-07-05T23:32:53.339583+0000","last_became_peered":"2023-07-05T23:32:53.339583+0000","last_unstale":"2023-07-05T23:32:57.783509+0000","last_undegraded":"2023-07-05T23:32:57.783509+0000","last_fullsized":"2023-07-05T23:32:57.783509+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:24:46.698746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779739+0000","last_change":"2023-07-05T23:32:57.365703+0000","last_active":"2023-07-05T23:32:57.779739+0000","last_peered":"2023-07-05T23:32:57.779739+0000","last_clean":"2023-07-05T23:32:57.779739+0000","last_became_active":"2023-07-05T23:32:57.365204+0000","last_became_peered":"2023-07-05T23:32:57.365204+0000","last_unstale":"2023-07-05T23:32:57.779739+0000","last_undegraded":"2023-07-05T23:32:57.779739+0000","last_fullsized":"2023-07-05T23:32:57.779739+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:20:33.100720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780561+0000","last_change":"2023-07-05T23:32:52.908276+0000","last_active":"2023-07-05T23:32:57.780561+0000","last_peered":"2023-07-05T23:32:57.780561+0000","last_clean":"2023-07-05T23:32:57.780561+0000","last_became_active":"2023-07-05T23:32:52.907970+0000","last_became_peered":"2023-07-05T23:32:52.907970+0000","last_unstale":"2023-07-05T23:32:57.780561+0000","last_undegraded":"2023-07-05T23:32:57.780561+0000","last_fullsized":"2023-07-05T23:32:57.780561+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:15:40.384473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780360+0000","last_change":"2023-07-05T23:32:53.340093+0000","last_active":"2023-07-05T23:32:57.780360+0000","last_peered":"2023-07-05T23:32:57.780360+0000","last_clean":"2023-07-05T23:32:57.780360+0000","last_became_active":"2023-07-05T23:32:53.339827+0000","last_became_peered":"2023-07-05T23:32:53.339827+0000","last_unstale":"2023-07-05T23:32:57.780360+0000","last_undegraded":"2023-07-05T23:32:57.780360+0000","last_fullsized":"2023-07-05T23:32:57.780360+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:19:10.358522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780060+0000","last_change":"2023-07-05T23:32:57.354664+0000","last_active":"2023-07-05T23:32:57.780060+0000","last_peered":"2023-07-05T23:32:57.780060+0000","last_clean":"2023-07-05T23:32:57.780060+0000","last_became_active":"2023-07-05T23:32:57.354235+0000","last_became_peered":"2023-07-05T23:32:57.354235+0000","last_unstale":"2023-07-05T23:32:57.780060+0000","last_undegraded":"2023-07-05T23:32:57.780060+0000","last_fullsized":"2023-07-05T23:32:57.780060+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:13:09.034988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781505+0000","last_change":"2023-07-05T23:32:52.900677+0000","last_active":"2023-07-05T23:32:57.781505+0000","last_peered":"2023-07-05T23:32:57.781505+0000","last_clean":"2023-07-05T23:32:57.781505+0000","last_became_active":"2023-07-05T23:32:52.900387+0000","last_became_peered":"2023-07-05T23:32:52.900387+0000","last_unstale":"2023-07-05T23:32:57.781505+0000","last_undegraded":"2023-07-05T23:32:57.781505+0000","last_fullsized":"2023-07-05T23:32:57.781505+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:19:37.582219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779376+0000","last_change":"2023-07-05T23:32:53.335865+0000","last_active":"2023-07-05T23:32:57.779376+0000","last_peered":"2023-07-05T23:32:57.779376+0000","last_clean":"2023-07-05T23:32:57.779376+0000","last_became_active":"2023-07-05T23:32:53.335513+0000","last_became_peered":"2023-07-05T23:32:53.335513+0000","last_unstale":"2023-07-05T23:32:57.779376+0000","last_undegraded":"2023-07-05T23:32:57.779376+0000","last_fullsized":"2023-07-05T23:32:57.779376+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:19:10.358522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780865+0000","last_change":"2023-07-05T23:32:57.362840+0000","last_active":"2023-07-05T23:32:57.780865+0000","last_peered":"2023-07-05T23:32:57.780865+0000","last_clean":"2023-07-05T23:32:57.780865+0000","last_became_active":"2023-07-05T23:32:57.362407+0000","last_became_peered":"2023-07-05T23:32:57.362407+0000","last_unstale":"2023-07-05T23:32:57.780865+0000","last_undegraded":"2023-07-05T23:32:57.780865+0000","last_fullsized":"2023-07-05T23:32:57.780865+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:20:33.100720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781326+0000","last_change":"2023-07-05T23:32:52.905899+0000","last_active":"2023-07-05T23:32:57.781326+0000","last_peered":"2023-07-05T23:32:57.781326+0000","last_clean":"2023-07-05T23:32:57.781326+0000","last_became_active":"2023-07-05T23:32:52.905595+0000","last_became_peered":"2023-07-05T23:32:52.905595+0000","last_unstale":"2023-07-05T23:32:57.781326+0000","last_undegraded":"2023-07-05T23:32:57.781326+0000","last_fullsized":"2023-07-05T23:32:57.781326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:17:19.088603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780958+0000","last_change":"2023-07-05T23:32:53.342284+0000","last_active":"2023-07-05T23:32:57.780958+0000","last_peered":"2023-07-05T23:32:57.780958+0000","last_clean":"2023-07-05T23:32:57.780958+0000","last_became_active":"2023-07-05T23:32:53.342033+0000","last_became_peered":"2023-07-05T23:32:53.342033+0000","last_unstale":"2023-07-05T23:32:57.780958+0000","last_undegraded":"2023-07-05T23:32:57.780958+0000","last_fullsized":"2023-07-05T23:32:57.780958+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:27:27.060118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779740+0000","last_change":"2023-07-05T23:32:57.360505+0000","last_active":"2023-07-05T23:32:57.779740+0000","last_peered":"2023-07-05T23:32:57.779740+0000","last_clean":"2023-07-05T23:32:57.779740+0000","last_became_active":"2023-07-05T23:32:57.359532+0000","last_became_peered":"2023-07-05T23:32:57.359532+0000","last_unstale":"2023-07-05T23:32:57.779740+0000","last_undegraded":"2023-07-05T23:32:57.779740+0000","last_fullsized":"2023-07-05T23:32:57.779740+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:44:00.668654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780375+0000","last_change":"2023-07-05T23:32:52.903656+0000","last_active":"2023-07-05T23:32:57.780375+0000","last_peered":"2023-07-05T23:32:57.780375+0000","last_clean":"2023-07-05T23:32:57.780375+0000","last_became_active":"2023-07-05T23:32:52.903419+0000","last_became_peered":"2023-07-05T23:32:52.903419+0000","last_unstale":"2023-07-05T23:32:57.780375+0000","last_undegraded":"2023-07-05T23:32:57.780375+0000","last_fullsized":"2023-07-05T23:32:57.780375+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:38:34.157098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780921+0000","last_change":"2023-07-05T23:32:53.341509+0000","last_active":"2023-07-05T23:32:57.780921+0000","last_peered":"2023-07-05T23:32:57.780921+0000","last_clean":"2023-07-05T23:32:57.780921+0000","last_became_active":"2023-07-05T23:32:53.341162+0000","last_became_peered":"2023-07-05T23:32:53.341162+0000","last_unstale":"2023-07-05T23:32:57.780921+0000","last_undegraded":"2023-07-05T23:32:57.780921+0000","last_fullsized":"2023-07-05T23:32:57.780921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:43:57.228961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781521+0000","last_change":"2023-07-05T23:32:57.358009+0000","last_active":"2023-07-05T23:32:57.781521+0000","last_peered":"2023-07-05T23:32:57.781521+0000","last_clean":"2023-07-05T23:32:57.781521+0000","last_became_active":"2023-07-05T23:32:57.357082+0000","last_became_peered":"2023-07-05T23:32:57.357082+0000","last_unstale":"2023-07-05T23:32:57.781521+0000","last_undegraded":"2023-07-05T23:32:57.781521+0000","last_fullsized":"2023-07-05T23:32:57.781521+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:44:00.668654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781205+0000","last_change":"2023-07-05T23:32:52.907916+0000","last_active":"2023-07-05T23:32:57.781205+0000","last_peered":"2023-07-05T23:32:57.781205+0000","last_clean":"2023-07-05T23:32:57.781205+0000","last_became_active":"2023-07-05T23:32:52.907397+0000","last_became_peered":"2023-07-05T23:32:52.907397+0000","last_unstale":"2023-07-05T23:32:57.781205+0000","last_undegraded":"2023-07-05T23:32:57.781205+0000","last_fullsized":"2023-07-05T23:32:57.781205+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:19:37.582219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.778327+0000","last_change":"2023-07-05T23:32:53.334487+0000","last_active":"2023-07-05T23:32:57.778327+0000","last_peered":"2023-07-05T23:32:57.778327+0000","last_clean":"2023-07-05T23:32:57.778327+0000","last_became_active":"2023-07-05T23:32:53.333978+0000","last_became_peered":"2023-07-05T23:32:53.333978+0000","last_unstale":"2023-07-05T23:32:57.778327+0000","last_undegraded":"2023-07-05T23:32:57.778327+0000","last_fullsized":"2023-07-05T23:32:57.778327+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:40:46.792647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780055+0000","last_change":"2023-07-05T23:32:57.362413+0000","last_active":"2023-07-05T23:32:57.780055+0000","last_peered":"2023-07-05T23:32:57.780055+0000","last_clean":"2023-07-05T23:32:57.780055+0000","last_became_active":"2023-07-05T23:32:57.361892+0000","last_became_peered":"2023-07-05T23:32:57.361892+0000","last_unstale":"2023-07-05T23:32:57.780055+0000","last_undegraded":"2023-07-05T23:32:57.780055+0000","last_fullsized":"2023-07-05T23:32:57.780055+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:36:17.176610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781017+0000","last_change":"2023-07-05T23:32:52.908261+0000","last_active":"2023-07-05T23:32:57.781017+0000","last_peered":"2023-07-05T23:32:57.781017+0000","last_clean":"2023-07-05T23:32:57.781017+0000","last_became_active":"2023-07-05T23:32:52.907975+0000","last_became_peered":"2023-07-05T23:32:52.907975+0000","last_unstale":"2023-07-05T23:32:57.781017+0000","last_undegraded":"2023-07-05T23:32:57.781017+0000","last_fullsized":"2023-07-05T23:32:57.781017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:38:12.885407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.782750+0000","last_change":"2023-07-05T23:32:53.339917+0000","last_active":"2023-07-05T23:32:57.782750+0000","last_peered":"2023-07-05T23:32:57.782750+0000","last_clean":"2023-07-05T23:32:57.782750+0000","last_became_active":"2023-07-05T23:32:53.339543+0000","last_became_peered":"2023-07-05T23:32:53.339543+0000","last_unstale":"2023-07-05T23:32:57.782750+0000","last_undegraded":"2023-07-05T23:32:57.782750+0000","last_fullsized":"2023-07-05T23:32:57.782750+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:52:59.154723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780459+0000","last_change":"2023-07-05T23:32:57.361110+0000","last_active":"2023-07-05T23:32:57.780459+0000","last_peered":"2023-07-05T23:32:57.780459+0000","last_clean":"2023-07-05T23:32:57.780459+0000","last_became_active":"2023-07-05T23:32:57.360614+0000","last_became_peered":"2023-07-05T23:32:57.360614+0000","last_unstale":"2023-07-05T23:32:57.780459+0000","last_undegraded":"2023-07-05T23:32:57.780459+0000","last_fullsized":"2023-07-05T23:32:57.780459+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:20:27.254800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781378+0000","last_change":"2023-07-05T23:32:52.907840+0000","last_active":"2023-07-05T23:32:57.781378+0000","last_peered":"2023-07-05T23:32:57.781378+0000","last_clean":"2023-07-05T23:32:57.781378+0000","last_became_active":"2023-07-05T23:32:52.907441+0000","last_became_peered":"2023-07-05T23:32:52.907441+0000","last_unstale":"2023-07-05T23:32:57.781378+0000","last_undegraded":"2023-07-05T23:32:57.781378+0000","last_fullsized":"2023-07-05T23:32:57.781378+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:17:17.281723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.782067+0000","last_change":"2023-07-05T23:32:53.343984+0000","last_active":"2023-07-05T23:32:57.782067+0000","last_peered":"2023-07-05T23:32:57.782067+0000","last_clean":"2023-07-05T23:32:57.782067+0000","last_became_active":"2023-07-05T23:32:53.343566+0000","last_became_peered":"2023-07-05T23:32:53.343566+0000","last_unstale":"2023-07-05T23:32:57.782067+0000","last_undegraded":"2023-07-05T23:32:57.782067+0000","last_fullsized":"2023-07-05T23:32:57.782067+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:37:24.930328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779979+0000","last_change":"2023-07-05T23:32:57.356615+0000","last_active":"2023-07-05T23:32:57.779979+0000","last_peered":"2023-07-05T23:32:57.779979+0000","last_clean":"2023-07-05T23:32:57.779979+0000","last_became_active":"2023-07-05T23:32:57.356091+0000","last_became_peered":"2023-07-05T23:32:57.356091+0000","last_unstale":"2023-07-05T23:32:57.779979+0000","last_undegraded":"2023-07-05T23:32:57.779979+0000","last_fullsized":"2023-07-05T23:32:57.779979+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:10:06.378615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.778881+0000","last_change":"2023-07-05T23:32:52.906210+0000","last_active":"2023-07-05T23:32:57.778881+0000","last_peered":"2023-07-05T23:32:57.778881+0000","last_clean":"2023-07-05T23:32:57.778881+0000","last_became_active":"2023-07-05T23:32:52.905988+0000","last_became_peered":"2023-07-05T23:32:52.905988+0000","last_unstale":"2023-07-05T23:32:57.778881+0000","last_undegraded":"2023-07-05T23:32:57.778881+0000","last_fullsized":"2023-07-05T23:32:57.778881+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:21:30.952101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780176+0000","last_change":"2023-07-05T23:32:53.339662+0000","last_active":"2023-07-05T23:32:57.780176+0000","last_peered":"2023-07-05T23:32:57.780176+0000","last_clean":"2023-07-05T23:32:57.780176+0000","last_became_active":"2023-07-05T23:32:53.339382+0000","last_became_peered":"2023-07-05T23:32:53.339382+0000","last_unstale":"2023-07-05T23:32:57.780176+0000","last_undegraded":"2023-07-05T23:32:57.780176+0000","last_fullsized":"2023-07-05T23:32:57.780176+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:02:13.839378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781483+0000","last_change":"2023-07-05T23:32:57.354958+0000","last_active":"2023-07-05T23:32:57.781483+0000","last_peered":"2023-07-05T23:32:57.781483+0000","last_clean":"2023-07-05T23:32:57.781483+0000","last_became_active":"2023-07-05T23:32:57.354576+0000","last_became_peered":"2023-07-05T23:32:57.354576+0000","last_unstale":"2023-07-05T23:32:57.781483+0000","last_undegraded":"2023-07-05T23:32:57.781483+0000","last_fullsized":"2023-07-05T23:32:57.781483+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:44:10.928501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779954+0000","last_change":"2023-07-05T23:32:52.906470+0000","last_active":"2023-07-05T23:32:57.779954+0000","last_peered":"2023-07-05T23:32:57.779954+0000","last_clean":"2023-07-05T23:32:57.779954+0000","last_became_active":"2023-07-05T23:32:52.906187+0000","last_became_peered":"2023-07-05T23:32:52.906187+0000","last_unstale":"2023-07-05T23:32:57.779954+0000","last_undegraded":"2023-07-05T23:32:57.779954+0000","last_fullsized":"2023-07-05T23:32:57.779954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:25:18.737329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.783687+0000","last_change":"2023-07-05T23:32:53.344178+0000","last_active":"2023-07-05T23:32:57.783687+0000","last_peered":"2023-07-05T23:32:57.783687+0000","last_clean":"2023-07-05T23:32:57.783687+0000","last_became_active":"2023-07-05T23:32:53.343393+0000","last_became_peered":"2023-07-05T23:32:53.343393+0000","last_unstale":"2023-07-05T23:32:57.783687+0000","last_undegraded":"2023-07-05T23:32:57.783687+0000","last_fullsized":"2023-07-05T23:32:57.783687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:01:16.732067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.776877+0000","last_change":"2023-07-05T23:32:57.362812+0000","last_active":"2023-07-05T23:32:57.776877+0000","last_peered":"2023-07-05T23:32:57.776877+0000","last_clean":"2023-07-05T23:32:57.776877+0000","last_became_active":"2023-07-05T23:32:57.362431+0000","last_became_peered":"2023-07-05T23:32:57.362431+0000","last_unstale":"2023-07-05T23:32:57.776877+0000","last_undegraded":"2023-07-05T23:32:57.776877+0000","last_fullsized":"2023-07-05T23:32:57.776877+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:24:35.809378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780786+0000","last_change":"2023-07-05T23:32:52.908272+0000","last_active":"2023-07-05T23:32:57.780786+0000","last_peered":"2023-07-05T23:32:57.780786+0000","last_clean":"2023-07-05T23:32:57.780786+0000","last_became_active":"2023-07-05T23:32:52.907983+0000","last_became_peered":"2023-07-05T23:32:52.907983+0000","last_unstale":"2023-07-05T23:32:57.780786+0000","last_undegraded":"2023-07-05T23:32:57.780786+0000","last_fullsized":"2023-07-05T23:32:57.780786+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:28:38.558463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.783118+0000","last_change":"2023-07-05T23:32:53.339766+0000","last_active":"2023-07-05T23:32:57.783118+0000","last_peered":"2023-07-05T23:32:57.783118+0000","last_clean":"2023-07-05T23:32:57.783118+0000","last_became_active":"2023-07-05T23:32:53.338903+0000","last_became_peered":"2023-07-05T23:32:53.338903+0000","last_unstale":"2023-07-05T23:32:57.783118+0000","last_undegraded":"2023-07-05T23:32:57.783118+0000","last_fullsized":"2023-07-05T23:32:57.783118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:32:24.944898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780131+0000","last_change":"2023-07-05T23:32:57.357001+0000","last_active":"2023-07-05T23:32:57.780131+0000","last_peered":"2023-07-05T23:32:57.780131+0000","last_clean":"2023-07-05T23:32:57.780131+0000","last_became_active":"2023-07-05T23:32:57.356611+0000","last_became_peered":"2023-07-05T23:32:57.356611+0000","last_unstale":"2023-07-05T23:32:57.780131+0000","last_undegraded":"2023-07-05T23:32:57.780131+0000","last_fullsized":"2023-07-05T23:32:57.780131+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:00:24.588333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.782328+0000","last_change":"2023-07-05T23:32:52.907064+0000","last_active":"2023-07-05T23:32:57.782328+0000","last_peered":"2023-07-05T23:32:57.782328+0000","last_clean":"2023-07-05T23:32:57.782328+0000","last_became_active":"2023-07-05T23:32:52.906779+0000","last_became_peered":"2023-07-05T23:32:52.906779+0000","last_unstale":"2023-07-05T23:32:57.782328+0000","last_undegraded":"2023-07-05T23:32:57.782328+0000","last_fullsized":"2023-07-05T23:32:57.782328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:15:22.364630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.782950+0000","last_change":"2023-07-05T23:32:53.341824+0000","last_active":"2023-07-05T23:32:57.782950+0000","last_peered":"2023-07-05T23:32:57.782950+0000","last_clean":"2023-07-05T23:32:57.782950+0000","last_became_active":"2023-07-05T23:32:53.339869+0000","last_became_peered":"2023-07-05T23:32:53.339869+0000","last_unstale":"2023-07-05T23:32:57.782950+0000","last_undegraded":"2023-07-05T23:32:57.782950+0000","last_fullsized":"2023-07-05T23:32:57.782950+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:24:31.034513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.783115+0000","last_change":"2023-07-05T23:32:57.363813+0000","last_active":"2023-07-05T23:32:57.783115+0000","last_peered":"2023-07-05T23:32:57.783115+0000","last_clean":"2023-07-05T23:32:57.783115+0000","last_became_active":"2023-07-05T23:32:57.363409+0000","last_became_peered":"2023-07-05T23:32:57.363409+0000","last_unstale":"2023-07-05T23:32:57.783115+0000","last_undegraded":"2023-07-05T23:32:57.783115+0000","last_fullsized":"2023-07-05T23:32:57.783115+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:28:02.584137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779951+0000","last_change":"2023-07-05T23:32:52.910057+0000","last_active":"2023-07-05T23:32:57.779951+0000","last_peered":"2023-07-05T23:32:57.779951+0000","last_clean":"2023-07-05T23:32:57.779951+0000","last_became_active":"2023-07-05T23:32:52.909169+0000","last_became_peered":"2023-07-05T23:32:52.909169+0000","last_unstale":"2023-07-05T23:32:57.779951+0000","last_undegraded":"2023-07-05T23:32:57.779951+0000","last_fullsized":"2023-07-05T23:32:57.779951+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:36:16.738830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.777230+0000","last_change":"2023-07-05T23:32:53.342851+0000","last_active":"2023-07-05T23:32:57.777230+0000","last_peered":"2023-07-05T23:32:57.777230+0000","last_clean":"2023-07-05T23:32:57.777230+0000","last_became_active":"2023-07-05T23:32:53.342420+0000","last_became_peered":"2023-07-05T23:32:53.342420+0000","last_unstale":"2023-07-05T23:32:57.777230+0000","last_undegraded":"2023-07-05T23:32:57.777230+0000","last_fullsized":"2023-07-05T23:32:57.777230+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:36:17.743168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780080+0000","last_change":"2023-07-05T23:32:57.358997+0000","last_active":"2023-07-05T23:32:57.780080+0000","last_peered":"2023-07-05T23:32:57.780080+0000","last_clean":"2023-07-05T23:32:57.780080+0000","last_became_active":"2023-07-05T23:32:57.358647+0000","last_became_peered":"2023-07-05T23:32:57.358647+0000","last_unstale":"2023-07-05T23:32:57.780080+0000","last_undegraded":"2023-07-05T23:32:57.780080+0000","last_fullsized":"2023-07-05T23:32:57.780080+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:34:23.584285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.777274+0000","last_change":"2023-07-05T23:32:47.790871+0000","last_active":"2023-07-05T23:32:57.777274+0000","last_peered":"2023-07-05T23:32:57.777274+0000","last_clean":"2023-07-05T23:32:57.777274+0000","last_became_active":"2023-07-05T23:32:47.790546+0000","last_became_peered":"2023-07-05T23:32:47.790546+0000","last_unstale":"2023-07-05T23:32:57.777274+0000","last_undegraded":"2023-07-05T23:32:57.777274+0000","last_fullsized":"2023-07-05T23:32:57.777274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_clean_scrub_stamp":"2023-07-05T23:32:46.741565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:12:59.454577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779269+0000","last_change":"2023-07-05T23:32:52.912985+0000","last_active":"2023-07-05T23:32:57.779269+0000","last_peered":"2023-07-05T23:32:57.779269+0000","last_clean":"2023-07-05T23:32:57.779269+0000","last_became_active":"2023-07-05T23:32:52.912682+0000","last_became_peered":"2023-07-05T23:32:52.912682+0000","last_unstale":"2023-07-05T23:32:57.779269+0000","last_undegraded":"2023-07-05T23:32:57.779269+0000","last_fullsized":"2023-07-05T23:32:57.779269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:38:12.885407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.776539+0000","last_change":"2023-07-05T23:32:53.335398+0000","last_active":"2023-07-05T23:32:57.776539+0000","last_peered":"2023-07-05T23:32:57.776539+0000","last_clean":"2023-07-05T23:32:57.776539+0000","last_became_active":"2023-07-05T23:32:53.335073+0000","last_became_peered":"2023-07-05T23:32:53.335073+0000","last_unstale":"2023-07-05T23:32:57.776539+0000","last_undegraded":"2023-07-05T23:32:57.776539+0000","last_fullsized":"2023-07-05T23:32:57.776539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:16:05.844225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780381+0000","last_change":"2023-07-05T23:32:57.368301+0000","last_active":"2023-07-05T23:32:57.780381+0000","last_peered":"2023-07-05T23:32:57.780381+0000","last_clean":"2023-07-05T23:32:57.780381+0000","last_became_active":"2023-07-05T23:32:57.368030+0000","last_became_peered":"2023-07-05T23:32:57.368030+0000","last_unstale":"2023-07-05T23:32:57.780381+0000","last_undegraded":"2023-07-05T23:32:57.780381+0000","last_fullsized":"2023-07-05T23:32:57.780381+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:16:09.283919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.778814+0000","last_change":"2023-07-05T23:32:47.762370+0000","last_active":"2023-07-05T23:32:57.778814+0000","last_peered":"2023-07-05T23:32:57.778814+0000","last_clean":"2023-07-05T23:32:57.778814+0000","last_became_active":"2023-07-05T23:32:47.761996+0000","last_became_peered":"2023-07-05T23:32:47.761996+0000","last_unstale":"2023-07-05T23:32:57.778814+0000","last_undegraded":"2023-07-05T23:32:57.778814+0000","last_fullsized":"2023-07-05T23:32:57.778814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_clean_scrub_stamp":"2023-07-05T23:32:46.741565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:27:20.919400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.783445+0000","last_change":"2023-07-05T23:32:52.904472+0000","last_active":"2023-07-05T23:32:57.783445+0000","last_peered":"2023-07-05T23:32:57.783445+0000","last_clean":"2023-07-05T23:32:57.783445+0000","last_became_active":"2023-07-05T23:32:52.904202+0000","last_became_peered":"2023-07-05T23:32:52.904202+0000","last_unstale":"2023-07-05T23:32:57.783445+0000","last_undegraded":"2023-07-05T23:32:57.783445+0000","last_fullsized":"2023-07-05T23:32:57.783445+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:14:11.507519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.776981+0000","last_change":"2023-07-05T23:32:53.341847+0000","last_active":"2023-07-05T23:32:57.776981+0000","last_peered":"2023-07-05T23:32:57.776981+0000","last_clean":"2023-07-05T23:32:57.776981+0000","last_became_active":"2023-07-05T23:32:53.338626+0000","last_became_peered":"2023-07-05T23:32:53.338626+0000","last_unstale":"2023-07-05T23:32:57.776981+0000","last_undegraded":"2023-07-05T23:32:57.776981+0000","last_fullsized":"2023-07-05T23:32:57.776981+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:07:52.872003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780950+0000","last_change":"2023-07-05T23:32:57.356351+0000","last_active":"2023-07-05T23:32:57.780950+0000","last_peered":"2023-07-05T23:32:57.780950+0000","last_clean":"2023-07-05T23:32:57.780950+0000","last_became_active":"2023-07-05T23:32:57.355882+0000","last_became_peered":"2023-07-05T23:32:57.355882+0000","last_unstale":"2023-07-05T23:32:57.780950+0000","last_undegraded":"2023-07-05T23:32:57.780950+0000","last_fullsized":"2023-07-05T23:32:57.780950+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:22:43.105654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780220+0000","last_change":"2023-07-05T23:32:47.979611+0000","last_active":"2023-07-05T23:32:57.780220+0000","last_peered":"2023-07-05T23:32:57.780220+0000","last_clean":"2023-07-05T23:32:57.780220+0000","last_became_active":"2023-07-05T23:32:47.979348+0000","last_became_peered":"2023-07-05T23:32:47.979348+0000","last_unstale":"2023-07-05T23:32:57.780220+0000","last_undegraded":"2023-07-05T23:32:57.780220+0000","last_fullsized":"2023-07-05T23:32:57.780220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_clean_scrub_stamp":"2023-07-05T23:32:46.741565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:28:01.280864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.776456+0000","last_change":"2023-07-05T23:32:52.907652+0000","last_active":"2023-07-05T23:32:57.776456+0000","last_peered":"2023-07-05T23:32:57.776456+0000","last_clean":"2023-07-05T23:32:57.776456+0000","last_became_active":"2023-07-05T23:32:52.907307+0000","last_became_peered":"2023-07-05T23:32:52.907307+0000","last_unstale":"2023-07-05T23:32:57.776456+0000","last_undegraded":"2023-07-05T23:32:57.776456+0000","last_fullsized":"2023-07-05T23:32:57.776456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:02:12.835040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.777189+0000","last_change":"2023-07-05T23:32:53.338185+0000","last_active":"2023-07-05T23:32:57.777189+0000","last_peered":"2023-07-05T23:32:57.777189+0000","last_clean":"2023-07-05T23:32:57.777189+0000","last_became_active":"2023-07-05T23:32:53.337896+0000","last_became_peered":"2023-07-05T23:32:53.337896+0000","last_unstale":"2023-07-05T23:32:57.777189+0000","last_undegraded":"2023-07-05T23:32:57.777189+0000","last_fullsized":"2023-07-05T23:32:57.777189+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:21:31.956439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780653+0000","last_change":"2023-07-05T23:32:57.355885+0000","last_active":"2023-07-05T23:32:57.780653+0000","last_peered":"2023-07-05T23:32:57.780653+0000","last_clean":"2023-07-05T23:32:57.780653+0000","last_became_active":"2023-07-05T23:32:57.355475+0000","last_became_peered":"2023-07-05T23:32:57.355475+0000","last_unstale":"2023-07-05T23:32:57.780653+0000","last_undegraded":"2023-07-05T23:32:57.780653+0000","last_fullsized":"2023-07-05T23:32:57.780653+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:27:30.499811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779129+0000","last_change":"2023-07-05T23:32:47.761727+0000","last_active":"2023-07-05T23:32:57.779129+0000","last_peered":"2023-07-05T23:32:57.779129+0000","last_clean":"2023-07-05T23:32:57.779129+0000","last_became_active":"2023-07-05T23:32:47.761392+0000","last_became_peered":"2023-07-05T23:32:47.761392+0000","last_unstale":"2023-07-05T23:32:57.779129+0000","last_undegraded":"2023-07-05T23:32:57.779129+0000","last_fullsized":"2023-07-05T23:32:57.779129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_clean_scrub_stamp":"2023-07-05T23:32:46.741565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:36:11.602450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":183,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780467+0000","last_change":"2023-07-05T23:32:42.737690+0000","last_active":"2023-07-05T23:32:57.780467+0000","last_peered":"2023-07-05T23:32:57.780467+0000","last_clean":"2023-07-05T23:32:57.780467+0000","last_became_active":"2023-07-05T23:32:42.736736+0000","last_became_peered":"2023-07-05T23:32:42.736736+0000","last_unstale":"2023-07-05T23:32:57.780467+0000","last_undegraded":"2023-07-05T23:32:57.780467+0000","last_fullsized":"2023-07-05T23:32:57.780467+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:41.674741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:41.674741+0000","last_clean_scrub_stamp":"2023-07-05T23:32:41.674741+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:58:57.987862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779842+0000","last_change":"2023-07-05T23:32:52.912999+0000","last_active":"2023-07-05T23:32:57.779842+0000","last_peered":"2023-07-05T23:32:57.779842+0000","last_clean":"2023-07-05T23:32:57.779842+0000","last_became_active":"2023-07-05T23:32:52.912684+0000","last_became_peered":"2023-07-05T23:32:52.912684+0000","last_unstale":"2023-07-05T23:32:57.779842+0000","last_undegraded":"2023-07-05T23:32:57.779842+0000","last_fullsized":"2023-07-05T23:32:57.779842+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:21:30.952101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780509+0000","last_change":"2023-07-05T23:32:53.344142+0000","last_active":"2023-07-05T23:32:57.780509+0000","last_peered":"2023-07-05T23:32:57.780509+0000","last_clean":"2023-07-05T23:32:57.780509+0000","last_became_active":"2023-07-05T23:32:53.343848+0000","last_became_peered":"2023-07-05T23:32:53.343848+0000","last_unstale":"2023-07-05T23:32:57.780509+0000","last_undegraded":"2023-07-05T23:32:57.780509+0000","last_fullsized":"2023-07-05T23:32:57.780509+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:20:35.381998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780142+0000","last_change":"2023-07-05T23:32:57.366415+0000","last_active":"2023-07-05T23:32:57.780142+0000","last_peered":"2023-07-05T23:32:57.780142+0000","last_clean":"2023-07-05T23:32:57.780142+0000","last_became_active":"2023-07-05T23:32:57.365013+0000","last_became_peered":"2023-07-05T23:32:57.365013+0000","last_unstale":"2023-07-05T23:32:57.780142+0000","last_undegraded":"2023-07-05T23:32:57.780142+0000","last_fullsized":"2023-07-05T23:32:57.780142+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:15:26.808661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780785+0000","last_change":"2023-07-05T23:32:47.767600+0000","last_active":"2023-07-05T23:32:57.780785+0000","last_peered":"2023-07-05T23:32:57.780785+0000","last_clean":"2023-07-05T23:32:57.780785+0000","last_became_active":"2023-07-05T23:32:47.767297+0000","last_became_peered":"2023-07-05T23:32:47.767297+0000","last_unstale":"2023-07-05T23:32:57.780785+0000","last_undegraded":"2023-07-05T23:32:57.780785+0000","last_fullsized":"2023-07-05T23:32:57.780785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_clean_scrub_stamp":"2023-07-05T23:32:46.741565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:25:13.600949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780399+0000","last_change":"2023-07-05T23:32:52.906517+0000","last_active":"2023-07-05T23:32:57.780399+0000","last_peered":"2023-07-05T23:32:57.780399+0000","last_clean":"2023-07-05T23:32:57.780399+0000","last_became_active":"2023-07-05T23:32:52.906204+0000","last_became_peered":"2023-07-05T23:32:52.906204+0000","last_unstale":"2023-07-05T23:32:57.780399+0000","last_undegraded":"2023-07-05T23:32:57.780399+0000","last_fullsized":"2023-07-05T23:32:57.780399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:24:31.365347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780712+0000","last_change":"2023-07-05T23:32:53.340334+0000","last_active":"2023-07-05T23:32:57.780712+0000","last_peered":"2023-07-05T23:32:57.780712+0000","last_clean":"2023-07-05T23:32:57.780712+0000","last_became_active":"2023-07-05T23:32:53.340061+0000","last_became_peered":"2023-07-05T23:32:53.340061+0000","last_unstale":"2023-07-05T23:32:57.780712+0000","last_undegraded":"2023-07-05T23:32:57.780712+0000","last_fullsized":"2023-07-05T23:32:57.780712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:59:09.195404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781199+0000","last_change":"2023-07-05T23:32:57.362424+0000","last_active":"2023-07-05T23:32:57.781199+0000","last_peered":"2023-07-05T23:32:57.781199+0000","last_clean":"2023-07-05T23:32:57.781199+0000","last_became_active":"2023-07-05T23:32:57.361941+0000","last_became_peered":"2023-07-05T23:32:57.361941+0000","last_unstale":"2023-07-05T23:32:57.781199+0000","last_undegraded":"2023-07-05T23:32:57.781199+0000","last_fullsized":"2023-07-05T23:32:57.781199+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:22:39.370920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781202+0000","last_change":"2023-07-05T23:32:47.790754+0000","last_active":"2023-07-05T23:32:57.781202+0000","last_peered":"2023-07-05T23:32:57.781202+0000","last_clean":"2023-07-05T23:32:57.781202+0000","last_became_active":"2023-07-05T23:32:47.790408+0000","last_became_peered":"2023-07-05T23:32:47.790408+0000","last_unstale":"2023-07-05T23:32:57.781202+0000","last_undegraded":"2023-07-05T23:32:57.781202+0000","last_fullsized":"2023-07-05T23:32:57.781202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_clean_scrub_stamp":"2023-07-05T23:32:46.741565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:19:04.217804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.777239+0000","last_change":"2023-07-05T23:32:52.908711+0000","last_active":"2023-07-05T23:32:57.777239+0000","last_peered":"2023-07-05T23:32:57.777239+0000","last_clean":"2023-07-05T23:32:57.777239+0000","last_became_active":"2023-07-05T23:32:52.908379+0000","last_became_peered":"2023-07-05T23:32:52.908379+0000","last_unstale":"2023-07-05T23:32:57.777239+0000","last_undegraded":"2023-07-05T23:32:57.777239+0000","last_fullsized":"2023-07-05T23:32:57.777239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:25:18.737329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780378+0000","last_change":"2023-07-05T23:32:53.331042+0000","last_active":"2023-07-05T23:32:57.780378+0000","last_peered":"2023-07-05T23:32:57.780378+0000","last_clean":"2023-07-05T23:32:57.780378+0000","last_became_active":"2023-07-05T23:32:53.330771+0000","last_became_peered":"2023-07-05T23:32:53.330771+0000","last_unstale":"2023-07-05T23:32:57.780378+0000","last_undegraded":"2023-07-05T23:32:57.780378+0000","last_fullsized":"2023-07-05T23:32:57.780378+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:51:56.888322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.782732+0000","last_change":"2023-07-05T23:32:57.357223+0000","last_active":"2023-07-05T23:32:57.782732+0000","last_peered":"2023-07-05T23:32:57.782732+0000","last_clean":"2023-07-05T23:32:57.782732+0000","last_became_active":"2023-07-05T23:32:57.356797+0000","last_became_peered":"2023-07-05T23:32:57.356797+0000","last_unstale":"2023-07-05T23:32:57.782732+0000","last_undegraded":"2023-07-05T23:32:57.782732+0000","last_fullsized":"2023-07-05T23:32:57.782732+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:49:42.024861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780991+0000","last_change":"2023-07-05T23:32:52.906030+0000","last_active":"2023-07-05T23:32:57.780991+0000","last_peered":"2023-07-05T23:32:57.780991+0000","last_clean":"2023-07-05T23:32:57.780991+0000","last_became_active":"2023-07-05T23:32:52.905704+0000","last_became_peered":"2023-07-05T23:32:52.905704+0000","last_unstale":"2023-07-05T23:32:57.780991+0000","last_undegraded":"2023-07-05T23:32:57.780991+0000","last_fullsized":"2023-07-05T23:32:57.780991+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:20:56.389364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.776986+0000","last_change":"2023-07-05T23:32:47.769126+0000","last_active":"2023-07-05T23:32:57.776986+0000","last_peered":"2023-07-05T23:32:57.776986+0000","last_clean":"2023-07-05T23:32:57.776986+0000","last_became_active":"2023-07-05T23:32:47.768844+0000","last_became_peered":"2023-07-05T23:32:47.768844+0000","last_unstale":"2023-07-05T23:32:57.776986+0000","last_undegraded":"2023-07-05T23:32:57.776986+0000","last_fullsized":"2023-07-05T23:32:57.776986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_clean_scrub_stamp":"2023-07-05T23:32:46.741565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:59:03.054686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779815+0000","last_change":"2023-07-05T23:32:53.335749+0000","last_active":"2023-07-05T23:32:57.779815+0000","last_peered":"2023-07-05T23:32:57.779815+0000","last_clean":"2023-07-05T23:32:57.779815+0000","last_became_active":"2023-07-05T23:32:53.335506+0000","last_became_peered":"2023-07-05T23:32:53.335506+0000","last_unstale":"2023-07-05T23:32:57.779815+0000","last_undegraded":"2023-07-05T23:32:57.779815+0000","last_fullsized":"2023-07-05T23:32:57.779815+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:27:27.060118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779649+0000","last_change":"2023-07-05T23:32:57.362654+0000","last_active":"2023-07-05T23:32:57.779649+0000","last_peered":"2023-07-05T23:32:57.779649+0000","last_clean":"2023-07-05T23:32:57.779649+0000","last_became_active":"2023-07-05T23:32:57.362112+0000","last_became_peered":"2023-07-05T23:32:57.362112+0000","last_unstale":"2023-07-05T23:32:57.779649+0000","last_undegraded":"2023-07-05T23:32:57.779649+0000","last_fullsized":"2023-07-05T23:32:57.779649+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:40:50.232341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780887+0000","last_change":"2023-07-05T23:32:47.769537+0000","last_active":"2023-07-05T23:32:57.780887+0000","last_peered":"2023-07-05T23:32:57.780887+0000","last_clean":"2023-07-05T23:32:57.780887+0000","last_became_active":"2023-07-05T23:32:47.769141+0000","last_became_peered":"2023-07-05T23:32:47.769141+0000","last_unstale":"2023-07-05T23:32:57.780887+0000","last_undegraded":"2023-07-05T23:32:57.780887+0000","last_fullsized":"2023-07-05T23:32:57.780887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_clean_scrub_stamp":"2023-07-05T23:32:46.741565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:48:48.465852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"28'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780818+0000","last_change":"2023-07-05T23:32:52.905759+0000","last_active":"2023-07-05T23:32:57.780818+0000","last_peered":"2023-07-05T23:32:57.780818+0000","last_clean":"2023-07-05T23:32:57.780818+0000","last_became_active":"2023-07-05T23:32:52.905451+0000","last_became_peered":"2023-07-05T23:32:52.905451+0000","last_unstale":"2023-07-05T23:32:57.780818+0000","last_undegraded":"2023-07-05T23:32:57.780818+0000","last_fullsized":"2023-07-05T23:32:57.780818+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:40:45.788309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.782350+0000","last_change":"2023-07-05T23:32:53.332443+0000","last_active":"2023-07-05T23:32:57.782350+0000","last_peered":"2023-07-05T23:32:57.782350+0000","last_clean":"2023-07-05T23:32:57.782350+0000","last_became_active":"2023-07-05T23:32:53.332159+0000","last_became_peered":"2023-07-05T23:32:53.332159+0000","last_unstale":"2023-07-05T23:32:57.782350+0000","last_undegraded":"2023-07-05T23:32:57.782350+0000","last_fullsized":"2023-07-05T23:32:57.782350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:43:31.795176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.777051+0000","last_change":"2023-07-05T23:32:57.363998+0000","last_active":"2023-07-05T23:32:57.777051+0000","last_peered":"2023-07-05T23:32:57.777051+0000","last_clean":"2023-07-05T23:32:57.777051+0000","last_became_active":"2023-07-05T23:32:57.363620+0000","last_became_peered":"2023-07-05T23:32:57.363620+0000","last_unstale":"2023-07-05T23:32:57.777051+0000","last_undegraded":"2023-07-05T23:32:57.777051+0000","last_fullsized":"2023-07-05T23:32:57.777051+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:40:50.232341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780355+0000","last_change":"2023-07-05T23:32:52.908550+0000","last_active":"2023-07-05T23:32:57.780355+0000","last_peered":"2023-07-05T23:32:57.780355+0000","last_clean":"2023-07-05T23:32:57.780355+0000","last_became_active":"2023-07-05T23:32:52.908111+0000","last_became_peered":"2023-07-05T23:32:52.908111+0000","last_unstale":"2023-07-05T23:32:57.780355+0000","last_undegraded":"2023-07-05T23:32:57.780355+0000","last_fullsized":"2023-07-05T23:32:57.780355+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:03:19.819620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781012+0000","last_change":"2023-07-05T23:32:53.340098+0000","last_active":"2023-07-05T23:32:57.781012+0000","last_peered":"2023-07-05T23:32:57.781012+0000","last_clean":"2023-07-05T23:32:57.781012+0000","last_became_active":"2023-07-05T23:32:53.339686+0000","last_became_peered":"2023-07-05T23:32:53.339686+0000","last_unstale":"2023-07-05T23:32:57.781012+0000","last_undegraded":"2023-07-05T23:32:57.781012+0000","last_fullsized":"2023-07-05T23:32:57.781012+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:23:39.749927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781965+0000","last_change":"2023-07-05T23:32:57.356309+0000","last_active":"2023-07-05T23:32:57.781965+0000","last_peered":"2023-07-05T23:32:57.781965+0000","last_clean":"2023-07-05T23:32:57.781965+0000","last_became_active":"2023-07-05T23:32:57.355910+0000","last_became_peered":"2023-07-05T23:32:57.355910+0000","last_unstale":"2023-07-05T23:32:57.781965+0000","last_undegraded":"2023-07-05T23:32:57.781965+0000","last_fullsized":"2023-07-05T23:32:57.781965+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:21:00.833395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779153+0000","last_change":"2023-07-05T23:32:52.899481+0000","last_active":"2023-07-05T23:32:57.779153+0000","last_peered":"2023-07-05T23:32:57.779153+0000","last_clean":"2023-07-05T23:32:57.779153+0000","last_became_active":"2023-07-05T23:32:52.899159+0000","last_became_peered":"2023-07-05T23:32:52.899159+0000","last_unstale":"2023-07-05T23:32:57.779153+0000","last_undegraded":"2023-07-05T23:32:57.779153+0000","last_fullsized":"2023-07-05T23:32:57.779153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:25:18.737329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.782590+0000","last_change":"2023-07-05T23:32:53.343643+0000","last_active":"2023-07-05T23:32:57.782590+0000","last_peered":"2023-07-05T23:32:57.782590+0000","last_clean":"2023-07-05T23:32:57.782590+0000","last_became_active":"2023-07-05T23:32:53.343262+0000","last_became_peered":"2023-07-05T23:32:53.343262+0000","last_unstale":"2023-07-05T23:32:57.782590+0000","last_undegraded":"2023-07-05T23:32:57.782590+0000","last_fullsized":"2023-07-05T23:32:57.782590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:22:31.213068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779248+0000","last_change":"2023-07-05T23:32:57.365478+0000","last_active":"2023-07-05T23:32:57.779248+0000","last_peered":"2023-07-05T23:32:57.779248+0000","last_clean":"2023-07-05T23:32:57.779248+0000","last_became_active":"2023-07-05T23:32:57.365087+0000","last_became_peered":"2023-07-05T23:32:57.365087+0000","last_unstale":"2023-07-05T23:32:57.779248+0000","last_undegraded":"2023-07-05T23:32:57.779248+0000","last_fullsized":"2023-07-05T23:32:57.779248+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:13:09.034988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779268+0000","last_change":"2023-07-05T23:32:52.902806+0000","last_active":"2023-07-05T23:32:57.779268+0000","last_peered":"2023-07-05T23:32:57.779268+0000","last_clean":"2023-07-05T23:32:57.779268+0000","last_became_active":"2023-07-05T23:32:52.901689+0000","last_became_peered":"2023-07-05T23:32:52.901689+0000","last_unstale":"2023-07-05T23:32:57.779268+0000","last_undegraded":"2023-07-05T23:32:57.779268+0000","last_fullsized":"2023-07-05T23:32:57.779268+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:19:37.582219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.782489+0000","last_change":"2023-07-05T23:32:53.346776+0000","last_active":"2023-07-05T23:32:57.782489+0000","last_peered":"2023-07-05T23:32:57.782489+0000","last_clean":"2023-07-05T23:32:57.782489+0000","last_became_active":"2023-07-05T23:32:53.346553+0000","last_became_peered":"2023-07-05T23:32:53.346553+0000","last_unstale":"2023-07-05T23:32:57.782489+0000","last_undegraded":"2023-07-05T23:32:57.782489+0000","last_fullsized":"2023-07-05T23:32:57.782489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:21:03.950759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.782335+0000","last_change":"2023-07-05T23:32:57.353173+0000","last_active":"2023-07-05T23:32:57.782335+0000","last_peered":"2023-07-05T23:32:57.782335+0000","last_clean":"2023-07-05T23:32:57.782335+0000","last_became_active":"2023-07-05T23:32:57.352716+0000","last_became_peered":"2023-07-05T23:32:57.352716+0000","last_unstale":"2023-07-05T23:32:57.782335+0000","last_undegraded":"2023-07-05T23:32:57.782335+0000","last_fullsized":"2023-07-05T23:32:57.782335+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:00:24.588333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780499+0000","last_change":"2023-07-05T23:32:52.906954+0000","last_active":"2023-07-05T23:32:57.780499+0000","last_peered":"2023-07-05T23:32:57.780499+0000","last_clean":"2023-07-05T23:32:57.780499+0000","last_became_active":"2023-07-05T23:32:52.906688+0000","last_became_peered":"2023-07-05T23:32:52.906688+0000","last_unstale":"2023-07-05T23:32:57.780499+0000","last_undegraded":"2023-07-05T23:32:57.780499+0000","last_fullsized":"2023-07-05T23:32:57.780499+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:17:19.088603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781851+0000","last_change":"2023-07-05T23:32:53.348210+0000","last_active":"2023-07-05T23:32:57.781851+0000","last_peered":"2023-07-05T23:32:57.781851+0000","last_clean":"2023-07-05T23:32:57.781851+0000","last_became_active":"2023-07-05T23:32:53.346652+0000","last_became_peered":"2023-07-05T23:32:53.346652+0000","last_unstale":"2023-07-05T23:32:57.781851+0000","last_undegraded":"2023-07-05T23:32:57.781851+0000","last_fullsized":"2023-07-05T23:32:57.781851+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:15:23.368968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.776688+0000","last_change":"2023-07-05T23:32:57.357185+0000","last_active":"2023-07-05T23:32:57.776688+0000","last_peered":"2023-07-05T23:32:57.776688+0000","last_clean":"2023-07-05T23:32:57.776688+0000","last_became_active":"2023-07-05T23:32:57.356637+0000","last_became_peered":"2023-07-05T23:32:57.356637+0000","last_unstale":"2023-07-05T23:32:57.776688+0000","last_undegraded":"2023-07-05T23:32:57.776688+0000","last_fullsized":"2023-07-05T23:32:57.776688+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:03:24.263651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781492+0000","last_change":"2023-07-05T23:32:52.904412+0000","last_active":"2023-07-05T23:32:57.781492+0000","last_peered":"2023-07-05T23:32:57.781492+0000","last_clean":"2023-07-05T23:32:57.781492+0000","last_became_active":"2023-07-05T23:32:52.903823+0000","last_became_peered":"2023-07-05T23:32:52.903823+0000","last_unstale":"2023-07-05T23:32:57.781492+0000","last_undegraded":"2023-07-05T23:32:57.781492+0000","last_fullsized":"2023-07-05T23:32:57.781492+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:38:12.885407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.782622+0000","last_change":"2023-07-05T23:32:53.342800+0000","last_active":"2023-07-05T23:32:57.782622+0000","last_peered":"2023-07-05T23:32:57.782622+0000","last_clean":"2023-07-05T23:32:57.782622+0000","last_became_active":"2023-07-05T23:32:53.339863+0000","last_became_peered":"2023-07-05T23:32:53.339863+0000","last_unstale":"2023-07-05T23:32:57.782622+0000","last_undegraded":"2023-07-05T23:32:57.782622+0000","last_fullsized":"2023-07-05T23:32:57.782622+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:23:04.385250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.780633+0000","last_change":"2023-07-05T23:32:53.337066+0000","last_active":"2023-07-05T23:32:57.780633+0000","last_peered":"2023-07-05T23:32:57.780633+0000","last_clean":"2023-07-05T23:32:57.780633+0000","last_became_active":"2023-07-05T23:32:53.336759+0000","last_became_peered":"2023-07-05T23:32:53.336759+0000","last_unstale":"2023-07-05T23:32:57.780633+0000","last_undegraded":"2023-07-05T23:32:57.780633+0000","last_fullsized":"2023-07-05T23:32:57.780633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:37:57.921126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.781993+0000","last_change":"2023-07-05T23:32:53.346160+0000","last_active":"2023-07-05T23:32:57.781993+0000","last_peered":"2023-07-05T23:32:57.781993+0000","last_clean":"2023-07-05T23:32:57.781993+0000","last_became_active":"2023-07-05T23:32:53.345711+0000","last_became_peered":"2023-07-05T23:32:53.345711+0000","last_unstale":"2023-07-05T23:32:57.781993+0000","last_undegraded":"2023-07-05T23:32:57.781993+0000","last_fullsized":"2023-07-05T23:32:57.781993+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:43:31.795176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.783058+0000","last_change":"2023-07-05T23:32:53.339729+0000","last_active":"2023-07-05T23:32:57.783058+0000","last_peered":"2023-07-05T23:32:57.783058+0000","last_clean":"2023-07-05T23:32:57.783058+0000","last_became_active":"2023-07-05T23:32:53.339431+0000","last_became_peered":"2023-07-05T23:32:53.339431+0000","last_unstale":"2023-07-05T23:32:57.783058+0000","last_undegraded":"2023-07-05T23:32:57.783058+0000","last_fullsized":"2023-07-05T23:32:57.783058+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:37:45.661547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.779811+0000","last_change":"2023-07-05T23:32:53.335512+0000","last_active":"2023-07-05T23:32:57.779811+0000","last_peered":"2023-07-05T23:32:57.779811+0000","last_clean":"2023-07-05T23:32:57.779811+0000","last_became_active":"2023-07-05T23:32:53.335181+0000","last_became_peered":"2023-07-05T23:32:53.335181+0000","last_unstale":"2023-07-05T23:32:57.779811+0000","last_undegraded":"2023-07-05T23:32:57.779811+0000","last_fullsized":"2023-07-05T23:32:57.779811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:15:41.388811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-07-05T23:32:57.777103+0000","last_change":"2023-07-05T23:32:53.338171+0000","last_active":"2023-07-05T23:32:57.777103+0000","last_peered":"2023-07-05T23:32:57.777103+0000","last_clean":"2023-07-05T23:32:57.777103+0000","last_became_active":"2023-07-05T23:32:53.337835+0000","last_became_peered":"2023-07-05T23:32:53.337835+0000","last_unstale":"2023-07-05T23:32:57.777103+0000","last_undegraded":"2023-07-05T23:32:57.777103+0000","last_fullsized":"2023-07-05T23:32:57.777103+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:15:41.388811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574860,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":904,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":925696,"data_stored":718950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574860,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":303104,"data_stored":124572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]}]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":303104,"data_stored":124572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574860,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":901120,"data_stored":715522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574861,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":303104,"data_stored":124572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574860,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":307200,"data_stored":124662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0469999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.1779999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1020000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":323584,"data_stored":128422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":311296,"data_stored":125224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2430000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-05T23:33:23.132 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-07-05T23:33:23.132 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-07-05T23:33:23.133 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-07-05T23:33:23.133 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-07-05T23:33:23.285 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.283+0000 7f2db69a0700 1 Processor -- start 2023-07-05T23:33:23.285 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.283+0000 7f2db69a0700 1 -- start start 2023-07-05T23:33:23.287 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.284+0000 7f2db69a0700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2db0069ef0 0x7f2db006a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:23.287 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.284+0000 7f2db69a0700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2db006bab0 0x7f2db006a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:23.287 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.284+0000 7f2db69a0700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2db00cc9e0 con 0x7f2db006eef0 2023-07-05T23:33:23.288 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.284+0000 7f2db69a0700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2db006ad40 con 0x7f2db006bab0 2023-07-05T23:33:23.288 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.284+0000 7f2db69a0700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2db00b5780 con 0x7f2db0069ef0 2023-07-05T23:33:23.288 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.284+0000 7f2daffff700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2db0069ef0 0x7f2db006a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:23.288 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.284+0000 7f2daf7fe700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2db006bab0 0x7f2db006a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:23.288 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.284+0000 7f2daf7fe700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2db006bab0 0x7f2db006a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.27:43564/0 (socket says 172.21.15.27:43564) 2023-07-05T23:33:23.288 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.284+0000 7f2daffff700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2db0069ef0 0x7f2db006a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.27:45660/0 (socket says 172.21.15.27:45660) 2023-07-05T23:33:23.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.284+0000 7f2daf7fe700 1 -- 172.21.15.27:0/105156531 learned_addr learned my addr 172.21.15.27:0/105156531 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:23.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.285+0000 7f2daf7fe700 1 -- 172.21.15.27:0/105156531 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2db0069ef0 msgr2=0x7f2db006a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:23.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.285+0000 7f2daf7fe700 1 --2- 172.21.15.27:0/105156531 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2db0069ef0 0x7f2db006a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:23.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.285+0000 7f2daf7fe700 1 -- 172.21.15.27:0/105156531 >> v1:172.21.15.162:6789/0 conn(0x7f2db006eef0 legacy=0x7f2db006f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:23.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.285+0000 7f2daf7fe700 1 -- 172.21.15.27:0/105156531 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2db00c9f40 con 0x7f2db006bab0 2023-07-05T23:33:23.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.285+0000 7f2daf7fe700 1 --2- 172.21.15.27:0/105156531 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2db006bab0 0x7f2db006a800 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2da40098f0 tx=0x7f2da4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8167ef7397c2410 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:23.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.285+0000 7f2daeffd700 1 -- 172.21.15.27:0/105156531 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da4011830 con 0x7f2db006bab0 2023-07-05T23:33:23.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.285+0000 7f2daeffd700 1 -- 172.21.15.27:0/105156531 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2da4011990 con 0x7f2db006bab0 2023-07-05T23:33:23.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.285+0000 7f2daeffd700 1 -- 172.21.15.27:0/105156531 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da4011d20 con 0x7f2db006bab0 2023-07-05T23:33:23.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.286+0000 7f2db69a0700 1 -- 172.21.15.27:0/105156531 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2db006bab0 msgr2=0x7f2db006a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:23.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.286+0000 7f2db69a0700 1 --2- 172.21.15.27:0/105156531 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2db006bab0 0x7f2db006a800 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2da40098f0 tx=0x7f2da4009c00 comp rx=0 tx=0).stop 2023-07-05T23:33:23.293 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.286+0000 7f2db69a0700 1 -- 172.21.15.27:0/105156531 shutdown_connections 2023-07-05T23:33:23.293 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.286+0000 7f2db69a0700 1 --2- 172.21.15.27:0/105156531 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2db0069ef0 0x7f2db006a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:23.293 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.286+0000 7f2db69a0700 1 --2- 172.21.15.27:0/105156531 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2db006bab0 0x7f2db006a800 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:23.293 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.286+0000 7f2db69a0700 1 -- 172.21.15.27:0/105156531 >> 172.21.15.27:0/105156531 conn(0x7f2db006d4a0 msgr2=0x7f2db006d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:23.293 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.286+0000 7f2db69a0700 1 -- 172.21.15.27:0/105156531 shutdown_connections 2023-07-05T23:33:23.293 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.286+0000 7f2db69a0700 1 -- 172.21.15.27:0/105156531 wait complete. 2023-07-05T23:33:23.294 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.287+0000 7f2db69a0700 1 Processor -- start 2023-07-05T23:33:23.294 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.287+0000 7f2db69a0700 1 -- start start 2023-07-05T23:33:23.294 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.288+0000 7f2db69a0700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2db0069ef0 0x7f2db00cd390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:23.294 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.288+0000 7f2db69a0700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2db006bab0 0x7f2db00c4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:23.294 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.288+0000 7f2db69a0700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2db006eef0 0x7f2db00c4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:23.294 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.288+0000 7f2db69a0700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db00cdca0 con 0x7f2db006eef0 2023-07-05T23:33:23.294 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.288+0000 7f2db69a0700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db00cdf80 con 0x7f2db0069ef0 2023-07-05T23:33:23.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.288+0000 7f2db69a0700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2db00ce260 con 0x7f2db006bab0 2023-07-05T23:33:23.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.288+0000 7f2daffff700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2db0069ef0 0x7f2db00cd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:23.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.288+0000 7f2db4f3d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2db006eef0 0x7f2db00c4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:23.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.288+0000 7f2daffff700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2db0069ef0 0x7f2db00cd390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.27:43568/0 (socket says 172.21.15.27:43568) 2023-07-05T23:33:23.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.288+0000 7f2daffff700 1 -- 172.21.15.27:0/3670351042 learned_addr learned my addr 172.21.15.27:0/3670351042 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:23.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.288+0000 7f2daf7fe700 1 --2- 172.21.15.27:0/3670351042 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2db006bab0 0x7f2db00c4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:23.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.288+0000 7f2daffff700 1 -- 172.21.15.27:0/3670351042 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2db006bab0 msgr2=0x7f2db00c4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:23.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.288+0000 7f2daffff700 1 --2- 172.21.15.27:0/3670351042 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2db006bab0 0x7f2db00c4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:23.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.288+0000 7f2daffff700 1 -- 172.21.15.27:0/3670351042 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2db006eef0 msgr2=0x7f2db00c4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:23.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.288+0000 7f2daffff700 1 --2- 172.21.15.27:0/3670351042 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2db006eef0 0x7f2db00c4d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:23.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.288+0000 7f2daffff700 1 -- 172.21.15.27:0/3670351042 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2da4009550 con 0x7f2db0069ef0 2023-07-05T23:33:23.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.288+0000 7f2db4f3d700 1 --2- 172.21.15.27:0/3670351042 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2db006eef0 0x7f2db00c4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T23:33:23.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.289+0000 7f2daffff700 1 --2- 172.21.15.27:0/3670351042 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2db0069ef0 0x7f2db00cd390 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2da000e870 tx=0x7f2da000eb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:23.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.289+0000 7f2dacff9700 1 -- 172.21.15.27:0/3670351042 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da0009590 con 0x7f2db0069ef0 2023-07-05T23:33:23.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.289+0000 7f2dacff9700 1 -- 172.21.15.27:0/3670351042 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2da0013680 con 0x7f2db0069ef0 2023-07-05T23:33:23.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.289+0000 7f2dacff9700 1 -- 172.21.15.27:0/3670351042 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da00139f0 con 0x7f2db0069ef0 2023-07-05T23:33:23.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.289+0000 7f2db69a0700 1 -- 172.21.15.27:0/3670351042 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2db00ce540 con 0x7f2db0069ef0 2023-07-05T23:33:23.298 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.289+0000 7f2db69a0700 1 -- 172.21.15.27:0/3670351042 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2db00ced40 con 0x7f2db0069ef0 2023-07-05T23:33:23.298 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.290+0000 7f2db69a0700 1 -- 172.21.15.27:0/3670351042 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2db00cea60 con 0x7f2db0069ef0 2023-07-05T23:33:23.298 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.290+0000 7f2dacff9700 1 -- 172.21.15.27:0/3670351042 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2da0013b50 con 0x7f2db0069ef0 2023-07-05T23:33:23.298 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.291+0000 7f2dacff9700 1 --2- 172.21.15.27:0/3670351042 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f2d9c06ad10 0x7f2d9c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:23.299 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.291+0000 7f2dacff9700 1 -- 172.21.15.27:0/3670351042 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2da0089440 con 0x7f2db0069ef0 2023-07-05T23:33:23.299 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.291+0000 7f2daf7fe700 1 --2- 172.21.15.27:0/3670351042 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f2d9c06ad10 0x7f2d9c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:23.299 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.291+0000 7f2daf7fe700 1 --2- 172.21.15.27:0/3670351042 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f2d9c06ad10 0x7f2d9c06d1c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2da4014040 tx=0x7f2da4008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:23.300 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.295+0000 7f2dacff9700 1 -- 172.21.15.27:0/3670351042 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2da00542e0 con 0x7f2db0069ef0 2023-07-05T23:33:23.537 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.535+0000 7f2db69a0700 1 -- 172.21.15.27:0/3670351042 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f2db00cea60 con 0x7f2db0069ef0 2023-07-05T23:33:23.537 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.536+0000 7f2dacff9700 1 -- 172.21.15.27:0/3670351042 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f2db00cea60 con 0x7f2db0069ef0 2023-07-05T23:33:23.538 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:33:23.538 INFO:teuthology.orchestra.run.smithi027.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-07-05T23:33:23.540 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.538+0000 7f2db69a0700 1 -- 172.21.15.27:0/3670351042 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f2d9c06ad10 msgr2=0x7f2d9c06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:23.540 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.538+0000 7f2db69a0700 1 --2- 172.21.15.27:0/3670351042 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f2d9c06ad10 0x7f2d9c06d1c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2da4014040 tx=0x7f2da4008030 comp rx=0 tx=0).stop 2023-07-05T23:33:23.540 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.538+0000 7f2db69a0700 1 -- 172.21.15.27:0/3670351042 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2db0069ef0 msgr2=0x7f2db00cd390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:23.541 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.538+0000 7f2db69a0700 1 --2- 172.21.15.27:0/3670351042 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2db0069ef0 0x7f2db00cd390 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2da000e870 tx=0x7f2da000eb80 comp rx=0 tx=0).stop 2023-07-05T23:33:23.541 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.538+0000 7f2db69a0700 1 -- 172.21.15.27:0/3670351042 shutdown_connections 2023-07-05T23:33:23.541 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.538+0000 7f2db69a0700 1 --2- 172.21.15.27:0/3670351042 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2db0069ef0 0x7f2db00cd390 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:23.541 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.538+0000 7f2db69a0700 1 --2- 172.21.15.27:0/3670351042 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f2d9c06ad10 0x7f2d9c06d1c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:23.541 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.538+0000 7f2db69a0700 1 --2- 172.21.15.27:0/3670351042 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2db006eef0 0x7f2db00c4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:23.541 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.538+0000 7f2db69a0700 1 --2- 172.21.15.27:0/3670351042 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2db006bab0 0x7f2db00c4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:23.541 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.538+0000 7f2db69a0700 1 -- 172.21.15.27:0/3670351042 >> 172.21.15.27:0/3670351042 conn(0x7f2db006d4a0 msgr2=0x7f2db006d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:23.542 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.538+0000 7f2db69a0700 1 -- 172.21.15.27:0/3670351042 shutdown_connections 2023-07-05T23:33:23.542 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.538+0000 7f2db69a0700 1 -- 172.21.15.27:0/3670351042 wait complete. 2023-07-05T23:33:23.552 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-07-05T23:33:23.553 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-05T23:33:23.677 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.675+0000 7fe22ba3f700 1 Processor -- start 2023-07-05T23:33:23.677 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.675+0000 7fe22ba3f700 1 -- start start 2023-07-05T23:33:23.678 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.676+0000 7fe22ba3f700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe2240d02d0 0x7fe2240cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:23.678 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.676+0000 7fe22ba3f700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe22406b640 0x7fe2240ced70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:23.679 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.676+0000 7fe22ba3f700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2240ce8e0 con 0x7fe22406b270 2023-07-05T23:33:23.679 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.676+0000 7fe22ba3f700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe22406f140 con 0x7fe22406b640 2023-07-05T23:33:23.679 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.676+0000 7fe22ba3f700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe22406f420 con 0x7fe2240d02d0 2023-07-05T23:33:23.679 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.676+0000 7fe2297db700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fe22406b270 0x7fe2240cd220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:52804/0 (socket says 172.21.15.27:52804) 2023-07-05T23:33:23.679 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.676+0000 7fe2297db700 1 -- 172.21.15.27:0/1550219086 learned_addr learned my addr 172.21.15.27:0/1550219086 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-07-05T23:33:23.679 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.677+0000 7fe228fda700 1 --2- 172.21.15.27:0/1550219086 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe2240d02d0 0x7fe2240cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:23.680 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.677+0000 7fe229fdc700 1 --2- 172.21.15.27:0/1550219086 >> v2:172.21.15.162:3300/0 conn(0x7fe22406b640 0x7fe2240ced70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:23.680 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.677+0000 7fe21bfff700 1 -- 172.21.15.27:0/1550219086 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 201869038 0 0) 0x7fe2240ce8e0 con 0x7fe22406b270 2023-07-05T23:33:23.680 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.677+0000 7fe21bfff700 1 -- 172.21.15.27:0/1550219086 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2100035b0 con 0x7fe22406b270 2023-07-05T23:33:23.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.677+0000 7fe229fdc700 1 -- 172.21.15.27:0/1550219086 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe2240d02d0 msgr2=0x7fe2240cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:23.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.677+0000 7fe229fdc700 1 --2- 172.21.15.27:0/1550219086 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe2240d02d0 0x7fe2240cd930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:23.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.677+0000 7fe229fdc700 1 -- 172.21.15.27:0/1550219086 >> v1:172.21.15.27:6789/0 conn(0x7fe22406b270 legacy=0x7fe2240cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:23.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.677+0000 7fe229fdc700 1 -- 172.21.15.27:0/1550219086 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe22406f700 con 0x7fe22406b640 2023-07-05T23:33:23.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.677+0000 7fe228fda700 1 --2- 172.21.15.27:0/1550219086 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe2240d02d0 0x7fe2240cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T23:33:23.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.677+0000 7fe229fdc700 1 --2- 172.21.15.27:0/1550219086 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe22406b640 0x7fe2240ced70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe21c009d90 tx=0x7fe21c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=722244e287298e4a server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:23.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.677+0000 7fe21bfff700 1 -- 172.21.15.27:0/1550219086 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe21c00e070 con 0x7fe22406b640 2023-07-05T23:33:23.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.677+0000 7fe21bfff700 1 -- 172.21.15.27:0/1550219086 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe21c00bb20 con 0x7fe22406b640 2023-07-05T23:33:23.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.677+0000 7fe21bfff700 1 -- 172.21.15.27:0/1550219086 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe21c012430 con 0x7fe22406b640 2023-07-05T23:33:23.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.678+0000 7fe22ba3f700 1 -- 172.21.15.27:0/1550219086 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe22406b640 msgr2=0x7fe2240ced70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:23.683 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.678+0000 7fe22ba3f700 1 --2- 172.21.15.27:0/1550219086 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe22406b640 0x7fe2240ced70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe21c009d90 tx=0x7fe21c00b330 comp rx=0 tx=0).stop 2023-07-05T23:33:23.683 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.678+0000 7fe22ba3f700 1 -- 172.21.15.27:0/1550219086 shutdown_connections 2023-07-05T23:33:23.683 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.678+0000 7fe22ba3f700 1 --2- 172.21.15.27:0/1550219086 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe22406b640 0x7fe2240ced70 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:23.683 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.678+0000 7fe22ba3f700 1 --2- 172.21.15.27:0/1550219086 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe2240d02d0 0x7fe2240cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:23.683 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.678+0000 7fe22ba3f700 1 -- 172.21.15.27:0/1550219086 >> 172.21.15.27:0/1550219086 conn(0x7fe224089fe0 msgr2=0x7fe2240d09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:23.683 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.678+0000 7fe22ba3f700 1 -- 172.21.15.27:0/1550219086 shutdown_connections 2023-07-05T23:33:23.683 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.678+0000 7fe22ba3f700 1 -- 172.21.15.27:0/1550219086 wait complete. 2023-07-05T23:33:23.683 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.679+0000 7fe22ba3f700 1 Processor -- start 2023-07-05T23:33:23.684 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.679+0000 7fe22ba3f700 1 -- start start 2023-07-05T23:33:23.685 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.680+0000 7fe22ba3f700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe22406b270 0x7fe224154ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:23.686 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.680+0000 7fe22ba3f700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe22406b640 0x7fe2240b0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:23.686 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.680+0000 7fe22ba3f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2240d02d0 0x7fe2240b0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:23.686 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.680+0000 7fe22ba3f700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe224155430 con 0x7fe2240d02d0 2023-07-05T23:33:23.686 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.680+0000 7fe22ba3f700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2240b05e0 con 0x7fe22406b640 2023-07-05T23:33:23.686 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.680+0000 7fe22ba3f700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2240c7f10 con 0x7fe22406b270 2023-07-05T23:33:23.686 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.680+0000 7fe229fdc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2240d02d0 0x7fe2240b0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:23.687 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.680+0000 7fe229fdc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2240d02d0 0x7fe2240b0d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45646/0 (socket says 172.21.15.27:45646) 2023-07-05T23:33:23.687 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.680+0000 7fe229fdc700 1 -- 172.21.15.27:0/942121012 learned_addr learned my addr 172.21.15.27:0/942121012 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:23.687 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.680+0000 7fe228fda700 1 --2- 172.21.15.27:0/942121012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe22406b640 0x7fe2240b0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:23.688 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.680+0000 7fe2297db700 1 --2- 172.21.15.27:0/942121012 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe22406b270 0x7fe224154ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:23.688 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.680+0000 7fe229fdc700 1 -- 172.21.15.27:0/942121012 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe22406b270 msgr2=0x7fe224154ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:23.688 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.680+0000 7fe229fdc700 1 --2- 172.21.15.27:0/942121012 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe22406b270 0x7fe224154ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:23.688 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.680+0000 7fe229fdc700 1 -- 172.21.15.27:0/942121012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe22406b640 msgr2=0x7fe2240b0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:23.688 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.680+0000 7fe229fdc700 1 --2- 172.21.15.27:0/942121012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe22406b640 0x7fe2240b0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:23.688 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.680+0000 7fe229fdc700 1 -- 172.21.15.27:0/942121012 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2200094a0 con 0x7fe2240d02d0 2023-07-05T23:33:23.688 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.681+0000 7fe229fdc700 1 --2- 172.21.15.27:0/942121012 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2240d02d0 0x7fe2240b0d60 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe21c014040 tx=0x7fe21c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:23.688 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.681+0000 7fe219ffb700 1 -- 172.21.15.27:0/942121012 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe21c0129f0 con 0x7fe2240d02d0 2023-07-05T23:33:23.689 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.681+0000 7fe219ffb700 1 -- 172.21.15.27:0/942121012 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe21c020070 con 0x7fe2240d02d0 2023-07-05T23:33:23.689 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.681+0000 7fe219ffb700 1 -- 172.21.15.27:0/942121012 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe21c012db0 con 0x7fe2240d02d0 2023-07-05T23:33:23.689 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.681+0000 7fe22ba3f700 1 -- 172.21.15.27:0/942121012 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe21c009a70 con 0x7fe2240d02d0 2023-07-05T23:33:23.689 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.681+0000 7fe22ba3f700 1 -- 172.21.15.27:0/942121012 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2240b0300 con 0x7fe2240d02d0 2023-07-05T23:33:23.689 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.682+0000 7fe22ba3f700 1 -- 172.21.15.27:0/942121012 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe22406be90 con 0x7fe2240d02d0 2023-07-05T23:33:23.689 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.682+0000 7fe219ffb700 1 -- 172.21.15.27:0/942121012 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe21c004040 con 0x7fe2240d02d0 2023-07-05T23:33:23.689 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.683+0000 7fe219ffb700 1 --2- 172.21.15.27:0/942121012 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fe20806ace0 0x7fe20806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:23.690 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.683+0000 7fe219ffb700 1 -- 172.21.15.27:0/942121012 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe21c022070 con 0x7fe2240d02d0 2023-07-05T23:33:23.690 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.683+0000 7fe2297db700 1 --2- 172.21.15.27:0/942121012 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fe20806ace0 0x7fe20806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:23.690 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.683+0000 7fe2297db700 1 --2- 172.21.15.27:0/942121012 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fe20806ace0 0x7fe20806d190 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe214007fd0 tx=0x7fe214007dc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:23.690 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.687+0000 7fe219ffb700 1 -- 172.21.15.27:0/942121012 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe21c056160 con 0x7fe2240d02d0 2023-07-05T23:33:23.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.885+0000 7fe22ba3f700 1 -- 172.21.15.27:0/942121012 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe2240c8080 con 0x7fe2240d02d0 2023-07-05T23:33:23.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.886+0000 7fe219ffb700 1 -- 172.21.15.27:0/942121012 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20120 (secure 0 0 0) 0x7fe21c059780 con 0x7fe2240d02d0 2023-07-05T23:33:23.889 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:33:23.889 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":28,"fsid":"23eebe48-65f5-4d3c-8c2d-4aa171c055d5","created":"2023-07-05T23:32:27.989612+0000","modified":"2023-07-05T23:32:57.768949+0000","last_up_change":"2023-07-05T23:32:39.601570+0000","last_in_change":"2023-07-05T23:32:30.488261+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-05T23:32:41.624598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-05T23:32:46.481587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-05T23:32:51.025210+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-05T23:32:52.286964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-05T23:32:55.354212+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ac2071e4-394b-4385-b9ba-fad5265efc65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6814","nonce":3766536605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6818","nonce":3766536605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6823","nonce":3766536605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6821","nonce":3766536605}]},"public_addr":"172.21.15.27:6814/3766536605","cluster_addr":"172.21.15.27:6818/3766536605","heartbeat_back_addr":"172.21.15.27:6823/3766536605","heartbeat_front_addr":"172.21.15.27:6821/3766536605","state":["exists","up"]},{"osd":1,"uuid":"8c9b61a0-39d5-46bf-afd6-5add78453ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6801","nonce":1579117455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6803","nonce":1579117455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6807","nonce":1579117455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6805","nonce":1579117455}]},"public_addr":"172.21.15.27:6801/1579117455","cluster_addr":"172.21.15.27:6803/1579117455","heartbeat_back_addr":"172.21.15.27:6807/1579117455","heartbeat_front_addr":"172.21.15.27:6805/1579117455","state":["exists","up"]},{"osd":2,"uuid":"dcd032a2-06b1-4055-b798-b86c71a7107d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6825","nonce":807520271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6827","nonce":807520271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6831","nonce":807520271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6829","nonce":807520271}]},"public_addr":"172.21.15.27:6825/807520271","cluster_addr":"172.21.15.27:6827/807520271","heartbeat_back_addr":"172.21.15.27:6831/807520271","heartbeat_front_addr":"172.21.15.27:6829/807520271","state":["exists","up"]},{"osd":3,"uuid":"b0ffe0fc-47ba-4636-b5ea-6bab637642c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6809","nonce":2125656143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6811","nonce":2125656143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6817","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6819","nonce":2125656143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6813","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6815","nonce":2125656143}]},"public_addr":"172.21.15.27:6809/2125656143","cluster_addr":"172.21.15.27:6811/2125656143","heartbeat_back_addr":"172.21.15.27:6819/2125656143","heartbeat_front_addr":"172.21.15.27:6815/2125656143","state":["exists","up"]},{"osd":4,"uuid":"7fab4e5a-1246-4efe-9562-10c4a6c789ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6801","nonce":2111223016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6803","nonce":2111223016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6807","nonce":2111223016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6805","nonce":2111223016}]},"public_addr":"172.21.15.162:6801/2111223016","cluster_addr":"172.21.15.162:6803/2111223016","heartbeat_back_addr":"172.21.15.162:6807/2111223016","heartbeat_front_addr":"172.21.15.162:6805/2111223016","state":["exists","up"]},{"osd":5,"uuid":"110c4d9f-cef6-48ab-a818-5a81e72372af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6825","nonce":3102609008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6827","nonce":3102609008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6831","nonce":3102609008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6829","nonce":3102609008}]},"public_addr":"172.21.15.162:6825/3102609008","cluster_addr":"172.21.15.162:6827/3102609008","heartbeat_back_addr":"172.21.15.162:6831/3102609008","heartbeat_front_addr":"172.21.15.162:6829/3102609008","state":["exists","up"]},{"osd":6,"uuid":"16803bcc-2c92-4aed-954e-487938c9f24a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6809","nonce":2657688865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6811","nonce":2657688865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6815","nonce":2657688865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6813","nonce":2657688865}]},"public_addr":"172.21.15.162:6809/2657688865","cluster_addr":"172.21.15.162:6811/2657688865","heartbeat_back_addr":"172.21.15.162:6815/2657688865","heartbeat_front_addr":"172.21.15.162:6813/2657688865","state":["exists","up"]},{"osd":7,"uuid":"b7c35377-3cf2-4569-b6b9-72376eb463bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6817","nonce":2096609978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6819","nonce":2096609978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6823","nonce":2096609978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6821","nonce":2096609978}]},"public_addr":"172.21.15.162:6817/2096609978","cluster_addr":"172.21.15.162:6819/2096609978","heartbeat_back_addr":"172.21.15.162:6823/2096609978","heartbeat_front_addr":"172.21.15.162:6821/2096609978","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.735448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.645561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.759120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.682507+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.736228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.694664+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.716002+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.680485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-05T23:33:23.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.889+0000 7fe22ba3f700 1 -- 172.21.15.27:0/942121012 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fe20806ace0 msgr2=0x7fe20806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:23.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.889+0000 7fe22ba3f700 1 --2- 172.21.15.27:0/942121012 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fe20806ace0 0x7fe20806d190 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe214007fd0 tx=0x7fe214007dc0 comp rx=0 tx=0).stop 2023-07-05T23:33:23.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.889+0000 7fe22ba3f700 1 -- 172.21.15.27:0/942121012 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2240d02d0 msgr2=0x7fe2240b0d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:23.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.889+0000 7fe22ba3f700 1 --2- 172.21.15.27:0/942121012 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2240d02d0 0x7fe2240b0d60 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe21c014040 tx=0x7fe21c004ad0 comp rx=0 tx=0).stop 2023-07-05T23:33:23.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.889+0000 7fe22ba3f700 1 -- 172.21.15.27:0/942121012 shutdown_connections 2023-07-05T23:33:23.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.889+0000 7fe22ba3f700 1 --2- 172.21.15.27:0/942121012 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fe20806ace0 0x7fe20806d190 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:23.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.889+0000 7fe22ba3f700 1 --2- 172.21.15.27:0/942121012 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2240d02d0 0x7fe2240b0d60 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:23.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.889+0000 7fe22ba3f700 1 --2- 172.21.15.27:0/942121012 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe22406b270 0x7fe224154ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:23.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.889+0000 7fe22ba3f700 1 --2- 172.21.15.27:0/942121012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe22406b640 0x7fe2240b0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:23.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.889+0000 7fe22ba3f700 1 -- 172.21.15.27:0/942121012 >> 172.21.15.27:0/942121012 conn(0x7fe224089fe0 msgr2=0x7fe2240b5a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:23.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.889+0000 7fe22ba3f700 1 -- 172.21.15.27:0/942121012 shutdown_connections 2023-07-05T23:33:23.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:23.889+0000 7fe22ba3f700 1 -- 172.21.15.27:0/942121012 wait complete. 2023-07-05T23:33:23.903 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-05T23:32:41.624598+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-05T23:32:46.481587+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-05T23:32:51.025210+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-05T23:32:52.286964+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-05T23:32:55.354212+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-05T23:33:23.904 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-05T23:33:24.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.029+0000 7fbd02c38700 1 Processor -- start 2023-07-05T23:33:24.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.029+0000 7fbd02c38700 1 -- start start 2023-07-05T23:33:24.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.029+0000 7fbd02c38700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbcfc15fc60 0x7fbcfc06a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:24.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.030+0000 7fbd02c38700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fbcfc0aecc0 0x7fbcfc0ac600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:24.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.030+0000 7fbd02c38700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcfc0ce620 con 0x7fbcfc06e260 2023-07-05T23:33:24.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.030+0000 7fbd02c38700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcfc160580 con 0x7fbcfc0aecc0 2023-07-05T23:33:24.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.030+0000 7fbd02c38700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcfc160860 con 0x7fbcfc15fc60 2023-07-05T23:33:24.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.030+0000 7fbcfbfff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fbcfc0aecc0 0x7fbcfc0ac600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:24.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.030+0000 7fbcfbfff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fbcfc0aecc0 0x7fbcfc0ac600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45652/0 (socket says 172.21.15.27:45652) 2023-07-05T23:33:24.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.030+0000 7fbd011d5700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fbcfc06e260 0x7fbcfc0cea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:52820/0 (socket says 172.21.15.27:52820) 2023-07-05T23:33:24.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.030+0000 7fbcfbfff700 1 -- 172.21.15.27:0/2641862456 learned_addr learned my addr 172.21.15.27:0/2641862456 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:24.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.030+0000 7fbd009d4700 1 --2- 172.21.15.27:0/2641862456 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbcfc15fc60 0x7fbcfc06a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:24.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.030+0000 7fbcfbfff700 1 -- 172.21.15.27:0/2641862456 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbcfc15fc60 msgr2=0x7fbcfc06a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:24.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.030+0000 7fbcfbfff700 1 --2- 172.21.15.27:0/2641862456 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbcfc15fc60 0x7fbcfc06a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:24.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.030+0000 7fbcfbfff700 1 -- 172.21.15.27:0/2641862456 >> v1:172.21.15.27:6789/0 conn(0x7fbcfc06e260 legacy=0x7fbcfc0cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:24.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.030+0000 7fbcfbfff700 1 -- 172.21.15.27:0/2641862456 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcfc160b40 con 0x7fbcfc0aecc0 2023-07-05T23:33:24.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.030+0000 7fbcfb7fe700 1 -- 172.21.15.27:0/2641862456 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1835056284 0 0) 0x7fbcfc0ce620 con 0x7fbcfc06e260 2023-07-05T23:33:24.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.030+0000 7fbcfbfff700 1 --2- 172.21.15.27:0/2641862456 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbcfc0aecc0 0x7fbcfc0ac600 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbce80098f0 tx=0x7fbce8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c21b8ea836023da server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:24.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.030+0000 7fbcfb7fe700 1 -- 172.21.15.27:0/2641862456 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce800b8a0 con 0x7fbcfc0aecc0 2023-07-05T23:33:24.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.030+0000 7fbcfb7fe700 1 -- 172.21.15.27:0/2641862456 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbce800ba00 con 0x7fbcfc0aecc0 2023-07-05T23:33:24.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.030+0000 7fbcfb7fe700 1 -- 172.21.15.27:0/2641862456 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce800bd90 con 0x7fbcfc0aecc0 2023-07-05T23:33:24.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.031+0000 7fbd02c38700 1 -- 172.21.15.27:0/2641862456 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbcfc0aecc0 msgr2=0x7fbcfc0ac600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:24.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.031+0000 7fbd02c38700 1 --2- 172.21.15.27:0/2641862456 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbcfc0aecc0 0x7fbcfc0ac600 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbce80098f0 tx=0x7fbce8009c00 comp rx=0 tx=0).stop 2023-07-05T23:33:24.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.031+0000 7fbd02c38700 1 -- 172.21.15.27:0/2641862456 shutdown_connections 2023-07-05T23:33:24.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.031+0000 7fbd02c38700 1 --2- 172.21.15.27:0/2641862456 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbcfc15fc60 0x7fbcfc06a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:24.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.031+0000 7fbd02c38700 1 --2- 172.21.15.27:0/2641862456 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbcfc0aecc0 0x7fbcfc0ac600 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:24.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.031+0000 7fbd02c38700 1 -- 172.21.15.27:0/2641862456 >> 172.21.15.27:0/2641862456 conn(0x7fbcfc06b920 msgr2=0x7fbcfc0cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:24.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.031+0000 7fbd02c38700 1 -- 172.21.15.27:0/2641862456 shutdown_connections 2023-07-05T23:33:24.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.031+0000 7fbd02c38700 1 -- 172.21.15.27:0/2641862456 wait complete. 2023-07-05T23:33:24.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.033+0000 7fbd02c38700 1 Processor -- start 2023-07-05T23:33:24.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.033+0000 7fbd02c38700 1 -- start start 2023-07-05T23:33:24.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.034+0000 7fbd02c38700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbcfc06e260 0x7fbcfc0ca040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:24.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.034+0000 7fbd02c38700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbcfc0aecc0 0x7fbcfc153aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:24.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.034+0000 7fbd02c38700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbcfc15fc60 0x7fbcfc0cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:24.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.034+0000 7fbd02c38700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcfc1f5dc0 con 0x7fbcfc06e260 2023-07-05T23:33:24.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.034+0000 7fbd02c38700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcfc153fe0 con 0x7fbcfc0aecc0 2023-07-05T23:33:24.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.034+0000 7fbd02c38700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcfc0c8bf0 con 0x7fbcfc15fc60 2023-07-05T23:33:24.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.034+0000 7fbd009d4700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbcfc06e260 0x7fbcfc0ca040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:24.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.034+0000 7fbd009d4700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbcfc06e260 0x7fbcfc0ca040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45656/0 (socket says 172.21.15.27:45656) 2023-07-05T23:33:24.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.034+0000 7fbd009d4700 1 -- 172.21.15.27:0/4233988514 learned_addr learned my addr 172.21.15.27:0/4233988514 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:24.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.034+0000 7fbcfbfff700 1 --2- 172.21.15.27:0/4233988514 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbcfc0aecc0 0x7fbcfc153aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:24.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.034+0000 7fbd011d5700 1 --2- 172.21.15.27:0/4233988514 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbcfc15fc60 0x7fbcfc0cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:24.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.034+0000 7fbd009d4700 1 -- 172.21.15.27:0/4233988514 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbcfc15fc60 msgr2=0x7fbcfc0cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:24.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.034+0000 7fbd009d4700 1 --2- 172.21.15.27:0/4233988514 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbcfc15fc60 0x7fbcfc0cc7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:24.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.034+0000 7fbd009d4700 1 -- 172.21.15.27:0/4233988514 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbcfc0aecc0 msgr2=0x7fbcfc153aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:24.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.034+0000 7fbd009d4700 1 --2- 172.21.15.27:0/4233988514 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbcfc0aecc0 0x7fbcfc153aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:24.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.034+0000 7fbd009d4700 1 -- 172.21.15.27:0/4233988514 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce8009550 con 0x7fbcfc06e260 2023-07-05T23:33:24.042 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.034+0000 7fbd009d4700 1 --2- 172.21.15.27:0/4233988514 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbcfc06e260 0x7fbcfc0ca040 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbcf000d7d0 tx=0x7fbcf000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:24.042 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.034+0000 7fbcf97fa700 1 -- 172.21.15.27:0/4233988514 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf0017070 con 0x7fbcfc06e260 2023-07-05T23:33:24.042 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.035+0000 7fbcf97fa700 1 -- 172.21.15.27:0/4233988514 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcf0005a20 con 0x7fbcfc06e260 2023-07-05T23:33:24.042 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.035+0000 7fbcf97fa700 1 -- 172.21.15.27:0/4233988514 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf0005bd0 con 0x7fbcfc06e260 2023-07-05T23:33:24.042 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.035+0000 7fbd02c38700 1 -- 172.21.15.27:0/4233988514 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcfc0c8ed0 con 0x7fbcfc06e260 2023-07-05T23:33:24.042 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.035+0000 7fbd02c38700 1 -- 172.21.15.27:0/4233988514 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcfc0b4010 con 0x7fbcfc06e260 2023-07-05T23:33:24.042 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.035+0000 7fbd02c38700 1 -- 172.21.15.27:0/4233988514 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcfc04ea20 con 0x7fbcfc06e260 2023-07-05T23:33:24.042 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.036+0000 7fbcf97fa700 1 -- 172.21.15.27:0/4233988514 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbcf0005d30 con 0x7fbcfc06e260 2023-07-05T23:33:24.043 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.036+0000 7fbcf97fa700 1 --2- 172.21.15.27:0/4233988514 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fbce006ad10 0x7fbce006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:24.043 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.036+0000 7fbcf97fa700 1 -- 172.21.15.27:0/4233988514 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbcf00891c0 con 0x7fbcfc06e260 2023-07-05T23:33:24.043 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.037+0000 7fbcfbfff700 1 --2- 172.21.15.27:0/4233988514 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fbce006ad10 0x7fbce006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:24.043 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.037+0000 7fbcfbfff700 1 --2- 172.21.15.27:0/4233988514 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fbce006ad10 0x7fbce006d1c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc0af090 tx=0x7fbce8008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:24.044 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.041+0000 7fbcf97fa700 1 -- 172.21.15.27:0/4233988514 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbcf0053ee0 con 0x7fbcfc06e260 2023-07-05T23:33:24.241 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.239+0000 7fbd02c38700 1 -- 172.21.15.27:0/4233988514 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbcfc0ced40 con 0x7fbcfc06e260 2023-07-05T23:33:24.242 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.240+0000 7fbcf97fa700 1 -- 172.21.15.27:0/4233988514 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbcf0057500 con 0x7fbcfc06e260 2023-07-05T23:33:24.242 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2023-07-05T23:33:24.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.242+0000 7fbd02c38700 1 -- 172.21.15.27:0/4233988514 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fbce006ad10 msgr2=0x7fbce006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:24.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.242+0000 7fbd02c38700 1 --2- 172.21.15.27:0/4233988514 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fbce006ad10 0x7fbce006d1c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc0af090 tx=0x7fbce8008030 comp rx=0 tx=0).stop 2023-07-05T23:33:24.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.242+0000 7fbd02c38700 1 -- 172.21.15.27:0/4233988514 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbcfc06e260 msgr2=0x7fbcfc0ca040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:24.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.242+0000 7fbd02c38700 1 --2- 172.21.15.27:0/4233988514 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbcfc06e260 0x7fbcfc0ca040 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbcf000d7d0 tx=0x7fbcf000dae0 comp rx=0 tx=0).stop 2023-07-05T23:33:24.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.242+0000 7fbd02c38700 1 -- 172.21.15.27:0/4233988514 shutdown_connections 2023-07-05T23:33:24.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.242+0000 7fbd02c38700 1 --2- 172.21.15.27:0/4233988514 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fbce006ad10 0x7fbce006d1c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:24.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.242+0000 7fbd02c38700 1 --2- 172.21.15.27:0/4233988514 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbcfc15fc60 0x7fbcfc0cc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:24.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.242+0000 7fbd02c38700 1 --2- 172.21.15.27:0/4233988514 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbcfc06e260 0x7fbcfc0ca040 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:24.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.242+0000 7fbd02c38700 1 --2- 172.21.15.27:0/4233988514 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbcfc0aecc0 0x7fbcfc153aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:24.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.242+0000 7fbd02c38700 1 -- 172.21.15.27:0/4233988514 >> 172.21.15.27:0/4233988514 conn(0x7fbcfc06b920 msgr2=0x7fbcfc0b14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:24.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.242+0000 7fbd02c38700 1 -- 172.21.15.27:0/4233988514 shutdown_connections 2023-07-05T23:33:24.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.242+0000 7fbd02c38700 1 -- 172.21.15.27:0/4233988514 wait complete. 2023-07-05T23:33:24.257 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-05T23:33:24.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.383+0000 7feb6e17e700 1 Processor -- start 2023-07-05T23:33:24.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.383+0000 7feb6e17e700 1 -- start start 2023-07-05T23:33:24.387 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.384+0000 7feb6e17e700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb6815fc60 0x7feb6806a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:24.387 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.384+0000 7feb6e17e700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7feb680aecc0 0x7feb680ac600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:24.387 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.384+0000 7feb6e17e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7feb6806e260 0x7feb6806e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:24.388 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.384+0000 7feb6e17e700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb6806ec20 con 0x7feb6806e260 2023-07-05T23:33:24.388 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.384+0000 7feb6e17e700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb680ce620 con 0x7feb680aecc0 2023-07-05T23:33:24.388 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.384+0000 7feb6e17e700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb68160580 con 0x7feb6815fc60 2023-07-05T23:33:24.388 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.384+0000 7feb67fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7feb6806e260 0x7feb6806e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:24.388 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.384+0000 7feb67fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7feb6806e260 0x7feb6806e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45668/0 (socket says 172.21.15.27:45668) 2023-07-05T23:33:24.388 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.384+0000 7feb67fff700 1 -- 172.21.15.27:0/2405834191 learned_addr learned my addr 172.21.15.27:0/2405834191 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:24.388 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.384+0000 7feb66ffd700 1 --2- 172.21.15.27:0/2405834191 >> v2:172.21.15.162:3300/0 conn(0x7feb680aecc0 0x7feb680ac600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:24.389 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.384+0000 7feb677fe700 1 --2- 172.21.15.27:0/2405834191 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb6815fc60 0x7feb6806a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:24.389 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.384+0000 7feb67fff700 1 -- 172.21.15.27:0/2405834191 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb6815fc60 msgr2=0x7feb6806a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:24.389 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.384+0000 7feb67fff700 1 --2- 172.21.15.27:0/2405834191 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb6815fc60 0x7feb6806a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:24.389 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.384+0000 7feb67fff700 1 -- 172.21.15.27:0/2405834191 >> v2:172.21.15.162:3300/0 conn(0x7feb680aecc0 msgr2=0x7feb680ac600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:24.389 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.384+0000 7feb67fff700 1 --2- 172.21.15.27:0/2405834191 >> v2:172.21.15.162:3300/0 conn(0x7feb680aecc0 0x7feb680ac600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:24.389 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.384+0000 7feb67fff700 1 -- 172.21.15.27:0/2405834191 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb68160860 con 0x7feb6806e260 2023-07-05T23:33:24.389 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.384+0000 7feb67fff700 1 --2- 172.21.15.27:0/2405834191 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb6806e260 0x7feb6806e6e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7feb6806fbd0 tx=0x7feb6000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64e61e5eec1469b server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:24.389 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.385+0000 7feb667fc700 1 -- 172.21.15.27:0/2405834191 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6000e070 con 0x7feb6806e260 2023-07-05T23:33:24.390 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.385+0000 7feb667fc700 1 -- 172.21.15.27:0/2405834191 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb6000b9c0 con 0x7feb6806e260 2023-07-05T23:33:24.390 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.385+0000 7feb667fc700 1 -- 172.21.15.27:0/2405834191 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6000bd70 con 0x7feb6806e260 2023-07-05T23:33:24.390 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.385+0000 7feb6e17e700 1 -- 172.21.15.27:0/2405834191 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb6806e260 msgr2=0x7feb6806e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:24.390 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.385+0000 7feb6e17e700 1 --2- 172.21.15.27:0/2405834191 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb6806e260 0x7feb6806e6e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7feb6806fbd0 tx=0x7feb6000b330 comp rx=0 tx=0).stop 2023-07-05T23:33:24.391 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.385+0000 7feb6e17e700 1 -- 172.21.15.27:0/2405834191 shutdown_connections 2023-07-05T23:33:24.391 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.385+0000 7feb6e17e700 1 --2- 172.21.15.27:0/2405834191 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb6806e260 0x7feb6806e6e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:24.391 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.385+0000 7feb6e17e700 1 --2- 172.21.15.27:0/2405834191 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb6815fc60 0x7feb6806a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:24.391 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.385+0000 7feb6e17e700 1 --2- 172.21.15.27:0/2405834191 >> v2:172.21.15.162:3300/0 conn(0x7feb680aecc0 0x7feb680ac600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:24.392 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.385+0000 7feb6e17e700 1 -- 172.21.15.27:0/2405834191 >> 172.21.15.27:0/2405834191 conn(0x7feb6806b920 msgr2=0x7feb680cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:24.392 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.385+0000 7feb6e17e700 1 -- 172.21.15.27:0/2405834191 shutdown_connections 2023-07-05T23:33:24.392 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.385+0000 7feb6e17e700 1 -- 172.21.15.27:0/2405834191 wait complete. 2023-07-05T23:33:24.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.386+0000 7feb6e17e700 1 Processor -- start 2023-07-05T23:33:24.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.387+0000 7feb6e17e700 1 -- start start 2023-07-05T23:33:24.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.387+0000 7feb6e17e700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb6806e260 0x7feb680c3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:24.395 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.387+0000 7feb6e17e700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb680aecc0 0x7feb680b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:24.395 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.387+0000 7feb6e17e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb6815fc60 0x7feb68153bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:24.395 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.387+0000 7feb6e17e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb680b4200 con 0x7feb6815fc60 2023-07-05T23:33:24.395 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.387+0000 7feb6e17e700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb680c3b00 con 0x7feb6806e260 2023-07-05T23:33:24.395 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.387+0000 7feb6e17e700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb680c3de0 con 0x7feb680aecc0 2023-07-05T23:33:24.395 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.387+0000 7feb67fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb6815fc60 0x7feb68153bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:24.396 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.387+0000 7feb67fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb6815fc60 0x7feb68153bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45674/0 (socket says 172.21.15.27:45674) 2023-07-05T23:33:24.396 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.387+0000 7feb67fff700 1 -- 172.21.15.27:0/326567299 learned_addr learned my addr 172.21.15.27:0/326567299 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:24.396 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.388+0000 7feb677fe700 1 --2- 172.21.15.27:0/326567299 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb6806e260 0x7feb680c3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:24.396 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.388+0000 7feb66ffd700 1 --2- 172.21.15.27:0/326567299 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb680aecc0 0x7feb680b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:24.396 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.388+0000 7feb67fff700 1 -- 172.21.15.27:0/326567299 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb680aecc0 msgr2=0x7feb680b4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:24.397 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.388+0000 7feb67fff700 1 --2- 172.21.15.27:0/326567299 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb680aecc0 0x7feb680b4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:24.397 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.388+0000 7feb67fff700 1 -- 172.21.15.27:0/326567299 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb6806e260 msgr2=0x7feb680c3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:24.397 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.388+0000 7feb67fff700 1 --2- 172.21.15.27:0/326567299 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb6806e260 0x7feb680c3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:24.397 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.388+0000 7feb67fff700 1 -- 172.21.15.27:0/326567299 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb60009b30 con 0x7feb6815fc60 2023-07-05T23:33:24.397 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.388+0000 7feb677fe700 1 --2- 172.21.15.27:0/326567299 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb6806e260 0x7feb680c3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T23:33:24.397 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.388+0000 7feb67fff700 1 --2- 172.21.15.27:0/326567299 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb6815fc60 0x7feb68153bd0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7feb6806fac0 tx=0x7feb60004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:24.397 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.388+0000 7feb5ffff700 1 -- 172.21.15.27:0/326567299 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb60004250 con 0x7feb6815fc60 2023-07-05T23:33:24.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.388+0000 7feb5ffff700 1 -- 172.21.15.27:0/326567299 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb600043d0 con 0x7feb6815fc60 2023-07-05T23:33:24.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.388+0000 7feb6e17e700 1 -- 172.21.15.27:0/326567299 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb680c40c0 con 0x7feb6815fc60 2023-07-05T23:33:24.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.388+0000 7feb5ffff700 1 -- 172.21.15.27:0/326567299 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb60004780 con 0x7feb6815fc60 2023-07-05T23:33:24.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.388+0000 7feb6e17e700 1 -- 172.21.15.27:0/326567299 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb680c4680 con 0x7feb6815fc60 2023-07-05T23:33:24.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.389+0000 7feb6e17e700 1 -- 172.21.15.27:0/326567299 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb680d0980 con 0x7feb6815fc60 2023-07-05T23:33:24.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.389+0000 7feb5ffff700 1 -- 172.21.15.27:0/326567299 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7feb6001b430 con 0x7feb6815fc60 2023-07-05T23:33:24.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.390+0000 7feb5ffff700 1 --2- 172.21.15.27:0/326567299 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7feb4806ace0 0x7feb4806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:24.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.390+0000 7feb5ffff700 1 -- 172.21.15.27:0/326567299 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7feb6008a8a0 con 0x7feb6815fc60 2023-07-05T23:33:24.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.390+0000 7feb677fe700 1 --2- 172.21.15.27:0/326567299 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7feb4806ace0 0x7feb4806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:24.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.391+0000 7feb677fe700 1 --2- 172.21.15.27:0/326567299 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7feb4806ace0 0x7feb4806d190 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7feb50006fd0 tx=0x7feb50008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:24.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.394+0000 7feb5ffff700 1 -- 172.21.15.27:0/326567299 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7feb600556f0 con 0x7feb6815fc60 2023-07-05T23:33:24.592 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.590+0000 7feb6e17e700 1 -- 172.21.15.27:0/326567299 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7feb6804ea20 con 0x7feb6815fc60 2023-07-05T23:33:24.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.591+0000 7feb5ffff700 1 -- 172.21.15.27:0/326567299 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7feb6001f020 con 0x7feb6815fc60 2023-07-05T23:33:24.594 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 8 2023-07-05T23:33:24.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.593+0000 7feb6e17e700 1 -- 172.21.15.27:0/326567299 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7feb4806ace0 msgr2=0x7feb4806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:24.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.593+0000 7feb6e17e700 1 --2- 172.21.15.27:0/326567299 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7feb4806ace0 0x7feb4806d190 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7feb50006fd0 tx=0x7feb50008040 comp rx=0 tx=0).stop 2023-07-05T23:33:24.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.593+0000 7feb6e17e700 1 -- 172.21.15.27:0/326567299 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb6815fc60 msgr2=0x7feb68153bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:24.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.593+0000 7feb6e17e700 1 --2- 172.21.15.27:0/326567299 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb6815fc60 0x7feb68153bd0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7feb6806fac0 tx=0x7feb60004ad0 comp rx=0 tx=0).stop 2023-07-05T23:33:24.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.593+0000 7feb6e17e700 1 -- 172.21.15.27:0/326567299 shutdown_connections 2023-07-05T23:33:24.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.593+0000 7feb6e17e700 1 --2- 172.21.15.27:0/326567299 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb6806e260 0x7feb680c3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:24.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.593+0000 7feb6e17e700 1 --2- 172.21.15.27:0/326567299 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7feb4806ace0 0x7feb4806d190 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:24.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.593+0000 7feb6e17e700 1 --2- 172.21.15.27:0/326567299 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb6815fc60 0x7feb68153bd0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:24.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.593+0000 7feb6e17e700 1 --2- 172.21.15.27:0/326567299 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb680aecc0 0x7feb680b4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:24.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.593+0000 7feb6e17e700 1 -- 172.21.15.27:0/326567299 >> 172.21.15.27:0/326567299 conn(0x7feb6806b920 msgr2=0x7feb680af6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:24.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.593+0000 7feb6e17e700 1 -- 172.21.15.27:0/326567299 shutdown_connections 2023-07-05T23:33:24.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.593+0000 7feb6e17e700 1 -- 172.21.15.27:0/326567299 wait complete. 2023-07-05T23:33:24.607 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-05T23:33:24.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.732+0000 7f5d7829b700 1 Processor -- start 2023-07-05T23:33:24.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.732+0000 7f5d7829b700 1 -- start start 2023-07-05T23:33:24.736 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.733+0000 7f5d7829b700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5d700cd1d0 0x7f5d700d3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:24.736 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.733+0000 7f5d7829b700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d7015d280 0x7f5d700d0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:24.736 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.733+0000 7f5d7829b700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d700cd6d0 con 0x7f5d700cf590 2023-07-05T23:33:24.736 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.733+0000 7f5d7829b700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d700cd9b0 con 0x7f5d700cd1d0 2023-07-05T23:33:24.736 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.733+0000 7f5d7829b700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d700b55b0 con 0x7f5d7015d280 2023-07-05T23:33:24.736 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.734+0000 7f5d75836700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5d700cd1d0 0x7f5d700d3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:24.737 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.734+0000 7f5d76838700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d7015d280 0x7f5d700d0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:24.737 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.734+0000 7f5d75836700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5d700cd1d0 0x7f5d700d3600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.27:43618/0 (socket says 172.21.15.27:43618) 2023-07-05T23:33:24.737 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.734+0000 7f5d75836700 1 -- 172.21.15.27:0/3435073299 learned_addr learned my addr 172.21.15.27:0/3435073299 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:24.737 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.734+0000 7f5d75836700 1 -- 172.21.15.27:0/3435073299 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d7015d280 msgr2=0x7f5d700d0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:24.738 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.734+0000 7f5d75836700 1 --2- 172.21.15.27:0/3435073299 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d7015d280 0x7f5d700d0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:24.738 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.734+0000 7f5d75836700 1 -- 172.21.15.27:0/3435073299 >> v1:172.21.15.162:6789/0 conn(0x7f5d700cf590 legacy=0x7f5d700cf960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:24.738 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.734+0000 7f5d75836700 1 -- 172.21.15.27:0/3435073299 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d700d2b20 con 0x7f5d700cd1d0 2023-07-05T23:33:24.743 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.734+0000 7f5d75836700 1 --2- 172.21.15.27:0/3435073299 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d700cd1d0 0x7f5d700d3600 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c0098f0 tx=0x7f5d6c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e965a9da7d727d4 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:24.743 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.734+0000 7f5d75035700 1 -- 172.21.15.27:0/3435073299 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6c011830 con 0x7f5d700cd1d0 2023-07-05T23:33:24.743 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.734+0000 7f5d75035700 1 -- 172.21.15.27:0/3435073299 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d6c011990 con 0x7f5d700cd1d0 2023-07-05T23:33:24.744 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.734+0000 7f5d75035700 1 -- 172.21.15.27:0/3435073299 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6c011d20 con 0x7f5d700cd1d0 2023-07-05T23:33:24.744 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.735+0000 7f5d7829b700 1 -- 172.21.15.27:0/3435073299 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d700cd1d0 msgr2=0x7f5d700d3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:24.744 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.735+0000 7f5d7829b700 1 --2- 172.21.15.27:0/3435073299 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d700cd1d0 0x7f5d700d3600 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c0098f0 tx=0x7f5d6c009c00 comp rx=0 tx=0).stop 2023-07-05T23:33:24.745 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.735+0000 7f5d7829b700 1 -- 172.21.15.27:0/3435073299 shutdown_connections 2023-07-05T23:33:24.745 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.735+0000 7f5d7829b700 1 --2- 172.21.15.27:0/3435073299 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d7015d280 0x7f5d700d0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:24.745 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.735+0000 7f5d7829b700 1 --2- 172.21.15.27:0/3435073299 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d700cd1d0 0x7f5d700d3600 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:24.745 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.735+0000 7f5d7829b700 1 -- 172.21.15.27:0/3435073299 >> 172.21.15.27:0/3435073299 conn(0x7f5d7006b3b0 msgr2=0x7f5d7006b780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:24.746 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.735+0000 7f5d7829b700 1 -- 172.21.15.27:0/3435073299 shutdown_connections 2023-07-05T23:33:24.746 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.735+0000 7f5d7829b700 1 -- 172.21.15.27:0/3435073299 wait complete. 2023-07-05T23:33:24.746 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.736+0000 7f5d7829b700 1 Processor -- start 2023-07-05T23:33:24.746 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.736+0000 7f5d7829b700 1 -- start start 2023-07-05T23:33:24.747 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.737+0000 7f5d7829b700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d700cd1d0 0x7f5d700cb640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:24.747 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.737+0000 7f5d7829b700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d700cf590 0x7f5d701505b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:24.747 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.737+0000 7f5d7829b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5d7015d280 0x7f5d700c9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:24.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.737+0000 7f5d7829b700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d700cb220 con 0x7f5d7015d280 2023-07-05T23:33:24.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.737+0000 7f5d7829b700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d700ca5a0 con 0x7f5d700cd1d0 2023-07-05T23:33:24.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.737+0000 7f5d7829b700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d700ca880 con 0x7f5d700cf590 2023-07-05T23:33:24.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.737+0000 7f5d76838700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5d7015d280 0x7f5d700c9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:24.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.737+0000 7f5d76838700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5d7015d280 0x7f5d700c9c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45688/0 (socket says 172.21.15.27:45688) 2023-07-05T23:33:24.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.737+0000 7f5d76838700 1 -- 172.21.15.27:0/3264971609 learned_addr learned my addr 172.21.15.27:0/3264971609 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:24.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.737+0000 7f5d75836700 1 --2- 172.21.15.27:0/3264971609 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d700cf590 0x7f5d701505b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:24.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.737+0000 7f5d76037700 1 --2- 172.21.15.27:0/3264971609 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d700cd1d0 0x7f5d700cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:24.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.738+0000 7f5d76838700 1 -- 172.21.15.27:0/3264971609 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d700cf590 msgr2=0x7f5d701505b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:24.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.738+0000 7f5d76838700 1 --2- 172.21.15.27:0/3264971609 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d700cf590 0x7f5d701505b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:24.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.738+0000 7f5d76838700 1 -- 172.21.15.27:0/3264971609 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d700cd1d0 msgr2=0x7f5d700cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:24.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.738+0000 7f5d76838700 1 --2- 172.21.15.27:0/3264971609 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d700cd1d0 0x7f5d700cb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:24.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.738+0000 7f5d76838700 1 -- 172.21.15.27:0/3264971609 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d6c009550 con 0x7f5d7015d280 2023-07-05T23:33:24.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.738+0000 7f5d76037700 1 --2- 172.21.15.27:0/3264971609 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d700cd1d0 0x7f5d700cb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T23:33:24.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.738+0000 7f5d76838700 1 --2- 172.21.15.27:0/3264971609 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5d7015d280 0x7f5d700c9c50 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5d6800efc0 tx=0x7f5d6800c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:24.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.738+0000 7f5d66ffd700 1 -- 172.21.15.27:0/3264971609 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6800cad0 con 0x7f5d7015d280 2023-07-05T23:33:24.752 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.738+0000 7f5d66ffd700 1 -- 172.21.15.27:0/3264971609 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d6800f040 con 0x7f5d7015d280 2023-07-05T23:33:24.752 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.738+0000 7f5d7829b700 1 -- 172.21.15.27:0/3264971609 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d700cab60 con 0x7f5d7015d280 2023-07-05T23:33:24.752 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.738+0000 7f5d66ffd700 1 -- 172.21.15.27:0/3264971609 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6800ce70 con 0x7f5d7015d280 2023-07-05T23:33:24.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.738+0000 7f5d7829b700 1 -- 172.21.15.27:0/3264971609 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d700cbb80 con 0x7f5d7015d280 2023-07-05T23:33:24.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.739+0000 7f5d7829b700 1 -- 172.21.15.27:0/3264971609 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d700cb360 con 0x7f5d7015d280 2023-07-05T23:33:24.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.739+0000 7f5d66ffd700 1 -- 172.21.15.27:0/3264971609 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5d68014480 con 0x7f5d7015d280 2023-07-05T23:33:24.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.740+0000 7f5d66ffd700 1 --2- 172.21.15.27:0/3264971609 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f5d5406ace0 0x7f5d5406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:24.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.740+0000 7f5d66ffd700 1 -- 172.21.15.27:0/3264971609 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5d68089e30 con 0x7f5d7015d280 2023-07-05T23:33:24.754 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.740+0000 7f5d76037700 1 --2- 172.21.15.27:0/3264971609 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f5d5406ace0 0x7f5d5406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:24.754 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.740+0000 7f5d76037700 1 --2- 172.21.15.27:0/3264971609 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f5d5406ace0 0x7f5d5406d190 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5d701f5450 tx=0x7f5d60009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:24.754 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.744+0000 7f5d66ffd700 1 -- 172.21.15.27:0/3264971609 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5d700cb360 con 0x7f5d7015d280 2023-07-05T23:33:24.944 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.943+0000 7f5d7829b700 1 -- 172.21.15.27:0/3264971609 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5d700cb360 con 0x7f5d7015d280 2023-07-05T23:33:24.945 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.943+0000 7f5d66ffd700 1 -- 172.21.15.27:0/3264971609 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5d700cb360 con 0x7f5d7015d280 2023-07-05T23:33:24.945 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 32 2023-07-05T23:33:24.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.945+0000 7f5d7829b700 1 -- 172.21.15.27:0/3264971609 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f5d5406ace0 msgr2=0x7f5d5406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:24.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.945+0000 7f5d7829b700 1 --2- 172.21.15.27:0/3264971609 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f5d5406ace0 0x7f5d5406d190 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5d701f5450 tx=0x7f5d60009040 comp rx=0 tx=0).stop 2023-07-05T23:33:24.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.945+0000 7f5d7829b700 1 -- 172.21.15.27:0/3264971609 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5d7015d280 msgr2=0x7f5d700c9c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:24.948 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.945+0000 7f5d7829b700 1 --2- 172.21.15.27:0/3264971609 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5d7015d280 0x7f5d700c9c50 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5d6800efc0 tx=0x7f5d6800c0c0 comp rx=0 tx=0).stop 2023-07-05T23:33:24.948 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.945+0000 7f5d7829b700 1 -- 172.21.15.27:0/3264971609 shutdown_connections 2023-07-05T23:33:24.948 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.945+0000 7f5d7829b700 1 --2- 172.21.15.27:0/3264971609 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d700cd1d0 0x7f5d700cb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:24.948 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.945+0000 7f5d7829b700 1 --2- 172.21.15.27:0/3264971609 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f5d5406ace0 0x7f5d5406d190 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:24.948 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.945+0000 7f5d7829b700 1 --2- 172.21.15.27:0/3264971609 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5d7015d280 0x7f5d700c9c50 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:24.948 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.945+0000 7f5d7829b700 1 --2- 172.21.15.27:0/3264971609 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d700cf590 0x7f5d701505b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:24.948 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.945+0000 7f5d7829b700 1 -- 172.21.15.27:0/3264971609 >> 172.21.15.27:0/3264971609 conn(0x7f5d7006b3b0 msgr2=0x7f5d700cdbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:24.949 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.945+0000 7f5d7829b700 1 -- 172.21.15.27:0/3264971609 shutdown_connections 2023-07-05T23:33:24.949 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:24.945+0000 7f5d7829b700 1 -- 172.21.15.27:0/3264971609 wait complete. 2023-07-05T23:33:24.959 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-05T23:33:25.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.085+0000 7f1944426700 1 Processor -- start 2023-07-05T23:33:25.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.085+0000 7f1944426700 1 -- start start 2023-07-05T23:33:25.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.086+0000 7f1944426700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f193c06d7b0 0x7f193c160800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:25.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.086+0000 7f1944426700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f193c0cce30 con 0x7f193c069ef0 2023-07-05T23:33:25.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.086+0000 7f1944426700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f193c160370 con 0x7f193c160d40 2023-07-05T23:33:25.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.086+0000 7f1944426700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f193c0cd360 con 0x7f193c06d7b0 2023-07-05T23:33:25.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.086+0000 7f19421c2700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f193c069ef0 0x7f193c06a2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:52858/0 (socket says 172.21.15.27:52858) 2023-07-05T23:33:25.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.086+0000 7f19421c2700 1 -- 172.21.15.27:0/580377084 learned_addr learned my addr 172.21.15.27:0/580377084 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-07-05T23:33:25.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.087+0000 7f19419c1700 1 --2- 172.21.15.27:0/580377084 >> v2:172.21.15.162:3300/0 conn(0x7f193c06d7b0 0x7f193c160800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:25.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.087+0000 7f19411c0700 1 -- 172.21.15.27:0/580377084 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2062589561 0 0) 0x7f193c0cce30 con 0x7f193c069ef0 2023-07-05T23:33:25.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.087+0000 7f19411c0700 1 -- 172.21.15.27:0/580377084 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19280035b0 con 0x7f193c069ef0 2023-07-05T23:33:25.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.087+0000 7f19411c0700 1 -- 172.21.15.27:0/580377084 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 628584379 0 0) 0x7f19280035b0 con 0x7f193c069ef0 2023-07-05T23:33:25.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.087+0000 7f19411c0700 1 -- 172.21.15.27:0/580377084 >> v2:172.21.15.162:3300/0 conn(0x7f193c06d7b0 msgr2=0x7f193c160800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:25.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.087+0000 7f19411c0700 1 --2- 172.21.15.27:0/580377084 >> v2:172.21.15.162:3300/0 conn(0x7f193c06d7b0 0x7f193c160800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:25.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.087+0000 7f19411c0700 1 -- 172.21.15.27:0/580377084 >> v1:172.21.15.162:6789/0 conn(0x7f193c160d40 legacy=0x7f193c0ce3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:25.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.087+0000 7f19411c0700 1 -- 172.21.15.27:0/580377084 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f193c15ca50 con 0x7f193c069ef0 2023-07-05T23:33:25.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.087+0000 7f19411c0700 1 -- 172.21.15.27:0/580377084 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1246168953 0 0) 0x7f192c0017f0 con 0x7f193c069ef0 2023-07-05T23:33:25.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.087+0000 7f19411c0700 1 -- 172.21.15.27:0/580377084 >> v1:172.21.15.27:6789/0 conn(0x7f193c069ef0 legacy=0x7f193c06a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:25.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.087+0000 7f19411c0700 1 --2- 172.21.15.27:0/580377084 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1928003a00 0x7f1928003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:25.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.087+0000 7f19411c0700 1 --2- 172.21.15.27:0/580377084 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1928004850 0x7f1928004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:25.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.087+0000 7f19411c0700 1 --2- 172.21.15.27:0/580377084 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1928005200 0x7f192800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:25.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.087+0000 7f19411c0700 1 -- 172.21.15.27:0/580377084 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f193c0cd360 con 0x7f1928004850 2023-07-05T23:33:25.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.087+0000 7f19411c0700 1 -- 172.21.15.27:0/580377084 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f192800c110 con 0x7f1928005200 2023-07-05T23:33:25.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.087+0000 7f19411c0700 1 -- 172.21.15.27:0/580377084 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f192800c2d0 con 0x7f1928003a00 2023-07-05T23:33:25.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.087+0000 7f19419c1700 1 --2- 172.21.15.27:0/580377084 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1928004850 0x7f1928004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:25.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.087+0000 7f19421c2700 1 --2- 172.21.15.27:0/580377084 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1928003a00 0x7f1928003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:25.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.087+0000 7f19429c3700 1 --2- 172.21.15.27:0/580377084 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1928005200 0x7f192800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:25.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.087+0000 7f19419c1700 1 -- 172.21.15.27:0/580377084 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1928003a00 msgr2=0x7f1928003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:25.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.087+0000 7f19419c1700 1 --2- 172.21.15.27:0/580377084 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1928003a00 0x7f1928003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:25.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.087+0000 7f19419c1700 1 -- 172.21.15.27:0/580377084 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1928005200 msgr2=0x7f192800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:25.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.087+0000 7f19419c1700 1 --2- 172.21.15.27:0/580377084 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1928005200 0x7f192800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:25.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.087+0000 7f19429c3700 1 -- 172.21.15.27:0/580377084 reap_dead start 2023-07-05T23:33:25.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.087+0000 7f19419c1700 1 -- 172.21.15.27:0/580377084 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19280035b0 con 0x7f1928004850 2023-07-05T23:33:25.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.088+0000 7f19419c1700 1 --2- 172.21.15.27:0/580377084 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1928004850 0x7f1928004cc0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1938009b60 tx=0x7f1928005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ca352489a52ec32 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:25.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.088+0000 7f19411c0700 1 -- 172.21.15.27:0/580377084 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193800e6c0 con 0x7f1928004850 2023-07-05T23:33:25.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.088+0000 7f19411c0700 1 -- 172.21.15.27:0/580377084 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f193800e820 con 0x7f1928004850 2023-07-05T23:33:25.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.088+0000 7f19411c0700 1 -- 172.21.15.27:0/580377084 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193800eb90 con 0x7f1928004850 2023-07-05T23:33:25.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.088+0000 7f1944426700 1 -- 172.21.15.27:0/580377084 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1928004850 msgr2=0x7f1928004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:25.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.088+0000 7f1944426700 1 --2- 172.21.15.27:0/580377084 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1928004850 0x7f1928004cc0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1938009b60 tx=0x7f1928005880 comp rx=0 tx=0).stop 2023-07-05T23:33:25.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.088+0000 7f1944426700 1 -- 172.21.15.27:0/580377084 shutdown_connections 2023-07-05T23:33:25.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.088+0000 7f1944426700 1 --2- 172.21.15.27:0/580377084 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1928004850 0x7f1928004cc0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:25.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.088+0000 7f1944426700 1 -- 172.21.15.27:0/580377084 >> 172.21.15.27:0/580377084 conn(0x7f193c06b920 msgr2=0x7f193c0cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:25.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.088+0000 7f1944426700 1 -- 172.21.15.27:0/580377084 shutdown_connections 2023-07-05T23:33:25.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.088+0000 7f1944426700 1 -- 172.21.15.27:0/580377084 wait complete. 2023-07-05T23:33:25.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.090+0000 7f1944426700 1 Processor -- start 2023-07-05T23:33:25.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.090+0000 7f1944426700 1 -- start start 2023-07-05T23:33:25.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.090+0000 7f1944426700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1928004850 0x7f193c1f58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:25.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.090+0000 7f1944426700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f193c0b2840 0x7f193c144db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:25.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.090+0000 7f1944426700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f193c15f320 0x7f193c1452f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:25.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.090+0000 7f1944426700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f193c0b2fb0 con 0x7f193c15f320 2023-07-05T23:33:25.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.090+0000 7f1944426700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f193c0b2cd0 con 0x7f193c0b2840 2023-07-05T23:33:25.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.090+0000 7f1944426700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f193c15e840 con 0x7f1928004850 2023-07-05T23:33:25.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.090+0000 7f19429c3700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f193c15f320 0x7f193c1452f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:25.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.091+0000 7f19429c3700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f193c15f320 0x7f193c1452f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45706/0 (socket says 172.21.15.27:45706) 2023-07-05T23:33:25.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.091+0000 7f19429c3700 1 -- 172.21.15.27:0/2225167352 learned_addr learned my addr 172.21.15.27:0/2225167352 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:25.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.091+0000 7f19419c1700 1 --2- 172.21.15.27:0/2225167352 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f193c0b2840 0x7f193c144db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:25.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.091+0000 7f19421c2700 1 --2- 172.21.15.27:0/2225167352 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1928004850 0x7f193c1f58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:25.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.091+0000 7f19429c3700 1 -- 172.21.15.27:0/2225167352 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1928004850 msgr2=0x7f193c1f58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:25.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.091+0000 7f19429c3700 1 --2- 172.21.15.27:0/2225167352 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1928004850 0x7f193c1f58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:25.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.091+0000 7f19429c3700 1 -- 172.21.15.27:0/2225167352 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f193c0b2840 msgr2=0x7f193c144db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:25.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.091+0000 7f19429c3700 1 --2- 172.21.15.27:0/2225167352 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f193c0b2840 0x7f193c144db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:25.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.091+0000 7f19429c3700 1 -- 172.21.15.27:0/2225167352 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f193c15eb20 con 0x7f193c15f320 2023-07-05T23:33:25.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.091+0000 7f19429c3700 1 --2- 172.21.15.27:0/2225167352 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f193c15f320 0x7f193c1452f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f193c071b40 tx=0x7f193400d150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:25.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.091+0000 7f1932ffd700 1 -- 172.21.15.27:0/2225167352 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1934003cd0 con 0x7f193c15f320 2023-07-05T23:33:25.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.091+0000 7f1932ffd700 1 -- 172.21.15.27:0/2225167352 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1934003e70 con 0x7f193c15f320 2023-07-05T23:33:25.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.091+0000 7f1944426700 1 -- 172.21.15.27:0/2225167352 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f193c15ee00 con 0x7f193c15f320 2023-07-05T23:33:25.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.091+0000 7f1932ffd700 1 -- 172.21.15.27:0/2225167352 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193400d9f0 con 0x7f193c15f320 2023-07-05T23:33:25.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.091+0000 7f1944426700 1 -- 172.21.15.27:0/2225167352 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f193c145830 con 0x7f193c15f320 2023-07-05T23:33:25.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.092+0000 7f1944426700 1 -- 172.21.15.27:0/2225167352 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f193c15e6a0 con 0x7f193c15f320 2023-07-05T23:33:25.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.093+0000 7f1932ffd700 1 -- 172.21.15.27:0/2225167352 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f193400db50 con 0x7f193c15f320 2023-07-05T23:33:25.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.093+0000 7f1932ffd700 1 --2- 172.21.15.27:0/2225167352 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f192006ace0 0x7f192006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:25.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.093+0000 7f1932ffd700 1 -- 172.21.15.27:0/2225167352 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f19340899f0 con 0x7f193c15f320 2023-07-05T23:33:25.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.093+0000 7f19421c2700 1 --2- 172.21.15.27:0/2225167352 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f192006ace0 0x7f192006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:25.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.094+0000 7f19421c2700 1 --2- 172.21.15.27:0/2225167352 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f192006ace0 0x7f192006d190 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f192c0011d0 tx=0x7f192c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:25.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.097+0000 7f1932ffd700 1 -- 172.21.15.27:0/2225167352 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f193c15e6a0 con 0x7f193c15f320 2023-07-05T23:33:25.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.293+0000 7f1944426700 1 -- 172.21.15.27:0/2225167352 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f193c15e6a0 con 0x7f193c15f320 2023-07-05T23:33:25.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.294+0000 7f1932ffd700 1 -- 172.21.15.27:0/2225167352 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f193c15e6a0 con 0x7f193c15f320 2023-07-05T23:33:25.296 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2023-07-05T23:33:25.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.295+0000 7f1944426700 1 -- 172.21.15.27:0/2225167352 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f192006ace0 msgr2=0x7f192006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:25.298 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.295+0000 7f1944426700 1 --2- 172.21.15.27:0/2225167352 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f192006ace0 0x7f192006d190 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f192c0011d0 tx=0x7f192c009040 comp rx=0 tx=0).stop 2023-07-05T23:33:25.298 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.295+0000 7f1944426700 1 -- 172.21.15.27:0/2225167352 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f193c15f320 msgr2=0x7f193c1452f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:25.298 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.295+0000 7f1944426700 1 --2- 172.21.15.27:0/2225167352 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f193c15f320 0x7f193c1452f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f193c071b40 tx=0x7f193400d150 comp rx=0 tx=0).stop 2023-07-05T23:33:25.298 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.295+0000 7f1944426700 1 -- 172.21.15.27:0/2225167352 shutdown_connections 2023-07-05T23:33:25.298 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.295+0000 7f1944426700 1 --2- 172.21.15.27:0/2225167352 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f192006ace0 0x7f192006d190 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:25.298 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.295+0000 7f1944426700 1 --2- 172.21.15.27:0/2225167352 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f193c15f320 0x7f193c1452f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:25.298 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.295+0000 7f1944426700 1 --2- 172.21.15.27:0/2225167352 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1928004850 0x7f193c1f58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:25.298 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.295+0000 7f1944426700 1 --2- 172.21.15.27:0/2225167352 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f193c0b2840 0x7f193c144db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:25.299 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.295+0000 7f1944426700 1 -- 172.21.15.27:0/2225167352 >> 172.21.15.27:0/2225167352 conn(0x7f193c06b920 msgr2=0x7f193c0ae0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:25.299 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.296+0000 7f1944426700 1 -- 172.21.15.27:0/2225167352 shutdown_connections 2023-07-05T23:33:25.299 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.296+0000 7f1944426700 1 -- 172.21.15.27:0/2225167352 wait complete. 2023-07-05T23:33:25.310 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-05T23:33:25.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.437+0000 7ff1b3fa3700 1 Processor -- start 2023-07-05T23:33:25.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.437+0000 7ff1b3fa3700 1 -- start start 2023-07-05T23:33:25.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.438+0000 7ff1b3fa3700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff1ac0b23a0 0x7ff1ac06cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:25.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.438+0000 7ff1b3fa3700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1ac15c720 con 0x7ff1ac15d2d0 2023-07-05T23:33:25.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.438+0000 7ff1b3fa3700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1ac0d03a0 con 0x7ff1ac06b000 2023-07-05T23:33:25.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.438+0000 7ff1b3fa3700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1ac15d820 con 0x7ff1ac0b23a0 2023-07-05T23:33:25.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.438+0000 7ff1b1d3f700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff1ac0b23a0 0x7ff1ac06cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:25.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.438+0000 7ff1b1d3f700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff1ac0b23a0 0x7ff1ac06cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45710/0 (socket says 172.21.15.27:45710) 2023-07-05T23:33:25.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.438+0000 7ff1b1d3f700 1 -- 172.21.15.27:0/281372527 learned_addr learned my addr 172.21.15.27:0/281372527 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:25.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.439+0000 7ff1b1d3f700 1 -- 172.21.15.27:0/281372527 >> v1:172.21.15.162:6789/0 conn(0x7ff1ac06b000 legacy=0x7ff1ac06b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:25.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.439+0000 7ff1b1d3f700 1 -- 172.21.15.27:0/281372527 >> v1:172.21.15.27:6789/0 conn(0x7ff1ac15d2d0 legacy=0x7ff1ac0b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:25.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.439+0000 7ff1b0d3d700 1 -- 172.21.15.27:0/281372527 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1115544150 0 0) 0x7ff1a8001110 con 0x7ff1ac15d2d0 2023-07-05T23:33:25.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.439+0000 7ff1b1d3f700 1 -- 172.21.15.27:0/281372527 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1ac0ce690 con 0x7ff1ac0b23a0 2023-07-05T23:33:25.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.439+0000 7ff1b1d3f700 1 --2- 172.21.15.27:0/281372527 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff1ac0b23a0 0x7ff1ac06cc60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff19c0098f0 tx=0x7ff19c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f399caa41d2a4b6a server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:25.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.439+0000 7ff1b0d3d700 1 -- 172.21.15.27:0/281372527 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff19c00b8a0 con 0x7ff1ac0b23a0 2023-07-05T23:33:25.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.439+0000 7ff1b0d3d700 1 -- 172.21.15.27:0/281372527 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff19c00ba00 con 0x7ff1ac0b23a0 2023-07-05T23:33:25.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.439+0000 7ff1b0d3d700 1 -- 172.21.15.27:0/281372527 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff19c00bd90 con 0x7ff1ac0b23a0 2023-07-05T23:33:25.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.440+0000 7ff1b3fa3700 1 -- 172.21.15.27:0/281372527 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff1ac0b23a0 msgr2=0x7ff1ac06cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:25.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.440+0000 7ff1b3fa3700 1 --2- 172.21.15.27:0/281372527 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff1ac0b23a0 0x7ff1ac06cc60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff19c0098f0 tx=0x7ff19c009c00 comp rx=0 tx=0).stop 2023-07-05T23:33:25.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.440+0000 7ff1b3fa3700 1 -- 172.21.15.27:0/281372527 shutdown_connections 2023-07-05T23:33:25.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.440+0000 7ff1b3fa3700 1 --2- 172.21.15.27:0/281372527 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff1ac0b23a0 0x7ff1ac06cc60 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:25.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.440+0000 7ff1b3fa3700 1 -- 172.21.15.27:0/281372527 >> 172.21.15.27:0/281372527 conn(0x7ff1ac06e5c0 msgr2=0x7ff1ac06e990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:25.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.440+0000 7ff1b3fa3700 1 -- 172.21.15.27:0/281372527 shutdown_connections 2023-07-05T23:33:25.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.440+0000 7ff1b3fa3700 1 -- 172.21.15.27:0/281372527 wait complete. 2023-07-05T23:33:25.447 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.441+0000 7ff1b3fa3700 1 Processor -- start 2023-07-05T23:33:25.447 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.441+0000 7ff1b3fa3700 1 -- start start 2023-07-05T23:33:25.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.442+0000 7ff1b3fa3700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1ac06b000 0x7ff1ac0b4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:25.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.442+0000 7ff1b3fa3700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff1ac0b23a0 0x7ff1ac1e6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:25.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.442+0000 7ff1b3fa3700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff1ac15d2d0 0x7ff1ac15e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:25.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.442+0000 7ff1b3fa3700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ac0b3750 con 0x7ff1ac0b23a0 2023-07-05T23:33:25.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.442+0000 7ff1b3fa3700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ac0b3ff0 con 0x7ff1ac06b000 2023-07-05T23:33:25.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.442+0000 7ff1b3fa3700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ac1e76b0 con 0x7ff1ac15d2d0 2023-07-05T23:33:25.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.442+0000 7ff1b153e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff1ac0b23a0 0x7ff1ac1e6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:25.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.442+0000 7ff1b153e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff1ac0b23a0 0x7ff1ac1e6aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45718/0 (socket says 172.21.15.27:45718) 2023-07-05T23:33:25.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.442+0000 7ff1b153e700 1 -- 172.21.15.27:0/3503465883 learned_addr learned my addr 172.21.15.27:0/3503465883 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:25.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.442+0000 7ff1b1d3f700 1 --2- 172.21.15.27:0/3503465883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1ac06b000 0x7ff1ac0b4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:25.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.442+0000 7ff1b2540700 1 --2- 172.21.15.27:0/3503465883 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff1ac15d2d0 0x7ff1ac15e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:25.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.442+0000 7ff1b153e700 1 -- 172.21.15.27:0/3503465883 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff1ac15d2d0 msgr2=0x7ff1ac15e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:25.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.442+0000 7ff1b153e700 1 --2- 172.21.15.27:0/3503465883 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff1ac15d2d0 0x7ff1ac15e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:25.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.442+0000 7ff1b153e700 1 -- 172.21.15.27:0/3503465883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1ac06b000 msgr2=0x7ff1ac0b4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:25.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.442+0000 7ff1b153e700 1 --2- 172.21.15.27:0/3503465883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1ac06b000 0x7ff1ac0b4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:25.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.442+0000 7ff1b153e700 1 -- 172.21.15.27:0/3503465883 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff19c009550 con 0x7ff1ac0b23a0 2023-07-05T23:33:25.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.442+0000 7ff1b2540700 1 --2- 172.21.15.27:0/3503465883 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff1ac15d2d0 0x7ff1ac15e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T23:33:25.451 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.442+0000 7ff1b153e700 1 --2- 172.21.15.27:0/3503465883 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff1ac0b23a0 0x7ff1ac1e6aa0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff1a800c780 tx=0x7ff1a800ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:25.451 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.443+0000 7ff1a27fc700 1 -- 172.21.15.27:0/3503465883 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a80054e0 con 0x7ff1ac0b23a0 2023-07-05T23:33:25.451 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.443+0000 7ff1a27fc700 1 -- 172.21.15.27:0/3503465883 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1a8003680 con 0x7ff1ac0b23a0 2023-07-05T23:33:25.451 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.443+0000 7ff1b3fa3700 1 -- 172.21.15.27:0/3503465883 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1ac1e73d0 con 0x7ff1ac0b23a0 2023-07-05T23:33:25.452 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.443+0000 7ff1a27fc700 1 -- 172.21.15.27:0/3503465883 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a8003a30 con 0x7ff1ac0b23a0 2023-07-05T23:33:25.452 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.443+0000 7ff1b3fa3700 1 -- 172.21.15.27:0/3503465883 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1ac0b3c10 con 0x7ff1ac0b23a0 2023-07-05T23:33:25.452 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.444+0000 7ff1b3fa3700 1 -- 172.21.15.27:0/3503465883 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1ac0b4130 con 0x7ff1ac0b23a0 2023-07-05T23:33:25.452 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.444+0000 7ff1a27fc700 1 -- 172.21.15.27:0/3503465883 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff1a8003b90 con 0x7ff1ac0b23a0 2023-07-05T23:33:25.452 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.444+0000 7ff1a27fc700 1 --2- 172.21.15.27:0/3503465883 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7ff19006ace0 0x7ff19006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:25.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.444+0000 7ff1a27fc700 1 -- 172.21.15.27:0/3503465883 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff1a80889e0 con 0x7ff1ac0b23a0 2023-07-05T23:33:25.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.445+0000 7ff1b1d3f700 1 --2- 172.21.15.27:0/3503465883 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7ff19006ace0 0x7ff19006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:25.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.445+0000 7ff1b1d3f700 1 --2- 172.21.15.27:0/3503465883 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7ff19006ace0 0x7ff19006d190 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff19c000c00 tx=0x7ff19c008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:25.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.449+0000 7ff1a27fc700 1 -- 172.21.15.27:0/3503465883 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff1ac0b4130 con 0x7ff1ac0b23a0 2023-07-05T23:33:25.649 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.646+0000 7ff1b3fa3700 1 -- 172.21.15.27:0/3503465883 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7ff1ac0b4130 con 0x7ff1ac0b23a0 2023-07-05T23:33:25.649 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.646+0000 7ff1a27fc700 1 -- 172.21.15.27:0/3503465883 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7ff1a8017020 con 0x7ff1ac0b23a0 2023-07-05T23:33:25.649 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 32 2023-07-05T23:33:25.651 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.648+0000 7ff1b3fa3700 1 -- 172.21.15.27:0/3503465883 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7ff19006ace0 msgr2=0x7ff19006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:25.651 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.648+0000 7ff1b3fa3700 1 --2- 172.21.15.27:0/3503465883 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7ff19006ace0 0x7ff19006d190 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff19c000c00 tx=0x7ff19c008030 comp rx=0 tx=0).stop 2023-07-05T23:33:25.651 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.648+0000 7ff1b3fa3700 1 -- 172.21.15.27:0/3503465883 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff1ac0b23a0 msgr2=0x7ff1ac1e6aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:25.651 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.648+0000 7ff1b3fa3700 1 --2- 172.21.15.27:0/3503465883 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff1ac0b23a0 0x7ff1ac1e6aa0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff1a800c780 tx=0x7ff1a800ca90 comp rx=0 tx=0).stop 2023-07-05T23:33:25.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.648+0000 7ff1b3fa3700 1 -- 172.21.15.27:0/3503465883 shutdown_connections 2023-07-05T23:33:25.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.648+0000 7ff1b3fa3700 1 --2- 172.21.15.27:0/3503465883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1ac06b000 0x7ff1ac0b4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:25.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.648+0000 7ff1b3fa3700 1 --2- 172.21.15.27:0/3503465883 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7ff19006ace0 0x7ff19006d190 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:25.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.648+0000 7ff1b3fa3700 1 --2- 172.21.15.27:0/3503465883 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff1ac15d2d0 0x7ff1ac15e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:25.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.648+0000 7ff1b3fa3700 1 --2- 172.21.15.27:0/3503465883 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff1ac0b23a0 0x7ff1ac1e6aa0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:25.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.649+0000 7ff1b3fa3700 1 -- 172.21.15.27:0/3503465883 >> 172.21.15.27:0/3503465883 conn(0x7ff1ac06e5c0 msgr2=0x7ff1ac15caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:25.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.649+0000 7ff1b3fa3700 1 -- 172.21.15.27:0/3503465883 shutdown_connections 2023-07-05T23:33:25.653 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.649+0000 7ff1b3fa3700 1 -- 172.21.15.27:0/3503465883 wait complete. 2023-07-05T23:33:25.663 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-05T23:33:25.787 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.785+0000 7f542a1fe700 1 Processor -- start 2023-07-05T23:33:25.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.785+0000 7f542a1fe700 1 -- start start 2023-07-05T23:33:25.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.786+0000 7f542a1fe700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5424156880 0x7f5424069ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:25.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.786+0000 7f542a1fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f54240aed30 0x7f5424160580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:25.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.786+0000 7f542a1fe700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54240cee80 con 0x7f54240cc1d0 2023-07-05T23:33:25.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.786+0000 7f542a1fe700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54240cf100 con 0x7f54240aed30 2023-07-05T23:33:25.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.786+0000 7f542a1fe700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54240cf3e0 con 0x7f5424156880 2023-07-05T23:33:25.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.786+0000 7f5422ffd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f54240aed30 0x7f5424160580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:25.791 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.786+0000 7f5422ffd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f54240aed30 0x7f5424160580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45724/0 (socket says 172.21.15.27:45724) 2023-07-05T23:33:25.791 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.786+0000 7f5422ffd700 1 -- 172.21.15.27:0/1128608936 learned_addr learned my addr 172.21.15.27:0/1128608936 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:25.791 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.786+0000 7f54237fe700 1 --2- 172.21.15.27:0/1128608936 >> v2:172.21.15.162:3300/0 conn(0x7f5424156880 0x7f5424069ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:25.791 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.786+0000 7f5422ffd700 1 -- 172.21.15.27:0/1128608936 >> v2:172.21.15.162:3300/0 conn(0x7f5424156880 msgr2=0x7f5424069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:25.791 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.786+0000 7f5422ffd700 1 --2- 172.21.15.27:0/1128608936 >> v2:172.21.15.162:3300/0 conn(0x7f5424156880 0x7f5424069ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:25.791 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.786+0000 7f5422ffd700 1 -- 172.21.15.27:0/1128608936 >> v1:172.21.15.162:6789/0 conn(0x7f54240cc1d0 legacy=0x7f542415cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:25.791 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.787+0000 7f5422ffd700 1 -- 172.21.15.27:0/1128608936 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54240cd390 con 0x7f54240aed30 2023-07-05T23:33:25.792 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.787+0000 7f54237fe700 1 --2- 172.21.15.27:0/1128608936 >> v2:172.21.15.162:3300/0 conn(0x7f5424156880 0x7f5424069ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T23:33:25.792 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.787+0000 7f5422ffd700 1 --2- 172.21.15.27:0/1128608936 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f54240aed30 0x7f5424160580 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f54240cf720 tx=0x7f5418009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e5bde1de9384186 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:25.792 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.787+0000 7f54227fc700 1 -- 172.21.15.27:0/1128608936 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5418004230 con 0x7f54240aed30 2023-07-05T23:33:25.792 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.787+0000 7f54227fc700 1 -- 172.21.15.27:0/1128608936 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5418004390 con 0x7f54240aed30 2023-07-05T23:33:25.792 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.787+0000 7f54227fc700 1 -- 172.21.15.27:0/1128608936 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54180036a0 con 0x7f54240aed30 2023-07-05T23:33:25.792 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.787+0000 7f542a1fe700 1 -- 172.21.15.27:0/1128608936 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f54240aed30 msgr2=0x7f5424160580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:25.792 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.787+0000 7f542a1fe700 1 --2- 172.21.15.27:0/1128608936 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f54240aed30 0x7f5424160580 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f54240cf720 tx=0x7f5418009bd0 comp rx=0 tx=0).stop 2023-07-05T23:33:25.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.787+0000 7f542a1fe700 1 -- 172.21.15.27:0/1128608936 shutdown_connections 2023-07-05T23:33:25.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.787+0000 7f542a1fe700 1 --2- 172.21.15.27:0/1128608936 >> v2:172.21.15.162:3300/0 conn(0x7f5424156880 0x7f5424069ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:25.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.787+0000 7f542a1fe700 1 --2- 172.21.15.27:0/1128608936 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f54240aed30 0x7f5424160580 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:25.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.787+0000 7f542a1fe700 1 -- 172.21.15.27:0/1128608936 >> 172.21.15.27:0/1128608936 conn(0x7f542406d4a0 msgr2=0x7f542406d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:25.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.787+0000 7f542a1fe700 1 -- 172.21.15.27:0/1128608936 shutdown_connections 2023-07-05T23:33:25.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.787+0000 7f542a1fe700 1 -- 172.21.15.27:0/1128608936 wait complete. 2023-07-05T23:33:25.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.789+0000 7f542a1fe700 1 Processor -- start 2023-07-05T23:33:25.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.789+0000 7f542a1fe700 1 -- start start 2023-07-05T23:33:25.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.789+0000 7f542a1fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f54240aed30 0x7f542415b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:25.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.790+0000 7f542a1fe700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54240cc1d0 0x7f54240b3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:25.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.790+0000 7f542a1fe700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5424156880 0x7f54240b3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:25.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.790+0000 7f542a1fe700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f542406b1a0 con 0x7f54240aed30 2023-07-05T23:33:25.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.790+0000 7f542a1fe700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f542415b190 con 0x7f5424156880 2023-07-05T23:33:25.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.790+0000 7f542a1fe700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f542415ae60 con 0x7f54240cc1d0 2023-07-05T23:33:25.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.790+0000 7f54237fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f54240aed30 0x7f542415b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:25.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.790+0000 7f54237fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f54240aed30 0x7f542415b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45730/0 (socket says 172.21.15.27:45730) 2023-07-05T23:33:25.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.790+0000 7f54237fe700 1 -- 172.21.15.27:0/2019594608 learned_addr learned my addr 172.21.15.27:0/2019594608 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:25.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.790+0000 7f5422ffd700 1 --2- 172.21.15.27:0/2019594608 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54240cc1d0 0x7f54240b3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:25.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.790+0000 7f5423fff700 1 --2- 172.21.15.27:0/2019594608 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5424156880 0x7f54240b3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:25.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.790+0000 7f54237fe700 1 -- 172.21.15.27:0/2019594608 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54240cc1d0 msgr2=0x7f54240b3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:25.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.790+0000 7f54237fe700 1 --2- 172.21.15.27:0/2019594608 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54240cc1d0 0x7f54240b3a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:25.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.790+0000 7f54237fe700 1 -- 172.21.15.27:0/2019594608 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5424156880 msgr2=0x7f54240b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:25.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.790+0000 7f54237fe700 1 --2- 172.21.15.27:0/2019594608 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5424156880 0x7f54240b3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:25.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.790+0000 7f54237fe700 1 -- 172.21.15.27:0/2019594608 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5418009550 con 0x7f54240aed30 2023-07-05T23:33:25.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.790+0000 7f54237fe700 1 --2- 172.21.15.27:0/2019594608 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f54240aed30 0x7f542415b620 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f541400c750 tx=0x7f541400cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:25.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.790+0000 7f540bfff700 1 -- 172.21.15.27:0/2019594608 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5414011800 con 0x7f54240aed30 2023-07-05T23:33:25.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.790+0000 7f540bfff700 1 -- 172.21.15.27:0/2019594608 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5414011960 con 0x7f54240aed30 2023-07-05T23:33:25.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.790+0000 7f542a1fe700 1 -- 172.21.15.27:0/2019594608 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f542406abe0 con 0x7f54240aed30 2023-07-05T23:33:25.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.790+0000 7f540bfff700 1 -- 172.21.15.27:0/2019594608 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5414011cd0 con 0x7f54240aed30 2023-07-05T23:33:25.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.790+0000 7f542a1fe700 1 -- 172.21.15.27:0/2019594608 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f542415bb60 con 0x7f54240aed30 2023-07-05T23:33:25.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.791+0000 7f542a1fe700 1 -- 172.21.15.27:0/2019594608 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f542415acc0 con 0x7f54240aed30 2023-07-05T23:33:25.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.792+0000 7f540bfff700 1 -- 172.21.15.27:0/2019594608 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5414023480 con 0x7f54240aed30 2023-07-05T23:33:25.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.792+0000 7f540bfff700 1 --2- 172.21.15.27:0/2019594608 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f541006ace0 0x7f541006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:25.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.793+0000 7f540bfff700 1 -- 172.21.15.27:0/2019594608 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5414089910 con 0x7f54240aed30 2023-07-05T23:33:25.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.793+0000 7f5422ffd700 1 --2- 172.21.15.27:0/2019594608 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f541006ace0 0x7f541006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:25.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.793+0000 7f5422ffd700 1 --2- 172.21.15.27:0/2019594608 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f541006ace0 0x7f541006d190 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5418009130 tx=0x7f5418008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:25.800 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:25.796+0000 7f540bfff700 1 -- 172.21.15.27:0/2019594608 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f54140547b0 con 0x7f54240aed30 2023-07-05T23:33:26.046 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.044+0000 7f542a1fe700 1 -- 172.21.15.27:0/2019594608 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f542415acc0 con 0x7f54240aed30 2023-07-05T23:33:26.046 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.045+0000 7f540bfff700 1 -- 172.21.15.27:0/2019594608 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4670 (secure 0 0 0) 0x7f542415acc0 con 0x7f54240aed30 2023-07-05T23:33:26.047 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:33:26.047 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/4263442347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":4263442347},{"type":"v1","addr":"172.21.15.162:6837","nonce":4263442347}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/2486008632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2486008632},{"type":"v1","addr":"172.21.15.162:6836","nonce":2486008632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/217781445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":217781445},{"type":"v1","addr":"172.21.15.27:6834","nonce":217781445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-05T23:32:53.313219+0000","modified":"2023-07-05T23:33:16.797372+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6835/3387103520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":3387103520},{"type":"v1","addr":"172.21.15.27:6835","nonce":3387103520}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-05T23:33:26.048 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.046+0000 7f542a1fe700 1 -- 172.21.15.27:0/2019594608 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f541006ace0 msgr2=0x7f541006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:26.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.046+0000 7f542a1fe700 1 --2- 172.21.15.27:0/2019594608 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f541006ace0 0x7f541006d190 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5418009130 tx=0x7f5418008030 comp rx=0 tx=0).stop 2023-07-05T23:33:26.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.046+0000 7f542a1fe700 1 -- 172.21.15.27:0/2019594608 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f54240aed30 msgr2=0x7f542415b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:26.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.046+0000 7f542a1fe700 1 --2- 172.21.15.27:0/2019594608 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f54240aed30 0x7f542415b620 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f541400c750 tx=0x7f541400cb10 comp rx=0 tx=0).stop 2023-07-05T23:33:26.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.047+0000 7f542a1fe700 1 -- 172.21.15.27:0/2019594608 shutdown_connections 2023-07-05T23:33:26.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.047+0000 7f542a1fe700 1 --2- 172.21.15.27:0/2019594608 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5424156880 0x7f54240b3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:26.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.047+0000 7f542a1fe700 1 --2- 172.21.15.27:0/2019594608 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f541006ace0 0x7f541006d190 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:26.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.047+0000 7f542a1fe700 1 --2- 172.21.15.27:0/2019594608 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f54240aed30 0x7f542415b620 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:26.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.047+0000 7f542a1fe700 1 --2- 172.21.15.27:0/2019594608 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54240cc1d0 0x7f54240b3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:26.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.047+0000 7f542a1fe700 1 -- 172.21.15.27:0/2019594608 >> 172.21.15.27:0/2019594608 conn(0x7f542406d4a0 msgr2=0x7f54240af250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:26.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.047+0000 7f542a1fe700 1 -- 172.21.15.27:0/2019594608 shutdown_connections 2023-07-05T23:33:26.051 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.047+0000 7f542a1fe700 1 -- 172.21.15.27:0/2019594608 wait complete. 2023-07-05T23:33:26.051 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 9 2023-07-05T23:33:26.061 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-05T23:33:26.188 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.184+0000 7f66f85dc700 1 Processor -- start 2023-07-05T23:33:26.188 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.184+0000 7f66f85dc700 1 -- start start 2023-07-05T23:33:26.189 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.185+0000 7f66f85dc700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f66f0159080 0x7f66f00cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:26.189 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.185+0000 7f66f85dc700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66f00c9df0 con 0x7f66f00ae6d0 2023-07-05T23:33:26.189 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.185+0000 7f66f85dc700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66f00ca3b0 con 0x7f66f00cb850 2023-07-05T23:33:26.189 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.185+0000 7f66f85dc700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66f015d9d0 con 0x7f66f0159080 2023-07-05T23:33:26.189 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.185+0000 7f66f6378700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f66f0159080 0x7f66f00cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:26.189 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.185+0000 7f66f6378700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f66f0159080 0x7f66f00cd370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45738/0 (socket says 172.21.15.27:45738) 2023-07-05T23:33:26.190 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.185+0000 7f66f6378700 1 -- 172.21.15.27:0/3597221739 learned_addr learned my addr 172.21.15.27:0/3597221739 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:26.190 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.185+0000 7f66f6378700 1 -- 172.21.15.27:0/3597221739 >> v1:172.21.15.162:6789/0 conn(0x7f66f00cb850 legacy=0x7f66f015d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:26.190 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.185+0000 7f66f6378700 1 -- 172.21.15.27:0/3597221739 >> v1:172.21.15.27:6789/0 conn(0x7f66f00ae6d0 legacy=0x7f66f015cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:26.190 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.185+0000 7f66f5376700 1 -- 172.21.15.27:0/3597221739 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 453619403 0 0) 0x7f66f00ca3b0 con 0x7f66f00cb850 2023-07-05T23:33:26.191 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.185+0000 7f66f6378700 1 -- 172.21.15.27:0/3597221739 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f00cf560 con 0x7f66f0159080 2023-07-05T23:33:26.191 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.186+0000 7f66f6378700 1 --2- 172.21.15.27:0/3597221739 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f66f0159080 0x7f66f00cd370 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f66ec00bb90 tx=0x7f66ec00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d34ca58acce16469 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:26.191 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.186+0000 7f66f5376700 1 -- 172.21.15.27:0/3597221739 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ec00dc90 con 0x7f66f0159080 2023-07-05T23:33:26.191 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.186+0000 7f66f5376700 1 -- 172.21.15.27:0/3597221739 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66ec00ddf0 con 0x7f66f0159080 2023-07-05T23:33:26.191 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.186+0000 7f66f5376700 1 -- 172.21.15.27:0/3597221739 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ec004250 con 0x7f66f0159080 2023-07-05T23:33:26.191 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.186+0000 7f66f85dc700 1 -- 172.21.15.27:0/3597221739 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f66f0159080 msgr2=0x7f66f00cd370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:26.191 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.186+0000 7f66f85dc700 1 --2- 172.21.15.27:0/3597221739 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f66f0159080 0x7f66f00cd370 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f66ec00bb90 tx=0x7f66ec00bea0 comp rx=0 tx=0).stop 2023-07-05T23:33:26.191 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.186+0000 7f66f85dc700 1 -- 172.21.15.27:0/3597221739 shutdown_connections 2023-07-05T23:33:26.192 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.186+0000 7f66f85dc700 1 --2- 172.21.15.27:0/3597221739 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f66f0159080 0x7f66f00cd370 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:26.192 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.186+0000 7f66f85dc700 1 -- 172.21.15.27:0/3597221739 >> 172.21.15.27:0/3597221739 conn(0x7f66f006b920 msgr2=0x7f66f00cf7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:26.192 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.186+0000 7f66f85dc700 1 -- 172.21.15.27:0/3597221739 shutdown_connections 2023-07-05T23:33:26.192 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.186+0000 7f66f85dc700 1 -- 172.21.15.27:0/3597221739 wait complete. 2023-07-05T23:33:26.194 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.188+0000 7f66f85dc700 1 Processor -- start 2023-07-05T23:33:26.194 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.188+0000 7f66f85dc700 1 -- start start 2023-07-05T23:33:26.195 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.188+0000 7f66f85dc700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66f00ae6d0 0x7f66f00c91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:26.195 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.188+0000 7f66f85dc700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66f00cb850 0x7f66f00c4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:26.195 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.188+0000 7f66f85dc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f66f0159080 0x7f66f0152d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:26.195 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.188+0000 7f66f85dc700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f00c9730 con 0x7f66f0159080 2023-07-05T23:33:26.195 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.188+0000 7f66f85dc700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f00c5100 con 0x7f66f00ae6d0 2023-07-05T23:33:26.195 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.188+0000 7f66f85dc700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66f01f10e0 con 0x7f66f00cb850 2023-07-05T23:33:26.195 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.188+0000 7f66f6b79700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f66f0159080 0x7f66f0152d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:26.196 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.188+0000 7f66f6b79700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f66f0159080 0x7f66f0152d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45748/0 (socket says 172.21.15.27:45748) 2023-07-05T23:33:26.196 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.188+0000 7f66f6b79700 1 -- 172.21.15.27:0/1749845843 learned_addr learned my addr 172.21.15.27:0/1749845843 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:26.196 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.189+0000 7f66f6378700 1 --2- 172.21.15.27:0/1749845843 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66f00ae6d0 0x7f66f00c91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:26.196 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.189+0000 7f66f5b77700 1 --2- 172.21.15.27:0/1749845843 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66f00cb850 0x7f66f00c4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:26.196 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.189+0000 7f66f6b79700 1 -- 172.21.15.27:0/1749845843 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66f00cb850 msgr2=0x7f66f00c4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:26.196 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.189+0000 7f66f6b79700 1 --2- 172.21.15.27:0/1749845843 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66f00cb850 0x7f66f00c4bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:26.197 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.189+0000 7f66f6b79700 1 -- 172.21.15.27:0/1749845843 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66f00ae6d0 msgr2=0x7f66f00c91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:26.197 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.189+0000 7f66f6b79700 1 --2- 172.21.15.27:0/1749845843 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66f00ae6d0 0x7f66f00c91f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:26.197 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.189+0000 7f66f6b79700 1 -- 172.21.15.27:0/1749845843 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66ec00b7f0 con 0x7f66f0159080 2023-07-05T23:33:26.197 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.189+0000 7f66f6378700 1 --2- 172.21.15.27:0/1749845843 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66f00ae6d0 0x7f66f00c91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T23:33:26.197 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.189+0000 7f66f6b79700 1 --2- 172.21.15.27:0/1749845843 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f66f0159080 0x7f66f0152d60 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f66e800c810 tx=0x7f66e800cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:26.197 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.189+0000 7f66e6ffd700 1 -- 172.21.15.27:0/1749845843 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e8003e30 con 0x7f66f0159080 2023-07-05T23:33:26.197 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.189+0000 7f66e6ffd700 1 -- 172.21.15.27:0/1749845843 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e8005070 con 0x7f66f0159080 2023-07-05T23:33:26.197 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.189+0000 7f66f85dc700 1 -- 172.21.15.27:0/1749845843 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66f01f13c0 con 0x7f66f0159080 2023-07-05T23:33:26.198 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.189+0000 7f66e6ffd700 1 -- 172.21.15.27:0/1749845843 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e8005420 con 0x7f66f0159080 2023-07-05T23:33:26.198 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.189+0000 7f66f85dc700 1 -- 172.21.15.27:0/1749845843 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66f01f1980 con 0x7f66f0159080 2023-07-05T23:33:26.198 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.190+0000 7f66f85dc700 1 -- 172.21.15.27:0/1749845843 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66f0073910 con 0x7f66f0159080 2023-07-05T23:33:26.198 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.190+0000 7f66e6ffd700 1 -- 172.21.15.27:0/1749845843 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f66e8005580 con 0x7f66f0159080 2023-07-05T23:33:26.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.191+0000 7f66e6ffd700 1 --2- 172.21.15.27:0/1749845843 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f66d406ace0 0x7f66d406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:26.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.191+0000 7f66e6ffd700 1 -- 172.21.15.27:0/1749845843 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f66e80894e0 con 0x7f66f0159080 2023-07-05T23:33:26.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.191+0000 7f66f6378700 1 --2- 172.21.15.27:0/1749845843 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f66d406ace0 0x7f66d406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:26.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.192+0000 7f66f6378700 1 --2- 172.21.15.27:0/1749845843 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f66d406ace0 0x7f66d406d190 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f66ec00bee0 tx=0x7f66ec013000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:26.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.195+0000 7f66e6ffd700 1 -- 172.21.15.27:0/1749845843 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f66e80542a0 con 0x7f66f0159080 2023-07-05T23:33:26.396 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.394+0000 7f66f85dc700 1 -- 172.21.15.27:0/1749845843 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f66f00d0470 con 0x7f66f0159080 2023-07-05T23:33:26.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.395+0000 7f66e6ffd700 1 -- 172.21.15.27:0/1749845843 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20120 (secure 0 0 0) 0x7f66e80578c0 con 0x7f66f0159080 2023-07-05T23:33:26.720 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:33:26.720 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":28,"fsid":"23eebe48-65f5-4d3c-8c2d-4aa171c055d5","created":"2023-07-05T23:32:27.989612+0000","modified":"2023-07-05T23:32:57.768949+0000","last_up_change":"2023-07-05T23:32:39.601570+0000","last_in_change":"2023-07-05T23:32:30.488261+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-05T23:32:41.624598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-05T23:32:46.481587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-05T23:32:51.025210+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-05T23:32:52.286964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-05T23:32:55.354212+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ac2071e4-394b-4385-b9ba-fad5265efc65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6814","nonce":3766536605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6818","nonce":3766536605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6823","nonce":3766536605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6821","nonce":3766536605}]},"public_addr":"172.21.15.27:6814/3766536605","cluster_addr":"172.21.15.27:6818/3766536605","heartbeat_back_addr":"172.21.15.27:6823/3766536605","heartbeat_front_addr":"172.21.15.27:6821/3766536605","state":["exists","up"]},{"osd":1,"uuid":"8c9b61a0-39d5-46bf-afd6-5add78453ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6801","nonce":1579117455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6803","nonce":1579117455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6807","nonce":1579117455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6805","nonce":1579117455}]},"public_addr":"172.21.15.27:6801/1579117455","cluster_addr":"172.21.15.27:6803/1579117455","heartbeat_back_addr":"172.21.15.27:6807/1579117455","heartbeat_front_addr":"172.21.15.27:6805/1579117455","state":["exists","up"]},{"osd":2,"uuid":"dcd032a2-06b1-4055-b798-b86c71a7107d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6825","nonce":807520271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6827","nonce":807520271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6831","nonce":807520271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6829","nonce":807520271}]},"public_addr":"172.21.15.27:6825/807520271","cluster_addr":"172.21.15.27:6827/807520271","heartbeat_back_addr":"172.21.15.27:6831/807520271","heartbeat_front_addr":"172.21.15.27:6829/807520271","state":["exists","up"]},{"osd":3,"uuid":"b0ffe0fc-47ba-4636-b5ea-6bab637642c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6809","nonce":2125656143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6811","nonce":2125656143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6817","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6819","nonce":2125656143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6813","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6815","nonce":2125656143}]},"public_addr":"172.21.15.27:6809/2125656143","cluster_addr":"172.21.15.27:6811/2125656143","heartbeat_back_addr":"172.21.15.27:6819/2125656143","heartbeat_front_addr":"172.21.15.27:6815/2125656143","state":["exists","up"]},{"osd":4,"uuid":"7fab4e5a-1246-4efe-9562-10c4a6c789ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6801","nonce":2111223016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6803","nonce":2111223016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6807","nonce":2111223016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6805","nonce":2111223016}]},"public_addr":"172.21.15.162:6801/2111223016","cluster_addr":"172.21.15.162:6803/2111223016","heartbeat_back_addr":"172.21.15.162:6807/2111223016","heartbeat_front_addr":"172.21.15.162:6805/2111223016","state":["exists","up"]},{"osd":5,"uuid":"110c4d9f-cef6-48ab-a818-5a81e72372af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6825","nonce":3102609008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6827","nonce":3102609008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6831","nonce":3102609008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6829","nonce":3102609008}]},"public_addr":"172.21.15.162:6825/3102609008","cluster_addr":"172.21.15.162:6827/3102609008","heartbeat_back_addr":"172.21.15.162:6831/3102609008","heartbeat_front_addr":"172.21.15.162:6829/3102609008","state":["exists","up"]},{"osd":6,"uuid":"16803bcc-2c92-4aed-954e-487938c9f24a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6809","nonce":2657688865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6811","nonce":2657688865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6815","nonce":2657688865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6813","nonce":2657688865}]},"public_addr":"172.21.15.162:6809/2657688865","cluster_addr":"172.21.15.162:6811/2657688865","heartbeat_back_addr":"172.21.15.162:6815/2657688865","heartbeat_front_addr":"172.21.15.162:6813/2657688865","state":["exists","up"]},{"osd":7,"uuid":"b7c35377-3cf2-4569-b6b9-72376eb463bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6817","nonce":2096609978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6819","nonce":2096609978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6823","nonce":2096609978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6821","nonce":2096609978}]},"public_addr":"172.21.15.162:6817/2096609978","cluster_addr":"172.21.15.162:6819/2096609978","heartbeat_back_addr":"172.21.15.162:6823/2096609978","heartbeat_front_addr":"172.21.15.162:6821/2096609978","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.735448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.645561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.759120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.682507+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.736228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.694664+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.716002+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.680485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-05T23:33:26.722 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.397+0000 7f66f85dc700 1 -- 172.21.15.27:0/1749845843 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f66d406ace0 msgr2=0x7f66d406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:26.722 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.397+0000 7f66f85dc700 1 --2- 172.21.15.27:0/1749845843 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f66d406ace0 0x7f66d406d190 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f66ec00bee0 tx=0x7f66ec013000 comp rx=0 tx=0).stop 2023-07-05T23:33:26.722 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.397+0000 7f66f85dc700 1 -- 172.21.15.27:0/1749845843 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f66f0159080 msgr2=0x7f66f0152d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:26.722 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.397+0000 7f66f85dc700 1 --2- 172.21.15.27:0/1749845843 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f66f0159080 0x7f66f0152d60 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f66e800c810 tx=0x7f66e800cbd0 comp rx=0 tx=0).stop 2023-07-05T23:33:26.722 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.397+0000 7f66f85dc700 1 -- 172.21.15.27:0/1749845843 shutdown_connections 2023-07-05T23:33:26.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.397+0000 7f66f85dc700 1 --2- 172.21.15.27:0/1749845843 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66f00ae6d0 0x7f66f00c91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:26.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.397+0000 7f66f85dc700 1 --2- 172.21.15.27:0/1749845843 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f66d406ace0 0x7f66d406d190 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:26.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.397+0000 7f66f85dc700 1 --2- 172.21.15.27:0/1749845843 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f66f0159080 0x7f66f0152d60 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:26.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.397+0000 7f66f85dc700 1 --2- 172.21.15.27:0/1749845843 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66f00cb850 0x7f66f00c4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:26.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.397+0000 7f66f85dc700 1 -- 172.21.15.27:0/1749845843 >> 172.21.15.27:0/1749845843 conn(0x7f66f006b920 msgr2=0x7f66f006d490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:26.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.397+0000 7f66f85dc700 1 -- 172.21.15.27:0/1749845843 shutdown_connections 2023-07-05T23:33:26.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.397+0000 7f66f85dc700 1 -- 172.21.15.27:0/1749845843 wait complete. 2023-07-05T23:33:26.724 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-05T23:32:41.624598+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-05T23:32:46.481587+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-05T23:32:51.025210+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-05T23:32:52.286964+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-05T23:32:55.354212+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-05T23:33:26.725 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-05T23:33:26.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.860+0000 7f2aaaef0700 1 Processor -- start 2023-07-05T23:33:26.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.860+0000 7f2aaaef0700 1 -- start start 2023-07-05T23:33:26.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.860+0000 7f2aaaef0700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2aa40cd5e0 0x7f2aa40cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:26.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.860+0000 7f2aaaef0700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2aa406e030 0x7f2aa406e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:26.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.860+0000 7f2aaaef0700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aa406f0e0 con 0x7f2aa415cf70 2023-07-05T23:33:26.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.860+0000 7f2aaaef0700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aa40ce2c0 con 0x7f2aa406e030 2023-07-05T23:33:26.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.860+0000 7f2aaaef0700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aa40cdef0 con 0x7f2aa40cd5e0 2023-07-05T23:33:26.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.861+0000 7f2aa3fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2aa406e030 0x7f2aa406e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:26.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.861+0000 7f2aa3fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2aa406e030 0x7f2aa406e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45752/0 (socket says 172.21.15.27:45752) 2023-07-05T23:33:26.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.861+0000 7f2aa3fff700 1 -- 172.21.15.27:0/2112259055 learned_addr learned my addr 172.21.15.27:0/2112259055 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:26.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.861+0000 7f2aa8c8c700 1 --2- 172.21.15.27:0/2112259055 >> v2:172.21.15.162:3300/0 conn(0x7f2aa40cd5e0 0x7f2aa40cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:26.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.861+0000 7f2aa3fff700 1 -- 172.21.15.27:0/2112259055 >> v2:172.21.15.162:3300/0 conn(0x7f2aa40cd5e0 msgr2=0x7f2aa40cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:26.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.861+0000 7f2aa3fff700 1 --2- 172.21.15.27:0/2112259055 >> v2:172.21.15.162:3300/0 conn(0x7f2aa40cd5e0 0x7f2aa40cd9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:26.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.861+0000 7f2aa3fff700 1 -- 172.21.15.27:0/2112259055 >> v1:172.21.15.27:6789/0 conn(0x7f2aa415cf70 legacy=0x7f2aa415d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:26.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.861+0000 7f2aa3fff700 1 -- 172.21.15.27:0/2112259055 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa406eb20 con 0x7f2aa406e030 2023-07-05T23:33:26.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.861+0000 7f2aa3fff700 1 --2- 172.21.15.27:0/2112259055 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2aa406e030 0x7f2aa406e4d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2aa4071470 tx=0x7f2a90009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33580025df8434f3 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:26.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.861+0000 7f2aa37fe700 1 -- 172.21.15.27:0/2112259055 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a90011830 con 0x7f2aa406e030 2023-07-05T23:33:26.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.861+0000 7f2aa37fe700 1 -- 172.21.15.27:0/2112259055 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a90011990 con 0x7f2aa406e030 2023-07-05T23:33:26.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.861+0000 7f2aa37fe700 1 -- 172.21.15.27:0/2112259055 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a90011d20 con 0x7f2aa406e030 2023-07-05T23:33:26.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.862+0000 7f2aaaef0700 1 -- 172.21.15.27:0/2112259055 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2aa406e030 msgr2=0x7f2aa406e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:26.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.862+0000 7f2aaaef0700 1 --2- 172.21.15.27:0/2112259055 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2aa406e030 0x7f2aa406e4d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2aa4071470 tx=0x7f2a90009bd0 comp rx=0 tx=0).stop 2023-07-05T23:33:26.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.862+0000 7f2aaaef0700 1 -- 172.21.15.27:0/2112259055 shutdown_connections 2023-07-05T23:33:26.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.862+0000 7f2aaaef0700 1 --2- 172.21.15.27:0/2112259055 >> v2:172.21.15.162:3300/0 conn(0x7f2aa40cd5e0 0x7f2aa40cd9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:26.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.862+0000 7f2aaaef0700 1 --2- 172.21.15.27:0/2112259055 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2aa406e030 0x7f2aa406e4d0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:26.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.862+0000 7f2aaaef0700 1 -- 172.21.15.27:0/2112259055 >> 172.21.15.27:0/2112259055 conn(0x7f2aa406b920 msgr2=0x7f2aa40cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:26.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.862+0000 7f2aaaef0700 1 -- 172.21.15.27:0/2112259055 shutdown_connections 2023-07-05T23:33:26.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.862+0000 7f2aaaef0700 1 -- 172.21.15.27:0/2112259055 wait complete. 2023-07-05T23:33:26.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.863+0000 7f2aaaef0700 1 Processor -- start 2023-07-05T23:33:26.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.863+0000 7f2aaaef0700 1 -- start start 2023-07-05T23:33:26.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.864+0000 7f2aaaef0700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2aa406e030 0x7f2aa406a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:26.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.864+0000 7f2aaaef0700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2aa40cd5e0 0x7f2aa41575b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:26.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.864+0000 7f2aaaef0700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2aa415cf70 0x7f2aa40c3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:26.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.864+0000 7f2aaaef0700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa4158000 con 0x7f2aa415cf70 2023-07-05T23:33:26.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.864+0000 7f2aaaef0700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa41582e0 con 0x7f2aa406e030 2023-07-05T23:33:26.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.864+0000 7f2aaaef0700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa41585c0 con 0x7f2aa40cd5e0 2023-07-05T23:33:26.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.864+0000 7f2aa948d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2aa415cf70 0x7f2aa40c3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:26.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.864+0000 7f2aa948d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2aa415cf70 0x7f2aa40c3270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45762/0 (socket says 172.21.15.27:45762) 2023-07-05T23:33:26.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.864+0000 7f2aa948d700 1 -- 172.21.15.27:0/3175208298 learned_addr learned my addr 172.21.15.27:0/3175208298 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:26.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.864+0000 7f2aa8c8c700 1 --2- 172.21.15.27:0/3175208298 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2aa406e030 0x7f2aa406a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:26.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.864+0000 7f2aa3fff700 1 --2- 172.21.15.27:0/3175208298 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2aa40cd5e0 0x7f2aa41575b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:26.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.864+0000 7f2aa948d700 1 -- 172.21.15.27:0/3175208298 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2aa40cd5e0 msgr2=0x7f2aa41575b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:26.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.864+0000 7f2aa948d700 1 --2- 172.21.15.27:0/3175208298 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2aa40cd5e0 0x7f2aa41575b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:26.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.864+0000 7f2aa948d700 1 -- 172.21.15.27:0/3175208298 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2aa406e030 msgr2=0x7f2aa406a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:26.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.864+0000 7f2aa948d700 1 --2- 172.21.15.27:0/3175208298 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2aa406e030 0x7f2aa406a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:26.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.864+0000 7f2aa948d700 1 -- 172.21.15.27:0/3175208298 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a90009550 con 0x7f2aa415cf70 2023-07-05T23:33:26.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.864+0000 7f2aa3fff700 1 --2- 172.21.15.27:0/3175208298 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2aa40cd5e0 0x7f2aa41575b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T23:33:26.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.865+0000 7f2aa948d700 1 --2- 172.21.15.27:0/3175208298 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2aa415cf70 0x7f2aa40c3270 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c00cb50 tx=0x7f2a9c00ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:26.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.865+0000 7f2aa17fa700 1 -- 172.21.15.27:0/3175208298 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c003c00 con 0x7f2aa415cf70 2023-07-05T23:33:26.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.865+0000 7f2aa17fa700 1 -- 172.21.15.27:0/3175208298 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a9c003d60 con 0x7f2aa415cf70 2023-07-05T23:33:26.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.865+0000 7f2aaaef0700 1 -- 172.21.15.27:0/3175208298 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2aa41588a0 con 0x7f2aa415cf70 2023-07-05T23:33:26.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.865+0000 7f2aa17fa700 1 -- 172.21.15.27:0/3175208298 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c00aac0 con 0x7f2aa415cf70 2023-07-05T23:33:26.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.865+0000 7f2aaaef0700 1 -- 172.21.15.27:0/3175208298 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2aa4152160 con 0x7f2aa415cf70 2023-07-05T23:33:26.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.866+0000 7f2aaaef0700 1 -- 172.21.15.27:0/3175208298 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2aa404ea20 con 0x7f2aa415cf70 2023-07-05T23:33:26.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.866+0000 7f2aa17fa700 1 -- 172.21.15.27:0/3175208298 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2a9c00ac20 con 0x7f2aa415cf70 2023-07-05T23:33:26.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.867+0000 7f2aa17fa700 1 --2- 172.21.15.27:0/3175208298 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f2a8806ace0 0x7f2a8806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:26.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.867+0000 7f2aa17fa700 1 -- 172.21.15.27:0/3175208298 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2a9c0896d0 con 0x7f2aa415cf70 2023-07-05T23:33:26.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.867+0000 7f2aa8c8c700 1 --2- 172.21.15.27:0/3175208298 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f2a8806ace0 0x7f2a8806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:26.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.867+0000 7f2aa8c8c700 1 --2- 172.21.15.27:0/3175208298 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f2a8806ace0 0x7f2a8806d190 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2a98009bc0 tx=0x7f2a980091c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:26.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:26.871+0000 7f2aa17fa700 1 -- 172.21.15.27:0/3175208298 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2a9c054520 con 0x7f2aa415cf70 2023-07-05T23:33:27.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.066+0000 7f2aaaef0700 1 -- 172.21.15.27:0/3175208298 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2aa40b5990 con 0x7f2aa415cf70 2023-07-05T23:33:27.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.067+0000 7f2aa17fa700 1 -- 172.21.15.27:0/3175208298 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2a9c057b40 con 0x7f2aa415cf70 2023-07-05T23:33:27.069 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2023-07-05T23:33:27.070 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.069+0000 7f2aaaef0700 1 -- 172.21.15.27:0/3175208298 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f2a8806ace0 msgr2=0x7f2a8806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:27.071 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.069+0000 7f2aaaef0700 1 --2- 172.21.15.27:0/3175208298 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f2a8806ace0 0x7f2a8806d190 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2a98009bc0 tx=0x7f2a980091c0 comp rx=0 tx=0).stop 2023-07-05T23:33:27.071 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.069+0000 7f2aaaef0700 1 -- 172.21.15.27:0/3175208298 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2aa415cf70 msgr2=0x7f2aa40c3270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:27.071 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.069+0000 7f2aaaef0700 1 --2- 172.21.15.27:0/3175208298 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2aa415cf70 0x7f2aa40c3270 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c00cb50 tx=0x7f2a9c00ce60 comp rx=0 tx=0).stop 2023-07-05T23:33:27.071 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.069+0000 7f2aaaef0700 1 -- 172.21.15.27:0/3175208298 shutdown_connections 2023-07-05T23:33:27.071 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.069+0000 7f2aaaef0700 1 --2- 172.21.15.27:0/3175208298 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2aa406e030 0x7f2aa406a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:27.071 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.069+0000 7f2aaaef0700 1 --2- 172.21.15.27:0/3175208298 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f2a8806ace0 0x7f2a8806d190 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:27.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.069+0000 7f2aaaef0700 1 --2- 172.21.15.27:0/3175208298 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2aa415cf70 0x7f2aa40c3270 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:27.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.069+0000 7f2aaaef0700 1 --2- 172.21.15.27:0/3175208298 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2aa40cd5e0 0x7f2aa41575b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:27.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.069+0000 7f2aaaef0700 1 -- 172.21.15.27:0/3175208298 >> 172.21.15.27:0/3175208298 conn(0x7f2aa406b920 msgr2=0x7f2aa40b14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:27.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.069+0000 7f2aaaef0700 1 -- 172.21.15.27:0/3175208298 shutdown_connections 2023-07-05T23:33:27.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.069+0000 7f2aaaef0700 1 -- 172.21.15.27:0/3175208298 wait complete. 2023-07-05T23:33:27.083 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-05T23:33:27.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.209+0000 7fd9e47ba700 1 Processor -- start 2023-07-05T23:33:27.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.209+0000 7fd9e47ba700 1 -- start start 2023-07-05T23:33:27.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.210+0000 7fd9e47ba700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd9dc0d0a60 0x7fd9dc0b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:27.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.210+0000 7fd9e47ba700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd9dc0b51d0 0x7fd9dc0cf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:27.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.210+0000 7fd9e47ba700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9dc0cd9d0 con 0x7fd9dc0d0e30 2023-07-05T23:33:27.213 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.210+0000 7fd9e47ba700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9dc0d0060 con 0x7fd9dc0d0a60 2023-07-05T23:33:27.213 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.210+0000 7fd9e47ba700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9dc0cfe50 con 0x7fd9dc0b51d0 2023-07-05T23:33:27.213 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.210+0000 7fd9e2556700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd9dc0d0a60 0x7fd9dc0b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:27.213 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.210+0000 7fd9e2556700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd9dc0d0a60 0x7fd9dc0b5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45766/0 (socket says 172.21.15.27:45766) 2023-07-05T23:33:27.213 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.210+0000 7fd9e2556700 1 -- 172.21.15.27:0/2752001036 learned_addr learned my addr 172.21.15.27:0/2752001036 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:27.213 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.210+0000 7fd9e1d55700 1 --2- 172.21.15.27:0/2752001036 >> v2:172.21.15.162:3300/0 conn(0x7fd9dc0b51d0 0x7fd9dc0cf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:27.213 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.210+0000 7fd9e2556700 1 -- 172.21.15.27:0/2752001036 >> v2:172.21.15.162:3300/0 conn(0x7fd9dc0b51d0 msgr2=0x7fd9dc0cf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:27.214 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.210+0000 7fd9e2556700 1 --2- 172.21.15.27:0/2752001036 >> v2:172.21.15.162:3300/0 conn(0x7fd9dc0b51d0 0x7fd9dc0cf910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:27.214 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.210+0000 7fd9e2556700 1 -- 172.21.15.27:0/2752001036 >> v1:172.21.15.27:6789/0 conn(0x7fd9dc0d0e30 legacy=0x7fd9dc0d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:27.214 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.210+0000 7fd9e2556700 1 -- 172.21.15.27:0/2752001036 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9dc0b5620 con 0x7fd9dc0d0a60 2023-07-05T23:33:27.214 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.210+0000 7fd9e2556700 1 --2- 172.21.15.27:0/2752001036 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9dc0d0a60 0x7fd9dc0b5a70 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc0d07a0 tx=0x7fd9d8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=290af1c576e2a0fd server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:27.214 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.210+0000 7fd9e1554700 1 -- 172.21.15.27:0/2752001036 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d800b870 con 0x7fd9dc0d0a60 2023-07-05T23:33:27.214 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.210+0000 7fd9e1554700 1 -- 172.21.15.27:0/2752001036 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9d800b9d0 con 0x7fd9dc0d0a60 2023-07-05T23:33:27.214 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.210+0000 7fd9e1554700 1 -- 172.21.15.27:0/2752001036 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d800bd60 con 0x7fd9dc0d0a60 2023-07-05T23:33:27.217 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.211+0000 7fd9e47ba700 1 -- 172.21.15.27:0/2752001036 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9dc0d0a60 msgr2=0x7fd9dc0b5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:27.217 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.211+0000 7fd9e47ba700 1 --2- 172.21.15.27:0/2752001036 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9dc0d0a60 0x7fd9dc0b5a70 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc0d07a0 tx=0x7fd9d8009bd0 comp rx=0 tx=0).stop 2023-07-05T23:33:27.217 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.211+0000 7fd9e47ba700 1 -- 172.21.15.27:0/2752001036 shutdown_connections 2023-07-05T23:33:27.217 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.211+0000 7fd9e47ba700 1 --2- 172.21.15.27:0/2752001036 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9dc0d0a60 0x7fd9dc0b5a70 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:27.218 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.211+0000 7fd9e47ba700 1 --2- 172.21.15.27:0/2752001036 >> v2:172.21.15.162:3300/0 conn(0x7fd9dc0b51d0 0x7fd9dc0cf910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:27.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.211+0000 7fd9e47ba700 1 -- 172.21.15.27:0/2752001036 >> 172.21.15.27:0/2752001036 conn(0x7fd9dc071620 msgr2=0x7fd9dc0719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:27.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.211+0000 7fd9e47ba700 1 -- 172.21.15.27:0/2752001036 shutdown_connections 2023-07-05T23:33:27.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.211+0000 7fd9e47ba700 1 -- 172.21.15.27:0/2752001036 wait complete. 2023-07-05T23:33:27.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.213+0000 7fd9e47ba700 1 Processor -- start 2023-07-05T23:33:27.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.213+0000 7fd9e47ba700 1 -- start start 2023-07-05T23:33:27.222 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.214+0000 7fd9e47ba700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9dc0b51d0 0x7fd9dc14e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:27.222 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.214+0000 7fd9e47ba700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9dc0d0a60 0x7fd9dc0b7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:27.223 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.214+0000 7fd9e47ba700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd9dc0d0e30 0x7fd9dc0c73d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:27.223 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.214+0000 7fd9e47ba700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9dc0b8100 con 0x7fd9dc0b51d0 2023-07-05T23:33:27.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.214+0000 7fd9e47ba700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9dc0b83e0 con 0x7fd9dc0d0a60 2023-07-05T23:33:27.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.214+0000 7fd9e47ba700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9dc0b6520 con 0x7fd9dc0d0e30 2023-07-05T23:33:27.226 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.214+0000 7fd9e2556700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9dc0b51d0 0x7fd9dc14e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:27.226 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.214+0000 7fd9e2556700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9dc0b51d0 0x7fd9dc14e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45772/0 (socket says 172.21.15.27:45772) 2023-07-05T23:33:27.226 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.214+0000 7fd9e2556700 1 -- 172.21.15.27:0/855042268 learned_addr learned my addr 172.21.15.27:0/855042268 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:27.226 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.214+0000 7fd9e1d55700 1 --2- 172.21.15.27:0/855042268 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9dc0d0a60 0x7fd9dc0b7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:27.226 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.214+0000 7fd9e2d57700 1 --2- 172.21.15.27:0/855042268 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd9dc0d0e30 0x7fd9dc0c73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:27.226 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.214+0000 7fd9e2556700 1 -- 172.21.15.27:0/855042268 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd9dc0d0e30 msgr2=0x7fd9dc0c73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:27.227 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.214+0000 7fd9e2556700 1 --2- 172.21.15.27:0/855042268 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd9dc0d0e30 0x7fd9dc0c73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:27.227 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.214+0000 7fd9e2556700 1 -- 172.21.15.27:0/855042268 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9dc0d0a60 msgr2=0x7fd9dc0b7000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:27.228 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.214+0000 7fd9e2556700 1 --2- 172.21.15.27:0/855042268 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9dc0d0a60 0x7fd9dc0b7000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:27.228 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.214+0000 7fd9e2556700 1 -- 172.21.15.27:0/855042268 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d8009550 con 0x7fd9dc0b51d0 2023-07-05T23:33:27.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.214+0000 7fd9e1d55700 1 --2- 172.21.15.27:0/855042268 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9dc0d0a60 0x7fd9dc0b7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T23:33:27.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.214+0000 7fd9e2d57700 1 --2- 172.21.15.27:0/855042268 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd9dc0d0e30 0x7fd9dc0c73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T23:33:27.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.214+0000 7fd9e2556700 1 --2- 172.21.15.27:0/855042268 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9dc0b51d0 0x7fd9dc14e170 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd9d8000c00 tx=0x7fd9d8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:27.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.214+0000 7fd9d2ffd700 1 -- 172.21.15.27:0/855042268 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d8004540 con 0x7fd9dc0b51d0 2023-07-05T23:33:27.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.214+0000 7fd9d2ffd700 1 -- 172.21.15.27:0/855042268 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9d80036a0 con 0x7fd9dc0b51d0 2023-07-05T23:33:27.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.214+0000 7fd9e47ba700 1 -- 172.21.15.27:0/855042268 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9dc0b6800 con 0x7fd9dc0b51d0 2023-07-05T23:33:27.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.214+0000 7fd9d2ffd700 1 -- 172.21.15.27:0/855042268 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d8003a30 con 0x7fd9dc0b51d0 2023-07-05T23:33:27.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.214+0000 7fd9e47ba700 1 -- 172.21.15.27:0/855042268 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9dc0b7dd0 con 0x7fd9dc0b51d0 2023-07-05T23:33:27.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.215+0000 7fd9e47ba700 1 -- 172.21.15.27:0/855042268 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9dc1e6d40 con 0x7fd9dc0b51d0 2023-07-05T23:33:27.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.216+0000 7fd9d2ffd700 1 -- 172.21.15.27:0/855042268 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd9d8021070 con 0x7fd9dc0b51d0 2023-07-05T23:33:27.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.216+0000 7fd9d2ffd700 1 --2- 172.21.15.27:0/855042268 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fd9c006ad10 0x7fd9c006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:27.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.216+0000 7fd9d2ffd700 1 -- 172.21.15.27:0/855042268 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd9d808ab60 con 0x7fd9dc0b51d0 2023-07-05T23:33:27.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.216+0000 7fd9e1d55700 1 --2- 172.21.15.27:0/855042268 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fd9c006ad10 0x7fd9c006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:27.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.217+0000 7fd9e1d55700 1 --2- 172.21.15.27:0/855042268 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fd9c006ad10 0x7fd9c006d1c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc0b8b70 tx=0x7fd9cc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:27.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.220+0000 7fd9d2ffd700 1 -- 172.21.15.27:0/855042268 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd9d8055920 con 0x7fd9dc0b51d0 2023-07-05T23:33:27.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.416+0000 7fd9e47ba700 1 -- 172.21.15.27:0/855042268 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd9dc04ea20 con 0x7fd9dc0b51d0 2023-07-05T23:33:27.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.417+0000 7fd9d2ffd700 1 -- 172.21.15.27:0/855042268 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd9d8058f40 con 0x7fd9dc0b51d0 2023-07-05T23:33:27.422 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 8 2023-07-05T23:33:27.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.419+0000 7fd9e47ba700 1 -- 172.21.15.27:0/855042268 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fd9c006ad10 msgr2=0x7fd9c006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:27.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.419+0000 7fd9e47ba700 1 --2- 172.21.15.27:0/855042268 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fd9c006ad10 0x7fd9c006d1c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc0b8b70 tx=0x7fd9cc008040 comp rx=0 tx=0).stop 2023-07-05T23:33:27.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.419+0000 7fd9e47ba700 1 -- 172.21.15.27:0/855042268 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9dc0b51d0 msgr2=0x7fd9dc14e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:27.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.419+0000 7fd9e47ba700 1 --2- 172.21.15.27:0/855042268 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9dc0b51d0 0x7fd9dc14e170 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd9d8000c00 tx=0x7fd9d8004750 comp rx=0 tx=0).stop 2023-07-05T23:33:27.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.419+0000 7fd9e47ba700 1 -- 172.21.15.27:0/855042268 shutdown_connections 2023-07-05T23:33:27.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.419+0000 7fd9e47ba700 1 --2- 172.21.15.27:0/855042268 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fd9c006ad10 0x7fd9c006d1c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:27.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.419+0000 7fd9e47ba700 1 --2- 172.21.15.27:0/855042268 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd9dc0d0e30 0x7fd9dc0c73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:27.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.419+0000 7fd9e47ba700 1 --2- 172.21.15.27:0/855042268 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9dc0b51d0 0x7fd9dc14e170 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:27.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.419+0000 7fd9e47ba700 1 --2- 172.21.15.27:0/855042268 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9dc0d0a60 0x7fd9dc0b7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:27.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.419+0000 7fd9e47ba700 1 -- 172.21.15.27:0/855042268 >> 172.21.15.27:0/855042268 conn(0x7fd9dc071620 msgr2=0x7fd9dc0ca780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:27.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.419+0000 7fd9e47ba700 1 -- 172.21.15.27:0/855042268 shutdown_connections 2023-07-05T23:33:27.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.419+0000 7fd9e47ba700 1 -- 172.21.15.27:0/855042268 wait complete. 2023-07-05T23:33:27.433 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-05T23:33:27.562 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.560+0000 7ff4d7cbb700 1 Processor -- start 2023-07-05T23:33:27.563 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.560+0000 7ff4d7cbb700 1 -- start start 2023-07-05T23:33:27.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.561+0000 7ff4d7cbb700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff4d015fc60 0x7ff4d006a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:27.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.561+0000 7ff4d7cbb700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff4d00aecc0 0x7ff4d00ac600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:27.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.561+0000 7ff4d7cbb700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4d00ce620 con 0x7ff4d006e260 2023-07-05T23:33:27.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.561+0000 7ff4d7cbb700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4d0160580 con 0x7ff4d015fc60 2023-07-05T23:33:27.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.561+0000 7ff4d7cbb700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4d0160860 con 0x7ff4d00aecc0 2023-07-05T23:33:27.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.561+0000 7ff4d5a57700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff4d015fc60 0x7ff4d006a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:27.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.561+0000 7ff4d5a57700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff4d015fc60 0x7ff4d006a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45780/0 (socket says 172.21.15.27:45780) 2023-07-05T23:33:27.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.561+0000 7ff4d5a57700 1 -- 172.21.15.27:0/563392104 learned_addr learned my addr 172.21.15.27:0/563392104 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:27.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.562+0000 7ff4d5256700 1 --2- 172.21.15.27:0/563392104 >> v2:172.21.15.162:3300/0 conn(0x7ff4d00aecc0 0x7ff4d00ac600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:27.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.562+0000 7ff4d5a57700 1 -- 172.21.15.27:0/563392104 >> v2:172.21.15.162:3300/0 conn(0x7ff4d00aecc0 msgr2=0x7ff4d00ac600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:27.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.562+0000 7ff4d5a57700 1 --2- 172.21.15.27:0/563392104 >> v2:172.21.15.162:3300/0 conn(0x7ff4d00aecc0 0x7ff4d00ac600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:27.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.562+0000 7ff4d5a57700 1 -- 172.21.15.27:0/563392104 >> v1:172.21.15.162:6789/0 conn(0x7ff4d006e260 legacy=0x7ff4d006e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:27.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.562+0000 7ff4d5a57700 1 -- 172.21.15.27:0/563392104 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4d0160b40 con 0x7ff4d015fc60 2023-07-05T23:33:27.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.562+0000 7ff4d5256700 1 --2- 172.21.15.27:0/563392104 >> v2:172.21.15.162:3300/0 conn(0x7ff4d00aecc0 0x7ff4d00ac600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T23:33:27.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.562+0000 7ff4d5a57700 1 --2- 172.21.15.27:0/563392104 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4d015fc60 0x7ff4d006a900 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff4d0071b40 tx=0x7ff4c0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea8d6f3aacd0d923 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:27.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.562+0000 7ff4d4a55700 1 -- 172.21.15.27:0/563392104 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c0005e30 con 0x7ff4d015fc60 2023-07-05T23:33:27.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.562+0000 7ff4d4a55700 1 -- 172.21.15.27:0/563392104 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4c0004030 con 0x7ff4d015fc60 2023-07-05T23:33:27.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.562+0000 7ff4d4a55700 1 -- 172.21.15.27:0/563392104 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c00043e0 con 0x7ff4d015fc60 2023-07-05T23:33:27.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.563+0000 7ff4d7cbb700 1 -- 172.21.15.27:0/563392104 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4d015fc60 msgr2=0x7ff4d006a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:27.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.563+0000 7ff4d7cbb700 1 --2- 172.21.15.27:0/563392104 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4d015fc60 0x7ff4d006a900 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff4d0071b40 tx=0x7ff4c0009bd0 comp rx=0 tx=0).stop 2023-07-05T23:33:27.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.563+0000 7ff4d7cbb700 1 -- 172.21.15.27:0/563392104 shutdown_connections 2023-07-05T23:33:27.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.563+0000 7ff4d7cbb700 1 --2- 172.21.15.27:0/563392104 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4d015fc60 0x7ff4d006a900 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:27.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.563+0000 7ff4d7cbb700 1 --2- 172.21.15.27:0/563392104 >> v2:172.21.15.162:3300/0 conn(0x7ff4d00aecc0 0x7ff4d00ac600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:27.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.563+0000 7ff4d7cbb700 1 -- 172.21.15.27:0/563392104 >> 172.21.15.27:0/563392104 conn(0x7ff4d006b920 msgr2=0x7ff4d00cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:27.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.563+0000 7ff4d7cbb700 1 -- 172.21.15.27:0/563392104 shutdown_connections 2023-07-05T23:33:27.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.563+0000 7ff4d7cbb700 1 -- 172.21.15.27:0/563392104 wait complete. 2023-07-05T23:33:27.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.564+0000 7ff4d7cbb700 1 Processor -- start 2023-07-05T23:33:27.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.564+0000 7ff4d7cbb700 1 -- start start 2023-07-05T23:33:27.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.565+0000 7ff4d7cbb700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff4d006e260 0x7ff4d0157e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:27.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.565+0000 7ff4d7cbb700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4d00aecc0 0x7ff4d00b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:27.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.565+0000 7ff4d7cbb700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4d015fc60 0x7ff4d0146d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:27.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.565+0000 7ff4d7cbb700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d00b3e40 con 0x7ff4d015fc60 2023-07-05T23:33:27.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.565+0000 7ff4d7cbb700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d00b56f0 con 0x7ff4d00aecc0 2023-07-05T23:33:27.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.565+0000 7ff4d7cbb700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d00b3250 con 0x7ff4d006e260 2023-07-05T23:33:27.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.565+0000 7ff4d6258700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4d015fc60 0x7ff4d0146d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:27.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.565+0000 7ff4d6258700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4d015fc60 0x7ff4d0146d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45788/0 (socket says 172.21.15.27:45788) 2023-07-05T23:33:27.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.565+0000 7ff4d6258700 1 -- 172.21.15.27:0/2143707736 learned_addr learned my addr 172.21.15.27:0/2143707736 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:27.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.565+0000 7ff4d5a57700 1 --2- 172.21.15.27:0/2143707736 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff4d006e260 0x7ff4d0157e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:27.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.565+0000 7ff4d5256700 1 --2- 172.21.15.27:0/2143707736 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4d00aecc0 0x7ff4d00b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:27.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.565+0000 7ff4d6258700 1 -- 172.21.15.27:0/2143707736 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff4d006e260 msgr2=0x7ff4d0157e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:27.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.565+0000 7ff4d6258700 1 --2- 172.21.15.27:0/2143707736 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff4d006e260 0x7ff4d0157e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:27.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.565+0000 7ff4d6258700 1 -- 172.21.15.27:0/2143707736 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4d00aecc0 msgr2=0x7ff4d00b51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:27.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.565+0000 7ff4d6258700 1 --2- 172.21.15.27:0/2143707736 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4d00aecc0 0x7ff4d00b51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:27.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.565+0000 7ff4d6258700 1 -- 172.21.15.27:0/2143707736 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c0009500 con 0x7ff4d015fc60 2023-07-05T23:33:27.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.565+0000 7ff4d6258700 1 --2- 172.21.15.27:0/2143707736 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4d015fc60 0x7ff4d0146d90 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff4c800cc50 tx=0x7ff4c800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:27.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.565+0000 7ff4c67fc700 1 -- 172.21.15.27:0/2143707736 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c8003c00 con 0x7ff4d015fc60 2023-07-05T23:33:27.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.565+0000 7ff4c67fc700 1 -- 172.21.15.27:0/2143707736 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4c8003d60 con 0x7ff4d015fc60 2023-07-05T23:33:27.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.565+0000 7ff4d7cbb700 1 -- 172.21.15.27:0/2143707736 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4d01472d0 con 0x7ff4d015fc60 2023-07-05T23:33:27.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.565+0000 7ff4c67fc700 1 -- 172.21.15.27:0/2143707736 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c800aab0 con 0x7ff4d015fc60 2023-07-05T23:33:27.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.566+0000 7ff4d7cbb700 1 -- 172.21.15.27:0/2143707736 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4d00b3780 con 0x7ff4d015fc60 2023-07-05T23:33:27.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.566+0000 7ff4d7cbb700 1 -- 172.21.15.27:0/2143707736 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4d004ea20 con 0x7ff4d015fc60 2023-07-05T23:33:27.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.567+0000 7ff4c67fc700 1 -- 172.21.15.27:0/2143707736 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff4c800ac10 con 0x7ff4d015fc60 2023-07-05T23:33:27.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.567+0000 7ff4c67fc700 1 --2- 172.21.15.27:0/2143707736 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7ff4b406ace0 0x7ff4b406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:27.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.567+0000 7ff4c67fc700 1 -- 172.21.15.27:0/2143707736 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff4c80896c0 con 0x7ff4d015fc60 2023-07-05T23:33:27.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.567+0000 7ff4d5a57700 1 --2- 172.21.15.27:0/2143707736 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7ff4b406ace0 0x7ff4b406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:27.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.568+0000 7ff4d5a57700 1 --2- 172.21.15.27:0/2143707736 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7ff4b406ace0 0x7ff4b406d190 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff4d0071b40 tx=0x7ff4c0008070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:27.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.572+0000 7ff4c67fc700 1 -- 172.21.15.27:0/2143707736 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff4c8054470 con 0x7ff4d015fc60 2023-07-05T23:33:27.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.767+0000 7ff4d7cbb700 1 -- 172.21.15.27:0/2143707736 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff4d00b5990 con 0x7ff4d015fc60 2023-07-05T23:33:27.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.767+0000 7ff4c67fc700 1 -- 172.21.15.27:0/2143707736 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff4c8057a90 con 0x7ff4d015fc60 2023-07-05T23:33:27.770 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 32 2023-07-05T23:33:27.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.770+0000 7ff4d7cbb700 1 -- 172.21.15.27:0/2143707736 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7ff4b406ace0 msgr2=0x7ff4b406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:27.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.770+0000 7ff4d7cbb700 1 --2- 172.21.15.27:0/2143707736 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7ff4b406ace0 0x7ff4b406d190 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff4d0071b40 tx=0x7ff4c0008070 comp rx=0 tx=0).stop 2023-07-05T23:33:27.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.770+0000 7ff4d7cbb700 1 -- 172.21.15.27:0/2143707736 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4d015fc60 msgr2=0x7ff4d0146d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:27.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.770+0000 7ff4d7cbb700 1 --2- 172.21.15.27:0/2143707736 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4d015fc60 0x7ff4d0146d90 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff4c800cc50 tx=0x7ff4c800cf60 comp rx=0 tx=0).stop 2023-07-05T23:33:27.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.770+0000 7ff4d7cbb700 1 -- 172.21.15.27:0/2143707736 shutdown_connections 2023-07-05T23:33:27.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.770+0000 7ff4d7cbb700 1 --2- 172.21.15.27:0/2143707736 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7ff4b406ace0 0x7ff4b406d190 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:27.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.770+0000 7ff4d7cbb700 1 --2- 172.21.15.27:0/2143707736 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4d015fc60 0x7ff4d0146d90 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:27.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.770+0000 7ff4d7cbb700 1 --2- 172.21.15.27:0/2143707736 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff4d006e260 0x7ff4d0157e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:27.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.770+0000 7ff4d7cbb700 1 --2- 172.21.15.27:0/2143707736 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4d00aecc0 0x7ff4d00b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:27.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.770+0000 7ff4d7cbb700 1 -- 172.21.15.27:0/2143707736 >> 172.21.15.27:0/2143707736 conn(0x7ff4d006b920 msgr2=0x7ff4d00cf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:27.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.770+0000 7ff4d7cbb700 1 -- 172.21.15.27:0/2143707736 shutdown_connections 2023-07-05T23:33:27.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.770+0000 7ff4d7cbb700 1 -- 172.21.15.27:0/2143707736 wait complete. 2023-07-05T23:33:27.784 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-05T23:33:27.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.910+0000 7f2ae81f9700 1 Processor -- start 2023-07-05T23:33:27.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.910+0000 7f2ae81f9700 1 -- start start 2023-07-05T23:33:27.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.911+0000 7f2ae81f9700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2ae006e030 0x7f2ae006e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:27.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.911+0000 7f2ae81f9700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2ae00acf30 0x7f2ae00ad350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:27.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.911+0000 7f2ae81f9700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ae006f0e0 con 0x7f2ae00cd5e0 2023-07-05T23:33:27.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.911+0000 7f2ae81f9700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ae00ce2c0 con 0x7f2ae006e030 2023-07-05T23:33:27.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.911+0000 7f2ae81f9700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ae006eb20 con 0x7f2ae00acf30 2023-07-05T23:33:27.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.911+0000 7f2ae5794700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2ae006e030 0x7f2ae006e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:27.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.911+0000 7f2ae5794700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2ae006e030 0x7f2ae006e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45794/0 (socket says 172.21.15.27:45794) 2023-07-05T23:33:27.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.911+0000 7f2ae5794700 1 -- 172.21.15.27:0/2153080120 learned_addr learned my addr 172.21.15.27:0/2153080120 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:27.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.911+0000 7f2ae6796700 1 --2- 172.21.15.27:0/2153080120 >> v2:172.21.15.162:3300/0 conn(0x7f2ae00acf30 0x7f2ae00ad350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:27.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.911+0000 7f2ae5794700 1 -- 172.21.15.27:0/2153080120 >> v2:172.21.15.162:3300/0 conn(0x7f2ae00acf30 msgr2=0x7f2ae00ad350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:27.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.911+0000 7f2ae5794700 1 --2- 172.21.15.27:0/2153080120 >> v2:172.21.15.162:3300/0 conn(0x7f2ae00acf30 0x7f2ae00ad350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:27.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.911+0000 7f2ae5794700 1 -- 172.21.15.27:0/2153080120 >> v1:172.21.15.27:6789/0 conn(0x7f2ae00cd5e0 legacy=0x7f2ae00cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:27.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.911+0000 7f2ae5794700 1 -- 172.21.15.27:0/2153080120 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae006ee00 con 0x7f2ae006e030 2023-07-05T23:33:27.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.912+0000 7f2ae5794700 1 --2- 172.21.15.27:0/2153080120 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ae006e030 0x7f2ae006e4d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2ae00b1490 tx=0x7f2adc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24e30e4bd9f36d75 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:27.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.912+0000 7f2ae4f93700 1 -- 172.21.15.27:0/2153080120 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2adc00b870 con 0x7f2ae006e030 2023-07-05T23:33:27.916 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.912+0000 7f2ae4f93700 1 -- 172.21.15.27:0/2153080120 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2adc00b9d0 con 0x7f2ae006e030 2023-07-05T23:33:27.916 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.912+0000 7f2ae4f93700 1 -- 172.21.15.27:0/2153080120 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2adc00bd60 con 0x7f2ae006e030 2023-07-05T23:33:27.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.912+0000 7f2ae81f9700 1 -- 172.21.15.27:0/2153080120 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ae006e030 msgr2=0x7f2ae006e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:27.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.912+0000 7f2ae81f9700 1 --2- 172.21.15.27:0/2153080120 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ae006e030 0x7f2ae006e4d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2ae00b1490 tx=0x7f2adc009bd0 comp rx=0 tx=0).stop 2023-07-05T23:33:27.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.912+0000 7f2ae81f9700 1 -- 172.21.15.27:0/2153080120 shutdown_connections 2023-07-05T23:33:27.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.912+0000 7f2ae81f9700 1 --2- 172.21.15.27:0/2153080120 >> v2:172.21.15.162:3300/0 conn(0x7f2ae00acf30 0x7f2ae00ad350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:27.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.912+0000 7f2ae81f9700 1 --2- 172.21.15.27:0/2153080120 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ae006e030 0x7f2ae006e4d0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:27.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.912+0000 7f2ae81f9700 1 -- 172.21.15.27:0/2153080120 >> 172.21.15.27:0/2153080120 conn(0x7f2ae006b920 msgr2=0x7f2ae00cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:27.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.912+0000 7f2ae81f9700 1 -- 172.21.15.27:0/2153080120 shutdown_connections 2023-07-05T23:33:27.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.912+0000 7f2ae81f9700 1 -- 172.21.15.27:0/2153080120 wait complete. 2023-07-05T23:33:27.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.914+0000 7f2ae81f9700 1 Processor -- start 2023-07-05T23:33:27.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.914+0000 7f2ae81f9700 1 -- start start 2023-07-05T23:33:27.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.914+0000 7f2ae81f9700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ae006e030 0x7f2ae01f34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:27.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.914+0000 7f2ae81f9700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ae00acf30 0x7f2ae014c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:27.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.914+0000 7f2ae81f9700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ae00cd5e0 0x7f2ae0069ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:27.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.914+0000 7f2ae81f9700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae01f3a20 con 0x7f2ae006e030 2023-07-05T23:33:27.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.914+0000 7f2ae81f9700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae014cd60 con 0x7f2ae00cd5e0 2023-07-05T23:33:27.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.914+0000 7f2ae81f9700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae0151b00 con 0x7f2ae00acf30 2023-07-05T23:33:27.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.914+0000 7f2ae5f95700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ae006e030 0x7f2ae01f34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:27.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.914+0000 7f2ae5f95700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ae006e030 0x7f2ae01f34e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45800/0 (socket says 172.21.15.27:45800) 2023-07-05T23:33:27.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.914+0000 7f2ae5f95700 1 -- 172.21.15.27:0/3162518136 learned_addr learned my addr 172.21.15.27:0/3162518136 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:27.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.915+0000 7f2ae5794700 1 --2- 172.21.15.27:0/3162518136 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ae00acf30 0x7f2ae014c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:27.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.915+0000 7f2ae6796700 1 --2- 172.21.15.27:0/3162518136 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ae00cd5e0 0x7f2ae0069ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:27.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.915+0000 7f2ae5f95700 1 -- 172.21.15.27:0/3162518136 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ae00acf30 msgr2=0x7f2ae014c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:27.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.915+0000 7f2ae5f95700 1 --2- 172.21.15.27:0/3162518136 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ae00acf30 0x7f2ae014c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:27.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.915+0000 7f2ae5f95700 1 -- 172.21.15.27:0/3162518136 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ae00cd5e0 msgr2=0x7f2ae0069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:27.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.915+0000 7f2ae5f95700 1 --2- 172.21.15.27:0/3162518136 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ae00cd5e0 0x7f2ae0069ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:27.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.915+0000 7f2ae5f95700 1 -- 172.21.15.27:0/3162518136 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2adc009550 con 0x7f2ae006e030 2023-07-05T23:33:27.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.915+0000 7f2ae5f95700 1 --2- 172.21.15.27:0/3162518136 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ae006e030 0x7f2ae01f34e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2ad000c460 tx=0x7f2ad000c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:27.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.915+0000 7f2ad67fc700 1 -- 172.21.15.27:0/3162518136 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad00054e0 con 0x7f2ae006e030 2023-07-05T23:33:27.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.915+0000 7f2ad67fc700 1 -- 172.21.15.27:0/3162518136 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad0003680 con 0x7f2ae006e030 2023-07-05T23:33:27.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.915+0000 7f2ae81f9700 1 -- 172.21.15.27:0/3162518136 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ae014f130 con 0x7f2ae006e030 2023-07-05T23:33:27.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.915+0000 7f2ad67fc700 1 -- 172.21.15.27:0/3162518136 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad0003a30 con 0x7f2ae006e030 2023-07-05T23:33:27.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.915+0000 7f2ae81f9700 1 -- 172.21.15.27:0/3162518136 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ae014f6f0 con 0x7f2ae006e030 2023-07-05T23:33:27.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.916+0000 7f2ae81f9700 1 -- 172.21.15.27:0/3162518136 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ae004ea20 con 0x7f2ae006e030 2023-07-05T23:33:27.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.917+0000 7f2ad67fc700 1 -- 172.21.15.27:0/3162518136 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2ad0003b90 con 0x7f2ae006e030 2023-07-05T23:33:27.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.917+0000 7f2ad67fc700 1 --2- 172.21.15.27:0/3162518136 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f2ac406ace0 0x7f2ac406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:27.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.917+0000 7f2ad67fc700 1 -- 172.21.15.27:0/3162518136 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2ad0088b40 con 0x7f2ae006e030 2023-07-05T23:33:27.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.917+0000 7f2ae5794700 1 --2- 172.21.15.27:0/3162518136 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f2ac406ace0 0x7f2ac406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:27.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.918+0000 7f2ae5794700 1 --2- 172.21.15.27:0/3162518136 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f2ac406ace0 0x7f2ac406d190 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2adc000c00 tx=0x7f2adc008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:27.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:27.922+0000 7f2ad67fc700 1 -- 172.21.15.27:0/3162518136 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2ad0053990 con 0x7f2ae006e030 2023-07-05T23:33:28.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.118+0000 7f2ae81f9700 1 -- 172.21.15.27:0/3162518136 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2ae00b5990 con 0x7f2ae006e030 2023-07-05T23:33:28.121 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.119+0000 7f2ad67fc700 1 -- 172.21.15.27:0/3162518136 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2ad00170a0 con 0x7f2ae006e030 2023-07-05T23:33:28.121 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2023-07-05T23:33:28.123 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.121+0000 7f2ae81f9700 1 -- 172.21.15.27:0/3162518136 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f2ac406ace0 msgr2=0x7f2ac406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:28.123 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.121+0000 7f2ae81f9700 1 --2- 172.21.15.27:0/3162518136 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f2ac406ace0 0x7f2ac406d190 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2adc000c00 tx=0x7f2adc008030 comp rx=0 tx=0).stop 2023-07-05T23:33:28.123 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.121+0000 7f2ae81f9700 1 -- 172.21.15.27:0/3162518136 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ae006e030 msgr2=0x7f2ae01f34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:28.123 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.121+0000 7f2ae81f9700 1 --2- 172.21.15.27:0/3162518136 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ae006e030 0x7f2ae01f34e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2ad000c460 tx=0x7f2ad000c820 comp rx=0 tx=0).stop 2023-07-05T23:33:28.123 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.121+0000 7f2ae81f9700 1 -- 172.21.15.27:0/3162518136 shutdown_connections 2023-07-05T23:33:28.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.121+0000 7f2ae81f9700 1 --2- 172.21.15.27:0/3162518136 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ae00cd5e0 0x7f2ae0069ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:28.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.121+0000 7f2ae81f9700 1 --2- 172.21.15.27:0/3162518136 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f2ac406ace0 0x7f2ac406d190 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:28.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.121+0000 7f2ae81f9700 1 --2- 172.21.15.27:0/3162518136 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ae006e030 0x7f2ae01f34e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:28.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.121+0000 7f2ae81f9700 1 --2- 172.21.15.27:0/3162518136 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ae00acf30 0x7f2ae014c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:28.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.121+0000 7f2ae81f9700 1 -- 172.21.15.27:0/3162518136 >> 172.21.15.27:0/3162518136 conn(0x7f2ae006b920 msgr2=0x7f2ae00b0080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:28.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.121+0000 7f2ae81f9700 1 -- 172.21.15.27:0/3162518136 shutdown_connections 2023-07-05T23:33:28.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.121+0000 7f2ae81f9700 1 -- 172.21.15.27:0/3162518136 wait complete. 2023-07-05T23:33:28.135 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-05T23:33:28.263 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.261+0000 7f30a9ca8700 1 Processor -- start 2023-07-05T23:33:28.263 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.261+0000 7f30a9ca8700 1 -- start start 2023-07-05T23:33:28.266 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.262+0000 7f30a9ca8700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f30a406d7b0 0x7f30a4160800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:28.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.262+0000 7f30a9ca8700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30a40cce30 con 0x7f30a4069ef0 2023-07-05T23:33:28.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.262+0000 7f30a9ca8700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30a4160370 con 0x7f30a4160d40 2023-07-05T23:33:28.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.262+0000 7f30a9ca8700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30a40cd360 con 0x7f30a406d7b0 2023-07-05T23:33:28.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.262+0000 7f30a37fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f30a4069ef0 0x7f30a406a2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:52974/0 (socket says 172.21.15.27:52974) 2023-07-05T23:33:28.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.262+0000 7f30a37fe700 1 -- 172.21.15.27:0/688698802 learned_addr learned my addr 172.21.15.27:0/688698802 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-07-05T23:33:28.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.262+0000 7f30a2ffd700 1 --2- 172.21.15.27:0/688698802 >> v2:172.21.15.162:3300/0 conn(0x7f30a406d7b0 0x7f30a4160800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:28.268 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.262+0000 7f30a27fc700 1 -- 172.21.15.27:0/688698802 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3397501699 0 0) 0x7f30a40cce30 con 0x7f30a4069ef0 2023-07-05T23:33:28.268 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.262+0000 7f30a27fc700 1 -- 172.21.15.27:0/688698802 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30900035b0 con 0x7f30a4069ef0 2023-07-05T23:33:28.268 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.262+0000 7f30a27fc700 1 -- 172.21.15.27:0/688698802 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3554886813 0 0) 0x7f30900035b0 con 0x7f30a4069ef0 2023-07-05T23:33:28.268 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.262+0000 7f30a27fc700 1 -- 172.21.15.27:0/688698802 >> v2:172.21.15.162:3300/0 conn(0x7f30a406d7b0 msgr2=0x7f30a4160800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:28.268 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.262+0000 7f30a27fc700 1 --2- 172.21.15.27:0/688698802 >> v2:172.21.15.162:3300/0 conn(0x7f30a406d7b0 0x7f30a4160800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:28.268 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.263+0000 7f30a27fc700 1 -- 172.21.15.27:0/688698802 >> v1:172.21.15.162:6789/0 conn(0x7f30a4160d40 legacy=0x7f30a40ce3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:28.269 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.263+0000 7f30a27fc700 1 -- 172.21.15.27:0/688698802 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30a415ca50 con 0x7f30a4069ef0 2023-07-05T23:33:28.269 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.263+0000 7f30a27fc700 1 -- 172.21.15.27:0/688698802 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1246168953 0 0) 0x7f308c0017f0 con 0x7f30a4069ef0 2023-07-05T23:33:28.269 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.263+0000 7f30a27fc700 1 -- 172.21.15.27:0/688698802 >> v1:172.21.15.27:6789/0 conn(0x7f30a4069ef0 legacy=0x7f30a406a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:28.269 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.263+0000 7f30a27fc700 1 --2- 172.21.15.27:0/688698802 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3090003a00 0x7f3090003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:28.269 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.263+0000 7f30a27fc700 1 --2- 172.21.15.27:0/688698802 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3090004850 0x7f3090004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:28.269 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.263+0000 7f30a27fc700 1 --2- 172.21.15.27:0/688698802 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3090005200 0x7f309000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:28.270 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.263+0000 7f30a27fc700 1 -- 172.21.15.27:0/688698802 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a40cd360 con 0x7f3090003a00 2023-07-05T23:33:28.270 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.263+0000 7f30a27fc700 1 -- 172.21.15.27:0/688698802 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f309000c110 con 0x7f3090004850 2023-07-05T23:33:28.270 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.263+0000 7f30a27fc700 1 -- 172.21.15.27:0/688698802 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f309000c2d0 con 0x7f3090005200 2023-07-05T23:33:28.270 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.263+0000 7f30a37fe700 1 --2- 172.21.15.27:0/688698802 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3090003a00 0x7f3090003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:28.270 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.263+0000 7f30a2ffd700 1 --2- 172.21.15.27:0/688698802 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3090004850 0x7f3090004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:28.270 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.263+0000 7f30a3fff700 1 --2- 172.21.15.27:0/688698802 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3090005200 0x7f309000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:28.271 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.263+0000 7f30a37fe700 1 -- 172.21.15.27:0/688698802 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3090005200 msgr2=0x7f309000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:28.271 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.263+0000 7f30a37fe700 1 --2- 172.21.15.27:0/688698802 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3090005200 0x7f309000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:28.271 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.263+0000 7f30a37fe700 1 -- 172.21.15.27:0/688698802 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3090004850 msgr2=0x7f3090004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:28.271 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.263+0000 7f30a37fe700 1 --2- 172.21.15.27:0/688698802 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3090004850 0x7f3090004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:28.271 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.263+0000 7f30a37fe700 1 -- 172.21.15.27:0/688698802 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30900035b0 con 0x7f3090003a00 2023-07-05T23:33:28.272 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.263+0000 7f30a3fff700 1 -- 172.21.15.27:0/688698802 reap_dead start 2023-07-05T23:33:28.272 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.263+0000 7f30a37fe700 1 --2- 172.21.15.27:0/688698802 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3090003a00 0x7f3090003e10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f308c00c240 tx=0x7f3090005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6715cb93f3a8274 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:28.272 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.263+0000 7f30a27fc700 1 -- 172.21.15.27:0/688698802 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f308c00cde0 con 0x7f3090003a00 2023-07-05T23:33:28.272 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.263+0000 7f30a27fc700 1 -- 172.21.15.27:0/688698802 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f308c007b80 con 0x7f3090003a00 2023-07-05T23:33:28.272 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.263+0000 7f30a27fc700 1 -- 172.21.15.27:0/688698802 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f308c0072f0 con 0x7f3090003a00 2023-07-05T23:33:28.272 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.264+0000 7f30a9ca8700 1 -- 172.21.15.27:0/688698802 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3090003a00 msgr2=0x7f3090003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:28.273 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.264+0000 7f30a9ca8700 1 --2- 172.21.15.27:0/688698802 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3090003a00 0x7f3090003e10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f308c00c240 tx=0x7f3090005880 comp rx=0 tx=0).stop 2023-07-05T23:33:28.273 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.264+0000 7f30a9ca8700 1 -- 172.21.15.27:0/688698802 shutdown_connections 2023-07-05T23:33:28.273 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.264+0000 7f30a9ca8700 1 --2- 172.21.15.27:0/688698802 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3090003a00 0x7f3090003e10 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:28.273 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.264+0000 7f30a9ca8700 1 -- 172.21.15.27:0/688698802 >> 172.21.15.27:0/688698802 conn(0x7f30a406b920 msgr2=0x7f30a40cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:28.273 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.264+0000 7f30a9ca8700 1 -- 172.21.15.27:0/688698802 shutdown_connections 2023-07-05T23:33:28.273 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.264+0000 7f30a9ca8700 1 -- 172.21.15.27:0/688698802 wait complete. 2023-07-05T23:33:28.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.265+0000 7f30a9ca8700 1 Processor -- start 2023-07-05T23:33:28.276 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.265+0000 7f30a9ca8700 1 -- start start 2023-07-05T23:33:28.276 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.266+0000 7f30a9ca8700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3090003a00 0x7f30a40c7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:28.276 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.266+0000 7f30a9ca8700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30a40c91b0 0x7f30a40b2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:28.276 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.266+0000 7f30a9ca8700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30a40b2d80 0x7f30a4144960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:28.276 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.266+0000 7f30a9ca8700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a40b3220 con 0x7f3090003a00 2023-07-05T23:33:28.276 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.266+0000 7f30a9ca8700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a40c8110 con 0x7f30a40c91b0 2023-07-05T23:33:28.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.266+0000 7f30a9ca8700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30a40c83f0 con 0x7f30a40b2d80 2023-07-05T23:33:28.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.266+0000 7f30a37fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3090003a00 0x7f30a40c7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:28.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.266+0000 7f30a37fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3090003a00 0x7f30a40c7b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45820/0 (socket says 172.21.15.27:45820) 2023-07-05T23:33:28.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.266+0000 7f30a37fe700 1 -- 172.21.15.27:0/864398216 learned_addr learned my addr 172.21.15.27:0/864398216 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:28.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.266+0000 7f30a2ffd700 1 --2- 172.21.15.27:0/864398216 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30a40c91b0 0x7f30a40b2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:28.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.266+0000 7f30a3fff700 1 --2- 172.21.15.27:0/864398216 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30a40b2d80 0x7f30a4144960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:28.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.267+0000 7f30a37fe700 1 -- 172.21.15.27:0/864398216 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30a40b2d80 msgr2=0x7f30a4144960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:28.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.267+0000 7f30a37fe700 1 --2- 172.21.15.27:0/864398216 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30a40b2d80 0x7f30a4144960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:28.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.267+0000 7f30a37fe700 1 -- 172.21.15.27:0/864398216 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30a40c91b0 msgr2=0x7f30a40b2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:28.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.267+0000 7f30a37fe700 1 --2- 172.21.15.27:0/864398216 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30a40c91b0 0x7f30a40b2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:28.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.267+0000 7f30a37fe700 1 -- 172.21.15.27:0/864398216 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30a40c86d0 con 0x7f3090003a00 2023-07-05T23:33:28.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.267+0000 7f30a2ffd700 1 --2- 172.21.15.27:0/864398216 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30a40c91b0 0x7f30a40b2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T23:33:28.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.267+0000 7f30a37fe700 1 --2- 172.21.15.27:0/864398216 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3090003a00 0x7f30a40c7b30 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f308c015040 tx=0x7f308c001b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:28.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.267+0000 7f309bfff700 1 -- 172.21.15.27:0/864398216 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f308c000f70 con 0x7f3090003a00 2023-07-05T23:33:28.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.267+0000 7f309bfff700 1 -- 172.21.15.27:0/864398216 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f308c005830 con 0x7f3090003a00 2023-07-05T23:33:28.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.267+0000 7f30a9ca8700 1 -- 172.21.15.27:0/864398216 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30a40c89b0 con 0x7f3090003a00 2023-07-05T23:33:28.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.267+0000 7f309bfff700 1 -- 172.21.15.27:0/864398216 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f308c005bc0 con 0x7f3090003a00 2023-07-05T23:33:28.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.267+0000 7f30a9ca8700 1 -- 172.21.15.27:0/864398216 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30a4144ea0 con 0x7f3090003a00 2023-07-05T23:33:28.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.268+0000 7f30a9ca8700 1 -- 172.21.15.27:0/864398216 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30a404ea20 con 0x7f3090003a00 2023-07-05T23:33:28.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.268+0000 7f309bfff700 1 -- 172.21.15.27:0/864398216 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f308c005d20 con 0x7f3090003a00 2023-07-05T23:33:28.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.269+0000 7f309bfff700 1 --2- 172.21.15.27:0/864398216 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f308406ace0 0x7f308406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:28.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.269+0000 7f309bfff700 1 -- 172.21.15.27:0/864398216 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f308c08a3a0 con 0x7f3090003a00 2023-07-05T23:33:28.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.269+0000 7f30a2ffd700 1 --2- 172.21.15.27:0/864398216 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f308406ace0 0x7f308406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:28.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.270+0000 7f30a2ffd700 1 --2- 172.21.15.27:0/864398216 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f308406ace0 0x7f308406d190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f30a4157a10 tx=0x7f3094008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:28.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.273+0000 7f309bfff700 1 -- 172.21.15.27:0/864398216 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f308c0551f0 con 0x7f3090003a00 2023-07-05T23:33:28.473 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.471+0000 7f30a9ca8700 1 -- 172.21.15.27:0/864398216 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f30a406ade0 con 0x7f3090003a00 2023-07-05T23:33:28.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.471+0000 7f309bfff700 1 -- 172.21.15.27:0/864398216 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f308c058810 con 0x7f3090003a00 2023-07-05T23:33:28.474 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 32 2023-07-05T23:33:28.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.473+0000 7f30a9ca8700 1 -- 172.21.15.27:0/864398216 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f308406ace0 msgr2=0x7f308406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:28.476 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.473+0000 7f30a9ca8700 1 --2- 172.21.15.27:0/864398216 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f308406ace0 0x7f308406d190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f30a4157a10 tx=0x7f3094008040 comp rx=0 tx=0).stop 2023-07-05T23:33:28.476 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.473+0000 7f30a9ca8700 1 -- 172.21.15.27:0/864398216 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3090003a00 msgr2=0x7f30a40c7b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:28.476 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.473+0000 7f30a9ca8700 1 --2- 172.21.15.27:0/864398216 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3090003a00 0x7f30a40c7b30 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f308c015040 tx=0x7f308c001b80 comp rx=0 tx=0).stop 2023-07-05T23:33:28.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.473+0000 7f30a9ca8700 1 -- 172.21.15.27:0/864398216 shutdown_connections 2023-07-05T23:33:28.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.473+0000 7f30a9ca8700 1 --2- 172.21.15.27:0/864398216 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f308406ace0 0x7f308406d190 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:28.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.473+0000 7f30a9ca8700 1 --2- 172.21.15.27:0/864398216 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30a40b2d80 0x7f30a4144960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:28.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.473+0000 7f30a9ca8700 1 --2- 172.21.15.27:0/864398216 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3090003a00 0x7f30a40c7b30 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:28.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.473+0000 7f30a9ca8700 1 --2- 172.21.15.27:0/864398216 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30a40c91b0 0x7f30a40b2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:28.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.473+0000 7f30a9ca8700 1 -- 172.21.15.27:0/864398216 >> 172.21.15.27:0/864398216 conn(0x7f30a406b920 msgr2=0x7f30a40ce3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:28.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.473+0000 7f30a9ca8700 1 -- 172.21.15.27:0/864398216 shutdown_connections 2023-07-05T23:33:28.478 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.474+0000 7f30a9ca8700 1 -- 172.21.15.27:0/864398216 wait complete. 2023-07-05T23:33:28.488 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-05T23:33:28.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.610+0000 7fd9ab259700 1 Processor -- start 2023-07-05T23:33:28.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.610+0000 7fd9ab259700 1 -- start start 2023-07-05T23:33:28.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.611+0000 7fd9ab259700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd9a415c570 0x7fd9a40cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:28.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.611+0000 7fd9ab259700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd9a4160a50 0x7fd9a40d0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:28.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.611+0000 7fd9ab259700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9a41610a0 con 0x7fd9a40cd660 2023-07-05T23:33:28.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.611+0000 7fd9ab259700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9a415d670 con 0x7fd9a415c570 2023-07-05T23:33:28.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.611+0000 7fd9ab259700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a4160eb0 con 0x7fd9a4160a50 2023-07-05T23:33:28.616 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.611+0000 7fd9a8ff5700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd9a415c570 0x7fd9a40cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:28.616 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.611+0000 7fd9a8ff5700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd9a415c570 0x7fd9a40cd120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45828/0 (socket says 172.21.15.27:45828) 2023-07-05T23:33:28.616 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.611+0000 7fd9a8ff5700 1 -- 172.21.15.27:0/1610960774 learned_addr learned my addr 172.21.15.27:0/1610960774 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:28.616 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.611+0000 7fd9a97f6700 1 --2- 172.21.15.27:0/1610960774 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd9a4160a50 0x7fd9a40d0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:28.616 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.612+0000 7fd9a8ff5700 1 -- 172.21.15.27:0/1610960774 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd9a4160a50 msgr2=0x7fd9a40d0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:28.616 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.612+0000 7fd9a8ff5700 1 --2- 172.21.15.27:0/1610960774 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd9a4160a50 0x7fd9a40d0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:28.616 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.612+0000 7fd9a8ff5700 1 -- 172.21.15.27:0/1610960774 >> v1:172.21.15.27:6789/0 conn(0x7fd9a40cd660 legacy=0x7fd9a4160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:28.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.612+0000 7fd9a8ff5700 1 -- 172.21.15.27:0/1610960774 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9a415da90 con 0x7fd9a415c570 2023-07-05T23:33:28.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.612+0000 7fd9a97f6700 1 --2- 172.21.15.27:0/1610960774 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd9a4160a50 0x7fd9a40d0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T23:33:28.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.612+0000 7fd9a8ff5700 1 --2- 172.21.15.27:0/1610960774 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9a415c570 0x7fd9a40cd120 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd998009920 tx=0x7fd998009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1743fab182efa553 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:28.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.612+0000 7fd9a37fe700 1 -- 172.21.15.27:0/1610960774 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd99800ba20 con 0x7fd9a415c570 2023-07-05T23:33:28.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.612+0000 7fd9a37fe700 1 -- 172.21.15.27:0/1610960774 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd99800bb80 con 0x7fd9a415c570 2023-07-05T23:33:28.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.612+0000 7fd9a37fe700 1 -- 172.21.15.27:0/1610960774 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd998009e70 con 0x7fd9a415c570 2023-07-05T23:33:28.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.612+0000 7fd9ab259700 1 -- 172.21.15.27:0/1610960774 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9a415c570 msgr2=0x7fd9a40cd120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:28.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.612+0000 7fd9ab259700 1 --2- 172.21.15.27:0/1610960774 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9a415c570 0x7fd9a40cd120 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd998009920 tx=0x7fd998009c30 comp rx=0 tx=0).stop 2023-07-05T23:33:28.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.612+0000 7fd9ab259700 1 -- 172.21.15.27:0/1610960774 shutdown_connections 2023-07-05T23:33:28.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.612+0000 7fd9ab259700 1 --2- 172.21.15.27:0/1610960774 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd9a4160a50 0x7fd9a40d0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:28.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.612+0000 7fd9ab259700 1 --2- 172.21.15.27:0/1610960774 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9a415c570 0x7fd9a40cd120 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:28.619 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.612+0000 7fd9ab259700 1 -- 172.21.15.27:0/1610960774 >> 172.21.15.27:0/1610960774 conn(0x7fd9a4071620 msgr2=0x7fd9a40719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:28.619 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.613+0000 7fd9ab259700 1 -- 172.21.15.27:0/1610960774 shutdown_connections 2023-07-05T23:33:28.619 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.613+0000 7fd9ab259700 1 -- 172.21.15.27:0/1610960774 wait complete. 2023-07-05T23:33:28.623 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.614+0000 7fd9ab259700 1 Processor -- start 2023-07-05T23:33:28.623 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.614+0000 7fd9ab259700 1 -- start start 2023-07-05T23:33:28.623 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.615+0000 7fd9ab259700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9a40cd660 0x7fd9a40b7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:28.623 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.615+0000 7fd9ab259700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9a415c570 0x7fd9a4153220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:28.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.615+0000 7fd9ab259700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd9a4160a50 0x7fd9a40cb180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:28.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.615+0000 7fd9ab259700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a4153760 con 0x7fd9a40cd660 2023-07-05T23:33:28.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.615+0000 7fd9ab259700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a40b7b70 con 0x7fd9a415c570 2023-07-05T23:33:28.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.615+0000 7fd9ab259700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a40b6540 con 0x7fd9a4160a50 2023-07-05T23:33:28.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.615+0000 7fd9a8ff5700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9a40cd660 0x7fd9a40b7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:28.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.615+0000 7fd9a8ff5700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9a40cd660 0x7fd9a40b7020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45834/0 (socket says 172.21.15.27:45834) 2023-07-05T23:33:28.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.615+0000 7fd9a8ff5700 1 -- 172.21.15.27:0/2291695389 learned_addr learned my addr 172.21.15.27:0/2291695389 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:28.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.615+0000 7fd9a97f6700 1 --2- 172.21.15.27:0/2291695389 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd9a4160a50 0x7fd9a40cb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:28.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.615+0000 7fd9a3fff700 1 --2- 172.21.15.27:0/2291695389 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9a415c570 0x7fd9a4153220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:28.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.615+0000 7fd9a8ff5700 1 -- 172.21.15.27:0/2291695389 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd9a4160a50 msgr2=0x7fd9a40cb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:28.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.615+0000 7fd9a8ff5700 1 --2- 172.21.15.27:0/2291695389 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd9a4160a50 0x7fd9a40cb180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:28.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.615+0000 7fd9a8ff5700 1 -- 172.21.15.27:0/2291695389 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9a415c570 msgr2=0x7fd9a4153220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:28.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.615+0000 7fd9a8ff5700 1 --2- 172.21.15.27:0/2291695389 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9a415c570 0x7fd9a4153220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:28.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.615+0000 7fd9a8ff5700 1 -- 172.21.15.27:0/2291695389 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd998009550 con 0x7fd9a40cd660 2023-07-05T23:33:28.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.615+0000 7fd9a8ff5700 1 --2- 172.21.15.27:0/2291695389 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9a40cd660 0x7fd9a40b7020 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd998009870 tx=0x7fd998004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:28.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.615+0000 7fd9a17fa700 1 -- 172.21.15.27:0/2291695389 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd998004300 con 0x7fd9a40cd660 2023-07-05T23:33:28.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.615+0000 7fd9a17fa700 1 -- 172.21.15.27:0/2291695389 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd99801f070 con 0x7fd9a40cd660 2023-07-05T23:33:28.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.615+0000 7fd9ab259700 1 -- 172.21.15.27:0/2291695389 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9a40b6820 con 0x7fd9a40cd660 2023-07-05T23:33:28.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.615+0000 7fd9a17fa700 1 -- 172.21.15.27:0/2291695389 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9980036a0 con 0x7fd9a40cd660 2023-07-05T23:33:28.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.615+0000 7fd9ab259700 1 -- 172.21.15.27:0/2291695389 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9a40b7800 con 0x7fd9a40cd660 2023-07-05T23:33:28.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.617+0000 7fd9ab259700 1 -- 172.21.15.27:0/2291695389 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9a40b6380 con 0x7fd9a40cd660 2023-07-05T23:33:28.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.617+0000 7fd9a17fa700 1 -- 172.21.15.27:0/2291695389 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd998021030 con 0x7fd9a40cd660 2023-07-05T23:33:28.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.617+0000 7fd9a17fa700 1 --2- 172.21.15.27:0/2291695389 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fd98806ace0 0x7fd98806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:28.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.617+0000 7fd9a17fa700 1 -- 172.21.15.27:0/2291695389 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd99808ab90 con 0x7fd9a40cd660 2023-07-05T23:33:28.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.618+0000 7fd9a3fff700 1 --2- 172.21.15.27:0/2291695389 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fd98806ace0 0x7fd98806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:28.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.618+0000 7fd9a3fff700 1 --2- 172.21.15.27:0/2291695389 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fd98806ace0 0x7fd98806d190 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd9a415a1f0 tx=0x7fd990009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:28.628 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.622+0000 7fd9a17fa700 1 -- 172.21.15.27:0/2291695389 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd998059590 con 0x7fd9a40cd660 2023-07-05T23:33:28.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.867+0000 7fd9ab259700 1 -- 172.21.15.27:0/2291695389 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd9a4073910 con 0x7fd9a40cd660 2023-07-05T23:33:28.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.867+0000 7fd9a17fa700 1 -- 172.21.15.27:0/2291695389 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4670 (secure 0 0 0) 0x7fd998059120 con 0x7fd9a40cd660 2023-07-05T23:33:28.870 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:33:28.870 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/4263442347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":4263442347},{"type":"v1","addr":"172.21.15.162:6837","nonce":4263442347}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/2486008632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2486008632},{"type":"v1","addr":"172.21.15.162:6836","nonce":2486008632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/217781445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":217781445},{"type":"v1","addr":"172.21.15.27:6834","nonce":217781445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-05T23:32:53.313219+0000","modified":"2023-07-05T23:33:16.797372+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6835/3387103520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":3387103520},{"type":"v1","addr":"172.21.15.27:6835","nonce":3387103520}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-05T23:33:28.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.869+0000 7fd9ab259700 1 -- 172.21.15.27:0/2291695389 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fd98806ace0 msgr2=0x7fd98806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:28.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.869+0000 7fd9ab259700 1 --2- 172.21.15.27:0/2291695389 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fd98806ace0 0x7fd98806d190 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd9a415a1f0 tx=0x7fd990009040 comp rx=0 tx=0).stop 2023-07-05T23:33:28.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.870+0000 7fd9ab259700 1 -- 172.21.15.27:0/2291695389 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9a40cd660 msgr2=0x7fd9a40b7020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:28.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.870+0000 7fd9ab259700 1 --2- 172.21.15.27:0/2291695389 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9a40cd660 0x7fd9a40b7020 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd998009870 tx=0x7fd998004750 comp rx=0 tx=0).stop 2023-07-05T23:33:28.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.870+0000 7fd9ab259700 1 -- 172.21.15.27:0/2291695389 shutdown_connections 2023-07-05T23:33:28.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.870+0000 7fd9ab259700 1 --2- 172.21.15.27:0/2291695389 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fd98806ace0 0x7fd98806d190 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:28.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.870+0000 7fd9ab259700 1 --2- 172.21.15.27:0/2291695389 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd9a4160a50 0x7fd9a40cb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:28.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.870+0000 7fd9ab259700 1 --2- 172.21.15.27:0/2291695389 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9a40cd660 0x7fd9a40b7020 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:28.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.870+0000 7fd9ab259700 1 --2- 172.21.15.27:0/2291695389 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9a415c570 0x7fd9a4153220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:28.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.870+0000 7fd9ab259700 1 -- 172.21.15.27:0/2291695389 >> 172.21.15.27:0/2291695389 conn(0x7fd9a4071620 msgr2=0x7fd9a415dc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:28.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.870+0000 7fd9ab259700 1 -- 172.21.15.27:0/2291695389 shutdown_connections 2023-07-05T23:33:28.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:28.870+0000 7fd9ab259700 1 -- 172.21.15.27:0/2291695389 wait complete. 2023-07-05T23:33:28.873 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 9 2023-07-05T23:33:28.884 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-05T23:33:29.008 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.006+0000 7f7b0d034700 1 Processor -- start 2023-07-05T23:33:29.008 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.006+0000 7f7b0d034700 1 -- start start 2023-07-05T23:33:29.010 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.007+0000 7f7b0d034700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7b08156880 0x7f7b08069ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:29.011 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.007+0000 7f7b0d034700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f7b080aed30 0x7f7b08160580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:29.011 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.007+0000 7f7b0d034700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b080cee80 con 0x7f7b080cc1d0 2023-07-05T23:33:29.011 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.007+0000 7f7b0d034700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b080cf100 con 0x7f7b080aed30 2023-07-05T23:33:29.011 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.007+0000 7f7b0d034700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b080cf3e0 con 0x7f7b08156880 2023-07-05T23:33:29.011 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.007+0000 7f7b0659c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f7b080aed30 0x7f7b08160580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:29.011 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.007+0000 7f7b0659c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f7b080aed30 0x7f7b08160580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45842/0 (socket says 172.21.15.27:45842) 2023-07-05T23:33:29.011 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.007+0000 7f7b0659c700 1 -- 172.21.15.27:0/258666863 learned_addr learned my addr 172.21.15.27:0/258666863 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:29.012 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.007+0000 7f7b06d9d700 1 --2- 172.21.15.27:0/258666863 >> v2:172.21.15.162:3300/0 conn(0x7f7b08156880 0x7f7b08069ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:29.012 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.007+0000 7f7b0659c700 1 -- 172.21.15.27:0/258666863 >> v2:172.21.15.162:3300/0 conn(0x7f7b08156880 msgr2=0x7f7b08069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:29.012 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.007+0000 7f7b0659c700 1 --2- 172.21.15.27:0/258666863 >> v2:172.21.15.162:3300/0 conn(0x7f7b08156880 0x7f7b08069ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:29.012 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.007+0000 7f7b0659c700 1 -- 172.21.15.27:0/258666863 >> v1:172.21.15.162:6789/0 conn(0x7f7b080cc1d0 legacy=0x7f7b0815cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:29.012 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.007+0000 7f7b0659c700 1 -- 172.21.15.27:0/258666863 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b080cd390 con 0x7f7b080aed30 2023-07-05T23:33:29.012 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.008+0000 7f7b0659c700 1 --2- 172.21.15.27:0/258666863 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b080aed30 0x7f7b08160580 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7b080cf720 tx=0x7f7af8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14b784a5e5eda0e3 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:29.012 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.008+0000 7f7b05d9b700 1 -- 172.21.15.27:0/258666863 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af800b870 con 0x7f7b080aed30 2023-07-05T23:33:29.013 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.008+0000 7f7b05d9b700 1 -- 172.21.15.27:0/258666863 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7af800b9d0 con 0x7f7b080aed30 2023-07-05T23:33:29.013 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.008+0000 7f7b05d9b700 1 -- 172.21.15.27:0/258666863 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af800bd60 con 0x7f7b080aed30 2023-07-05T23:33:29.013 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.008+0000 7f7b0d034700 1 -- 172.21.15.27:0/258666863 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b080aed30 msgr2=0x7f7b08160580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:29.013 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.008+0000 7f7b0d034700 1 --2- 172.21.15.27:0/258666863 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b080aed30 0x7f7b08160580 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7b080cf720 tx=0x7f7af8009bd0 comp rx=0 tx=0).stop 2023-07-05T23:33:29.013 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.008+0000 7f7b0d034700 1 -- 172.21.15.27:0/258666863 shutdown_connections 2023-07-05T23:33:29.013 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.008+0000 7f7b0d034700 1 --2- 172.21.15.27:0/258666863 >> v2:172.21.15.162:3300/0 conn(0x7f7b08156880 0x7f7b08069ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:29.014 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.008+0000 7f7b0d034700 1 --2- 172.21.15.27:0/258666863 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b080aed30 0x7f7b08160580 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:29.014 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.008+0000 7f7b0d034700 1 -- 172.21.15.27:0/258666863 >> 172.21.15.27:0/258666863 conn(0x7f7b0806d4a0 msgr2=0x7f7b0806d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:29.014 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.008+0000 7f7b0d034700 1 -- 172.21.15.27:0/258666863 shutdown_connections 2023-07-05T23:33:29.014 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.008+0000 7f7b0d034700 1 -- 172.21.15.27:0/258666863 wait complete. 2023-07-05T23:33:29.016 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.010+0000 7f7b0d034700 1 Processor -- start 2023-07-05T23:33:29.016 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.010+0000 7f7b0d034700 1 -- start start 2023-07-05T23:33:29.016 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.011+0000 7f7b0d034700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b080aed30 0x7f7b08150140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:29.017 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.011+0000 7f7b0d034700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b080cc1d0 0x7f7b080ae0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:29.017 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.011+0000 7f7b0d034700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b08156880 0x7f7b0815d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:29.017 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.011+0000 7f7b0d034700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b08150680 con 0x7f7b08156880 2023-07-05T23:33:29.017 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.011+0000 7f7b0d034700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b08156c50 con 0x7f7b080cc1d0 2023-07-05T23:33:29.017 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.011+0000 7f7b0d034700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b08156ef0 con 0x7f7b080aed30 2023-07-05T23:33:29.017 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.011+0000 7f7b0759e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b08156880 0x7f7b0815d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:29.017 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.011+0000 7f7b0759e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b08156880 0x7f7b0815d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45852/0 (socket says 172.21.15.27:45852) 2023-07-05T23:33:29.018 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.011+0000 7f7b0759e700 1 -- 172.21.15.27:0/1294263061 learned_addr learned my addr 172.21.15.27:0/1294263061 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:29.018 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.011+0000 7f7b0659c700 1 --2- 172.21.15.27:0/1294263061 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b080cc1d0 0x7f7b080ae0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:29.018 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.011+0000 7f7b06d9d700 1 --2- 172.21.15.27:0/1294263061 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b080aed30 0x7f7b08150140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:29.018 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.011+0000 7f7b0759e700 1 -- 172.21.15.27:0/1294263061 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b080aed30 msgr2=0x7f7b08150140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:29.018 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.011+0000 7f7b0759e700 1 --2- 172.21.15.27:0/1294263061 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b080aed30 0x7f7b08150140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:29.018 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.011+0000 7f7b0759e700 1 -- 172.21.15.27:0/1294263061 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b080cc1d0 msgr2=0x7f7b080ae0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:29.018 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.011+0000 7f7b0759e700 1 --2- 172.21.15.27:0/1294263061 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b080cc1d0 0x7f7b080ae0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:29.019 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.011+0000 7f7b0759e700 1 -- 172.21.15.27:0/1294263061 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7af8009550 con 0x7f7b08156880 2023-07-05T23:33:29.019 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.011+0000 7f7b06d9d700 1 --2- 172.21.15.27:0/1294263061 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b080aed30 0x7f7b08150140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T23:33:29.019 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.011+0000 7f7b0659c700 1 --2- 172.21.15.27:0/1294263061 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b080cc1d0 0x7f7b080ae0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T23:33:29.019 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.011+0000 7f7b0759e700 1 --2- 172.21.15.27:0/1294263061 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b08156880 0x7f7b0815d850 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7b0000cc50 tx=0x7f7b0000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:29.019 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.011+0000 7f7aef7fe700 1 -- 172.21.15.27:0/1294263061 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0000ad80 con 0x7f7b08156880 2023-07-05T23:33:29.019 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.011+0000 7f7aef7fe700 1 -- 172.21.15.27:0/1294263061 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b0000ce50 con 0x7f7b08156880 2023-07-05T23:33:29.019 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.011+0000 7f7b0d034700 1 -- 172.21.15.27:0/1294263061 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b081571d0 con 0x7f7b08156880 2023-07-05T23:33:29.019 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.011+0000 7f7aef7fe700 1 -- 172.21.15.27:0/1294263061 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b00003c40 con 0x7f7b08156880 2023-07-05T23:33:29.020 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.011+0000 7f7b0d034700 1 -- 172.21.15.27:0/1294263061 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b08157790 con 0x7f7b08156880 2023-07-05T23:33:29.020 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.012+0000 7f7b0d034700 1 -- 172.21.15.27:0/1294263061 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b08073910 con 0x7f7b08156880 2023-07-05T23:33:29.020 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.013+0000 7f7aef7fe700 1 -- 172.21.15.27:0/1294263061 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7b000050d0 con 0x7f7b08156880 2023-07-05T23:33:29.020 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.013+0000 7f7aef7fe700 1 --2- 172.21.15.27:0/1294263061 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f7af406ace0 0x7f7af406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:29.020 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.014+0000 7f7aef7fe700 1 -- 172.21.15.27:0/1294263061 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7b000898c0 con 0x7f7b08156880 2023-07-05T23:33:29.020 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.014+0000 7f7b06d9d700 1 --2- 172.21.15.27:0/1294263061 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f7af406ace0 0x7f7af406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:29.020 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.014+0000 7f7b06d9d700 1 --2- 172.21.15.27:0/1294263061 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f7af406ace0 0x7f7af406d190 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7afc009a00 tx=0x7f7afc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:29.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.018+0000 7f7aef7fe700 1 -- 172.21.15.27:0/1294263061 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7b00054680 con 0x7f7b08156880 2023-07-05T23:33:29.215 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.213+0000 7f7b0d034700 1 -- 172.21.15.27:0/1294263061 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7b0806a400 con 0x7f7b08156880 2023-07-05T23:33:29.217 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.215+0000 7f7aef7fe700 1 -- 172.21.15.27:0/1294263061 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20120 (secure 0 0 0) 0x7f7b00057ca0 con 0x7f7b08156880 2023-07-05T23:33:29.217 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:33:29.217 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":28,"fsid":"23eebe48-65f5-4d3c-8c2d-4aa171c055d5","created":"2023-07-05T23:32:27.989612+0000","modified":"2023-07-05T23:32:57.768949+0000","last_up_change":"2023-07-05T23:32:39.601570+0000","last_in_change":"2023-07-05T23:32:30.488261+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-05T23:32:41.624598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-05T23:32:46.481587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-05T23:32:51.025210+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-05T23:32:52.286964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-05T23:32:55.354212+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ac2071e4-394b-4385-b9ba-fad5265efc65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6814","nonce":3766536605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6818","nonce":3766536605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6823","nonce":3766536605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6821","nonce":3766536605}]},"public_addr":"172.21.15.27:6814/3766536605","cluster_addr":"172.21.15.27:6818/3766536605","heartbeat_back_addr":"172.21.15.27:6823/3766536605","heartbeat_front_addr":"172.21.15.27:6821/3766536605","state":["exists","up"]},{"osd":1,"uuid":"8c9b61a0-39d5-46bf-afd6-5add78453ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6801","nonce":1579117455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6803","nonce":1579117455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6807","nonce":1579117455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6805","nonce":1579117455}]},"public_addr":"172.21.15.27:6801/1579117455","cluster_addr":"172.21.15.27:6803/1579117455","heartbeat_back_addr":"172.21.15.27:6807/1579117455","heartbeat_front_addr":"172.21.15.27:6805/1579117455","state":["exists","up"]},{"osd":2,"uuid":"dcd032a2-06b1-4055-b798-b86c71a7107d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6825","nonce":807520271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6827","nonce":807520271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6831","nonce":807520271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6829","nonce":807520271}]},"public_addr":"172.21.15.27:6825/807520271","cluster_addr":"172.21.15.27:6827/807520271","heartbeat_back_addr":"172.21.15.27:6831/807520271","heartbeat_front_addr":"172.21.15.27:6829/807520271","state":["exists","up"]},{"osd":3,"uuid":"b0ffe0fc-47ba-4636-b5ea-6bab637642c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6809","nonce":2125656143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6811","nonce":2125656143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6817","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6819","nonce":2125656143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6813","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6815","nonce":2125656143}]},"public_addr":"172.21.15.27:6809/2125656143","cluster_addr":"172.21.15.27:6811/2125656143","heartbeat_back_addr":"172.21.15.27:6819/2125656143","heartbeat_front_addr":"172.21.15.27:6815/2125656143","state":["exists","up"]},{"osd":4,"uuid":"7fab4e5a-1246-4efe-9562-10c4a6c789ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6801","nonce":2111223016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6803","nonce":2111223016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6807","nonce":2111223016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6805","nonce":2111223016}]},"public_addr":"172.21.15.162:6801/2111223016","cluster_addr":"172.21.15.162:6803/2111223016","heartbeat_back_addr":"172.21.15.162:6807/2111223016","heartbeat_front_addr":"172.21.15.162:6805/2111223016","state":["exists","up"]},{"osd":5,"uuid":"110c4d9f-cef6-48ab-a818-5a81e72372af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6825","nonce":3102609008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6827","nonce":3102609008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6831","nonce":3102609008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6829","nonce":3102609008}]},"public_addr":"172.21.15.162:6825/3102609008","cluster_addr":"172.21.15.162:6827/3102609008","heartbeat_back_addr":"172.21.15.162:6831/3102609008","heartbeat_front_addr":"172.21.15.162:6829/3102609008","state":["exists","up"]},{"osd":6,"uuid":"16803bcc-2c92-4aed-954e-487938c9f24a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6809","nonce":2657688865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6811","nonce":2657688865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6815","nonce":2657688865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6813","nonce":2657688865}]},"public_addr":"172.21.15.162:6809/2657688865","cluster_addr":"172.21.15.162:6811/2657688865","heartbeat_back_addr":"172.21.15.162:6815/2657688865","heartbeat_front_addr":"172.21.15.162:6813/2657688865","state":["exists","up"]},{"osd":7,"uuid":"b7c35377-3cf2-4569-b6b9-72376eb463bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6817","nonce":2096609978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6819","nonce":2096609978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6823","nonce":2096609978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6821","nonce":2096609978}]},"public_addr":"172.21.15.162:6817/2096609978","cluster_addr":"172.21.15.162:6819/2096609978","heartbeat_back_addr":"172.21.15.162:6823/2096609978","heartbeat_front_addr":"172.21.15.162:6821/2096609978","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.735448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.645561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.759120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.682507+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.736228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.694664+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.716002+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.680485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-05T23:33:29.219 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.217+0000 7f7b0d034700 1 -- 172.21.15.27:0/1294263061 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f7af406ace0 msgr2=0x7f7af406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:29.219 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.217+0000 7f7b0d034700 1 --2- 172.21.15.27:0/1294263061 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f7af406ace0 0x7f7af406d190 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7afc009a00 tx=0x7f7afc008040 comp rx=0 tx=0).stop 2023-07-05T23:33:29.219 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.217+0000 7f7b0d034700 1 -- 172.21.15.27:0/1294263061 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b08156880 msgr2=0x7f7b0815d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:29.219 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.217+0000 7f7b0d034700 1 --2- 172.21.15.27:0/1294263061 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b08156880 0x7f7b0815d850 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7b0000cc50 tx=0x7f7b0000a340 comp rx=0 tx=0).stop 2023-07-05T23:33:29.219 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.217+0000 7f7b0d034700 1 -- 172.21.15.27:0/1294263061 shutdown_connections 2023-07-05T23:33:29.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.217+0000 7f7b0d034700 1 --2- 172.21.15.27:0/1294263061 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f7af406ace0 0x7f7af406d190 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:29.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.217+0000 7f7b0d034700 1 --2- 172.21.15.27:0/1294263061 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b08156880 0x7f7b0815d850 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:29.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.217+0000 7f7b0d034700 1 --2- 172.21.15.27:0/1294263061 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b080aed30 0x7f7b08150140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:29.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.217+0000 7f7b0d034700 1 --2- 172.21.15.27:0/1294263061 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b080cc1d0 0x7f7b080ae0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:29.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.217+0000 7f7b0d034700 1 -- 172.21.15.27:0/1294263061 >> 172.21.15.27:0/1294263061 conn(0x7f7b0806d4a0 msgr2=0x7f7b08072990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:29.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.217+0000 7f7b0d034700 1 -- 172.21.15.27:0/1294263061 shutdown_connections 2023-07-05T23:33:29.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.217+0000 7f7b0d034700 1 -- 172.21.15.27:0/1294263061 wait complete. 2023-07-05T23:33:29.233 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-05T23:33:29.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.357+0000 7f49dd6c6700 1 Processor -- start 2023-07-05T23:33:29.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.357+0000 7f49dd6c6700 1 -- start start 2023-07-05T23:33:29.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.358+0000 7f49dd6c6700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f49d806a890 0x7f49d806acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:29.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.358+0000 7f49dd6c6700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49d815cc30 con 0x7f49d8158850 2023-07-05T23:33:29.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.358+0000 7f49dd6c6700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49d815cf10 con 0x7f49d80ccf90 2023-07-05T23:33:29.364 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.358+0000 7f49dd6c6700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49d815d1f0 con 0x7f49d806a890 2023-07-05T23:33:29.364 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.358+0000 7f49d67fc700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f49d8158850 0x7f49d815c1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:53024/0 (socket says 172.21.15.27:53024) 2023-07-05T23:33:29.364 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.358+0000 7f49d67fc700 1 -- 172.21.15.27:0/1321038151 learned_addr learned my addr 172.21.15.27:0/1321038151 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-07-05T23:33:29.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.358+0000 7f49d77fe700 1 --2- 172.21.15.27:0/1321038151 >> v2:172.21.15.162:3300/0 conn(0x7f49d806a890 0x7f49d806acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:29.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.358+0000 7f49d5ffb700 1 -- 172.21.15.27:0/1321038151 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2382945902 0 0) 0x7f49d815cc30 con 0x7f49d8158850 2023-07-05T23:33:29.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.358+0000 7f49d5ffb700 1 -- 172.21.15.27:0/1321038151 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49c00046c0 con 0x7f49d8158850 2023-07-05T23:33:29.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.358+0000 7f49d5ffb700 1 -- 172.21.15.27:0/1321038151 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3682786716 0 0) 0x7f49d815cf10 con 0x7f49d80ccf90 2023-07-05T23:33:29.366 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.358+0000 7f49d5ffb700 1 -- 172.21.15.27:0/1321038151 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49d815cc30 con 0x7f49d80ccf90 2023-07-05T23:33:29.366 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.358+0000 7f49d77fe700 1 -- 172.21.15.27:0/1321038151 >> v1:172.21.15.162:6789/0 conn(0x7f49d80ccf90 legacy=0x7f49d80cd360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:29.366 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.358+0000 7f49d77fe700 1 -- 172.21.15.27:0/1321038151 >> v1:172.21.15.27:6789/0 conn(0x7f49d8158850 legacy=0x7f49d815c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:29.367 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.358+0000 7f49d77fe700 1 -- 172.21.15.27:0/1321038151 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d806a090 con 0x7f49d806a890 2023-07-05T23:33:29.367 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.358+0000 7f49d77fe700 1 --2- 172.21.15.27:0/1321038151 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49d806a890 0x7f49d806acb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f49d0009d90 tx=0x7f49d000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13085f36c9250013 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:29.367 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.359+0000 7f49d5ffb700 1 -- 172.21.15.27:0/1321038151 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d000e070 con 0x7f49d806a890 2023-07-05T23:33:29.367 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.359+0000 7f49d5ffb700 1 -- 172.21.15.27:0/1321038151 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d000bb20 con 0x7f49d806a890 2023-07-05T23:33:29.368 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.359+0000 7f49d5ffb700 1 -- 172.21.15.27:0/1321038151 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d0012430 con 0x7f49d806a890 2023-07-05T23:33:29.368 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.359+0000 7f49dd6c6700 1 -- 172.21.15.27:0/1321038151 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49d806a890 msgr2=0x7f49d806acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:29.368 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.359+0000 7f49dd6c6700 1 --2- 172.21.15.27:0/1321038151 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49d806a890 0x7f49d806acb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f49d0009d90 tx=0x7f49d000b330 comp rx=0 tx=0).stop 2023-07-05T23:33:29.369 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.359+0000 7f49dd6c6700 1 -- 172.21.15.27:0/1321038151 shutdown_connections 2023-07-05T23:33:29.369 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.359+0000 7f49dd6c6700 1 --2- 172.21.15.27:0/1321038151 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49d806a890 0x7f49d806acb0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:29.369 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.359+0000 7f49dd6c6700 1 -- 172.21.15.27:0/1321038151 >> 172.21.15.27:0/1321038151 conn(0x7f49d80b1740 msgr2=0x7f49d806cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:29.370 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.359+0000 7f49dd6c6700 1 -- 172.21.15.27:0/1321038151 shutdown_connections 2023-07-05T23:33:29.370 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.360+0000 7f49dd6c6700 1 -- 172.21.15.27:0/1321038151 wait complete. 2023-07-05T23:33:29.370 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.361+0000 7f49dd6c6700 1 Processor -- start 2023-07-05T23:33:29.370 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.361+0000 7f49dd6c6700 1 -- start start 2023-07-05T23:33:29.374 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.362+0000 7f49dd6c6700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f49d806a890 0x7f49d81f2770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:29.374 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.362+0000 7f49dd6c6700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49d80ccf90 0x7f49d81f2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:29.374 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.362+0000 7f49dd6c6700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f49d8158850 0x7f49d814f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:29.375 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.362+0000 7f49dd6c6700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d814f0a0 con 0x7f49d806a890 2023-07-05T23:33:29.375 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.362+0000 7f49dd6c6700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d81f6280 con 0x7f49d80ccf90 2023-07-05T23:33:29.375 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.362+0000 7f49dd6c6700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49d814e460 con 0x7f49d8158850 2023-07-05T23:33:29.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.362+0000 7f49d6ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f49d806a890 0x7f49d81f2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:29.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.362+0000 7f49d6ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f49d806a890 0x7f49d81f2770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45864/0 (socket says 172.21.15.27:45864) 2023-07-05T23:33:29.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.362+0000 7f49d77fe700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f49d8158850 0x7f49d814f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:29.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.362+0000 7f49d6ffd700 1 -- 172.21.15.27:0/2544025155 learned_addr learned my addr 172.21.15.27:0/2544025155 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:29.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.362+0000 7f49d67fc700 1 --2- 172.21.15.27:0/2544025155 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49d80ccf90 0x7f49d81f2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:29.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.363+0000 7f49d6ffd700 1 -- 172.21.15.27:0/2544025155 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f49d8158850 msgr2=0x7f49d814f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:29.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.363+0000 7f49d6ffd700 1 --2- 172.21.15.27:0/2544025155 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f49d8158850 0x7f49d814f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:29.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.363+0000 7f49d6ffd700 1 -- 172.21.15.27:0/2544025155 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49d80ccf90 msgr2=0x7f49d81f2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:29.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.363+0000 7f49d6ffd700 1 --2- 172.21.15.27:0/2544025155 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49d80ccf90 0x7f49d81f2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:29.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.363+0000 7f49d6ffd700 1 -- 172.21.15.27:0/2544025155 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d0009a70 con 0x7f49d806a890 2023-07-05T23:33:29.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.363+0000 7f49d6ffd700 1 --2- 172.21.15.27:0/2544025155 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f49d806a890 0x7f49d81f2770 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f49c800c520 tx=0x7f49c800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:29.379 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.363+0000 7f49bf7fe700 1 -- 172.21.15.27:0/2544025155 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c80052d0 con 0x7f49d806a890 2023-07-05T23:33:29.379 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.363+0000 7f49bf7fe700 1 -- 172.21.15.27:0/2544025155 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49c8005430 con 0x7f49d806a890 2023-07-05T23:33:29.379 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.363+0000 7f49dd6c6700 1 -- 172.21.15.27:0/2544025155 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49d81f2cb0 con 0x7f49d806a890 2023-07-05T23:33:29.379 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.363+0000 7f49bf7fe700 1 -- 172.21.15.27:0/2544025155 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c80038c0 con 0x7f49d806a890 2023-07-05T23:33:29.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.363+0000 7f49dd6c6700 1 -- 172.21.15.27:0/2544025155 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49d814e9e0 con 0x7f49d806a890 2023-07-05T23:33:29.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.364+0000 7f49dd6c6700 1 -- 172.21.15.27:0/2544025155 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49d814f310 con 0x7f49d806a890 2023-07-05T23:33:29.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.365+0000 7f49bf7fe700 1 -- 172.21.15.27:0/2544025155 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f49c8003a20 con 0x7f49d806a890 2023-07-05T23:33:29.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.365+0000 7f49bf7fe700 1 --2- 172.21.15.27:0/2544025155 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f49c406ace0 0x7f49c406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:29.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.365+0000 7f49bf7fe700 1 -- 172.21.15.27:0/2544025155 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f49c8088b50 con 0x7f49d806a890 2023-07-05T23:33:29.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.366+0000 7f49d67fc700 1 --2- 172.21.15.27:0/2544025155 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f49c406ace0 0x7f49c406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:29.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.366+0000 7f49d67fc700 1 --2- 172.21.15.27:0/2544025155 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f49c406ace0 0x7f49c406d190 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f49d806cc70 tx=0x7f49cc007dc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:29.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.370+0000 7f49bf7fe700 1 -- 172.21.15.27:0/2544025155 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f49c8053910 con 0x7f49d806a890 2023-07-05T23:33:29.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.609+0000 7f49dd6c6700 1 -- 172.21.15.27:0/2544025155 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f49d8073910 con 0x7f49d806a890 2023-07-05T23:33:29.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.609+0000 7f49bf7fe700 1 -- 172.21.15.27:0/2544025155 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4670 (secure 0 0 0) 0x7f49c8056f30 con 0x7f49d806a890 2023-07-05T23:33:29.612 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:33:29.612 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/4263442347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":4263442347},{"type":"v1","addr":"172.21.15.162:6837","nonce":4263442347}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/2486008632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2486008632},{"type":"v1","addr":"172.21.15.162:6836","nonce":2486008632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/217781445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":217781445},{"type":"v1","addr":"172.21.15.27:6834","nonce":217781445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-05T23:32:53.313219+0000","modified":"2023-07-05T23:33:16.797372+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6835/3387103520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":3387103520},{"type":"v1","addr":"172.21.15.27:6835","nonce":3387103520}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-05T23:33:29.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.611+0000 7f49dd6c6700 1 -- 172.21.15.27:0/2544025155 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f49c406ace0 msgr2=0x7f49c406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:29.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.611+0000 7f49dd6c6700 1 --2- 172.21.15.27:0/2544025155 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f49c406ace0 0x7f49c406d190 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f49d806cc70 tx=0x7f49cc007dc0 comp rx=0 tx=0).stop 2023-07-05T23:33:29.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.611+0000 7f49dd6c6700 1 -- 172.21.15.27:0/2544025155 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f49d806a890 msgr2=0x7f49d81f2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:29.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.611+0000 7f49dd6c6700 1 --2- 172.21.15.27:0/2544025155 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f49d806a890 0x7f49d81f2770 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f49c800c520 tx=0x7f49c800c830 comp rx=0 tx=0).stop 2023-07-05T23:33:29.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.611+0000 7f49dd6c6700 1 -- 172.21.15.27:0/2544025155 shutdown_connections 2023-07-05T23:33:29.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.611+0000 7f49dd6c6700 1 --2- 172.21.15.27:0/2544025155 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f49c406ace0 0x7f49c406d190 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:29.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.611+0000 7f49dd6c6700 1 --2- 172.21.15.27:0/2544025155 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f49d8158850 0x7f49d814f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:29.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.611+0000 7f49dd6c6700 1 --2- 172.21.15.27:0/2544025155 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f49d806a890 0x7f49d81f2770 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:29.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.611+0000 7f49dd6c6700 1 --2- 172.21.15.27:0/2544025155 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49d80ccf90 0x7f49d81f2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:29.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.611+0000 7f49dd6c6700 1 -- 172.21.15.27:0/2544025155 >> 172.21.15.27:0/2544025155 conn(0x7f49d80b1740 msgr2=0x7f49d8065c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:29.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.611+0000 7f49dd6c6700 1 -- 172.21.15.27:0/2544025155 shutdown_connections 2023-07-05T23:33:29.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:29.611+0000 7f49dd6c6700 1 -- 172.21.15.27:0/2544025155 wait complete. 2023-07-05T23:33:29.615 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 9 2023-07-05T23:33:30.027 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-05T23:32:53.313219+0000', 'modified': '2023-07-05T23:33:16.797372+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4293}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4293': {'gid': 4293, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.27:6835/3387103520', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.27:6833', 'nonce': 3387103520}, {'type': 'v1', 'addr': '172.21.15.27:6835', 'nonce': 3387103520}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-05T23:33:30.028 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-05T23:33:30.028 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-07-05T23:33:30.156 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.154+0000 7f8921a8a700 1 Processor -- start 2023-07-05T23:33:30.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.155+0000 7f8921a8a700 1 -- start start 2023-07-05T23:33:30.158 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.155+0000 7f8921a8a700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f891c15a640 0x7f891c06fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:30.159 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.155+0000 7f8921a8a700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f891c0d05d0 0x7f891c0ce570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:30.159 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.155+0000 7f8921a8a700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f891c0ae580 con 0x7f891c0ceab0 2023-07-05T23:33:30.159 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.155+0000 7f8921a8a700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f891c0cef50 con 0x7f891c0d05d0 2023-07-05T23:33:30.159 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.155+0000 7f8921a8a700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f891c0adf70 con 0x7f891c15a640 2023-07-05T23:33:30.159 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.156+0000 7f891affd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f891c0d05d0 0x7f891c0ce570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:30.159 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.156+0000 7f891affd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f891c0d05d0 0x7f891c0ce570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45872/0 (socket says 172.21.15.27:45872) 2023-07-05T23:33:30.160 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.156+0000 7f891affd700 1 -- 172.21.15.27:0/3594223011 learned_addr learned my addr 172.21.15.27:0/3594223011 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:30.160 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.156+0000 7f891b7fe700 1 --2- 172.21.15.27:0/3594223011 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f891c15a640 0x7f891c06fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:30.160 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.156+0000 7f891affd700 1 -- 172.21.15.27:0/3594223011 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f891c15a640 msgr2=0x7f891c06fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:30.160 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.156+0000 7f891affd700 1 --2- 172.21.15.27:0/3594223011 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f891c15a640 0x7f891c06fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:30.160 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.156+0000 7f891affd700 1 -- 172.21.15.27:0/3594223011 >> v1:172.21.15.27:6789/0 conn(0x7f891c0ceab0 legacy=0x7f891c06e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:30.160 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.156+0000 7f891affd700 1 -- 172.21.15.27:0/3594223011 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f891c06f860 con 0x7f891c0d05d0 2023-07-05T23:33:30.160 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.156+0000 7f891affd700 1 --2- 172.21.15.27:0/3594223011 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f891c0d05d0 0x7f891c0ce570 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f89100098f0 tx=0x7f8910009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8323e49e465f41bb server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:30.161 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.156+0000 7f891a7fc700 1 -- 172.21.15.27:0/3594223011 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891000b8a0 con 0x7f891c0d05d0 2023-07-05T23:33:30.161 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.156+0000 7f891a7fc700 1 -- 172.21.15.27:0/3594223011 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f891000ba00 con 0x7f891c0d05d0 2023-07-05T23:33:30.161 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.156+0000 7f891a7fc700 1 -- 172.21.15.27:0/3594223011 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891000bd90 con 0x7f891c0d05d0 2023-07-05T23:33:30.161 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.157+0000 7f8921a8a700 1 -- 172.21.15.27:0/3594223011 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f891c0d05d0 msgr2=0x7f891c0ce570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:30.161 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.157+0000 7f8921a8a700 1 --2- 172.21.15.27:0/3594223011 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f891c0d05d0 0x7f891c0ce570 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f89100098f0 tx=0x7f8910009c00 comp rx=0 tx=0).stop 2023-07-05T23:33:30.161 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.157+0000 7f8921a8a700 1 -- 172.21.15.27:0/3594223011 shutdown_connections 2023-07-05T23:33:30.161 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.157+0000 7f8921a8a700 1 --2- 172.21.15.27:0/3594223011 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f891c15a640 0x7f891c06fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:30.162 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.157+0000 7f8921a8a700 1 --2- 172.21.15.27:0/3594223011 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f891c0d05d0 0x7f891c0ce570 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:30.162 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.157+0000 7f8921a8a700 1 -- 172.21.15.27:0/3594223011 >> 172.21.15.27:0/3594223011 conn(0x7f891c089fe0 msgr2=0x7f891c0d09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:30.162 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.157+0000 7f8921a8a700 1 -- 172.21.15.27:0/3594223011 shutdown_connections 2023-07-05T23:33:30.162 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.157+0000 7f8921a8a700 1 -- 172.21.15.27:0/3594223011 wait complete. 2023-07-05T23:33:30.165 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.158+0000 7f8921a8a700 1 Processor -- start 2023-07-05T23:33:30.165 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.158+0000 7f8921a8a700 1 -- start start 2023-07-05T23:33:30.165 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.159+0000 7f8921a8a700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f891c0ceab0 0x7f891c155cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:30.165 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.159+0000 7f8921a8a700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f891c0d05d0 0x7f891c0b4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:30.165 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.159+0000 7f8921a8a700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f891c15a640 0x7f891c156420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:30.166 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.159+0000 7f8921a8a700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f891c09d290 con 0x7f891c0d05d0 2023-07-05T23:33:30.166 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.159+0000 7f8921a8a700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f891c0b41e0 con 0x7f891c0ceab0 2023-07-05T23:33:30.166 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.159+0000 7f8921a8a700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f891c156230 con 0x7f891c15a640 2023-07-05T23:33:30.166 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.159+0000 7f891affd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f891c0d05d0 0x7f891c0b4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:30.166 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.159+0000 7f891affd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f891c0d05d0 0x7f891c0b4c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45878/0 (socket says 172.21.15.27:45878) 2023-07-05T23:33:30.166 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.159+0000 7f891affd700 1 -- 172.21.15.27:0/2148861247 learned_addr learned my addr 172.21.15.27:0/2148861247 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:30.166 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.159+0000 7f891bfff700 1 --2- 172.21.15.27:0/2148861247 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f891c15a640 0x7f891c156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:30.166 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.159+0000 7f891b7fe700 1 --2- 172.21.15.27:0/2148861247 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f891c0ceab0 0x7f891c155cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:30.167 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.159+0000 7f891affd700 1 -- 172.21.15.27:0/2148861247 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f891c15a640 msgr2=0x7f891c156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:30.167 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.159+0000 7f891affd700 1 --2- 172.21.15.27:0/2148861247 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f891c15a640 0x7f891c156420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:30.167 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.159+0000 7f891affd700 1 -- 172.21.15.27:0/2148861247 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f891c0ceab0 msgr2=0x7f891c155cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:30.167 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.159+0000 7f891affd700 1 --2- 172.21.15.27:0/2148861247 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f891c0ceab0 0x7f891c155cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:30.167 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.159+0000 7f891affd700 1 -- 172.21.15.27:0/2148861247 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8910009550 con 0x7f891c0d05d0 2023-07-05T23:33:30.167 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.159+0000 7f891affd700 1 --2- 172.21.15.27:0/2148861247 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f891c0d05d0 0x7f891c0b4c30 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8910000c00 tx=0x7f8910004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:30.167 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.160+0000 7f8903fff700 1 -- 172.21.15.27:0/2148861247 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8910004300 con 0x7f891c0d05d0 2023-07-05T23:33:30.168 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.160+0000 7f8903fff700 1 -- 172.21.15.27:0/2148861247 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f891001f070 con 0x7f891c0d05d0 2023-07-05T23:33:30.168 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.160+0000 7f8903fff700 1 -- 172.21.15.27:0/2148861247 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89100036a0 con 0x7f891c0d05d0 2023-07-05T23:33:30.168 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.160+0000 7f8921a8a700 1 -- 172.21.15.27:0/2148861247 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f891c0b62a0 con 0x7f891c0d05d0 2023-07-05T23:33:30.168 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.160+0000 7f8921a8a700 1 -- 172.21.15.27:0/2148861247 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f891c0b4430 con 0x7f891c0d05d0 2023-07-05T23:33:30.168 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.161+0000 7f8903fff700 1 -- 172.21.15.27:0/2148861247 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8910021030 con 0x7f891c0d05d0 2023-07-05T23:33:30.168 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.162+0000 7f8903fff700 1 --2- 172.21.15.27:0/2148861247 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f890806ace0 0x7f890806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:30.168 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.162+0000 7f8903fff700 1 -- 172.21.15.27:0/2148861247 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f891008aa30 con 0x7f891c0d05d0 2023-07-05T23:33:30.168 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.162+0000 7f891b7fe700 1 --2- 172.21.15.27:0/2148861247 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f890806ace0 0x7f890806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:30.169 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.163+0000 7f891b7fe700 1 --2- 172.21.15.27:0/2148861247 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f890806ace0 0x7f890806d190 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f891c0c4440 tx=0x7f890c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:30.174 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.164+0000 7f892dc0fb80 1 Processor -- start 2023-07-05T23:33:30.174 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.164+0000 7f892dc0fb80 1 -- start start 2023-07-05T23:33:30.174 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.165+0000 7f892dc0fb80 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d67b6c2270 0x55d67b6c2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:30.174 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.165+0000 7f892dc0fb80 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d67b6bf740 0x55d67b6e89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:30.175 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.165+0000 7f892dc0fb80 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d67b6e8f00 0x55d67b6ec1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:30.175 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.165+0000 7f892dc0fb80 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d67b5c6c60 con 0x55d67b6c2270 2023-07-05T23:33:30.175 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.165+0000 7f892dc0fb80 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d67b6199f0 con 0x55d67b6e8f00 2023-07-05T23:33:30.175 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.165+0000 7f892dc0fb80 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d67b612e80 con 0x55d67b6bf740 2023-07-05T23:33:30.175 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.165+0000 7f891b7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d67b6c2270 0x55d67b6c2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:30.175 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.165+0000 7f891b7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d67b6c2270 0x55d67b6c2640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45884/0 (socket says 172.21.15.27:45884) 2023-07-05T23:33:30.175 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.165+0000 7f891b7fe700 1 -- 172.21.15.27:0/2434183417 learned_addr learned my addr 172.21.15.27:0/2434183417 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:30.176 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.165+0000 7f891bfff700 1 --2- 172.21.15.27:0/2434183417 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d67b6e8f00 0x55d67b6ec1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:30.176 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.165+0000 7f891affd700 1 --2- 172.21.15.27:0/2434183417 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d67b6bf740 0x55d67b6e89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:30.176 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.165+0000 7f891b7fe700 1 -- 172.21.15.27:0/2434183417 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d67b6bf740 msgr2=0x55d67b6e89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:30.176 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.165+0000 7f891b7fe700 1 --2- 172.21.15.27:0/2434183417 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d67b6bf740 0x55d67b6e89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:30.176 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.165+0000 7f891b7fe700 1 -- 172.21.15.27:0/2434183417 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d67b6e8f00 msgr2=0x55d67b6ec1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:30.176 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.165+0000 7f891b7fe700 1 --2- 172.21.15.27:0/2434183417 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d67b6e8f00 0x55d67b6ec1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:30.176 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.165+0000 7f891b7fe700 1 -- 172.21.15.27:0/2434183417 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d67b4945e0 con 0x55d67b6c2270 2023-07-05T23:33:30.177 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.165+0000 7f891affd700 1 --2- 172.21.15.27:0/2434183417 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d67b6bf740 0x55d67b6e89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T23:33:30.177 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.165+0000 7f891bfff700 1 --2- 172.21.15.27:0/2434183417 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d67b6e8f00 0x55d67b6ec1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T23:33:30.177 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.165+0000 7f891b7fe700 1 --2- 172.21.15.27:0/2434183417 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d67b6c2270 0x55d67b6c2640 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f890c011920 tx=0x7f890c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1c7959785418e6f server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:30.177 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.165+0000 7f89017fa700 1 -- 172.21.15.27:0/2434183417 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f890c0157c0 con 0x55d67b6c2270 2023-07-05T23:33:30.177 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.165+0000 7f89017fa700 1 -- 172.21.15.27:0/2434183417 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f890c015920 con 0x55d67b6c2270 2023-07-05T23:33:30.177 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.165+0000 7f89017fa700 1 -- 172.21.15.27:0/2434183417 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f890c015c90 con 0x55d67b6c2270 2023-07-05T23:33:30.177 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.166+0000 7f892dc0fb80 1 -- 172.21.15.27:0/2434183417 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d67b6c2270 msgr2=0x55d67b6c2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:30.177 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.166+0000 7f892dc0fb80 1 --2- 172.21.15.27:0/2434183417 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d67b6c2270 0x55d67b6c2640 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f890c011920 tx=0x7f890c014000 comp rx=0 tx=0).stop 2023-07-05T23:33:30.178 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.166+0000 7f892dc0fb80 1 -- 172.21.15.27:0/2434183417 shutdown_connections 2023-07-05T23:33:30.178 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.166+0000 7f892dc0fb80 1 --2- 172.21.15.27:0/2434183417 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d67b6e8f00 0x55d67b6ec1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:30.178 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.166+0000 7f892dc0fb80 1 --2- 172.21.15.27:0/2434183417 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d67b6c2270 0x55d67b6c2640 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:30.178 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.166+0000 7f892dc0fb80 1 --2- 172.21.15.27:0/2434183417 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d67b6bf740 0x55d67b6e89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:30.178 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.166+0000 7f892dc0fb80 1 -- 172.21.15.27:0/2434183417 >> 172.21.15.27:0/2434183417 conn(0x55d67b6b6fc0 msgr2=0x55d67b7071a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:30.178 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.166+0000 7f892dc0fb80 1 -- 172.21.15.27:0/2434183417 shutdown_connections 2023-07-05T23:33:30.178 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.166+0000 7f892dc0fb80 1 -- 172.21.15.27:0/2434183417 wait complete. 2023-07-05T23:33:30.178 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.167+0000 7f892dc0fb80 1 -- start start 2023-07-05T23:33:30.179 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.167+0000 7f892dc0fb80 1 Processor -- start 2023-07-05T23:33:30.179 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.168+0000 7f892dc0fb80 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d67b6bf740 0x55d67b709000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:30.179 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.168+0000 7f892dc0fb80 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d67b6c2270 0x55d67b6e5a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:30.179 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.168+0000 7f892dc0fb80 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d67b6e8f00 0x55d67b6c10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:30.179 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.168+0000 7f892dc0fb80 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d67b5b2a70 con 0x55d67b6c2270 2023-07-05T23:33:30.179 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.168+0000 7f892dc0fb80 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d67b5b2770 con 0x55d67b6e8f00 2023-07-05T23:33:30.179 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.168+0000 7f892dc0fb80 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d67b4968d0 con 0x55d67b6bf740 2023-07-05T23:33:30.179 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.168+0000 7f892dc0fb80 10 client.0 _ll_register_callbacks cb 0x55d67b5b8210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-05T23:33:30.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.168+0000 7f891affd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d67b6c2270 0x55d67b6e5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:30.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.168+0000 7f891affd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d67b6c2270 0x55d67b6e5a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45894/0 (socket says 172.21.15.27:45894) 2023-07-05T23:33:30.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.168+0000 7f891affd700 1 -- 172.21.15.27:0/1706937400 learned_addr learned my addr 172.21.15.27:0/1706937400 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:30.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.168+0000 7f891b7fe700 1 --2- 172.21.15.27:0/1706937400 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d67b6bf740 0x55d67b709000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:30.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.168+0000 7f891bfff700 1 --2- 172.21.15.27:0/1706937400 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d67b6e8f00 0x55d67b6c10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:30.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.168+0000 7f891affd700 1 -- 172.21.15.27:0/1706937400 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d67b6bf740 msgr2=0x55d67b709000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:30.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.168+0000 7f891affd700 1 --2- 172.21.15.27:0/1706937400 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d67b6bf740 0x55d67b709000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:30.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.168+0000 7f891affd700 1 -- 172.21.15.27:0/1706937400 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d67b6e8f00 msgr2=0x55d67b6c10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:30.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.168+0000 7f891affd700 1 --2- 172.21.15.27:0/1706937400 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d67b6e8f00 0x55d67b6c10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:30.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.168+0000 7f891affd700 1 -- 172.21.15.27:0/1706937400 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f890c00e040 con 0x55d67b6c2270 2023-07-05T23:33:30.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.168+0000 7f891bfff700 1 --2- 172.21.15.27:0/1706937400 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d67b6e8f00 0x55d67b6c10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T23:33:30.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.168+0000 7f891affd700 1 --2- 172.21.15.27:0/1706937400 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d67b6c2270 0x55d67b6e5a50 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8910088ba0 tx=0x7f8910058f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ebb87ea78c2fc85 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:30.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.168+0000 7f88fa7fc700 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2023-07-05T23:33:30.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.168+0000 7f88fa7fc700 1 -- 172.21.15.27:0/1706937400 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8910061810 con 0x55d67b6c2270 2023-07-05T23:33:30.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.168+0000 7f88fa7fc700 1 -- 172.21.15.27:0/1706937400 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f89100589b0 con 0x55d67b6c2270 2023-07-05T23:33:30.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.168+0000 7f892dc0fb80 1 -- 172.21.15.27:0/1706937400 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d67b6b4780 con 0x55d67b6c2270 2023-07-05T23:33:30.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.168+0000 7f88fa7fc700 1 -- 172.21.15.27:0/1706937400 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8910058b90 con 0x55d67b6c2270 2023-07-05T23:33:30.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.168+0000 7f892dc0fb80 10 client.4893 fetch_fsmap learned FSMap version 9 2023-07-05T23:33:30.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.168+0000 7f892dc0fb80 1 -- 172.21.15.27:0/1706937400 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55d67b440d90 con 0x55d67b6c2270 2023-07-05T23:33:30.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.169+0000 7f88fa7fc700 1 -- 172.21.15.27:0/1706937400 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d67b6b4780 con 0x55d67b6c2270 2023-07-05T23:33:30.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.169+0000 7f88fa7fc700 1 -- 172.21.15.27:0/1706937400 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 9) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f8910061380 con 0x55d67b6c2270 2023-07-05T23:33:30.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.169+0000 7f892dc0fb80 10 client.4893 fetch_fsmap finished waiting for FSMap version 9 2023-07-05T23:33:30.183 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.169+0000 7f892dc0fb80 10 client.4893 resolve_mds: resolved name 'a' to daemon mds.a 2023-07-05T23:33:30.183 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.169+0000 7f892dc0fb80 20 client.4893 populate_metadata read hostname 'smithi027' 2023-07-05T23:33:30.183 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.169+0000 7f892dc0fb80 1 --2- 172.21.15.27:0/1706937400 >> [v2:172.21.15.27:6833/3387103520,v1:172.21.15.27:6835/3387103520] conn(0x55d67b70d0b0 0x55d67b70d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:30.183 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.169+0000 7f892dc0fb80 4 client.4893 mds_command: new command op to 4293 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-05T23:33:30.183 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.169+0000 7f892dc0fb80 1 -- 172.21.15.27:0/1706937400 --> [v2:172.21.15.27:6833/3387103520,v1:172.21.15.27:6835/3387103520] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d67b60be60 con 0x55d67b70d0b0 2023-07-05T23:33:30.183 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.169+0000 7f891b7fe700 1 --2- 172.21.15.27:0/1706937400 >> [v2:172.21.15.27:6833/3387103520,v1:172.21.15.27:6835/3387103520] conn(0x55d67b70d0b0 0x55d67b70d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:30.183 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.169+0000 7f88fa7fc700 10 client.4893 ms_handle_connect on v2:172.21.15.27:6833/3387103520 2023-07-05T23:33:30.183 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.169+0000 7f891b7fe700 1 --2- 172.21.15.27:0/1706937400 >> [v2:172.21.15.27:6833/3387103520,v1:172.21.15.27:6835/3387103520] conn(0x55d67b70d0b0 0x55d67b70d480 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3bf32ffdc5db9a37 server_cookie=5fcfe539946659a5 in_seq=0 out_seq=0 2023-07-05T23:33:30.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.170+0000 7f88fa7fc700 1 -- 172.21.15.27:0/1706937400 <== mds.0 v2:172.21.15.27:6833/3387103520 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55d67b60be60 con 0x55d67b70d0b0 2023-07-05T23:33:30.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.170+0000 7f88fa7fc700 10 client.4893 handle_command_reply: tid=0 2023-07-05T23:33:30.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.170+0000 7f892dc0fb80 1 client.4893 shutdown 2023-07-05T23:33:30.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.170+0000 7f892dc0fb80 1 -- 172.21.15.27:0/1706937400 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d67b6c2270 msgr2=0x55d67b6e5a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:30.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.170+0000 7f892dc0fb80 1 --2- 172.21.15.27:0/1706937400 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d67b6c2270 0x55d67b6e5a50 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8910088ba0 tx=0x7f8910058f10 comp rx=0 tx=0).stop 2023-07-05T23:33:30.185 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.170+0000 7f892dc0fb80 1 -- 172.21.15.27:0/1706937400 shutdown_connections 2023-07-05T23:33:30.185 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.170+0000 7f892dc0fb80 1 --2- 172.21.15.27:0/1706937400 >> [v2:172.21.15.27:6833/3387103520,v1:172.21.15.27:6835/3387103520] conn(0x55d67b70d0b0 0x55d67b70d480 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:30.185 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.170+0000 7f892dc0fb80 1 --2- 172.21.15.27:0/1706937400 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d67b6e8f00 0x55d67b6c10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:30.185 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.170+0000 7f88fa7fc700 0 client.4893 ms_handle_reset on v2:172.21.15.27:6833/3387103520 2023-07-05T23:33:30.185 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.170+0000 7f892dc0fb80 1 --2- 172.21.15.27:0/1706937400 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d67b6bf740 0x55d67b709000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:30.185 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.170+0000 7f892dc0fb80 1 --2- 172.21.15.27:0/1706937400 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d67b6c2270 0x55d67b6e5a50 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:30.185 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.170+0000 7f892dc0fb80 1 -- 172.21.15.27:0/1706937400 >> 172.21.15.27:0/1706937400 conn(0x55d67b6b6fc0 msgr2=0x55d67b70ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:30.186 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.170+0000 7f892dc0fb80 1 -- 172.21.15.27:0/1706937400 shutdown_connections 2023-07-05T23:33:30.186 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.170+0000 7f892dc0fb80 1 -- 172.21.15.27:0/1706937400 wait complete. 2023-07-05T23:33:30.186 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.170+0000 7f892dc0fb80 20 client.4893 trim_cache size 0 max 16384 2023-07-05T23:33:30.189 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.188+0000 7f892dc0fb80 1 Processor -- start 2023-07-05T23:33:30.190 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.188+0000 7f892dc0fb80 1 -- start start 2023-07-05T23:33:30.191 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.189+0000 7f892dc0fb80 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d67b6bf740 0x55d67b70abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:30.191 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.189+0000 7f892dc0fb80 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d67b6c2270 0x55d67b724540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:30.191 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.189+0000 7f892dc0fb80 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d67b6e8f00 0x55d67b724a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:30.191 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.189+0000 7f892dc0fb80 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d67b6c1000 con 0x55d67b6e8f00 2023-07-05T23:33:30.191 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.189+0000 7f892dc0fb80 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d67b6ece40 con 0x55d67b6c2270 2023-07-05T23:33:30.192 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.189+0000 7f892dc0fb80 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d67b6ed640 con 0x55d67b6bf740 2023-07-05T23:33:30.192 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.189+0000 7f891bfff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d67b6e8f00 0x55d67b724a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:30.192 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.189+0000 7f891bfff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d67b6e8f00 0x55d67b724a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45902/0 (socket says 172.21.15.27:45902) 2023-07-05T23:33:30.192 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.189+0000 7f891bfff700 1 -- 172.21.15.27:0/1775832285 learned_addr learned my addr 172.21.15.27:0/1775832285 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:30.192 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.189+0000 7f891affd700 1 --2- 172.21.15.27:0/1775832285 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d67b6c2270 0x55d67b724540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:30.192 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.189+0000 7f891b7fe700 1 --2- 172.21.15.27:0/1775832285 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d67b6bf740 0x55d67b70abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:30.192 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.189+0000 7f891bfff700 1 -- 172.21.15.27:0/1775832285 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d67b6bf740 msgr2=0x55d67b70abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:30.193 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.189+0000 7f891bfff700 1 --2- 172.21.15.27:0/1775832285 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d67b6bf740 0x55d67b70abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:30.193 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.189+0000 7f891bfff700 1 -- 172.21.15.27:0/1775832285 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d67b6c2270 msgr2=0x55d67b724540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:30.193 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.189+0000 7f891bfff700 1 --2- 172.21.15.27:0/1775832285 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d67b6c2270 0x55d67b724540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:30.193 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.189+0000 7f891bfff700 1 -- 172.21.15.27:0/1775832285 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d67b429c10 con 0x55d67b6e8f00 2023-07-05T23:33:30.193 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.189+0000 7f891affd700 1 --2- 172.21.15.27:0/1775832285 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d67b6c2270 0x55d67b724540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T23:33:30.193 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.189+0000 7f891bfff700 1 --2- 172.21.15.27:0/1775832285 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d67b6e8f00 0x55d67b724a80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8914002190 tx=0x7f8914001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0da1f711d269bd9 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:30.197 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.189+0000 7f8901ffb700 1 -- 172.21.15.27:0/1775832285 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8914005300 con 0x55d67b6e8f00 2023-07-05T23:33:30.197 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.189+0000 7f8901ffb700 1 -- 172.21.15.27:0/1775832285 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8914005460 con 0x55d67b6e8f00 2023-07-05T23:33:30.197 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.189+0000 7f8901ffb700 1 -- 172.21.15.27:0/1775832285 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89140057f0 con 0x55d67b6e8f00 2023-07-05T23:33:30.197 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.190+0000 7f892dc0fb80 1 -- 172.21.15.27:0/1775832285 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d67b6e8f00 msgr2=0x55d67b724a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:30.197 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.190+0000 7f892dc0fb80 1 --2- 172.21.15.27:0/1775832285 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d67b6e8f00 0x55d67b724a80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8914002190 tx=0x7f8914001a70 comp rx=0 tx=0).stop 2023-07-05T23:33:30.198 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.190+0000 7f892dc0fb80 1 -- 172.21.15.27:0/1775832285 shutdown_connections 2023-07-05T23:33:30.198 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.190+0000 7f892dc0fb80 1 --2- 172.21.15.27:0/1775832285 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d67b6e8f00 0x55d67b724a80 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:30.198 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.190+0000 7f892dc0fb80 1 --2- 172.21.15.27:0/1775832285 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d67b6bf740 0x55d67b70abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:30.198 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.190+0000 7f892dc0fb80 1 --2- 172.21.15.27:0/1775832285 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d67b6c2270 0x55d67b724540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:30.198 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.190+0000 7f892dc0fb80 1 -- 172.21.15.27:0/1775832285 >> 172.21.15.27:0/1775832285 conn(0x55d67b6b6fc0 msgr2=0x55d67b6bd250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:30.198 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.190+0000 7f892dc0fb80 1 -- 172.21.15.27:0/1775832285 shutdown_connections 2023-07-05T23:33:30.198 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.190+0000 7f892dc0fb80 1 -- 172.21.15.27:0/1775832285 wait complete. 2023-07-05T23:33:30.198 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.191+0000 7f892dc0fb80 1 -- start start 2023-07-05T23:33:30.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.191+0000 7f892dc0fb80 1 Processor -- start 2023-07-05T23:33:30.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.191+0000 7f892dc0fb80 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d67b6bf740 0x55d67b6e6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:30.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.191+0000 7f892dc0fb80 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d67b6c2270 0x55d67b6e6650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:30.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.191+0000 7f892dc0fb80 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d67b6e8f00 0x55d67b6e7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:30.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.191+0000 7f892dc0fb80 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d67b7238b0 con 0x55d67b6bf740 2023-07-05T23:33:30.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.191+0000 7f892dc0fb80 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d67b6e4de0 con 0x55d67b6c2270 2023-07-05T23:33:30.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.192+0000 7f892dc0fb80 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d67b7738d0 con 0x55d67b6e8f00 2023-07-05T23:33:30.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.192+0000 7f892dc0fb80 10 client.0 _ll_register_callbacks cb 0x7f8910059340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-05T23:33:30.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.192+0000 7f891b7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d67b6bf740 0x55d67b6e6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:30.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.192+0000 7f891b7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d67b6bf740 0x55d67b6e6110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45904/0 (socket says 172.21.15.27:45904) 2023-07-05T23:33:30.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.192+0000 7f891b7fe700 1 -- 172.21.15.27:0/1202823913 learned_addr learned my addr 172.21.15.27:0/1202823913 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:30.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.192+0000 7f891bfff700 1 --2- 172.21.15.27:0/1202823913 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d67b6e8f00 0x55d67b6e7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:30.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.192+0000 7f891affd700 1 --2- 172.21.15.27:0/1202823913 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d67b6c2270 0x55d67b6e6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:30.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.192+0000 7f891b7fe700 1 -- 172.21.15.27:0/1202823913 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d67b6e8f00 msgr2=0x55d67b6e7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:30.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.192+0000 7f891b7fe700 1 --2- 172.21.15.27:0/1202823913 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d67b6e8f00 0x55d67b6e7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:30.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.192+0000 7f891b7fe700 1 -- 172.21.15.27:0/1202823913 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d67b6c2270 msgr2=0x55d67b6e6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:30.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.192+0000 7f891b7fe700 1 --2- 172.21.15.27:0/1202823913 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d67b6c2270 0x55d67b6e6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:30.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.192+0000 7f891b7fe700 1 -- 172.21.15.27:0/1202823913 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f891400f040 con 0x55d67b6bf740 2023-07-05T23:33:30.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.192+0000 7f891affd700 1 --2- 172.21.15.27:0/1202823913 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d67b6c2270 0x55d67b6e6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T23:33:30.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.192+0000 7f891b7fe700 1 --2- 172.21.15.27:0/1202823913 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d67b6bf740 0x55d67b6e6110 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f890c011920 tx=0x7f890c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=383baacac9a5fca9 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:30.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.192+0000 7f88fa7fc700 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2023-07-05T23:33:30.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.192+0000 7f88fa7fc700 1 -- 172.21.15.27:0/1202823913 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f890c031040 con 0x55d67b6bf740 2023-07-05T23:33:30.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.192+0000 7f88fa7fc700 1 -- 172.21.15.27:0/1202823913 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f890c037530 con 0x55d67b6bf740 2023-07-05T23:33:30.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.192+0000 7f892dc0fb80 1 -- 172.21.15.27:0/1202823913 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f890c015920 con 0x55d67b6bf740 2023-07-05T23:33:30.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.192+0000 7f88fa7fc700 1 -- 172.21.15.27:0/1202823913 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f890c015b10 con 0x55d67b6bf740 2023-07-05T23:33:30.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.192+0000 7f892dc0fb80 10 client.4899 fetch_fsmap learned FSMap version 9 2023-07-05T23:33:30.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.192+0000 7f892dc0fb80 1 -- 172.21.15.27:0/1202823913 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55d67b467200 con 0x55d67b6bf740 2023-07-05T23:33:30.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.192+0000 7f88fa7fc700 1 -- 172.21.15.27:0/1202823913 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f890c015920 con 0x55d67b6bf740 2023-07-05T23:33:30.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.193+0000 7f88fa7fc700 1 -- 172.21.15.27:0/1202823913 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 9) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f890c015c70 con 0x55d67b6bf740 2023-07-05T23:33:30.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.193+0000 7f892dc0fb80 10 client.4899 fetch_fsmap finished waiting for FSMap version 9 2023-07-05T23:33:30.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.193+0000 7f892dc0fb80 10 client.4899 resolve_mds: resolved name 'a' to daemon mds.a 2023-07-05T23:33:30.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.193+0000 7f892dc0fb80 20 client.4899 populate_metadata read hostname 'smithi027' 2023-07-05T23:33:30.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.193+0000 7f892dc0fb80 1 --2- 172.21.15.27:0/1202823913 >> [v2:172.21.15.27:6833/3387103520,v1:172.21.15.27:6835/3387103520] conn(0x55d67b6e7fa0 0x55d67b771f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:30.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.193+0000 7f892dc0fb80 4 client.4899 mds_command: new command op to 4293 tid=0[{"prefix": "status"}] 2023-07-05T23:33:30.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.193+0000 7f892dc0fb80 1 -- 172.21.15.27:0/1202823913 --> [v2:172.21.15.27:6833/3387103520,v1:172.21.15.27:6835/3387103520] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d67b5ce000 con 0x55d67b6e7fa0 2023-07-05T23:33:30.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.193+0000 7f891affd700 1 --2- 172.21.15.27:0/1202823913 >> [v2:172.21.15.27:6833/3387103520,v1:172.21.15.27:6835/3387103520] conn(0x55d67b6e7fa0 0x55d67b771f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:30.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.193+0000 7f88fa7fc700 10 client.4899 ms_handle_connect on v2:172.21.15.27:6833/3387103520 2023-07-05T23:33:30.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.193+0000 7f891affd700 1 --2- 172.21.15.27:0/1202823913 >> [v2:172.21.15.27:6833/3387103520,v1:172.21.15.27:6835/3387103520] conn(0x55d67b6e7fa0 0x55d67b771f20 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78f0a5c49a653c99 server_cookie=47f7f5303025c04b in_seq=0 out_seq=0 2023-07-05T23:33:30.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.193+0000 7f88fa7fc700 1 -- 172.21.15.27:0/1202823913 <== mds.0 v2:172.21.15.27:6833/3387103520 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55d67b5ce000 con 0x55d67b6e7fa0 2023-07-05T23:33:30.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.193+0000 7f88fa7fc700 10 client.4899 handle_command_reply: tid=0 2023-07-05T23:33:30.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.193+0000 7f892dc0fb80 1 client.4899 shutdown 2023-07-05T23:33:30.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.193+0000 7f892dc0fb80 1 -- 172.21.15.27:0/1202823913 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d67b6bf740 msgr2=0x55d67b6e6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:30.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.193+0000 7f892dc0fb80 1 --2- 172.21.15.27:0/1202823913 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d67b6bf740 0x55d67b6e6110 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f890c011920 tx=0x7f890c018000 comp rx=0 tx=0).stop 2023-07-05T23:33:30.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.193+0000 7f892dc0fb80 1 -- 172.21.15.27:0/1202823913 shutdown_connections 2023-07-05T23:33:30.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.193+0000 7f892dc0fb80 1 --2- 172.21.15.27:0/1202823913 >> [v2:172.21.15.27:6833/3387103520,v1:172.21.15.27:6835/3387103520] conn(0x55d67b6e7fa0 0x55d67b771f20 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:30.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.193+0000 7f892dc0fb80 1 --2- 172.21.15.27:0/1202823913 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d67b6e8f00 0x55d67b6e7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:30.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.193+0000 7f892dc0fb80 1 --2- 172.21.15.27:0/1202823913 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d67b6bf740 0x55d67b6e6110 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:30.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.193+0000 7f88fa7fc700 0 client.4899 ms_handle_reset on v2:172.21.15.27:6833/3387103520 2023-07-05T23:33:30.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.193+0000 7f892dc0fb80 1 --2- 172.21.15.27:0/1202823913 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d67b6c2270 0x55d67b6e6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:30.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.193+0000 7f892dc0fb80 1 -- 172.21.15.27:0/1202823913 >> 172.21.15.27:0/1202823913 conn(0x55d67b6b6fc0 msgr2=0x55d67b6be5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:30.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.193+0000 7f892dc0fb80 1 -- 172.21.15.27:0/1202823913 shutdown_connections 2023-07-05T23:33:30.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.193+0000 7f892dc0fb80 1 -- 172.21.15.27:0/1202823913 wait complete. 2023-07-05T23:33:30.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.194+0000 7f892dc0fb80 20 client.4899 trim_cache size 0 max 16384 2023-07-05T23:33:30.206 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2023-07-05T23:33:30.206 INFO:teuthology.orchestra.run.smithi027.stdout: "cluster_fsid": "23eebe48-65f5-4d3c-8c2d-4aa171c055d5", 2023-07-05T23:33:30.206 INFO:teuthology.orchestra.run.smithi027.stdout: "whoami": 0, 2023-07-05T23:33:30.206 INFO:teuthology.orchestra.run.smithi027.stdout: "id": 4293, 2023-07-05T23:33:30.206 INFO:teuthology.orchestra.run.smithi027.stdout: "want_state": "up:active", 2023-07-05T23:33:30.207 INFO:teuthology.orchestra.run.smithi027.stdout: "state": "up:active", 2023-07-05T23:33:30.207 INFO:teuthology.orchestra.run.smithi027.stdout: "fs_name": "cephfs", 2023-07-05T23:33:30.207 INFO:teuthology.orchestra.run.smithi027.stdout: "rank_uptime": 36.877935635999997, 2023-07-05T23:33:30.207 INFO:teuthology.orchestra.run.smithi027.stdout: "mdsmap_epoch": 9, 2023-07-05T23:33:30.207 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_epoch": 28, 2023-07-05T23:33:30.207 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_epoch_barrier": 28, 2023-07-05T23:33:30.207 INFO:teuthology.orchestra.run.smithi027.stdout: "uptime": 42.323468550999998 2023-07-05T23:33:30.207 INFO:teuthology.orchestra.run.smithi027.stdout:} 2023-07-05T23:33:30.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.194+0000 7f8921a8a700 1 -- 172.21.15.27:0/2148861247 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f890806ace0 msgr2=0x7f890806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:30.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.194+0000 7f8921a8a700 1 --2- 172.21.15.27:0/2148861247 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f890806ace0 0x7f890806d190 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f891c0c4440 tx=0x7f890c008040 comp rx=0 tx=0).stop 2023-07-05T23:33:30.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.194+0000 7f8921a8a700 1 -- 172.21.15.27:0/2148861247 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f891c0d05d0 msgr2=0x7f891c0b4c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:30.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.194+0000 7f8921a8a700 1 --2- 172.21.15.27:0/2148861247 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f891c0d05d0 0x7f891c0b4c30 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8910000c00 tx=0x7f8910004750 comp rx=0 tx=0).stop 2023-07-05T23:33:30.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.194+0000 7f8921a8a700 1 -- 172.21.15.27:0/2148861247 shutdown_connections 2023-07-05T23:33:30.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.194+0000 7f8921a8a700 1 --2- 172.21.15.27:0/2148861247 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f891c0ceab0 0x7f891c155cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:30.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.194+0000 7f8921a8a700 1 --2- 172.21.15.27:0/2148861247 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f890806ace0 0x7f890806d190 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:30.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.194+0000 7f8921a8a700 1 --2- 172.21.15.27:0/2148861247 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f891c15a640 0x7f891c156420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:30.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.194+0000 7f8921a8a700 1 --2- 172.21.15.27:0/2148861247 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f891c0d05d0 0x7f891c0b4c30 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:30.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.194+0000 7f8921a8a700 1 -- 172.21.15.27:0/2148861247 >> 172.21.15.27:0/2148861247 conn(0x7f891c089fe0 msgr2=0x7f891c1585d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:30.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.194+0000 7f8921a8a700 1 -- 172.21.15.27:0/2148861247 shutdown_connections 2023-07-05T23:33:30.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.194+0000 7f8921a8a700 1 -- 172.21.15.27:0/2148861247 wait complete. 2023-07-05T23:33:30.211 INFO:teuthology.run_tasks:Running task kclient... 2023-07-05T23:33:30.224 INFO:tasks.kclient:Mounting kernel clients... 2023-07-05T23:33:30.224 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-07-05T23:33:30.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:30.225 DEBUG:teuthology.orchestra.run.smithi027:> ip netns list 2023-07-05T23:33:30.242 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-07-05T23:33:30.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:30.243 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-07-05T23:33:30.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:30.327 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link delete ceph-brx 2023-07-05T23:33:30.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:30.430 DEBUG:teuthology.orchestra.run.smithi027:> ip netns list 2023-07-05T23:33:30.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:30.448 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link delete ceph-brx 2023-07-05T23:33:30.519 INFO:teuthology.orchestra.run.smithi027.stderr:Cannot find device "ceph-brx" 2023-07-05T23:33:30.520 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-05T23:33:30.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:30.521 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2023-07-05T23:33:30.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:30.543 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link delete ceph-brx 2023-07-05T23:33:30.617 INFO:teuthology.orchestra.run.smithi162.stderr:Cannot find device "ceph-brx" 2023-07-05T23:33:30.619 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-05T23:33:30.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:30.620 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2023-07-05T23:33:30.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:30.680 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link delete ceph-brx 2023-07-05T23:33:30.750 INFO:teuthology.orchestra.run.smithi162.stderr:Cannot find device "ceph-brx" 2023-07-05T23:33:30.751 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-05T23:33:30.752 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-07-05T23:33:30.752 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-05T23:33:30.753 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-05T23:33:30.753 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-05T23:33:30.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.878+0000 7f66169e1700 1 Processor -- start 2023-07-05T23:33:30.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.878+0000 7f66169e1700 1 -- start start 2023-07-05T23:33:30.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.879+0000 7f66169e1700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f661006a600 0x7f66100c9df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:30.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.879+0000 7f66169e1700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66100b08d0 0x7f66100ca330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:30.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.879+0000 7f66169e1700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66100cf2a0 con 0x7f661015c420 2023-07-05T23:33:30.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.879+0000 7f66169e1700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66100ce690 con 0x7f661006a600 2023-07-05T23:33:30.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.879+0000 7f66169e1700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66100ce970 con 0x7f66100b08d0 2023-07-05T23:33:30.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.879+0000 7f660f7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f661006a600 0x7f66100c9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:30.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.879+0000 7f660f7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f661006a600 0x7f66100c9df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45912/0 (socket says 172.21.15.27:45912) 2023-07-05T23:33:30.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.879+0000 7f660f7fe700 1 -- 172.21.15.27:0/2692695401 learned_addr learned my addr 172.21.15.27:0/2692695401 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:30.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.879+0000 7f6614f7e700 1 --2- 172.21.15.27:0/2692695401 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66100b08d0 0x7f66100ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:30.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.879+0000 7f660f7fe700 1 -- 172.21.15.27:0/2692695401 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66100b08d0 msgr2=0x7f66100ca330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:30.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.879+0000 7f660f7fe700 1 --2- 172.21.15.27:0/2692695401 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66100b08d0 0x7f66100ca330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:30.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.879+0000 7f660f7fe700 1 -- 172.21.15.27:0/2692695401 >> v1:172.21.15.162:6789/0 conn(0x7f661015c420 legacy=0x7f6610069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:30.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.879+0000 7f660f7fe700 1 -- 172.21.15.27:0/2692695401 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66100cec50 con 0x7f661006a600 2023-07-05T23:33:30.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.880+0000 7f660f7fe700 1 --2- 172.21.15.27:0/2692695401 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f661006a600 0x7f66100c9df0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f66040098f0 tx=0x7f6604009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0ccde8291186f7a server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:30.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.880+0000 7f660effd700 1 -- 172.21.15.27:0/2692695401 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6604011830 con 0x7f661006a600 2023-07-05T23:33:30.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.880+0000 7f660effd700 1 -- 172.21.15.27:0/2692695401 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6604011990 con 0x7f661006a600 2023-07-05T23:33:30.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.880+0000 7f660effd700 1 -- 172.21.15.27:0/2692695401 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6604011d20 con 0x7f661006a600 2023-07-05T23:33:30.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.880+0000 7f66169e1700 1 -- 172.21.15.27:0/2692695401 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f661006a600 msgr2=0x7f66100c9df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:30.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.880+0000 7f66169e1700 1 --2- 172.21.15.27:0/2692695401 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f661006a600 0x7f66100c9df0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f66040098f0 tx=0x7f6604009c00 comp rx=0 tx=0).stop 2023-07-05T23:33:30.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.880+0000 7f66169e1700 1 -- 172.21.15.27:0/2692695401 shutdown_connections 2023-07-05T23:33:30.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.880+0000 7f66169e1700 1 --2- 172.21.15.27:0/2692695401 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66100b08d0 0x7f66100ca330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:30.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.880+0000 7f66169e1700 1 --2- 172.21.15.27:0/2692695401 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f661006a600 0x7f66100c9df0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:30.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.880+0000 7f66169e1700 1 -- 172.21.15.27:0/2692695401 >> 172.21.15.27:0/2692695401 conn(0x7f661006b920 msgr2=0x7f66100cf7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:30.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.880+0000 7f66169e1700 1 -- 172.21.15.27:0/2692695401 shutdown_connections 2023-07-05T23:33:30.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.880+0000 7f66169e1700 1 -- 172.21.15.27:0/2692695401 wait complete. 2023-07-05T23:33:30.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.882+0000 7f66169e1700 1 Processor -- start 2023-07-05T23:33:30.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.882+0000 7f66169e1700 1 -- start start 2023-07-05T23:33:30.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.883+0000 7f66169e1700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f661006a600 0x7f661015f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:30.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.883+0000 7f66169e1700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f66100b08d0 0x7f661015e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:30.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.883+0000 7f66169e1700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f661015c420 0x7f66100adc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:30.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.883+0000 7f66169e1700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66100ac490 con 0x7f66100b08d0 2023-07-05T23:33:30.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.883+0000 7f66169e1700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f661015fef0 con 0x7f661006a600 2023-07-05T23:33:30.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.883+0000 7f66169e1700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f661015e9f0 con 0x7f661015c420 2023-07-05T23:33:30.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.883+0000 7f660f7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f66100b08d0 0x7f661015e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:30.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.883+0000 7f660f7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f66100b08d0 0x7f661015e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45920/0 (socket says 172.21.15.27:45920) 2023-07-05T23:33:30.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.883+0000 7f660f7fe700 1 -- 172.21.15.27:0/3555268333 learned_addr learned my addr 172.21.15.27:0/3555268333 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:30.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.883+0000 7f6614f7e700 1 --2- 172.21.15.27:0/3555268333 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f661015c420 0x7f66100adc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:30.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.883+0000 7f660ffff700 1 --2- 172.21.15.27:0/3555268333 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f661006a600 0x7f661015f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:30.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.883+0000 7f660f7fe700 1 -- 172.21.15.27:0/3555268333 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f661015c420 msgr2=0x7f66100adc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:30.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.883+0000 7f660f7fe700 1 --2- 172.21.15.27:0/3555268333 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f661015c420 0x7f66100adc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:30.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.883+0000 7f660f7fe700 1 -- 172.21.15.27:0/3555268333 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f661006a600 msgr2=0x7f661015f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:30.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.883+0000 7f660f7fe700 1 --2- 172.21.15.27:0/3555268333 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f661006a600 0x7f661015f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:30.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.883+0000 7f660f7fe700 1 -- 172.21.15.27:0/3555268333 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6604009550 con 0x7f66100b08d0 2023-07-05T23:33:30.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.883+0000 7f660f7fe700 1 --2- 172.21.15.27:0/3555268333 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f66100b08d0 0x7f661015e4b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6604014040 tx=0x7f6604004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:30.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.883+0000 7f660cff9700 1 -- 172.21.15.27:0/3555268333 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6604004510 con 0x7f66100b08d0 2023-07-05T23:33:30.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.883+0000 7f660cff9700 1 -- 172.21.15.27:0/3555268333 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f660401e070 con 0x7f66100b08d0 2023-07-05T23:33:30.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.883+0000 7f660cff9700 1 -- 172.21.15.27:0/3555268333 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66040038e0 con 0x7f66100b08d0 2023-07-05T23:33:30.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.883+0000 7f66169e1700 1 -- 172.21.15.27:0/3555268333 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66100ac6e0 con 0x7f66100b08d0 2023-07-05T23:33:30.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.883+0000 7f66169e1700 1 -- 172.21.15.27:0/3555268333 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66100acca0 con 0x7f66100b08d0 2023-07-05T23:33:30.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.884+0000 7f66169e1700 1 -- 172.21.15.27:0/3555268333 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6610073910 con 0x7f66100b08d0 2023-07-05T23:33:30.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.885+0000 7f660cff9700 1 -- 172.21.15.27:0/3555268333 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6604003a40 con 0x7f66100b08d0 2023-07-05T23:33:30.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.885+0000 7f660cff9700 1 --2- 172.21.15.27:0/3555268333 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f65fc06ace0 0x7f65fc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:30.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.885+0000 7f660cff9700 1 -- 172.21.15.27:0/3555268333 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f660408a4d0 con 0x7f66100b08d0 2023-07-05T23:33:30.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.885+0000 7f660ffff700 1 --2- 172.21.15.27:0/3555268333 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f65fc06ace0 0x7f65fc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:30.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.886+0000 7f660ffff700 1 --2- 172.21.15.27:0/3555268333 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f65fc06ace0 0x7f65fc06d190 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6600007fd0 tx=0x7f6600009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:30.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:30.890+0000 7f660cff9700 1 -- 172.21.15.27:0/3555268333 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6604055320 con 0x7f66100b08d0 2023-07-05T23:33:31.133 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:31.131+0000 7f66169e1700 1 -- 172.21.15.27:0/3555268333 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f66100ccc40 con 0x7f66100b08d0 2023-07-05T23:33:31.133 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:31.131+0000 7f660cff9700 1 -- 172.21.15.27:0/3555268333 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f6604058940 con 0x7f66100b08d0 2023-07-05T23:33:31.134 INFO:teuthology.orchestra.run.smithi027.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-07-05T23:33:31.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:31.133+0000 7f66169e1700 1 -- 172.21.15.27:0/3555268333 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f65fc06ace0 msgr2=0x7f65fc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:31.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:31.133+0000 7f66169e1700 1 --2- 172.21.15.27:0/3555268333 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f65fc06ace0 0x7f65fc06d190 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6600007fd0 tx=0x7f6600009040 comp rx=0 tx=0).stop 2023-07-05T23:33:31.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:31.133+0000 7f66169e1700 1 -- 172.21.15.27:0/3555268333 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f66100b08d0 msgr2=0x7f661015e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:31.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:31.133+0000 7f66169e1700 1 --2- 172.21.15.27:0/3555268333 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f66100b08d0 0x7f661015e4b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6604014040 tx=0x7f6604004750 comp rx=0 tx=0).stop 2023-07-05T23:33:31.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:31.134+0000 7f66169e1700 1 -- 172.21.15.27:0/3555268333 shutdown_connections 2023-07-05T23:33:31.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:31.134+0000 7f66169e1700 1 --2- 172.21.15.27:0/3555268333 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f661006a600 0x7f661015f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:31.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:31.134+0000 7f66169e1700 1 --2- 172.21.15.27:0/3555268333 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f65fc06ace0 0x7f65fc06d190 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:31.137 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:31.134+0000 7f66169e1700 1 --2- 172.21.15.27:0/3555268333 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f661015c420 0x7f66100adc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:31.137 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:31.134+0000 7f66169e1700 1 --2- 172.21.15.27:0/3555268333 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f66100b08d0 0x7f661015e4b0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:31.137 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:31.134+0000 7f66169e1700 1 -- 172.21.15.27:0/3555268333 >> 172.21.15.27:0/3555268333 conn(0x7f661006b920 msgr2=0x7f661006ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:31.137 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:31.134+0000 7f66169e1700 1 -- 172.21.15.27:0/3555268333 shutdown_connections 2023-07-05T23:33:31.137 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:31.134+0000 7f66169e1700 1 -- 172.21.15.27:0/3555268333 wait complete. 2023-07-05T23:33:31.148 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-05T23:33:31.148 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-05T23:33:31.148 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi027.front.sepia.ceph.com 2023-07-05T23:33:31.149 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-05T23:33:31.149 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-05T23:33:31.149 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-05T23:33:31.150 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-05T23:33:31.150 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-05T23:33:31.150 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-05T23:33:31.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:31.151 DEBUG:teuthology.orchestra.run.smithi027:> ip addr 2023-07-05T23:33:31.168 INFO:teuthology.orchestra.run.smithi027.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-05T23:33:31.169 INFO:teuthology.orchestra.run.smithi027.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-05T23:33:31.169 INFO:teuthology.orchestra.run.smithi027.stdout: inet 127.0.0.1/8 scope host lo 2023-07-05T23:33:31.169 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-07-05T23:33:31.169 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 ::1/128 scope host 2023-07-05T23:33:31.169 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-07-05T23:33:31.170 INFO:teuthology.orchestra.run.smithi027.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-05T23:33:31.170 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 0c:c4:7a:6b:fe:c8 brd ff:ff:ff:ff:ff:ff 2023-07-05T23:33:31.170 INFO:teuthology.orchestra.run.smithi027.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-05T23:33:31.170 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether ac:1f:6b:f8:39:5a brd ff:ff:ff:ff:ff:ff 2023-07-05T23:33:31.170 INFO:teuthology.orchestra.run.smithi027.stdout: inet 172.21.15.27/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-07-05T23:33:31.170 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft 42371sec preferred_lft 42371sec 2023-07-05T23:33:31.170 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::ae1f:6bff:fef8:395a/64 scope link 2023-07-05T23:33:31.170 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-07-05T23:33:31.171 INFO:teuthology.orchestra.run.smithi027.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-05T23:33:31.171 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 0c:c4:7a:6b:fe:c9 brd ff:ff:ff:ff:ff:ff 2023-07-05T23:33:31.171 INFO:teuthology.orchestra.run.smithi027.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-05T23:33:31.171 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether ac:1f:6b:f8:39:5b brd ff:ff:ff:ff:ff:ff 2023-07-05T23:33:31.171 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-07-05T23:33:31.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:31.172 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec bash -c ' 2023-07-05T23:33:31.172 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2023-07-05T23:33:31.172 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link add name ceph-brx type bridge 2023-07-05T23:33:31.173 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip addr flush dev ceph-brx 2023-07-05T23:33:31.173 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link set ceph-brx up 2023-07-05T23:33:31.173 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-07-05T23:33:31.173 DEBUG:teuthology.orchestra.run.smithi027:> ') 2023-07-05T23:33:31.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:31.288 DEBUG:teuthology.orchestra.run.smithi027:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-05T23:33:31.314 INFO:teuthology.orchestra.run.smithi027.stdout:1 2023-07-05T23:33:31.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:31.316 DEBUG:teuthology.orchestra.run.smithi027:> route 2023-07-05T23:33:31.375 INFO:teuthology.orchestra.run.smithi027.stdout:Kernel IP routing table 2023-07-05T23:33:31.375 INFO:teuthology.orchestra.run.smithi027.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-05T23:33:31.375 INFO:teuthology.orchestra.run.smithi027.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-07-05T23:33:31.375 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-07-05T23:33:31.376 INFO:teuthology.orchestra.run.smithi027.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-05T23:33:31.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:31.376 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec bash -c ' 2023-07-05T23:33:31.377 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2023-07-05T23:33:31.377 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-05T23:33:31.377 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-05T23:33:31.377 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-05T23:33:31.378 DEBUG:teuthology.orchestra.run.smithi027:> ') 2023-07-05T23:33:31.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:31.482 DEBUG:teuthology.orchestra.run.smithi027:> ip netns list 2023-07-05T23:33:31.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:31.500 DEBUG:teuthology.orchestra.run.smithi027:> ip netns list-id 2023-07-05T23:33:31.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:31.557 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec bash -c ' 2023-07-05T23:33:31.557 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2023-07-05T23:33:31.557 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-05T23:33:31.558 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-07-05T23:33:31.558 DEBUG:teuthology.orchestra.run.smithi027:> ') 2023-07-05T23:33:31.652 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-07-05T23:33:31.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:31.653 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec bash -c ' 2023-07-05T23:33:31.653 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2023-07-05T23:33:31.653 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-07-05T23:33:31.654 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-07-05T23:33:31.654 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-07-05T23:33:31.654 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-07-05T23:33:31.655 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-07-05T23:33:31.655 DEBUG:teuthology.orchestra.run.smithi027:> ') 2023-07-05T23:33:31.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:31.878 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec bash -c ' 2023-07-05T23:33:31.878 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2023-07-05T23:33:31.879 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link set brx.0 up 2023-07-05T23:33:31.879 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link set dev brx.0 master ceph-brx 2023-07-05T23:33:31.879 DEBUG:teuthology.orchestra.run.smithi027:> ') 2023-07-05T23:33:31.988 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-05T23:33:31.990 DEBUG:teuthology.orchestra.run.smithi027:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-05T23:33:32.010 INFO:teuthology.orchestra.run.smithi027.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-05T23:33:32.011 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-05T23:33:32.011 DEBUG:teuthology.orchestra.run.smithi027:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-05T23:33:32.067 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-07-05T23:33:32.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:32.068 DEBUG:teuthology.orchestra.run.smithi027:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-05T23:33:32.154 INFO:teuthology.orchestra.run.smithi027.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-05T23:33:32.155 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-05T23:33:32.291 INFO:teuthology.orchestra.run.smithi027.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-05T23:33:32.291 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-05T23:33:32.292 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: resolved to: "172.21.15.27:3300,172.21.15.162:3300,172.21.15.162:3301" 2023-07-05T23:33:32.292 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: trying mount with new device syntax: 0@23eebe48-65f5-4d3c-8c2d-4aa171c055d5.cephfs=/ 2023-07-05T23:33:32.292 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.27:3300/172.21.15.162:3300/172.21.15.162:3301" will pass to kernel 2023-07-05T23:33:32.292 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: v2 mount support check returned 2 2023-07-05T23:33:32.292 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: kernel does not support v2 syntax 2023-07-05T23:33:32.292 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-05T23:33:32.319 INFO:teuthology.orchestra.run.smithi027.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-05T23:33:32.319 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-05T23:33:32.319 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: resolved to: "172.21.15.27:3300,172.21.15.162:3300,172.21.15.162:3301" 2023-07-05T23:33:32.319 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: trying mount with new device syntax: 0@23eebe48-65f5-4d3c-8c2d-4aa171c055d5.cephfs=/ 2023-07-05T23:33:32.319 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.27:3300/172.21.15.162:3300/172.21.15.162:3301" will pass to kernel 2023-07-05T23:33:32.320 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: v2 mount support check returned 2 2023-07-05T23:33:32.320 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: kernel does not support v2 syntax 2023-07-05T23:33:32.320 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-05T23:33:32.320 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: resolved to: "172.21.15.27:6789,172.21.15.162:6789,172.21.15.162:6790" 2023-07-05T23:33:32.320 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.27:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2023-07-05T23:33:32.320 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=23eebe48-65f5-4d3c-8c2d-4aa171c055d5" will pass to kernel 2023-07-05T23:33:32.323 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-05T23:33:32.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:32.324 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-05T23:33:32.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:32.355 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-05T23:33:32.427 INFO:teuthology.orchestra.run.smithi027.stdout:client4908 2023-07-05T23:33:32.428 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-07-05T23:33:32.428 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-05T23:33:32.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:32.486 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-05T23:33:32.558 INFO:teuthology.orchestra.run.smithi027.stdout:client4908 2023-07-05T23:33:32.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:32.560 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-05T23:33:32.632 INFO:teuthology.orchestra.run.smithi027.stdout:client4908 2023-07-05T23:33:32.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:32.633 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/23eebe48-65f5-4d3c-8c2d-4aa171c055d5.client4908/status') 2023-07-05T23:33:32.713 INFO:teuthology.orchestra.run.smithi027.stdout:instance: client.4908 (3)192.168.0.1:0/493794350 2023-07-05T23:33:32.713 INFO:teuthology.orchestra.run.smithi027.stdout:blocklisted: false 2023-07-05T23:33:32.713 INFO:teuthology.orchestra.run.smithi027.stderr:0+1 records in 2023-07-05T23:33:32.714 INFO:teuthology.orchestra.run.smithi027.stderr:0+1 records out 2023-07-05T23:33:32.714 INFO:teuthology.orchestra.run.smithi027.stderr:68 bytes copied, 2.6803e-05 s, 2.5 MB/s 2023-07-05T23:33:32.715 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2023-07-05T23:33:32.715 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-05T23:33:32.715 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-07-05T23:33:32.716 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-05T23:33:32.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:32.877+0000 7fbc65953700 1 Processor -- start 2023-07-05T23:33:32.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:32.877+0000 7fbc65953700 1 -- start start 2023-07-05T23:33:32.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:32.878+0000 7fbc65953700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fbc6015c570 0x7fbc600cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:32.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:32.878+0000 7fbc65953700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc60160a50 0x7fbc600d0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:32.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:32.878+0000 7fbc65953700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc601610a0 con 0x7fbc600cd660 2023-07-05T23:33:32.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:32.878+0000 7fbc65953700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc6015d670 con 0x7fbc6015c570 2023-07-05T23:33:32.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:32.878+0000 7fbc65953700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc60160eb0 con 0x7fbc60160a50 2023-07-05T23:33:32.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:32.878+0000 7fbc5effd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fbc6015c570 0x7fbc600cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:32.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:32.878+0000 7fbc5e7fc700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fbc600cd660 0x7fbc60160340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:53100/0 (socket says 172.21.15.27:53100) 2023-07-05T23:33:32.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:32.878+0000 7fbc5e7fc700 1 -- 172.21.15.27:0/192554179 learned_addr learned my addr 172.21.15.27:0/192554179 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-07-05T23:33:32.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:32.878+0000 7fbc5f7fe700 1 --2- 172.21.15.27:0/192554179 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc60160a50 0x7fbc600d0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:32.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:32.878+0000 7fbc5dffb700 1 -- 172.21.15.27:0/192554179 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 784537153 0 0) 0x7fbc601610a0 con 0x7fbc600cd660 2023-07-05T23:33:32.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:32.878+0000 7fbc5effd700 1 -- 172.21.15.27:0/192554179 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc60160a50 msgr2=0x7fbc600d0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:32.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:32.878+0000 7fbc5effd700 1 --2- 172.21.15.27:0/192554179 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc60160a50 0x7fbc600d0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:32.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:32.878+0000 7fbc5effd700 1 -- 172.21.15.27:0/192554179 >> v1:172.21.15.27:6789/0 conn(0x7fbc600cd660 legacy=0x7fbc60160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:32.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:32.878+0000 7fbc5effd700 1 -- 172.21.15.27:0/192554179 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc6015da90 con 0x7fbc6015c570 2023-07-05T23:33:32.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:32.878+0000 7fbc5effd700 1 --2- 172.21.15.27:0/192554179 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbc6015c570 0x7fbc600cd120 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fbc50009870 tx=0x7fbc50009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1b24152f4f7d2fd server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:32.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:32.878+0000 7fbc5dffb700 1 -- 172.21.15.27:0/192554179 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc50011830 con 0x7fbc6015c570 2023-07-05T23:33:32.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:32.878+0000 7fbc5dffb700 1 -- 172.21.15.27:0/192554179 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc50011990 con 0x7fbc6015c570 2023-07-05T23:33:32.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:32.878+0000 7fbc5dffb700 1 -- 172.21.15.27:0/192554179 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc50011d20 con 0x7fbc6015c570 2023-07-05T23:33:32.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:32.879+0000 7fbc65953700 1 -- 172.21.15.27:0/192554179 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbc6015c570 msgr2=0x7fbc600cd120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:32.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:32.879+0000 7fbc65953700 1 --2- 172.21.15.27:0/192554179 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbc6015c570 0x7fbc600cd120 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fbc50009870 tx=0x7fbc50009b80 comp rx=0 tx=0).stop 2023-07-05T23:33:32.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:32.879+0000 7fbc65953700 1 -- 172.21.15.27:0/192554179 shutdown_connections 2023-07-05T23:33:32.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:32.879+0000 7fbc65953700 1 --2- 172.21.15.27:0/192554179 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc60160a50 0x7fbc600d0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:32.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:32.879+0000 7fbc65953700 1 --2- 172.21.15.27:0/192554179 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbc6015c570 0x7fbc600cd120 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:32.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:32.879+0000 7fbc65953700 1 -- 172.21.15.27:0/192554179 >> 172.21.15.27:0/192554179 conn(0x7fbc60071620 msgr2=0x7fbc600719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:32.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:32.879+0000 7fbc65953700 1 -- 172.21.15.27:0/192554179 shutdown_connections 2023-07-05T23:33:32.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:32.879+0000 7fbc65953700 1 -- 172.21.15.27:0/192554179 wait complete. 2023-07-05T23:33:32.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:32.880+0000 7fbc65953700 1 Processor -- start 2023-07-05T23:33:32.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:32.881+0000 7fbc65953700 1 -- start start 2023-07-05T23:33:32.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:32.881+0000 7fbc65953700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc600cd660 0x7fbc60149520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:32.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:32.881+0000 7fbc65953700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc6015c570 0x7fbc600b25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:32.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:32.881+0000 7fbc65953700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbc60160a50 0x7fbc600b4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:32.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:32.881+0000 7fbc65953700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc600b2b00 con 0x7fbc60160a50 2023-07-05T23:33:32.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:32.881+0000 7fbc65953700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc600b2dd0 con 0x7fbc6015c570 2023-07-05T23:33:32.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:32.881+0000 7fbc65953700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc600b30b0 con 0x7fbc600cd660 2023-07-05T23:33:32.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:32.881+0000 7fbc5f7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbc60160a50 0x7fbc600b4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:32.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:32.881+0000 7fbc5f7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbc60160a50 0x7fbc600b4310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45940/0 (socket says 172.21.15.27:45940) 2023-07-05T23:33:32.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:32.881+0000 7fbc5f7fe700 1 -- 172.21.15.27:0/1948287114 learned_addr learned my addr 172.21.15.27:0/1948287114 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:32.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:32.881+0000 7fbc5effd700 1 --2- 172.21.15.27:0/1948287114 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc600cd660 0x7fbc60149520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:32.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:32.881+0000 7fbc5e7fc700 1 --2- 172.21.15.27:0/1948287114 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc6015c570 0x7fbc600b25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:32.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:32.882+0000 7fbc5f7fe700 1 -- 172.21.15.27:0/1948287114 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc600cd660 msgr2=0x7fbc60149520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:32.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:32.882+0000 7fbc5f7fe700 1 --2- 172.21.15.27:0/1948287114 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc600cd660 0x7fbc60149520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:32.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:32.882+0000 7fbc5f7fe700 1 -- 172.21.15.27:0/1948287114 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc6015c570 msgr2=0x7fbc600b25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:32.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:32.882+0000 7fbc5f7fe700 1 --2- 172.21.15.27:0/1948287114 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc6015c570 0x7fbc600b25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:32.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:32.882+0000 7fbc5f7fe700 1 -- 172.21.15.27:0/1948287114 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc500094a0 con 0x7fbc60160a50 2023-07-05T23:33:32.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:32.882+0000 7fbc5e7fc700 1 --2- 172.21.15.27:0/1948287114 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc6015c570 0x7fbc600b25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T23:33:32.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:32.882+0000 7fbc5f7fe700 1 --2- 172.21.15.27:0/1948287114 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbc60160a50 0x7fbc600b4310 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fbc5800efc0 tx=0x7fbc5800c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:32.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:32.882+0000 7fbc47fff700 1 -- 172.21.15.27:0/1948287114 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5800cb80 con 0x7fbc60160a50 2023-07-05T23:33:32.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:32.882+0000 7fbc47fff700 1 -- 172.21.15.27:0/1948287114 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc5800f040 con 0x7fbc60160a50 2023-07-05T23:33:32.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:32.882+0000 7fbc65953700 1 -- 172.21.15.27:0/1948287114 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc600b3390 con 0x7fbc60160a50 2023-07-05T23:33:32.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:32.882+0000 7fbc47fff700 1 -- 172.21.15.27:0/1948287114 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc58014480 con 0x7fbc60160a50 2023-07-05T23:33:32.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:32.882+0000 7fbc65953700 1 -- 172.21.15.27:0/1948287114 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc600b3df0 con 0x7fbc60160a50 2023-07-05T23:33:32.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:32.883+0000 7fbc65953700 1 -- 172.21.15.27:0/1948287114 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc60073910 con 0x7fbc60160a50 2023-07-05T23:33:32.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:32.883+0000 7fbc47fff700 1 -- 172.21.15.27:0/1948287114 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbc580145e0 con 0x7fbc60160a50 2023-07-05T23:33:32.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:32.884+0000 7fbc47fff700 1 --2- 172.21.15.27:0/1948287114 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fbc4c06ace0 0x7fbc4c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:32.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:32.884+0000 7fbc47fff700 1 -- 172.21.15.27:0/1948287114 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbc58089f30 con 0x7fbc60160a50 2023-07-05T23:33:32.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:32.884+0000 7fbc5effd700 1 --2- 172.21.15.27:0/1948287114 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fbc4c06ace0 0x7fbc4c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:32.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:32.885+0000 7fbc5effd700 1 --2- 172.21.15.27:0/1948287114 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fbc4c06ace0 0x7fbc4c06d190 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbc500097c0 tx=0x7fbc5001c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:32.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:32.888+0000 7fbc47fff700 1 -- 172.21.15.27:0/1948287114 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbc58054d00 con 0x7fbc60160a50 2023-07-05T23:33:33.137 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:33.134+0000 7fbc65953700 1 -- 172.21.15.27:0/1948287114 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fbc600c6380 con 0x7fbc60160a50 2023-07-05T23:33:33.137 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:33.134+0000 7fbc47fff700 1 -- 172.21.15.27:0/1948287114 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fbc58058320 con 0x7fbc60160a50 2023-07-05T23:33:33.137 INFO:teuthology.orchestra.run.smithi027.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-07-05T23:33:33.141 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:33.136+0000 7fbc65953700 1 -- 172.21.15.27:0/1948287114 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fbc4c06ace0 msgr2=0x7fbc4c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:33.141 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:33.136+0000 7fbc65953700 1 --2- 172.21.15.27:0/1948287114 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fbc4c06ace0 0x7fbc4c06d190 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbc500097c0 tx=0x7fbc5001c040 comp rx=0 tx=0).stop 2023-07-05T23:33:33.142 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:33.136+0000 7fbc65953700 1 -- 172.21.15.27:0/1948287114 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbc60160a50 msgr2=0x7fbc600b4310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:33.142 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:33.136+0000 7fbc65953700 1 --2- 172.21.15.27:0/1948287114 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbc60160a50 0x7fbc600b4310 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fbc5800efc0 tx=0x7fbc5800c0c0 comp rx=0 tx=0).stop 2023-07-05T23:33:33.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:33.136+0000 7fbc65953700 1 -- 172.21.15.27:0/1948287114 shutdown_connections 2023-07-05T23:33:33.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:33.136+0000 7fbc65953700 1 --2- 172.21.15.27:0/1948287114 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fbc4c06ace0 0x7fbc4c06d190 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:33.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:33.136+0000 7fbc65953700 1 --2- 172.21.15.27:0/1948287114 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbc60160a50 0x7fbc600b4310 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:33.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:33.136+0000 7fbc65953700 1 --2- 172.21.15.27:0/1948287114 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc600cd660 0x7fbc60149520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:33.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:33.136+0000 7fbc65953700 1 --2- 172.21.15.27:0/1948287114 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc6015c570 0x7fbc600b25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:33.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:33.136+0000 7fbc65953700 1 -- 172.21.15.27:0/1948287114 >> 172.21.15.27:0/1948287114 conn(0x7fbc60071620 msgr2=0x7fbc6015a470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:33.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:33.136+0000 7fbc65953700 1 -- 172.21.15.27:0/1948287114 shutdown_connections 2023-07-05T23:33:33.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:33.136+0000 7fbc65953700 1 -- 172.21.15.27:0/1948287114 wait complete. 2023-07-05T23:33:33.151 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-05T23:33:33.152 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-05T23:33:33.152 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi027.front.sepia.ceph.com 2023-07-05T23:33:33.153 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-07-05T23:33:33.153 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-07-05T23:33:33.153 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-05T23:33:33.154 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-05T23:33:33.154 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-05T23:33:33.155 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-07-05T23:33:33.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:33.156 DEBUG:teuthology.orchestra.run.smithi027:> ip addr 2023-07-05T23:33:33.176 INFO:teuthology.orchestra.run.smithi027.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-05T23:33:33.176 INFO:teuthology.orchestra.run.smithi027.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-05T23:33:33.177 INFO:teuthology.orchestra.run.smithi027.stdout: inet 127.0.0.1/8 scope host lo 2023-07-05T23:33:33.177 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-07-05T23:33:33.178 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 ::1/128 scope host 2023-07-05T23:33:33.178 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-07-05T23:33:33.179 INFO:teuthology.orchestra.run.smithi027.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-05T23:33:33.179 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 0c:c4:7a:6b:fe:c8 brd ff:ff:ff:ff:ff:ff 2023-07-05T23:33:33.179 INFO:teuthology.orchestra.run.smithi027.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-05T23:33:33.180 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether ac:1f:6b:f8:39:5a brd ff:ff:ff:ff:ff:ff 2023-07-05T23:33:33.180 INFO:teuthology.orchestra.run.smithi027.stdout: inet 172.21.15.27/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-07-05T23:33:33.181 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft 42369sec preferred_lft 42369sec 2023-07-05T23:33:33.181 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::ae1f:6bff:fef8:395a/64 scope link 2023-07-05T23:33:33.181 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-07-05T23:33:33.182 INFO:teuthology.orchestra.run.smithi027.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-05T23:33:33.182 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 0c:c4:7a:6b:fe:c9 brd ff:ff:ff:ff:ff:ff 2023-07-05T23:33:33.182 INFO:teuthology.orchestra.run.smithi027.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-05T23:33:33.184 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether ac:1f:6b:f8:39:5b brd ff:ff:ff:ff:ff:ff 2023-07-05T23:33:33.184 INFO:teuthology.orchestra.run.smithi027.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-05T23:33:33.185 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether a6:41:a6:ff:87:e4 brd ff:ff:ff:ff:ff:ff 2023-07-05T23:33:33.185 INFO:teuthology.orchestra.run.smithi027.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-05T23:33:33.186 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-07-05T23:33:33.186 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::1008:b1ff:fe3e:172a/64 scope link 2023-07-05T23:33:33.187 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-07-05T23:33:33.187 INFO:teuthology.orchestra.run.smithi027.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-05T23:33:33.187 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether a6:41:a6:ff:87:e4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-05T23:33:33.188 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::a441:a6ff:feff:87e4/64 scope link tentative 2023-07-05T23:33:33.188 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-07-05T23:33:33.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:33.190 DEBUG:teuthology.orchestra.run.smithi027:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-05T23:33:33.242 INFO:teuthology.orchestra.run.smithi027.stdout:1 2023-07-05T23:33:33.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:33.243 DEBUG:teuthology.orchestra.run.smithi027:> route 2023-07-05T23:33:33.302 INFO:teuthology.orchestra.run.smithi027.stdout:Kernel IP routing table 2023-07-05T23:33:33.302 INFO:teuthology.orchestra.run.smithi027.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-05T23:33:33.302 INFO:teuthology.orchestra.run.smithi027.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-07-05T23:33:33.303 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-07-05T23:33:33.303 INFO:teuthology.orchestra.run.smithi027.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-05T23:33:33.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:33.303 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec bash -c ' 2023-07-05T23:33:33.304 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2023-07-05T23:33:33.304 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-05T23:33:33.304 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-05T23:33:33.305 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-05T23:33:33.305 DEBUG:teuthology.orchestra.run.smithi027:> ') 2023-07-05T23:33:33.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:33.409 DEBUG:teuthology.orchestra.run.smithi027:> ip netns list 2023-07-05T23:33:33.428 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-05T23:33:33.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:33.429 DEBUG:teuthology.orchestra.run.smithi027:> ip netns list-id 2023-07-05T23:33:33.486 INFO:teuthology.orchestra.run.smithi027.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-07-05T23:33:33.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:33.487 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec bash -c ' 2023-07-05T23:33:33.487 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2023-07-05T23:33:33.488 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-05T23:33:33.488 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-07-05T23:33:33.488 DEBUG:teuthology.orchestra.run.smithi027:> ') 2023-07-05T23:33:33.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:33.580 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-07-05T23:33:33.617 INFO:teuthology.orchestra.run.smithi027.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-05T23:33:33.618 INFO:teuthology.orchestra.run.smithi027.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-05T23:33:33.618 INFO:teuthology.orchestra.run.smithi027.stdout: inet 127.0.0.1/8 scope host lo 2023-07-05T23:33:33.618 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-07-05T23:33:33.618 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 ::1/128 scope host 2023-07-05T23:33:33.618 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-07-05T23:33:33.619 INFO:teuthology.orchestra.run.smithi027.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-05T23:33:33.619 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether b2:ef:d1:91:71:9d brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-05T23:33:33.619 INFO:teuthology.orchestra.run.smithi027.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-05T23:33:33.619 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-07-05T23:33:33.619 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::b0ef:d1ff:fe91:719d/64 scope link 2023-07-05T23:33:33.620 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-07-05T23:33:33.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:33.632 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-07-05T23:33:33.714 INFO:teuthology.orchestra.run.smithi027.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-05T23:33:33.714 INFO:teuthology.orchestra.run.smithi027.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-05T23:33:33.715 INFO:teuthology.orchestra.run.smithi027.stdout: inet 127.0.0.1/8 scope host lo 2023-07-05T23:33:33.715 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-07-05T23:33:33.715 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 ::1/128 scope host 2023-07-05T23:33:33.715 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-07-05T23:33:33.716 INFO:teuthology.orchestra.run.smithi027.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-05T23:33:33.716 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether b2:ef:d1:91:71:9d brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-05T23:33:33.716 INFO:teuthology.orchestra.run.smithi027.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-05T23:33:33.717 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-07-05T23:33:33.717 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::b0ef:d1ff:fe91:719d/64 scope link 2023-07-05T23:33:33.717 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-07-05T23:33:33.723 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-07-05T23:33:33.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:33.724 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec bash -c ' 2023-07-05T23:33:33.724 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2023-07-05T23:33:33.725 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-07-05T23:33:33.726 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-07-05T23:33:33.726 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-07-05T23:33:33.726 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-07-05T23:33:33.726 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-07-05T23:33:33.727 DEBUG:teuthology.orchestra.run.smithi027:> ') 2023-07-05T23:33:33.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:33.986 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec bash -c ' 2023-07-05T23:33:33.987 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2023-07-05T23:33:33.987 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link set brx.1 up 2023-07-05T23:33:33.987 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link set dev brx.1 master ceph-brx 2023-07-05T23:33:33.987 DEBUG:teuthology.orchestra.run.smithi027:> ') 2023-07-05T23:33:34.098 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-05T23:33:34.098 DEBUG:teuthology.orchestra.run.smithi027:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-07-05T23:33:34.117 INFO:teuthology.orchestra.run.smithi027.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-07-05T23:33:34.118 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-05T23:33:34.118 DEBUG:teuthology.orchestra.run.smithi027:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-07-05T23:33:34.174 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2023-07-05T23:33:34.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:34.175 DEBUG:teuthology.orchestra.run.smithi027:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-05T23:33:34.260 INFO:teuthology.orchestra.run.smithi027.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-05T23:33:34.261 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-05T23:33:34.283 INFO:teuthology.orchestra.run.smithi027.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-05T23:33:34.284 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-05T23:33:34.284 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: resolved to: "172.21.15.27:3300,172.21.15.162:3300,172.21.15.162:3301" 2023-07-05T23:33:34.285 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: trying mount with new device syntax: 2@23eebe48-65f5-4d3c-8c2d-4aa171c055d5.cephfs=/ 2023-07-05T23:33:34.285 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.27:3300/172.21.15.162:3300/172.21.15.162:3301" will pass to kernel 2023-07-05T23:33:34.286 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: v2 mount support check returned 2 2023-07-05T23:33:34.286 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: kernel does not support v2 syntax 2023-07-05T23:33:34.286 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-05T23:33:34.361 INFO:teuthology.orchestra.run.smithi027.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-05T23:33:34.361 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-05T23:33:34.362 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: resolved to: "172.21.15.27:3300,172.21.15.162:3300,172.21.15.162:3301" 2023-07-05T23:33:34.362 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: trying mount with new device syntax: 2@23eebe48-65f5-4d3c-8c2d-4aa171c055d5.cephfs=/ 2023-07-05T23:33:34.362 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.27:3300/172.21.15.162:3300/172.21.15.162:3301" will pass to kernel 2023-07-05T23:33:34.362 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: v2 mount support check returned 2 2023-07-05T23:33:34.362 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: kernel does not support v2 syntax 2023-07-05T23:33:34.362 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-05T23:33:34.362 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: resolved to: "172.21.15.27:6789,172.21.15.162:6789,172.21.15.162:6790" 2023-07-05T23:33:34.363 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.27:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2023-07-05T23:33:34.363 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,key=2,mds_namespace=cephfs,fsid=23eebe48-65f5-4d3c-8c2d-4aa171c055d5" will pass to kernel 2023-07-05T23:33:34.364 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-05T23:33:34.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:34.365 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-07-05T23:33:34.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:34.392 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-05T23:33:34.466 INFO:teuthology.orchestra.run.smithi027.stdout:client4637 2023-07-05T23:33:34.466 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-07-05T23:33:34.467 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-05T23:33:34.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:34.529 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-05T23:33:34.601 INFO:teuthology.orchestra.run.smithi027.stdout:client4637 2023-07-05T23:33:34.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:34.601 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-05T23:33:34.673 INFO:teuthology.orchestra.run.smithi027.stdout:client4637 2023-07-05T23:33:34.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:34.674 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/23eebe48-65f5-4d3c-8c2d-4aa171c055d5.client4637/status') 2023-07-05T23:33:34.755 INFO:teuthology.orchestra.run.smithi027.stdout:instance: client.4637 (3)172.21.15.27:0/596638201 2023-07-05T23:33:34.755 INFO:teuthology.orchestra.run.smithi027.stdout:blocklisted: false 2023-07-05T23:33:34.757 INFO:teuthology.orchestra.run.smithi027.stderr:0+1 records in 2023-07-05T23:33:34.757 INFO:teuthology.orchestra.run.smithi027.stderr:0+1 records out 2023-07-05T23:33:34.758 INFO:teuthology.orchestra.run.smithi027.stderr:69 bytes copied, 2.5284e-05 s, 2.7 MB/s 2023-07-05T23:33:34.758 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2023-07-05T23:33:34.759 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-05T23:33:34.759 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-05T23:33:34.760 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-05T23:33:34.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:34.922+0000 7f9fb981c700 1 Processor -- start 2023-07-05T23:33:34.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:34.922+0000 7f9fb981c700 1 -- start start 2023-07-05T23:33:34.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:34.922+0000 7f9fb981c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f9fb4160a50 0x7f9fb41674d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:34.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:34.922+0000 7f9fb981c700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fb4160e70 con 0x7f9fb40cd830 2023-07-05T23:33:34.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:34.922+0000 7f9fb981c700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fb41610a0 con 0x7f9fb415c570 2023-07-05T23:33:34.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:34.922+0000 7f9fb981c700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fb415d670 con 0x7f9fb4160a50 2023-07-05T23:33:34.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:34.922+0000 7f9fb37fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f9fb4160a50 0x7f9fb41674d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:34.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:34.923+0000 7f9fb27fc700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f9fb40cd830 0x7f9fb4160340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:53116/0 (socket says 172.21.15.27:53116) 2023-07-05T23:33:34.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:34.923+0000 7f9fb27fc700 1 -- 172.21.15.27:0/3075190703 learned_addr learned my addr 172.21.15.27:0/3075190703 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-07-05T23:33:34.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:34.923+0000 7f9fb37fe700 1 -- 172.21.15.27:0/3075190703 >> v1:172.21.15.162:6789/0 conn(0x7f9fb415c570 legacy=0x7f9fb40cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:34.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:34.923+0000 7f9fb37fe700 1 -- 172.21.15.27:0/3075190703 >> v1:172.21.15.27:6789/0 conn(0x7f9fb40cd830 legacy=0x7f9fb4160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:34.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:34.923+0000 7f9fb37fe700 1 -- 172.21.15.27:0/3075190703 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb415da90 con 0x7f9fb4160a50 2023-07-05T23:33:34.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:34.923+0000 7f9fb37fe700 1 --2- 172.21.15.27:0/3075190703 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9fb4160a50 0x7f9fb41674d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9fac009d90 tx=0x7f9fac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edb55e8c85d30014 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:34.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:34.923+0000 7f9fb1ffb700 1 -- 172.21.15.27:0/3075190703 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fac00e070 con 0x7f9fb4160a50 2023-07-05T23:33:34.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:34.923+0000 7f9fb1ffb700 1 -- 172.21.15.27:0/3075190703 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fac00bb90 con 0x7f9fb4160a50 2023-07-05T23:33:34.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:34.923+0000 7f9fb1ffb700 1 -- 172.21.15.27:0/3075190703 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fac003a20 con 0x7f9fb4160a50 2023-07-05T23:33:34.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:34.924+0000 7f9fb981c700 1 -- 172.21.15.27:0/3075190703 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9fb4160a50 msgr2=0x7f9fb41674d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:34.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:34.924+0000 7f9fb981c700 1 --2- 172.21.15.27:0/3075190703 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9fb4160a50 0x7f9fb41674d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9fac009d90 tx=0x7f9fac00b330 comp rx=0 tx=0).stop 2023-07-05T23:33:34.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:34.924+0000 7f9fb981c700 1 -- 172.21.15.27:0/3075190703 shutdown_connections 2023-07-05T23:33:34.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:34.924+0000 7f9fb981c700 1 --2- 172.21.15.27:0/3075190703 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9fb4160a50 0x7f9fb41674d0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:34.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:34.924+0000 7f9fb981c700 1 -- 172.21.15.27:0/3075190703 >> 172.21.15.27:0/3075190703 conn(0x7f9fb4071620 msgr2=0x7f9fb40719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:34.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:34.924+0000 7f9fb981c700 1 -- 172.21.15.27:0/3075190703 shutdown_connections 2023-07-05T23:33:34.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:34.924+0000 7f9fb981c700 1 -- 172.21.15.27:0/3075190703 wait complete. 2023-07-05T23:33:34.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:34.925+0000 7f9fb981c700 1 Processor -- start 2023-07-05T23:33:34.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:34.925+0000 7f9fb981c700 1 -- start start 2023-07-05T23:33:34.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:34.926+0000 7f9fb981c700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9fb40cd830 0x7f9fb4156cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:34.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:34.926+0000 7f9fb981c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9fb415c570 0x7f9fb41566f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:34.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:34.926+0000 7f9fb981c700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9fb4160a50 0x7f9fb41e5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:34.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:34.926+0000 7f9fb981c700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb40b7730 con 0x7f9fb415c570 2023-07-05T23:33:34.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:34.926+0000 7f9fb981c700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb41e64c0 con 0x7f9fb4160a50 2023-07-05T23:33:34.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:34.926+0000 7f9fb981c700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb40b6b40 con 0x7f9fb40cd830 2023-07-05T23:33:34.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:34.926+0000 7f9fb27fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9fb415c570 0x7f9fb41566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:34.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:34.926+0000 7f9fb27fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9fb415c570 0x7f9fb41566f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45958/0 (socket says 172.21.15.27:45958) 2023-07-05T23:33:34.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:34.926+0000 7f9fb27fc700 1 -- 172.21.15.27:0/3473352728 learned_addr learned my addr 172.21.15.27:0/3473352728 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:34.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:34.926+0000 7f9fb37fe700 1 --2- 172.21.15.27:0/3473352728 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9fb4160a50 0x7f9fb41e5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:34.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:34.926+0000 7f9fb2ffd700 1 --2- 172.21.15.27:0/3473352728 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9fb40cd830 0x7f9fb4156cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:34.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:34.926+0000 7f9fb27fc700 1 -- 172.21.15.27:0/3473352728 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9fb40cd830 msgr2=0x7f9fb4156cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:34.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:34.926+0000 7f9fb27fc700 1 --2- 172.21.15.27:0/3473352728 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9fb40cd830 0x7f9fb4156cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:34.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:34.926+0000 7f9fb27fc700 1 -- 172.21.15.27:0/3473352728 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9fb4160a50 msgr2=0x7f9fb41e5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:34.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:34.926+0000 7f9fb27fc700 1 --2- 172.21.15.27:0/3473352728 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9fb4160a50 0x7f9fb41e5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:34.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:34.926+0000 7f9fb27fc700 1 -- 172.21.15.27:0/3473352728 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fac009a70 con 0x7f9fb415c570 2023-07-05T23:33:34.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:34.926+0000 7f9fb27fc700 1 --2- 172.21.15.27:0/3473352728 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9fb415c570 0x7f9fb41566f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c00c490 tx=0x7f9f9c00c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:34.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:34.927+0000 7f9fabfff700 1 -- 172.21.15.27:0/3473352728 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c00cea0 con 0x7f9fb415c570 2023-07-05T23:33:34.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:34.927+0000 7f9fabfff700 1 -- 172.21.15.27:0/3473352728 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f9c005d70 con 0x7f9fb415c570 2023-07-05T23:33:34.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:34.927+0000 7f9fabfff700 1 -- 172.21.15.27:0/3473352728 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c0072f0 con 0x7f9fb415c570 2023-07-05T23:33:34.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:34.927+0000 7f9fb981c700 1 -- 172.21.15.27:0/3473352728 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fb40b6d90 con 0x7f9fb415c570 2023-07-05T23:33:34.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:34.927+0000 7f9fb981c700 1 -- 172.21.15.27:0/3473352728 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fb40b7350 con 0x7f9fb415c570 2023-07-05T23:33:34.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:34.928+0000 7f9fb981c700 1 -- 172.21.15.27:0/3473352728 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fb40b7870 con 0x7f9fb415c570 2023-07-05T23:33:34.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:34.928+0000 7f9fabfff700 1 -- 172.21.15.27:0/3473352728 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9f9c007450 con 0x7f9fb415c570 2023-07-05T23:33:34.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:34.928+0000 7f9fabfff700 1 --2- 172.21.15.27:0/3473352728 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f9f9406ace0 0x7f9f9406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:34.937 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:34.929+0000 7f9fabfff700 1 -- 172.21.15.27:0/3473352728 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9f9c088aa0 con 0x7f9fb415c570 2023-07-05T23:33:34.937 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:34.929+0000 7f9fb2ffd700 1 --2- 172.21.15.27:0/3473352728 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f9f9406ace0 0x7f9f9406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:34.937 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:34.929+0000 7f9fb2ffd700 1 --2- 172.21.15.27:0/3473352728 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f9f9406ace0 0x7f9f9406d190 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9fb40b6430 tx=0x7f9fa4007ec0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:34.938 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:34.933+0000 7f9fabfff700 1 -- 172.21.15.27:0/3473352728 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9fb40b7870 con 0x7f9fb415c570 2023-07-05T23:33:35.178 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:35.175+0000 7f9fb981c700 1 -- 172.21.15.27:0/3473352728 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9fb40b7870 con 0x7f9fb415c570 2023-07-05T23:33:35.178 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:35.175+0000 7f9fabfff700 1 -- 172.21.15.27:0/3473352728 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f9f9c017070 con 0x7f9fb415c570 2023-07-05T23:33:35.179 INFO:teuthology.orchestra.run.smithi027.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-07-05T23:33:35.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:35.177+0000 7f9fb981c700 1 -- 172.21.15.27:0/3473352728 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f9f9406ace0 msgr2=0x7f9f9406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:35.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:35.177+0000 7f9fb981c700 1 --2- 172.21.15.27:0/3473352728 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f9f9406ace0 0x7f9f9406d190 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9fb40b6430 tx=0x7f9fa4007ec0 comp rx=0 tx=0).stop 2023-07-05T23:33:35.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:35.177+0000 7f9fb981c700 1 -- 172.21.15.27:0/3473352728 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9fb415c570 msgr2=0x7f9fb41566f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:35.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:35.177+0000 7f9fb981c700 1 --2- 172.21.15.27:0/3473352728 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9fb415c570 0x7f9fb41566f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c00c490 tx=0x7f9f9c00c7a0 comp rx=0 tx=0).stop 2023-07-05T23:33:35.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:35.177+0000 7f9fb981c700 1 -- 172.21.15.27:0/3473352728 shutdown_connections 2023-07-05T23:33:35.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:35.177+0000 7f9fb981c700 1 --2- 172.21.15.27:0/3473352728 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9fb4160a50 0x7f9fb41e5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:35.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:35.177+0000 7f9fb981c700 1 --2- 172.21.15.27:0/3473352728 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f9f9406ace0 0x7f9f9406d190 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:35.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:35.177+0000 7f9fb981c700 1 --2- 172.21.15.27:0/3473352728 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9fb40cd830 0x7f9fb4156cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:35.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:35.177+0000 7f9fb981c700 1 --2- 172.21.15.27:0/3473352728 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9fb415c570 0x7f9fb41566f0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:35.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:35.177+0000 7f9fb981c700 1 -- 172.21.15.27:0/3473352728 >> 172.21.15.27:0/3473352728 conn(0x7f9fb4071620 msgr2=0x7f9fb40cf3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:35.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:35.177+0000 7f9fb981c700 1 -- 172.21.15.27:0/3473352728 shutdown_connections 2023-07-05T23:33:35.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:35.178+0000 7f9fb981c700 1 -- 172.21.15.27:0/3473352728 wait complete. 2023-07-05T23:33:35.193 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-05T23:33:35.193 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-05T23:33:35.193 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi162.front.sepia.ceph.com 2023-07-05T23:33:35.194 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-07-05T23:33:35.194 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-05T23:33:35.194 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-05T23:33:35.194 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-05T23:33:35.194 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-05T23:33:35.195 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-05T23:33:35.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:35.196 DEBUG:teuthology.orchestra.run.smithi162:> ip addr 2023-07-05T23:33:35.219 INFO:teuthology.orchestra.run.smithi162.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-05T23:33:35.219 INFO:teuthology.orchestra.run.smithi162.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-05T23:33:35.220 INFO:teuthology.orchestra.run.smithi162.stdout: inet 127.0.0.1/8 scope host lo 2023-07-05T23:33:35.220 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2023-07-05T23:33:35.220 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 ::1/128 scope host 2023-07-05T23:33:35.220 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2023-07-05T23:33:35.220 INFO:teuthology.orchestra.run.smithi162.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-05T23:33:35.221 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f8 brd ff:ff:ff:ff:ff:ff 2023-07-05T23:33:35.221 INFO:teuthology.orchestra.run.smithi162.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-05T23:33:35.221 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f9 brd ff:ff:ff:ff:ff:ff 2023-07-05T23:33:35.222 INFO:teuthology.orchestra.run.smithi162.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-05T23:33:35.222 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:40 brd ff:ff:ff:ff:ff:ff 2023-07-05T23:33:35.222 INFO:teuthology.orchestra.run.smithi162.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-05T23:33:35.222 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:41 brd ff:ff:ff:ff:ff:ff 2023-07-05T23:33:35.223 INFO:teuthology.orchestra.run.smithi162.stdout: inet 172.21.15.162/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-05T23:33:35.223 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft 42339sec preferred_lft 42339sec 2023-07-05T23:33:35.223 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::3174:a979:a80d:83f/64 scope link noprefixroute 2023-07-05T23:33:35.223 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2023-07-05T23:33:35.223 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-07-05T23:33:35.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:35.225 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec bash -c ' 2023-07-05T23:33:35.225 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2023-07-05T23:33:35.226 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link add name ceph-brx type bridge 2023-07-05T23:33:35.227 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip addr flush dev ceph-brx 2023-07-05T23:33:35.228 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link set ceph-brx up 2023-07-05T23:33:35.229 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-07-05T23:33:35.229 DEBUG:teuthology.orchestra.run.smithi162:> ') 2023-07-05T23:33:35.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:35.406 DEBUG:teuthology.orchestra.run.smithi162:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-05T23:33:35.433 INFO:teuthology.orchestra.run.smithi162.stdout:1 2023-07-05T23:33:35.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:35.435 DEBUG:teuthology.orchestra.run.smithi162:> route 2023-07-05T23:33:35.510 INFO:teuthology.orchestra.run.smithi162.stdout:Kernel IP routing table 2023-07-05T23:33:35.511 INFO:teuthology.orchestra.run.smithi162.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-05T23:33:35.511 INFO:teuthology.orchestra.run.smithi162.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-05T23:33:35.511 INFO:teuthology.orchestra.run.smithi162.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-05T23:33:35.511 INFO:teuthology.orchestra.run.smithi162.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-05T23:33:35.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:35.512 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec bash -c ' 2023-07-05T23:33:35.512 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2023-07-05T23:33:35.512 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-05T23:33:35.513 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-05T23:33:35.513 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-05T23:33:35.513 DEBUG:teuthology.orchestra.run.smithi162:> ') 2023-07-05T23:33:35.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:35.748 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2023-07-05T23:33:35.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:35.766 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list-id 2023-07-05T23:33:35.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:35.823 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec bash -c ' 2023-07-05T23:33:35.823 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2023-07-05T23:33:35.823 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-05T23:33:35.823 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-07-05T23:33:35.824 DEBUG:teuthology.orchestra.run.smithi162:> ') 2023-07-05T23:33:35.918 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-07-05T23:33:35.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:35.919 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec bash -c ' 2023-07-05T23:33:35.919 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2023-07-05T23:33:35.919 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-07-05T23:33:35.920 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-07-05T23:33:35.920 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-07-05T23:33:35.921 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-07-05T23:33:35.921 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-07-05T23:33:35.921 DEBUG:teuthology.orchestra.run.smithi162:> ') 2023-07-05T23:33:36.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:36.131 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec bash -c ' 2023-07-05T23:33:36.132 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2023-07-05T23:33:36.132 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link set brx.0 up 2023-07-05T23:33:36.132 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link set dev brx.0 master ceph-brx 2023-07-05T23:33:36.132 DEBUG:teuthology.orchestra.run.smithi162:> ') 2023-07-05T23:33:36.236 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-05T23:33:36.236 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-07-05T23:33:36.255 INFO:teuthology.orchestra.run.smithi162.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-07-05T23:33:36.256 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-05T23:33:36.256 DEBUG:teuthology.orchestra.run.smithi162:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-07-05T23:33:36.312 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-07-05T23:33:36.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:36.313 DEBUG:teuthology.orchestra.run.smithi162:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-05T23:33:36.430 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-05T23:33:36.430 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-05T23:33:36.539 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-05T23:33:36.540 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-05T23:33:36.540 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.27:3300,172.21.15.162:3300,172.21.15.162:3301" 2023-07-05T23:33:36.540 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: trying mount with new device syntax: 1@23eebe48-65f5-4d3c-8c2d-4aa171c055d5.cephfs=/ 2023-07-05T23:33:36.541 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.27:3300/172.21.15.162:3300/172.21.15.162:3301" will pass to kernel 2023-07-05T23:33:36.541 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: v2 mount support check returned 2 2023-07-05T23:33:36.541 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: kernel does not support v2 syntax 2023-07-05T23:33:36.541 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-05T23:33:36.569 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-05T23:33:36.569 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-05T23:33:36.570 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.27:3300,172.21.15.162:3300,172.21.15.162:3301" 2023-07-05T23:33:36.570 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: trying mount with new device syntax: 1@23eebe48-65f5-4d3c-8c2d-4aa171c055d5.cephfs=/ 2023-07-05T23:33:36.570 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.27:3300/172.21.15.162:3300/172.21.15.162:3301" will pass to kernel 2023-07-05T23:33:36.570 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: v2 mount support check returned 2 2023-07-05T23:33:36.570 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: kernel does not support v2 syntax 2023-07-05T23:33:36.570 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-05T23:33:36.570 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.27:6789,172.21.15.162:6789,172.21.15.162:6790" 2023-07-05T23:33:36.571 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.27:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2023-07-05T23:33:36.571 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=23eebe48-65f5-4d3c-8c2d-4aa171c055d5" will pass to kernel 2023-07-05T23:33:36.573 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-05T23:33:36.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:36.575 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-07-05T23:33:36.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:36.608 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-05T23:33:36.679 INFO:teuthology.orchestra.run.smithi162.stdout:client4643 2023-07-05T23:33:36.680 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-07-05T23:33:36.680 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-05T23:33:36.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:36.740 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-05T23:33:36.816 INFO:teuthology.orchestra.run.smithi162.stdout:client4643 2023-07-05T23:33:36.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:36.820 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-05T23:33:36.900 INFO:teuthology.orchestra.run.smithi162.stdout:client4643 2023-07-05T23:33:36.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:36.902 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/23eebe48-65f5-4d3c-8c2d-4aa171c055d5.client4643/status') 2023-07-05T23:33:36.988 INFO:teuthology.orchestra.run.smithi162.stdout:instance: client.4643 (3)192.168.0.1:0/3253249521 2023-07-05T23:33:36.989 INFO:teuthology.orchestra.run.smithi162.stdout:blocklisted: false 2023-07-05T23:33:36.990 INFO:teuthology.orchestra.run.smithi162.stderr:0+1 records in 2023-07-05T23:33:36.990 INFO:teuthology.orchestra.run.smithi162.stderr:0+1 records out 2023-07-05T23:33:36.990 INFO:teuthology.orchestra.run.smithi162.stderr:69 bytes copied, 2.1999e-05 s, 3.1 MB/s 2023-07-05T23:33:36.990 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2023-07-05T23:33:36.991 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-05T23:33:36.991 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-07-05T23:33:36.991 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-05T23:33:37.134 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.128+0000 7fcfa0f92700 1 Processor -- start 2023-07-05T23:33:37.134 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.128+0000 7fcfa0f92700 1 -- start start 2023-07-05T23:33:37.134 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.129+0000 7fcfa0f92700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcf9c157a90 0x7fcf9c15e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:37.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.129+0000 7fcfa0f92700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fcf9c0711f0 0x7fcf9c15a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:37.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.129+0000 7fcfa0f92700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf9c0cb580 con 0x7fcf9c069ef0 2023-07-05T23:33:37.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.129+0000 7fcfa0f92700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf9c06db80 con 0x7fcf9c0711f0 2023-07-05T23:33:37.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.129+0000 7fcfa0f92700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9c15eb10 con 0x7fcf9c157a90 2023-07-05T23:33:37.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.129+0000 7fcf9ad9d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fcf9c0711f0 0x7fcf9c15a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:37.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.129+0000 7fcf9ad9d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fcf9c0711f0 0x7fcf9c15a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45966/0 (socket says 172.21.15.27:45966) 2023-07-05T23:33:37.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.129+0000 7fcf9ad9d700 1 -- 172.21.15.27:0/3589411377 learned_addr learned my addr 172.21.15.27:0/3589411377 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:37.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.129+0000 7fcf9a59c700 1 --2- 172.21.15.27:0/3589411377 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcf9c157a90 0x7fcf9c15e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:37.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.129+0000 7fcf9ad9d700 1 -- 172.21.15.27:0/3589411377 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcf9c157a90 msgr2=0x7fcf9c15e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:33:37.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.129+0000 7fcf9ad9d700 1 --2- 172.21.15.27:0/3589411377 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcf9c157a90 0x7fcf9c15e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:37.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.129+0000 7fcf9ad9d700 1 -- 172.21.15.27:0/3589411377 >> v1:172.21.15.27:6789/0 conn(0x7fcf9c069ef0 legacy=0x7fcf9c070ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:37.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.129+0000 7fcf9ad9d700 1 -- 172.21.15.27:0/3589411377 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf9c0cafb0 con 0x7fcf9c0711f0 2023-07-05T23:33:37.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.129+0000 7fcf9a59c700 1 --2- 172.21.15.27:0/3589411377 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcf9c157a90 0x7fcf9c15e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T23:33:37.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.129+0000 7fcf9ad9d700 1 --2- 172.21.15.27:0/3589411377 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf9c0711f0 0x7fcf9c15a740 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fcf94009e50 tx=0x7fcf9400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afcc6a2ceb6e7986 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:37.137 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.130+0000 7fcf9959a700 1 -- 172.21.15.27:0/3589411377 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9400e070 con 0x7fcf9c0711f0 2023-07-05T23:33:37.137 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.130+0000 7fcf9959a700 1 -- 172.21.15.27:0/3589411377 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf9400b9c0 con 0x7fcf9c0711f0 2023-07-05T23:33:37.137 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.130+0000 7fcf9959a700 1 -- 172.21.15.27:0/3589411377 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9400bd70 con 0x7fcf9c0711f0 2023-07-05T23:33:37.137 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.130+0000 7fcfa0f92700 1 -- 172.21.15.27:0/3589411377 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf9c0711f0 msgr2=0x7fcf9c15a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:37.137 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.130+0000 7fcfa0f92700 1 --2- 172.21.15.27:0/3589411377 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf9c0711f0 0x7fcf9c15a740 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fcf94009e50 tx=0x7fcf9400b330 comp rx=0 tx=0).stop 2023-07-05T23:33:37.137 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.130+0000 7fcfa0f92700 1 -- 172.21.15.27:0/3589411377 shutdown_connections 2023-07-05T23:33:37.137 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.130+0000 7fcfa0f92700 1 --2- 172.21.15.27:0/3589411377 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf9c0711f0 0x7fcf9c15a740 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:37.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.130+0000 7fcfa0f92700 1 --2- 172.21.15.27:0/3589411377 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcf9c157a90 0x7fcf9c15e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:37.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.130+0000 7fcfa0f92700 1 -- 172.21.15.27:0/3589411377 >> 172.21.15.27:0/3589411377 conn(0x7fcf9c0b1740 msgr2=0x7fcf9c06cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:37.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.130+0000 7fcfa0f92700 1 -- 172.21.15.27:0/3589411377 shutdown_connections 2023-07-05T23:33:37.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.130+0000 7fcfa0f92700 1 -- 172.21.15.27:0/3589411377 wait complete. 2023-07-05T23:33:37.140 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.132+0000 7fcfa0f92700 1 Processor -- start 2023-07-05T23:33:37.141 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.132+0000 7fcfa0f92700 1 -- start start 2023-07-05T23:33:37.141 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.132+0000 7fcfa0f92700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf9c069ef0 0x7fcf9c0c6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:37.141 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.132+0000 7fcfa0f92700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcf9c0711f0 0x7fcf9c0c7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:37.141 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.132+0000 7fcfa0f92700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf9c157a90 0x7fcf9c0c80c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:37.141 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.132+0000 7fcfa0f92700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9c14f8f0 con 0x7fcf9c069ef0 2023-07-05T23:33:37.142 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.132+0000 7fcfa0f92700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9c0cd540 con 0x7fcf9c157a90 2023-07-05T23:33:37.142 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.132+0000 7fcfa0f92700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9c0cd810 con 0x7fcf9c0711f0 2023-07-05T23:33:37.142 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.133+0000 7fcf9a59c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf9c069ef0 0x7fcf9c0c6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:37.142 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.133+0000 7fcf9a59c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf9c069ef0 0x7fcf9c0c6060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45970/0 (socket says 172.21.15.27:45970) 2023-07-05T23:33:37.142 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.133+0000 7fcf9a59c700 1 -- 172.21.15.27:0/4168993786 learned_addr learned my addr 172.21.15.27:0/4168993786 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:33:37.142 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.133+0000 7fcf9ad9d700 1 --2- 172.21.15.27:0/4168993786 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf9c157a90 0x7fcf9c0c80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:37.142 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.133+0000 7fcf99d9b700 1 --2- 172.21.15.27:0/4168993786 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcf9c0711f0 0x7fcf9c0c7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:37.142 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.133+0000 7fcf9a59c700 1 -- 172.21.15.27:0/4168993786 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcf9c0711f0 msgr2=0x7fcf9c0c7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:37.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.133+0000 7fcf9a59c700 1 --2- 172.21.15.27:0/4168993786 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcf9c0711f0 0x7fcf9c0c7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:37.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.133+0000 7fcf9a59c700 1 -- 172.21.15.27:0/4168993786 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf9c157a90 msgr2=0x7fcf9c0c80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:37.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.133+0000 7fcf9a59c700 1 --2- 172.21.15.27:0/4168993786 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf9c157a90 0x7fcf9c0c80c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:37.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.133+0000 7fcf9a59c700 1 -- 172.21.15.27:0/4168993786 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf94009b30 con 0x7fcf9c069ef0 2023-07-05T23:33:37.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.133+0000 7fcf9ad9d700 1 --2- 172.21.15.27:0/4168993786 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf9c157a90 0x7fcf9c0c80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T23:33:37.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.133+0000 7fcf9a59c700 1 --2- 172.21.15.27:0/4168993786 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf9c069ef0 0x7fcf9c0c6060 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c00e760 tx=0x7fcf8c00ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:37.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.133+0000 7fcf8affd700 1 -- 172.21.15.27:0/4168993786 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c013610 con 0x7fcf9c069ef0 2023-07-05T23:33:37.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.133+0000 7fcf8affd700 1 -- 172.21.15.27:0/4168993786 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf8c013770 con 0x7fcf9c069ef0 2023-07-05T23:33:37.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.133+0000 7fcfa0f92700 1 -- 172.21.15.27:0/4168993786 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf9c0cdaf0 con 0x7fcf9c069ef0 2023-07-05T23:33:37.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.133+0000 7fcf8affd700 1 -- 172.21.15.27:0/4168993786 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c013b20 con 0x7fcf9c069ef0 2023-07-05T23:33:37.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.133+0000 7fcfa0f92700 1 -- 172.21.15.27:0/4168993786 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf9c0ce0b0 con 0x7fcf9c069ef0 2023-07-05T23:33:37.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.134+0000 7fcfa0f92700 1 -- 172.21.15.27:0/4168993786 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf9c15a960 con 0x7fcf9c069ef0 2023-07-05T23:33:37.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.135+0000 7fcf8affd700 1 -- 172.21.15.27:0/4168993786 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcf8c013c80 con 0x7fcf9c069ef0 2023-07-05T23:33:37.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.135+0000 7fcf8affd700 1 --2- 172.21.15.27:0/4168993786 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fcf7c06ace0 0x7fcf7c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:33:37.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.135+0000 7fcf8affd700 1 -- 172.21.15.27:0/4168993786 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fcf8c089340 con 0x7fcf9c069ef0 2023-07-05T23:33:37.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.135+0000 7fcf99d9b700 1 --2- 172.21.15.27:0/4168993786 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fcf7c06ace0 0x7fcf7c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:33:37.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.136+0000 7fcf99d9b700 1 --2- 172.21.15.27:0/4168993786 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fcf7c06ace0 0x7fcf7c06d190 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c157340 tx=0x7fcf90009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:33:37.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.139+0000 7fcf8affd700 1 -- 172.21.15.27:0/4168993786 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcf8c057b50 con 0x7fcf9c069ef0 2023-07-05T23:33:37.387 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.384+0000 7fcfa0f92700 1 -- 172.21.15.27:0/4168993786 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fcf9c073910 con 0x7fcf9c069ef0 2023-07-05T23:33:37.388 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.385+0000 7fcf8affd700 1 -- 172.21.15.27:0/4168993786 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fcf8c0576e0 con 0x7fcf9c069ef0 2023-07-05T23:33:37.388 INFO:teuthology.orchestra.run.smithi027.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-07-05T23:33:37.390 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.387+0000 7fcfa0f92700 1 -- 172.21.15.27:0/4168993786 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fcf7c06ace0 msgr2=0x7fcf7c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:37.390 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.387+0000 7fcfa0f92700 1 --2- 172.21.15.27:0/4168993786 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fcf7c06ace0 0x7fcf7c06d190 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c157340 tx=0x7fcf90009040 comp rx=0 tx=0).stop 2023-07-05T23:33:37.390 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.387+0000 7fcfa0f92700 1 -- 172.21.15.27:0/4168993786 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf9c069ef0 msgr2=0x7fcf9c0c6060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:33:37.390 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.387+0000 7fcfa0f92700 1 --2- 172.21.15.27:0/4168993786 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf9c069ef0 0x7fcf9c0c6060 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c00e760 tx=0x7fcf8c00ea70 comp rx=0 tx=0).stop 2023-07-05T23:33:37.391 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.387+0000 7fcfa0f92700 1 -- 172.21.15.27:0/4168993786 shutdown_connections 2023-07-05T23:33:37.391 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.387+0000 7fcfa0f92700 1 --2- 172.21.15.27:0/4168993786 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf9c157a90 0x7fcf9c0c80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:37.391 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.387+0000 7fcfa0f92700 1 --2- 172.21.15.27:0/4168993786 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fcf7c06ace0 0x7fcf7c06d190 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:37.391 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.387+0000 7fcfa0f92700 1 --2- 172.21.15.27:0/4168993786 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf9c069ef0 0x7fcf9c0c6060 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:37.391 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.387+0000 7fcfa0f92700 1 --2- 172.21.15.27:0/4168993786 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcf9c0711f0 0x7fcf9c0c7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:33:37.392 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.387+0000 7fcfa0f92700 1 -- 172.21.15.27:0/4168993786 >> 172.21.15.27:0/4168993786 conn(0x7fcf9c0b1740 msgr2=0x7fcf9c06e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:33:37.392 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.387+0000 7fcfa0f92700 1 -- 172.21.15.27:0/4168993786 shutdown_connections 2023-07-05T23:33:37.392 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:33:37.387+0000 7fcfa0f92700 1 -- 172.21.15.27:0/4168993786 wait complete. 2023-07-05T23:33:37.403 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-05T23:33:37.403 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-05T23:33:37.403 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi162.front.sepia.ceph.com 2023-07-05T23:33:37.404 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-07-05T23:33:37.404 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-07-05T23:33:37.405 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-05T23:33:37.405 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-05T23:33:37.405 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-05T23:33:37.406 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-07-05T23:33:37.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:37.407 DEBUG:teuthology.orchestra.run.smithi162:> ip addr 2023-07-05T23:33:37.426 INFO:teuthology.orchestra.run.smithi162.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-05T23:33:37.426 INFO:teuthology.orchestra.run.smithi162.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-05T23:33:37.427 INFO:teuthology.orchestra.run.smithi162.stdout: inet 127.0.0.1/8 scope host lo 2023-07-05T23:33:37.427 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2023-07-05T23:33:37.427 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 ::1/128 scope host 2023-07-05T23:33:37.427 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2023-07-05T23:33:37.427 INFO:teuthology.orchestra.run.smithi162.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-05T23:33:37.427 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f8 brd ff:ff:ff:ff:ff:ff 2023-07-05T23:33:37.428 INFO:teuthology.orchestra.run.smithi162.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-05T23:33:37.428 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f9 brd ff:ff:ff:ff:ff:ff 2023-07-05T23:33:37.428 INFO:teuthology.orchestra.run.smithi162.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-05T23:33:37.428 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:40 brd ff:ff:ff:ff:ff:ff 2023-07-05T23:33:37.428 INFO:teuthology.orchestra.run.smithi162.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-05T23:33:37.428 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:41 brd ff:ff:ff:ff:ff:ff 2023-07-05T23:33:37.428 INFO:teuthology.orchestra.run.smithi162.stdout: inet 172.21.15.162/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-05T23:33:37.429 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft 42336sec preferred_lft 42336sec 2023-07-05T23:33:37.429 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::3174:a979:a80d:83f/64 scope link noprefixroute 2023-07-05T23:33:37.429 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2023-07-05T23:33:37.429 INFO:teuthology.orchestra.run.smithi162.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-05T23:33:37.429 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether be:57:34:32:52:4a brd ff:ff:ff:ff:ff:ff 2023-07-05T23:33:37.429 INFO:teuthology.orchestra.run.smithi162.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-05T23:33:37.429 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2023-07-05T23:33:37.430 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::59:3bff:fe94:847b/64 scope link 2023-07-05T23:33:37.430 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2023-07-05T23:33:37.430 INFO:teuthology.orchestra.run.smithi162.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-05T23:33:37.430 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether be:57:34:32:52:4a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-05T23:33:37.430 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::bc57:34ff:fe32:524a/64 scope link tentative 2023-07-05T23:33:37.430 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2023-07-05T23:33:37.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:37.431 DEBUG:teuthology.orchestra.run.smithi162:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-05T23:33:37.494 INFO:teuthology.orchestra.run.smithi162.stdout:1 2023-07-05T23:33:37.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:37.495 DEBUG:teuthology.orchestra.run.smithi162:> route 2023-07-05T23:33:37.554 INFO:teuthology.orchestra.run.smithi162.stdout:Kernel IP routing table 2023-07-05T23:33:37.555 INFO:teuthology.orchestra.run.smithi162.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-05T23:33:37.555 INFO:teuthology.orchestra.run.smithi162.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-05T23:33:37.555 INFO:teuthology.orchestra.run.smithi162.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-05T23:33:37.555 INFO:teuthology.orchestra.run.smithi162.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-05T23:33:37.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:37.556 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec bash -c ' 2023-07-05T23:33:37.556 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2023-07-05T23:33:37.556 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-05T23:33:37.557 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-05T23:33:37.557 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-05T23:33:37.557 DEBUG:teuthology.orchestra.run.smithi162:> ') 2023-07-05T23:33:37.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:37.661 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2023-07-05T23:33:37.677 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-05T23:33:37.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:37.678 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list-id 2023-07-05T23:33:37.733 INFO:teuthology.orchestra.run.smithi162.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-07-05T23:33:37.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:37.734 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec bash -c ' 2023-07-05T23:33:37.734 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2023-07-05T23:33:37.734 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-07-05T23:33:37.735 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-07-05T23:33:37.735 DEBUG:teuthology.orchestra.run.smithi162:> ') 2023-07-05T23:33:37.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:37.829 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-07-05T23:33:37.872 INFO:teuthology.orchestra.run.smithi162.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-05T23:33:37.872 INFO:teuthology.orchestra.run.smithi162.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-05T23:33:37.873 INFO:teuthology.orchestra.run.smithi162.stdout: inet 127.0.0.1/8 scope host lo 2023-07-05T23:33:37.873 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2023-07-05T23:33:37.873 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 ::1/128 scope host 2023-07-05T23:33:37.873 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2023-07-05T23:33:37.873 INFO:teuthology.orchestra.run.smithi162.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-05T23:33:37.873 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 22:2c:ec:96:da:1d brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-05T23:33:37.874 INFO:teuthology.orchestra.run.smithi162.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-05T23:33:37.874 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2023-07-05T23:33:37.874 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::202c:ecff:fe96:da1d/64 scope link 2023-07-05T23:33:37.874 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2023-07-05T23:33:37.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:37.884 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-07-05T23:33:37.975 INFO:teuthology.orchestra.run.smithi162.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-05T23:33:37.975 INFO:teuthology.orchestra.run.smithi162.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-05T23:33:37.975 INFO:teuthology.orchestra.run.smithi162.stdout: inet 127.0.0.1/8 scope host lo 2023-07-05T23:33:37.975 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2023-07-05T23:33:37.976 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 ::1/128 scope host 2023-07-05T23:33:37.976 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2023-07-05T23:33:37.976 INFO:teuthology.orchestra.run.smithi162.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-05T23:33:37.976 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 22:2c:ec:96:da:1d brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-05T23:33:37.976 INFO:teuthology.orchestra.run.smithi162.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-05T23:33:37.976 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2023-07-05T23:33:37.976 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::202c:ecff:fe96:da1d/64 scope link 2023-07-05T23:33:37.977 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2023-07-05T23:33:37.994 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-07-05T23:33:37.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:37.995 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec bash -c ' 2023-07-05T23:33:37.996 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2023-07-05T23:33:37.996 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-07-05T23:33:37.996 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-07-05T23:33:37.996 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-07-05T23:33:37.997 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-07-05T23:33:37.997 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-07-05T23:33:37.997 DEBUG:teuthology.orchestra.run.smithi162:> ') 2023-07-05T23:33:38.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:38.216 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec bash -c ' 2023-07-05T23:33:38.217 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2023-07-05T23:33:38.217 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link set brx.1 up 2023-07-05T23:33:38.217 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link set dev brx.1 master ceph-brx 2023-07-05T23:33:38.218 DEBUG:teuthology.orchestra.run.smithi162:> ') 2023-07-05T23:33:38.328 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-05T23:33:38.329 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-07-05T23:33:38.351 INFO:teuthology.orchestra.run.smithi162.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-07-05T23:33:38.352 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-05T23:33:38.352 DEBUG:teuthology.orchestra.run.smithi162:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-07-05T23:33:38.409 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2023-07-05T23:33:38.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:38.409 DEBUG:teuthology.orchestra.run.smithi162:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-05T23:33:38.495 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-05T23:33:38.495 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-05T23:33:38.518 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-05T23:33:38.518 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-05T23:33:38.519 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.27:3300,172.21.15.162:3300,172.21.15.162:3301" 2023-07-05T23:33:38.519 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: trying mount with new device syntax: 3@23eebe48-65f5-4d3c-8c2d-4aa171c055d5.cephfs=/ 2023-07-05T23:33:38.519 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.27:3300/172.21.15.162:3300/172.21.15.162:3301" will pass to kernel 2023-07-05T23:33:38.519 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: v2 mount support check returned 2 2023-07-05T23:33:38.519 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: kernel does not support v2 syntax 2023-07-05T23:33:38.519 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-05T23:33:38.591 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-05T23:33:38.591 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-05T23:33:38.591 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.27:3300,172.21.15.162:3300,172.21.15.162:3301" 2023-07-05T23:33:38.591 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: trying mount with new device syntax: 3@23eebe48-65f5-4d3c-8c2d-4aa171c055d5.cephfs=/ 2023-07-05T23:33:38.591 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.27:3300/172.21.15.162:3300/172.21.15.162:3301" will pass to kernel 2023-07-05T23:33:38.592 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: v2 mount support check returned 2 2023-07-05T23:33:38.592 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: kernel does not support v2 syntax 2023-07-05T23:33:38.592 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-05T23:33:38.592 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.27:6789,172.21.15.162:6789,172.21.15.162:6790" 2023-07-05T23:33:38.592 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.27:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2023-07-05T23:33:38.592 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,key=3,mds_namespace=cephfs,fsid=23eebe48-65f5-4d3c-8c2d-4aa171c055d5" will pass to kernel 2023-07-05T23:33:38.593 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-05T23:33:38.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:38.594 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-07-05T23:33:38.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:38.621 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-05T23:33:38.694 INFO:teuthology.orchestra.run.smithi162.stdout:client4938 2023-07-05T23:33:38.694 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-07-05T23:33:38.695 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-05T23:33:38.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:38.752 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-05T23:33:38.826 INFO:teuthology.orchestra.run.smithi162.stdout:client4938 2023-07-05T23:33:38.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:38.826 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-05T23:33:38.897 INFO:teuthology.orchestra.run.smithi162.stdout:client4938 2023-07-05T23:33:38.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:33:38.898 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/23eebe48-65f5-4d3c-8c2d-4aa171c055d5.client4938/status') 2023-07-05T23:33:38.978 INFO:teuthology.orchestra.run.smithi162.stdout:instance: client.4938 (3)172.21.15.162:0/3176445647 2023-07-05T23:33:38.978 INFO:teuthology.orchestra.run.smithi162.stdout:blocklisted: false 2023-07-05T23:33:38.979 INFO:teuthology.orchestra.run.smithi162.stderr:0+1 records in 2023-07-05T23:33:38.979 INFO:teuthology.orchestra.run.smithi162.stderr:0+1 records out 2023-07-05T23:33:38.980 INFO:teuthology.orchestra.run.smithi162.stderr:71 bytes copied, 2.0822e-05 s, 3.4 MB/s 2023-07-05T23:33:38.980 INFO:teuthology.run_tasks:Running task workunit... 2023-07-05T23:33:38.993 INFO:tasks.workunit:Pulling workunits from ref 0a781ef0807ae9473fb1306ef07036226ca4f1a6 2023-07-05T23:33:38.993 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-07-05T23:33:38.994 INFO:tasks.workunit:timeout=3h 2023-07-05T23:33:38.994 INFO:tasks.workunit:cleanup=True 2023-07-05T23:33:38.994 DEBUG:teuthology.orchestra.run.smithi027:> stat -- /home/ubuntu/cephtest/mnt.0 2023-07-05T23:33:39.015 INFO:teuthology.orchestra.run.smithi027.stdout: File: /home/ubuntu/cephtest/mnt.0 2023-07-05T23:33:39.015 INFO:teuthology.orchestra.run.smithi027.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2023-07-05T23:33:39.015 INFO:teuthology.orchestra.run.smithi027.stdout:Device: 2fh/47d Inode: 1 Links: 2 2023-07-05T23:33:39.015 INFO:teuthology.orchestra.run.smithi027.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-05T23:33:39.015 INFO:teuthology.orchestra.run.smithi027.stdout:Context: system_u:object_r:cephfs_t:s0 2023-07-05T23:33:39.016 INFO:teuthology.orchestra.run.smithi027.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-07-05T23:33:39.017 INFO:teuthology.orchestra.run.smithi027.stdout:Modify: 2023-07-05 23:32:53.316560229 +0000 2023-07-05T23:33:39.017 INFO:teuthology.orchestra.run.smithi027.stdout:Change: 2023-07-05 23:33:03.184161043 +0000 2023-07-05T23:33:39.017 INFO:teuthology.orchestra.run.smithi027.stdout: Birth: 2023-07-05 23:32:53.316560229 +0000 2023-07-05T23:33:39.018 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2023-07-05T23:33:39.018 DEBUG:teuthology.orchestra.run.smithi027:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2023-07-05T23:33:39.090 DEBUG:teuthology.orchestra.run.smithi027:> stat -- /home/ubuntu/cephtest/mnt.2 2023-07-05T23:33:39.152 INFO:teuthology.orchestra.run.smithi027.stdout: File: /home/ubuntu/cephtest/mnt.2 2023-07-05T23:33:39.152 INFO:teuthology.orchestra.run.smithi027.stdout: Size: 1 Blocks: 0 IO Block: 65536 directory 2023-07-05T23:33:39.152 INFO:teuthology.orchestra.run.smithi027.stdout:Device: 30h/48d Inode: 1 Links: 3 2023-07-05T23:33:39.153 INFO:teuthology.orchestra.run.smithi027.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-05T23:33:39.153 INFO:teuthology.orchestra.run.smithi027.stdout:Context: system_u:object_r:cephfs_t:s0 2023-07-05T23:33:39.153 INFO:teuthology.orchestra.run.smithi027.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-07-05T23:33:39.153 INFO:teuthology.orchestra.run.smithi027.stdout:Modify: 2023-07-05 23:33:39.082830683 +0000 2023-07-05T23:33:39.154 INFO:teuthology.orchestra.run.smithi027.stdout:Change: 2023-07-05 23:33:39.082830683 +0000 2023-07-05T23:33:39.154 INFO:teuthology.orchestra.run.smithi027.stdout: Birth: 2023-07-05 23:32:53.316560229 +0000 2023-07-05T23:33:39.155 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.2 2023-07-05T23:33:39.155 DEBUG:teuthology.orchestra.run.smithi027:> cd -- /home/ubuntu/cephtest/mnt.2 && sudo install -d -m 0755 --owner=ubuntu -- client.2 2023-07-05T23:33:39.225 DEBUG:teuthology.orchestra.run.smithi162:> stat -- /home/ubuntu/cephtest/mnt.1 2023-07-05T23:33:39.244 INFO:teuthology.orchestra.run.smithi162.stdout: File: /home/ubuntu/cephtest/mnt.1 2023-07-05T23:33:39.244 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 2 Blocks: 0 IO Block: 65536 directory 2023-07-05T23:33:39.244 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 2eh/46d Inode: 1 Links: 4 2023-07-05T23:33:39.244 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-05T23:33:39.245 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:cephfs_t:s0 2023-07-05T23:33:39.245 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-07-05T23:33:39.245 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2023-07-05 23:33:39.218827243 +0000 2023-07-05T23:33:39.245 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2023-07-05 23:33:39.218827243 +0000 2023-07-05T23:33:39.245 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2023-07-05 23:32:53.316560229 +0000 2023-07-05T23:33:39.245 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2023-07-05T23:33:39.246 DEBUG:teuthology.orchestra.run.smithi162:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2023-07-05T23:33:39.316 DEBUG:teuthology.orchestra.run.smithi162:> stat -- /home/ubuntu/cephtest/mnt.3 2023-07-05T23:33:39.374 INFO:teuthology.orchestra.run.smithi162.stdout: File: /home/ubuntu/cephtest/mnt.3 2023-07-05T23:33:39.374 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 3 Blocks: 0 IO Block: 65536 directory 2023-07-05T23:33:39.374 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 30h/48d Inode: 1 Links: 5 2023-07-05T23:33:39.374 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-05T23:33:39.375 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:cephfs_t:s0 2023-07-05T23:33:39.375 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-07-05T23:33:39.375 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2023-07-05 23:33:39.309020181 +0000 2023-07-05T23:33:39.375 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2023-07-05 23:33:39.309020181 +0000 2023-07-05T23:33:39.375 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2023-07-05 23:32:53.316560229 +0000 2023-07-05T23:33:39.375 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.3 2023-07-05T23:33:39.376 DEBUG:teuthology.orchestra.run.smithi162:> cd -- /home/ubuntu/cephtest/mnt.3 && sudo install -d -m 0755 --owner=ubuntu -- client.3 2023-07-05T23:33:39.445 DEBUG:teuthology.orchestra.run.smithi027:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 0a781ef0807ae9473fb1306ef07036226ca4f1a6 2023-07-05T23:33:39.445 DEBUG:teuthology.orchestra.run.smithi027:> rm -rf /home/ubuntu/cephtest/clone.client.2 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.2 && cd /home/ubuntu/cephtest/clone.client.2 && git checkout 0a781ef0807ae9473fb1306ef07036226ca4f1a6 2023-07-05T23:33:39.446 DEBUG:teuthology.orchestra.run.smithi162:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 0a781ef0807ae9473fb1306ef07036226ca4f1a6 2023-07-05T23:33:39.447 DEBUG:teuthology.orchestra.run.smithi162:> rm -rf /home/ubuntu/cephtest/clone.client.3 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.3 && cd /home/ubuntu/cephtest/clone.client.3 && git checkout 0a781ef0807ae9473fb1306ef07036226ca4f1a6 2023-07-05T23:33:39.466 INFO:tasks.workunit.client.0.smithi027.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-07-05T23:33:39.467 INFO:tasks.workunit.client.2.smithi027.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.2'... 2023-07-05T23:33:39.501 INFO:tasks.workunit.client.1.smithi162.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2023-07-05T23:33:39.502 INFO:tasks.workunit.client.3.smithi162.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.3'... 2023-07-05T23:33:51.630 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:33:51.634 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:34:21.718 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:34:21.768 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:34:50.435 INFO:tasks.workunit.client.1.smithi162.stderr:Updating files: 86% (10074/11710) Updating files: 87% (10188/11710) Updating files: 88% (10305/11710) Updating files: 89% (10422/11710) Updating files: 90% (10539/11710) Updating files: 91% (10657/11710) Updating files: 92% (10774/11710) Updating files: 93% (10891/11710) Updating files: 94% (11008/11710) Updating files: 95% (11125/11710) Updating files: 96% (11242/11710) Updating files: 97% (11359/11710) Updating files: 98% (11476/11710) Updating files: 99% (11593/11710) Updating files: 100% (11710/11710) Updating files: 100% (11710/11710), done. 2023-07-05T23:34:50.738 INFO:tasks.workunit.client.3.smithi162.stderr:Updating files: 95% (11185/11710) Updating files: 96% (11242/11710) Updating files: 97% (11359/11710) Updating files: 98% (11476/11710) Updating files: 99% (11593/11710) Updating files: 100% (11710/11710) Updating files: 100% (11710/11710), done. 2023-07-05T23:34:51.042 INFO:tasks.workunit.client.1.smithi162.stderr:Note: switching to '0a781ef0807ae9473fb1306ef07036226ca4f1a6'. 2023-07-05T23:34:51.043 INFO:tasks.workunit.client.1.smithi162.stderr: 2023-07-05T23:34:51.043 INFO:tasks.workunit.client.1.smithi162.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-07-05T23:34:51.043 INFO:tasks.workunit.client.1.smithi162.stderr:changes and commit them, and you can discard any commits you make in this 2023-07-05T23:34:51.043 INFO:tasks.workunit.client.1.smithi162.stderr:state without impacting any branches by switching back to a branch. 2023-07-05T23:34:51.043 INFO:tasks.workunit.client.1.smithi162.stderr: 2023-07-05T23:34:51.044 INFO:tasks.workunit.client.1.smithi162.stderr:If you want to create a new branch to retain commits you create, you may 2023-07-05T23:34:51.044 INFO:tasks.workunit.client.1.smithi162.stderr:do so (now or later) by using -c with the switch command. Example: 2023-07-05T23:34:51.044 INFO:tasks.workunit.client.1.smithi162.stderr: 2023-07-05T23:34:51.044 INFO:tasks.workunit.client.1.smithi162.stderr: git switch -c 2023-07-05T23:34:51.044 INFO:tasks.workunit.client.1.smithi162.stderr: 2023-07-05T23:34:51.044 INFO:tasks.workunit.client.1.smithi162.stderr:Or undo this operation with: 2023-07-05T23:34:51.044 INFO:tasks.workunit.client.1.smithi162.stderr: 2023-07-05T23:34:51.044 INFO:tasks.workunit.client.1.smithi162.stderr: git switch - 2023-07-05T23:34:51.045 INFO:tasks.workunit.client.1.smithi162.stderr: 2023-07-05T23:34:51.045 INFO:tasks.workunit.client.1.smithi162.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-07-05T23:34:51.045 INFO:tasks.workunit.client.1.smithi162.stderr: 2023-07-05T23:34:51.045 INFO:tasks.workunit.client.1.smithi162.stderr:HEAD is now at 0a781ef0807 qa/cephfs: use run_ceph_cmd() when cmd output is not needed 2023-07-05T23:34:51.048 DEBUG:teuthology.orchestra.run.smithi162:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2023-07-05T23:34:51.081 INFO:tasks.workunit.client.1.smithi162.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-07-05T23:34:51.083 INFO:tasks.workunit.client.1.smithi162.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2023-07-05T23:34:51.085 INFO:tasks.workunit.client.1.smithi162.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-07-05T23:34:51.460 INFO:tasks.workunit.client.3.smithi162.stderr:Note: switching to '0a781ef0807ae9473fb1306ef07036226ca4f1a6'. 2023-07-05T23:34:51.460 INFO:tasks.workunit.client.3.smithi162.stderr: 2023-07-05T23:34:51.460 INFO:tasks.workunit.client.3.smithi162.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-07-05T23:34:51.461 INFO:tasks.workunit.client.3.smithi162.stderr:changes and commit them, and you can discard any commits you make in this 2023-07-05T23:34:51.461 INFO:tasks.workunit.client.3.smithi162.stderr:state without impacting any branches by switching back to a branch. 2023-07-05T23:34:51.461 INFO:tasks.workunit.client.3.smithi162.stderr: 2023-07-05T23:34:51.461 INFO:tasks.workunit.client.3.smithi162.stderr:If you want to create a new branch to retain commits you create, you may 2023-07-05T23:34:51.461 INFO:tasks.workunit.client.3.smithi162.stderr:do so (now or later) by using -c with the switch command. Example: 2023-07-05T23:34:51.462 INFO:tasks.workunit.client.3.smithi162.stderr: 2023-07-05T23:34:51.462 INFO:tasks.workunit.client.3.smithi162.stderr: git switch -c 2023-07-05T23:34:51.462 INFO:tasks.workunit.client.3.smithi162.stderr: 2023-07-05T23:34:51.462 INFO:tasks.workunit.client.3.smithi162.stderr:Or undo this operation with: 2023-07-05T23:34:51.462 INFO:tasks.workunit.client.3.smithi162.stderr: 2023-07-05T23:34:51.463 INFO:tasks.workunit.client.3.smithi162.stderr: git switch - 2023-07-05T23:34:51.463 INFO:tasks.workunit.client.3.smithi162.stderr: 2023-07-05T23:34:51.463 INFO:tasks.workunit.client.3.smithi162.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-07-05T23:34:51.463 INFO:tasks.workunit.client.3.smithi162.stderr: 2023-07-05T23:34:51.463 INFO:tasks.workunit.client.3.smithi162.stderr:HEAD is now at 0a781ef0807 qa/cephfs: use run_ceph_cmd() when cmd output is not needed 2023-07-05T23:34:51.466 DEBUG:teuthology.orchestra.run.smithi162:> cd -- /home/ubuntu/cephtest/clone.client.3/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.3 2023-07-05T23:34:51.530 INFO:tasks.workunit.client.3.smithi162.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-07-05T23:34:51.531 INFO:tasks.workunit.client.3.smithi162.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.3/qa/workunits/direct_io' 2023-07-05T23:34:51.531 INFO:tasks.workunit.client.3.smithi162.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-07-05T23:34:51.664 INFO:tasks.workunit.client.1.smithi162.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-07-05T23:34:51.664 INFO:tasks.workunit.client.3.smithi162.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-07-05T23:34:51.724 INFO:tasks.workunit.client.1.smithi162.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-07-05T23:34:51.725 INFO:tasks.workunit.client.3.smithi162.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-07-05T23:34:51.762 INFO:tasks.workunit.client.1.smithi162.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2023-07-05T23:34:51.763 INFO:tasks.workunit.client.3.smithi162.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.3/qa/workunits/direct_io' 2023-07-05T23:34:51.765 INFO:tasks.workunit.client.1.smithi162.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2023-07-05T23:34:51.766 INFO:tasks.workunit.client.1.smithi162.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-07-05T23:34:51.766 INFO:tasks.workunit.client.3.smithi162.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.3/qa/workunits/fs' 2023-07-05T23:34:51.766 INFO:tasks.workunit.client.3.smithi162.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-07-05T23:34:51.801 INFO:tasks.workunit.client.1.smithi162.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2023-07-05T23:34:51.802 INFO:tasks.workunit.client.3.smithi162.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.3/qa/workunits/fs' 2023-07-05T23:34:51.805 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-07-05T23:34:51.806 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/home/ubuntu/cephtest/workunits.list.client.3 of=/dev/stdout 2023-07-05T23:34:51.807 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-07-05T23:34:51.807 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2023-07-05T23:34:51.866 INFO:tasks.workunit:Running workunits matching fs/quota on client.3... 2023-07-05T23:34:51.867 INFO:tasks.workunit:Running workunit fs/quota/quota.sh... 2023-07-05T23:34:51.868 DEBUG:teuthology.orchestra.run.smithi162:workunit test fs/quota/quota.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.3/client.3/tmp && cd -- /home/ubuntu/cephtest/mnt.3/client.3/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0a781ef0807ae9473fb1306ef07036226ca4f1a6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="3" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.3 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.3 CEPH_MNT=/home/ubuntu/cephtest/mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.3/qa/workunits/fs/quota/quota.sh 2023-07-05T23:34:51.870 INFO:tasks.workunit:Running workunits matching fs/quota on client.1... 2023-07-05T23:34:51.871 INFO:tasks.workunit:Running workunit fs/quota/quota.sh... 2023-07-05T23:34:51.872 DEBUG:teuthology.orchestra.run.smithi162:workunit test fs/quota/quota.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0a781ef0807ae9473fb1306ef07036226ca4f1a6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/fs/quota/quota.sh 2023-07-05T23:34:51.935 INFO:tasks.workunit.client.3.smithi162.stderr:+ mkdir quota-test 2023-07-05T23:34:51.936 INFO:tasks.workunit.client.1.smithi162.stderr:+ mkdir quota-test 2023-07-05T23:34:51.937 INFO:tasks.workunit.client.3.smithi162.stderr:+ cd quota-test 2023-07-05T23:34:51.938 INFO:tasks.workunit.client.3.smithi162.stderr:+ setfattr . -n ceph.quota.max_bytes -v 100M 2023-07-05T23:34:51.938 INFO:tasks.workunit.client.1.smithi162.stderr:+ cd quota-test 2023-07-05T23:34:51.939 INFO:tasks.workunit.client.1.smithi162.stderr:+ setfattr . -n ceph.quota.max_bytes -v 100M 2023-07-05T23:34:51.951 INFO:tasks.workunit.client.3.smithi162.stderr:+ expect_false write_file big 1000 2023-07-05T23:34:51.951 INFO:tasks.workunit.client.3.smithi162.stderr:+ set -x 2023-07-05T23:34:51.951 INFO:tasks.workunit.client.3.smithi162.stderr:+ write_file big 1000 2023-07-05T23:34:51.951 INFO:tasks.workunit.client.3.smithi162.stderr:+ set +x 2023-07-05T23:34:51.952 INFO:tasks.workunit.client.1.smithi162.stderr:+ expect_false write_file big 1000 2023-07-05T23:34:51.952 INFO:tasks.workunit.client.1.smithi162.stderr:+ set -x 2023-07-05T23:34:51.953 INFO:tasks.workunit.client.1.smithi162.stderr:+ write_file big 1000 2023-07-05T23:34:51.953 INFO:tasks.workunit.client.1.smithi162.stderr:+ set +x 2023-07-05T23:34:52.552 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:34:52.555 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:34:53.169 INFO:tasks.workunit.client.2.smithi027.stderr:Updating files: 82% (9661/11710) Updating files: 83% (9720/11710) Updating files: 84% (9837/11710) Updating files: 85% (9954/11710) Updating files: 86% (10071/11710) Updating files: 87% (10188/11710) Updating files: 88% (10305/11710) Updating files: 89% (10422/11710) Updating files: 90% (10539/11710) Updating files: 91% (10657/11710) Updating files: 92% (10774/11710) Updating files: 93% (10891/11710) Updating files: 94% (11008/11710) Updating files: 95% (11125/11710) Updating files: 96% (11242/11710) Updating files: 97% (11359/11710) Updating files: 98% (11476/11710) Updating files: 99% (11593/11710) Updating files: 100% (11710/11710) Updating files: 100% (11710/11710), done. 2023-07-05T23:34:53.180 INFO:tasks.workunit.client.0.smithi027.stderr:Updating files: 82% (9631/11710) Updating files: 83% (9720/11710) Updating files: 84% (9837/11710) Updating files: 85% (9954/11710) Updating files: 86% (10071/11710) Updating files: 87% (10188/11710) Updating files: 88% (10305/11710) Updating files: 89% (10422/11710) Updating files: 90% (10539/11710) Updating files: 91% (10657/11710) Updating files: 92% (10774/11710) Updating files: 93% (10891/11710) Updating files: 94% (11008/11710) Updating files: 95% (11125/11710) Updating files: 96% (11242/11710) Updating files: 97% (11359/11710) Updating files: 98% (11476/11710) Updating files: 99% (11593/11710) Updating files: 100% (11710/11710) Updating files: 100% (11710/11710), done. 2023-07-05T23:34:53.570 INFO:tasks.workunit.client.2.smithi027.stderr:Note: switching to '0a781ef0807ae9473fb1306ef07036226ca4f1a6'. 2023-07-05T23:34:53.570 INFO:tasks.workunit.client.2.smithi027.stderr: 2023-07-05T23:34:53.570 INFO:tasks.workunit.client.2.smithi027.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-07-05T23:34:53.570 INFO:tasks.workunit.client.2.smithi027.stderr:changes and commit them, and you can discard any commits you make in this 2023-07-05T23:34:53.571 INFO:tasks.workunit.client.2.smithi027.stderr:state without impacting any branches by switching back to a branch. 2023-07-05T23:34:53.571 INFO:tasks.workunit.client.2.smithi027.stderr: 2023-07-05T23:34:53.571 INFO:tasks.workunit.client.2.smithi027.stderr:If you want to create a new branch to retain commits you create, you may 2023-07-05T23:34:53.571 INFO:tasks.workunit.client.2.smithi027.stderr:do so (now or later) by using -c with the switch command. Example: 2023-07-05T23:34:53.571 INFO:tasks.workunit.client.2.smithi027.stderr: 2023-07-05T23:34:53.571 INFO:tasks.workunit.client.2.smithi027.stderr: git switch -c 2023-07-05T23:34:53.572 INFO:tasks.workunit.client.2.smithi027.stderr: 2023-07-05T23:34:53.572 INFO:tasks.workunit.client.2.smithi027.stderr:Or undo this operation with: 2023-07-05T23:34:53.572 INFO:tasks.workunit.client.2.smithi027.stderr: 2023-07-05T23:34:53.572 INFO:tasks.workunit.client.2.smithi027.stderr: git switch - 2023-07-05T23:34:53.572 INFO:tasks.workunit.client.2.smithi027.stderr: 2023-07-05T23:34:53.572 INFO:tasks.workunit.client.2.smithi027.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-07-05T23:34:53.572 INFO:tasks.workunit.client.2.smithi027.stderr: 2023-07-05T23:34:53.573 INFO:tasks.workunit.client.2.smithi027.stderr:HEAD is now at 0a781ef0807 qa/cephfs: use run_ceph_cmd() when cmd output is not needed 2023-07-05T23:34:53.575 DEBUG:teuthology.orchestra.run.smithi027:> cd -- /home/ubuntu/cephtest/clone.client.2/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.2 2023-07-05T23:34:53.583 INFO:tasks.workunit.client.0.smithi027.stderr:Note: switching to '0a781ef0807ae9473fb1306ef07036226ca4f1a6'. 2023-07-05T23:34:53.583 INFO:tasks.workunit.client.0.smithi027.stderr: 2023-07-05T23:34:53.583 INFO:tasks.workunit.client.0.smithi027.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-07-05T23:34:53.583 INFO:tasks.workunit.client.0.smithi027.stderr:changes and commit them, and you can discard any commits you make in this 2023-07-05T23:34:53.583 INFO:tasks.workunit.client.0.smithi027.stderr:state without impacting any branches by switching back to a branch. 2023-07-05T23:34:53.584 INFO:tasks.workunit.client.0.smithi027.stderr: 2023-07-05T23:34:53.584 INFO:tasks.workunit.client.0.smithi027.stderr:If you want to create a new branch to retain commits you create, you may 2023-07-05T23:34:53.584 INFO:tasks.workunit.client.0.smithi027.stderr:do so (now or later) by using -c with the switch command. Example: 2023-07-05T23:34:53.584 INFO:tasks.workunit.client.0.smithi027.stderr: 2023-07-05T23:34:53.584 INFO:tasks.workunit.client.0.smithi027.stderr: git switch -c 2023-07-05T23:34:53.584 INFO:tasks.workunit.client.0.smithi027.stderr: 2023-07-05T23:34:53.584 INFO:tasks.workunit.client.0.smithi027.stderr:Or undo this operation with: 2023-07-05T23:34:53.584 INFO:tasks.workunit.client.0.smithi027.stderr: 2023-07-05T23:34:53.585 INFO:tasks.workunit.client.0.smithi027.stderr: git switch - 2023-07-05T23:34:53.585 INFO:tasks.workunit.client.0.smithi027.stderr: 2023-07-05T23:34:53.585 INFO:tasks.workunit.client.0.smithi027.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-07-05T23:34:53.585 INFO:tasks.workunit.client.0.smithi027.stderr: 2023-07-05T23:34:53.585 INFO:tasks.workunit.client.0.smithi027.stderr:HEAD is now at 0a781ef0807 qa/cephfs: use run_ceph_cmd() when cmd output is not needed 2023-07-05T23:34:53.589 DEBUG:teuthology.orchestra.run.smithi027:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-07-05T23:34:53.599 INFO:tasks.workunit.client.2.smithi027.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-07-05T23:34:53.602 INFO:tasks.workunit.client.2.smithi027.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.2/qa/workunits/direct_io' 2023-07-05T23:34:53.602 INFO:tasks.workunit.client.2.smithi027.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-07-05T23:34:53.616 INFO:tasks.workunit.client.0.smithi027.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-07-05T23:34:53.618 INFO:tasks.workunit.client.0.smithi027.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-07-05T23:34:53.618 INFO:tasks.workunit.client.0.smithi027.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-07-05T23:34:54.170 INFO:tasks.workunit.client.0.smithi027.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-07-05T23:34:54.171 INFO:tasks.workunit.client.2.smithi027.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-07-05T23:34:54.233 INFO:tasks.workunit.client.0.smithi027.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-07-05T23:34:54.233 INFO:tasks.workunit.client.2.smithi027.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-07-05T23:34:54.274 INFO:tasks.workunit.client.0.smithi027.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-07-05T23:34:54.275 INFO:tasks.workunit.client.2.smithi027.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.2/qa/workunits/direct_io' 2023-07-05T23:34:54.275 INFO:tasks.workunit.client.0.smithi027.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-07-05T23:34:54.275 INFO:tasks.workunit.client.0.smithi027.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-07-05T23:34:54.276 INFO:tasks.workunit.client.2.smithi027.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.2/qa/workunits/fs' 2023-07-05T23:34:54.276 INFO:tasks.workunit.client.2.smithi027.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-07-05T23:34:54.314 INFO:tasks.workunit.client.0.smithi027.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-07-05T23:34:54.315 INFO:tasks.workunit.client.2.smithi027.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.2/qa/workunits/fs' 2023-07-05T23:34:54.317 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-07-05T23:34:54.318 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-07-05T23:34:54.318 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-07-05T23:34:54.319 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/home/ubuntu/cephtest/workunits.list.client.2 of=/dev/stdout 2023-07-05T23:34:54.378 INFO:tasks.workunit:Running workunits matching fs/quota on client.0... 2023-07-05T23:34:54.381 INFO:tasks.workunit:Running workunit fs/quota/quota.sh... 2023-07-05T23:34:54.381 DEBUG:teuthology.orchestra.run.smithi027:workunit test fs/quota/quota.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0a781ef0807ae9473fb1306ef07036226ca4f1a6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/quota/quota.sh 2023-07-05T23:34:54.382 INFO:tasks.workunit:Running workunits matching fs/quota on client.2... 2023-07-05T23:34:54.385 INFO:tasks.workunit:Running workunit fs/quota/quota.sh... 2023-07-05T23:34:54.386 DEBUG:teuthology.orchestra.run.smithi027:workunit test fs/quota/quota.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.2/client.2/tmp && cd -- /home/ubuntu/cephtest/mnt.2/client.2/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0a781ef0807ae9473fb1306ef07036226ca4f1a6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="2" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.2 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.2 CEPH_MNT=/home/ubuntu/cephtest/mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.2/qa/workunits/fs/quota/quota.sh 2023-07-05T23:34:54.443 INFO:tasks.workunit.client.0.smithi027.stderr:+ mkdir quota-test 2023-07-05T23:34:54.448 INFO:tasks.workunit.client.2.smithi027.stderr:+ mkdir quota-test 2023-07-05T23:34:54.448 INFO:tasks.workunit.client.0.smithi027.stderr:+ cd quota-test 2023-07-05T23:34:54.448 INFO:tasks.workunit.client.0.smithi027.stderr:+ setfattr . -n ceph.quota.max_bytes -v 100M 2023-07-05T23:34:54.449 INFO:tasks.workunit.client.2.smithi027.stderr:+ cd quota-test 2023-07-05T23:34:54.449 INFO:tasks.workunit.client.2.smithi027.stderr:+ setfattr . -n ceph.quota.max_bytes -v 100M 2023-07-05T23:34:54.451 INFO:tasks.workunit.client.0.smithi027.stderr:+ expect_false write_file big 1000 2023-07-05T23:34:54.451 INFO:tasks.workunit.client.0.smithi027.stderr:+ set -x 2023-07-05T23:34:54.452 INFO:tasks.workunit.client.0.smithi027.stderr:+ write_file big 1000 2023-07-05T23:34:54.452 INFO:tasks.workunit.client.0.smithi027.stderr:+ set +x 2023-07-05T23:34:54.452 INFO:tasks.workunit.client.2.smithi027.stderr:+ expect_false write_file big 1000 2023-07-05T23:34:54.453 INFO:tasks.workunit.client.2.smithi027.stderr:+ set -x 2023-07-05T23:34:54.453 INFO:tasks.workunit.client.2.smithi027.stderr:+ write_file big 1000 2023-07-05T23:34:54.453 INFO:tasks.workunit.client.2.smithi027.stderr:+ set +x 2023-07-05T23:34:59.747 INFO:tasks.workunit.client.1.smithi162.stdout:Try to write 155189248 2023-07-05T23:34:59.748 INFO:tasks.workunit.client.1.smithi162.stderr:+ return 1 2023-07-05T23:34:59.749 INFO:tasks.workunit.client.1.smithi162.stderr:+ return 0 2023-07-05T23:34:59.749 INFO:tasks.workunit.client.1.smithi162.stderr:+ expect_false write_file second 10 2023-07-05T23:34:59.749 INFO:tasks.workunit.client.1.smithi162.stderr:+ set -x 2023-07-05T23:34:59.749 INFO:tasks.workunit.client.1.smithi162.stderr:+ write_file second 10 2023-07-05T23:34:59.749 INFO:tasks.workunit.client.1.smithi162.stderr:+ set +x 2023-07-05T23:34:59.749 INFO:tasks.workunit.client.3.smithi162.stdout:Try to write 155189248 2023-07-05T23:34:59.750 INFO:tasks.workunit.client.3.smithi162.stderr:+ return 1 2023-07-05T23:34:59.750 INFO:tasks.workunit.client.3.smithi162.stderr:+ return 0 2023-07-05T23:34:59.750 INFO:tasks.workunit.client.3.smithi162.stderr:+ expect_false write_file second 10 2023-07-05T23:34:59.751 INFO:tasks.workunit.client.3.smithi162.stderr:+ set -x 2023-07-05T23:34:59.751 INFO:tasks.workunit.client.3.smithi162.stderr:+ write_file second 10 2023-07-05T23:34:59.751 INFO:tasks.workunit.client.3.smithi162.stderr:+ set +x 2023-07-05T23:34:59.751 INFO:tasks.workunit.client.1.smithi162.stdout:Try to write 1048576 2023-07-05T23:34:59.752 INFO:tasks.workunit.client.1.smithi162.stderr:+ return 1 2023-07-05T23:34:59.752 INFO:tasks.workunit.client.1.smithi162.stderr:+ return 0 2023-07-05T23:34:59.753 INFO:tasks.workunit.client.1.smithi162.stderr:+ setfattr . -n ceph.quota.max_bytes -v 0 2023-07-05T23:34:59.753 INFO:tasks.workunit.client.3.smithi162.stdout:Try to write 1048576 2023-07-05T23:34:59.753 INFO:tasks.workunit.client.3.smithi162.stderr:+ return 1 2023-07-05T23:34:59.754 INFO:tasks.workunit.client.3.smithi162.stderr:+ return 0 2023-07-05T23:34:59.754 INFO:tasks.workunit.client.3.smithi162.stderr:+ setfattr . -n ceph.quota.max_bytes -v 0 2023-07-05T23:34:59.804 INFO:tasks.workunit.client.3.smithi162.stderr:+ dd if=/dev/zero of=third bs=1M count=10 2023-07-05T23:34:59.804 INFO:tasks.workunit.client.1.smithi162.stderr:+ dd if=/dev/zero of=third bs=1M count=10 2023-07-05T23:34:59.818 INFO:tasks.workunit.client.1.smithi162.stderr:10+0 records in 2023-07-05T23:34:59.818 INFO:tasks.workunit.client.1.smithi162.stderr:10+0 records out 2023-07-05T23:34:59.818 INFO:tasks.workunit.client.1.smithi162.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0114769 s, 914 MB/s 2023-07-05T23:34:59.819 INFO:tasks.workunit.client.3.smithi162.stderr:10+0 records in 2023-07-05T23:34:59.819 INFO:tasks.workunit.client.3.smithi162.stderr:10+0 records out 2023-07-05T23:34:59.819 INFO:tasks.workunit.client.3.smithi162.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0110189 s, 952 MB/s 2023-07-05T23:34:59.819 INFO:tasks.workunit.client.1.smithi162.stderr:+ dd if=/dev/zero of=big2 bs=1M count=100 2023-07-05T23:34:59.819 INFO:tasks.workunit.client.3.smithi162.stderr:+ dd if=/dev/zero of=big2 bs=1M count=100 2023-07-05T23:34:59.873 INFO:tasks.workunit.client.1.smithi162.stderr:100+0 records in 2023-07-05T23:34:59.873 INFO:tasks.workunit.client.1.smithi162.stderr:100+0 records out 2023-07-05T23:34:59.873 INFO:tasks.workunit.client.1.smithi162.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.0534137 s, 2.0 GB/s 2023-07-05T23:34:59.874 INFO:tasks.workunit.client.1.smithi162.stderr:+ rm -rf big big2 second third 2023-07-05T23:34:59.877 INFO:tasks.workunit.client.3.smithi162.stderr:100+0 records in 2023-07-05T23:34:59.877 INFO:tasks.workunit.client.3.smithi162.stderr:100+0 records out 2023-07-05T23:34:59.877 INFO:tasks.workunit.client.3.smithi162.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.056999 s, 1.8 GB/s 2023-07-05T23:34:59.878 INFO:tasks.workunit.client.3.smithi162.stderr:+ rm -rf big big2 second third 2023-07-05T23:34:59.880 INFO:tasks.workunit.client.1.smithi162.stderr:+ setfattr . -n ceph.quota.max_files -v 5 2023-07-05T23:34:59.886 INFO:tasks.workunit.client.3.smithi162.stderr:+ setfattr . -n ceph.quota.max_files -v 5 2023-07-05T23:34:59.887 INFO:tasks.workunit.client.1.smithi162.stderr:+ mkdir ok 2023-07-05T23:34:59.889 INFO:tasks.workunit.client.1.smithi162.stderr:+ touch ok/1 2023-07-05T23:34:59.891 INFO:tasks.workunit.client.1.smithi162.stderr:+ touch ok/2 2023-07-05T23:34:59.892 INFO:tasks.workunit.client.3.smithi162.stderr:+ mkdir ok 2023-07-05T23:34:59.893 INFO:tasks.workunit.client.1.smithi162.stderr:+ touch 3 2023-07-05T23:34:59.894 INFO:tasks.workunit.client.3.smithi162.stderr:+ touch ok/1 2023-07-05T23:34:59.895 INFO:tasks.workunit.client.1.smithi162.stderr:+ expect_false touch shouldbefail 2023-07-05T23:34:59.895 INFO:tasks.workunit.client.1.smithi162.stderr:+ set -x 2023-07-05T23:34:59.896 INFO:tasks.workunit.client.1.smithi162.stderr:+ touch shouldbefail 2023-07-05T23:34:59.896 INFO:tasks.workunit.client.1.smithi162.stderr:touch: cannot touch 'shouldbefail': Disk quota exceeded 2023-07-05T23:34:59.896 INFO:tasks.workunit.client.1.smithi162.stderr:+ return 0 2023-07-05T23:34:59.896 INFO:tasks.workunit.client.1.smithi162.stderr:+ expect_false touch ok/shouldbefail 2023-07-05T23:34:59.896 INFO:tasks.workunit.client.1.smithi162.stderr:+ set -x 2023-07-05T23:34:59.896 INFO:tasks.workunit.client.1.smithi162.stderr:+ touch ok/shouldbefail 2023-07-05T23:34:59.897 INFO:tasks.workunit.client.3.smithi162.stderr:+ touch ok/2 2023-07-05T23:34:59.897 INFO:tasks.workunit.client.1.smithi162.stderr:touch: cannot touch 'ok/shouldbefail': Disk quota exceeded 2023-07-05T23:34:59.897 INFO:tasks.workunit.client.1.smithi162.stderr:+ return 0 2023-07-05T23:34:59.898 INFO:tasks.workunit.client.1.smithi162.stderr:+ setfattr . -n ceph.quota.max_files -v 0 2023-07-05T23:34:59.898 INFO:tasks.workunit.client.3.smithi162.stderr:+ touch 3 2023-07-05T23:34:59.899 INFO:tasks.workunit.client.3.smithi162.stderr:+ expect_false touch shouldbefail 2023-07-05T23:34:59.899 INFO:tasks.workunit.client.3.smithi162.stderr:+ set -x 2023-07-05T23:34:59.899 INFO:tasks.workunit.client.3.smithi162.stderr:+ touch shouldbefail 2023-07-05T23:34:59.899 INFO:tasks.workunit.client.3.smithi162.stderr:touch: cannot touch 'shouldbefail': Disk quota exceeded 2023-07-05T23:34:59.900 INFO:tasks.workunit.client.3.smithi162.stderr:+ return 0 2023-07-05T23:34:59.900 INFO:tasks.workunit.client.3.smithi162.stderr:+ expect_false touch ok/shouldbefail 2023-07-05T23:34:59.900 INFO:tasks.workunit.client.3.smithi162.stderr:+ set -x 2023-07-05T23:34:59.900 INFO:tasks.workunit.client.3.smithi162.stderr:+ touch ok/shouldbefail 2023-07-05T23:34:59.901 INFO:tasks.workunit.client.3.smithi162.stderr:touch: cannot touch 'ok/shouldbefail': Disk quota exceeded 2023-07-05T23:34:59.901 INFO:tasks.workunit.client.3.smithi162.stderr:+ return 0 2023-07-05T23:34:59.901 INFO:tasks.workunit.client.3.smithi162.stderr:+ setfattr . -n ceph.quota.max_files -v 0 2023-07-05T23:34:59.903 INFO:tasks.workunit.client.1.smithi162.stderr:+ touch shouldbecreated 2023-07-05T23:34:59.905 INFO:tasks.workunit.client.1.smithi162.stderr:+ touch shouldbecreated2 2023-07-05T23:34:59.905 INFO:tasks.workunit.client.3.smithi162.stderr:+ touch shouldbecreated 2023-07-05T23:34:59.907 INFO:tasks.workunit.client.3.smithi162.stderr:+ touch shouldbecreated2 2023-07-05T23:34:59.910 INFO:tasks.workunit.client.1.smithi162.stderr:+ rm -rf 3 ok shouldbecreated shouldbecreated2 2023-07-05T23:34:59.912 INFO:tasks.workunit.client.3.smithi162.stderr:+ rm -rf 3 ok shouldbecreated shouldbecreated2 2023-07-05T23:34:59.927 INFO:tasks.workunit.client.1.smithi162.stderr:+ mkdir bytes bytes/files 2023-07-05T23:34:59.931 INFO:tasks.workunit.client.3.smithi162.stderr:+ mkdir bytes bytes/files 2023-07-05T23:34:59.931 INFO:tasks.workunit.client.1.smithi162.stderr:+ setfattr bytes -n ceph.quota.max_bytes -v 10M 2023-07-05T23:34:59.933 INFO:tasks.workunit.client.3.smithi162.stderr:+ setfattr bytes -n ceph.quota.max_bytes -v 10M 2023-07-05T23:34:59.942 INFO:tasks.workunit.client.1.smithi162.stderr:+ setfattr bytes/files -n ceph.quota.max_files -v 5 2023-07-05T23:34:59.942 INFO:tasks.workunit.client.3.smithi162.stderr:+ setfattr bytes/files -n ceph.quota.max_files -v 5 2023-07-05T23:34:59.945 INFO:tasks.workunit.client.1.smithi162.stderr:+ dd if=/dev/zero of=bytes/files/1 bs=1M count=4 2023-07-05T23:34:59.946 INFO:tasks.workunit.client.3.smithi162.stderr:+ dd if=/dev/zero of=bytes/files/1 bs=1M count=4 2023-07-05T23:34:59.949 INFO:tasks.workunit.client.1.smithi162.stderr:4+0 records in 2023-07-05T23:34:59.949 INFO:tasks.workunit.client.1.smithi162.stderr:4+0 records out 2023-07-05T23:34:59.949 INFO:tasks.workunit.client.1.smithi162.stderr:4194304 bytes (4.2 MB, 4.0 MiB) copied, 0.00173998 s, 2.4 GB/s 2023-07-05T23:34:59.949 INFO:tasks.workunit.client.1.smithi162.stderr:+ dd if=/dev/zero of=bytes/files/2 bs=1M count=4 2023-07-05T23:34:59.950 INFO:tasks.workunit.client.3.smithi162.stderr:4+0 records in 2023-07-05T23:34:59.950 INFO:tasks.workunit.client.3.smithi162.stderr:4+0 records out 2023-07-05T23:34:59.950 INFO:tasks.workunit.client.3.smithi162.stderr:4194304 bytes (4.2 MB, 4.0 MiB) copied, 0.00162161 s, 2.6 GB/s 2023-07-05T23:34:59.950 INFO:tasks.workunit.client.3.smithi162.stderr:+ dd if=/dev/zero of=bytes/files/2 bs=1M count=4 2023-07-05T23:34:59.952 INFO:tasks.workunit.client.1.smithi162.stderr:4+0 records in 2023-07-05T23:34:59.952 INFO:tasks.workunit.client.1.smithi162.stderr:4+0 records out 2023-07-05T23:34:59.952 INFO:tasks.workunit.client.1.smithi162.stderr:4194304 bytes (4.2 MB, 4.0 MiB) copied, 0.0017686 s, 2.4 GB/s 2023-07-05T23:34:59.953 INFO:tasks.workunit.client.1.smithi162.stderr:+ expect_false write_file bytes/files/3 1000 2023-07-05T23:34:59.953 INFO:tasks.workunit.client.1.smithi162.stderr:+ set -x 2023-07-05T23:34:59.953 INFO:tasks.workunit.client.1.smithi162.stderr:+ write_file bytes/files/3 1000 2023-07-05T23:34:59.953 INFO:tasks.workunit.client.1.smithi162.stderr:+ set +x 2023-07-05T23:34:59.954 INFO:tasks.workunit.client.3.smithi162.stderr:4+0 records in 2023-07-05T23:34:59.954 INFO:tasks.workunit.client.3.smithi162.stderr:4+0 records out 2023-07-05T23:34:59.954 INFO:tasks.workunit.client.3.smithi162.stderr:4194304 bytes (4.2 MB, 4.0 MiB) copied, 0.00194458 s, 2.2 GB/s 2023-07-05T23:34:59.955 INFO:tasks.workunit.client.3.smithi162.stderr:+ expect_false write_file bytes/files/3 1000 2023-07-05T23:34:59.955 INFO:tasks.workunit.client.3.smithi162.stderr:+ set -x 2023-07-05T23:34:59.955 INFO:tasks.workunit.client.3.smithi162.stderr:+ write_file bytes/files/3 1000 2023-07-05T23:34:59.955 INFO:tasks.workunit.client.3.smithi162.stderr:+ set +x 2023-07-05T23:35:01.212 INFO:tasks.workunit.client.3.smithi162.stdout:Try to write 26214400 2023-07-05T23:35:01.212 INFO:tasks.workunit.client.3.smithi162.stderr:+ return 1 2023-07-05T23:35:01.213 INFO:tasks.workunit.client.3.smithi162.stderr:+ return 0 2023-07-05T23:35:01.213 INFO:tasks.workunit.client.3.smithi162.stderr:+ expect_false write_file bytes/files/4 1000 2023-07-05T23:35:01.213 INFO:tasks.workunit.client.3.smithi162.stderr:+ set -x 2023-07-05T23:35:01.213 INFO:tasks.workunit.client.1.smithi162.stdout:Try to write 26214400 2023-07-05T23:35:01.214 INFO:tasks.workunit.client.3.smithi162.stderr:+ write_file bytes/files/4 1000 2023-07-05T23:35:01.214 INFO:tasks.workunit.client.3.smithi162.stderr:+ set +x 2023-07-05T23:35:01.214 INFO:tasks.workunit.client.1.smithi162.stderr:+ return 1 2023-07-05T23:35:01.214 INFO:tasks.workunit.client.1.smithi162.stderr:+ return 0 2023-07-05T23:35:01.215 INFO:tasks.workunit.client.1.smithi162.stderr:+ expect_false write_file bytes/files/4 1000 2023-07-05T23:35:01.215 INFO:tasks.workunit.client.1.smithi162.stderr:+ set -x 2023-07-05T23:35:01.215 INFO:tasks.workunit.client.1.smithi162.stderr:+ write_file bytes/files/4 1000 2023-07-05T23:35:01.215 INFO:tasks.workunit.client.1.smithi162.stderr:+ set +x 2023-07-05T23:35:01.215 INFO:tasks.workunit.client.3.smithi162.stdout:Try to write 1048576 2023-07-05T23:35:01.216 INFO:tasks.workunit.client.3.smithi162.stderr:+ return 1 2023-07-05T23:35:01.216 INFO:tasks.workunit.client.3.smithi162.stderr:+ return 0 2023-07-05T23:35:01.216 INFO:tasks.workunit.client.3.smithi162.stderr:+ expect_false write_file bytes/files/5 1000 2023-07-05T23:35:01.217 INFO:tasks.workunit.client.3.smithi162.stderr:+ set -x 2023-07-05T23:35:01.217 INFO:tasks.workunit.client.3.smithi162.stderr:+ write_file bytes/files/5 1000 2023-07-05T23:35:01.217 INFO:tasks.workunit.client.3.smithi162.stderr:+ set +x 2023-07-05T23:35:01.217 INFO:tasks.workunit.client.1.smithi162.stdout:Try to write 1048576 2023-07-05T23:35:01.218 INFO:tasks.workunit.client.1.smithi162.stderr:+ return 1 2023-07-05T23:35:01.218 INFO:tasks.workunit.client.1.smithi162.stderr:+ return 0 2023-07-05T23:35:01.218 INFO:tasks.workunit.client.1.smithi162.stderr:+ expect_false write_file bytes/files/5 1000 2023-07-05T23:35:01.218 INFO:tasks.workunit.client.1.smithi162.stderr:+ set -x 2023-07-05T23:35:01.218 INFO:tasks.workunit.client.1.smithi162.stderr:+ write_file bytes/files/5 1000 2023-07-05T23:35:01.219 INFO:tasks.workunit.client.1.smithi162.stderr:+ set +x 2023-07-05T23:35:01.219 INFO:tasks.workunit.client.3.smithi162.stdout:Try to write 1048576 2023-07-05T23:35:01.219 INFO:tasks.workunit.client.3.smithi162.stderr:+ return 1 2023-07-05T23:35:01.220 INFO:tasks.workunit.client.3.smithi162.stderr:+ return 0 2023-07-05T23:35:01.220 INFO:tasks.workunit.client.3.smithi162.stderr:+ stat '--printf=%n %s\n' bytes/files/1 2023-07-05T23:35:01.220 INFO:tasks.workunit.client.1.smithi162.stdout:Try to write 1048576 2023-07-05T23:35:01.221 INFO:tasks.workunit.client.1.smithi162.stderr:+ return 1 2023-07-05T23:35:01.221 INFO:tasks.workunit.client.1.smithi162.stderr:+ return 0 2023-07-05T23:35:01.221 INFO:tasks.workunit.client.1.smithi162.stderr:+ stat '--printf=%n %s\n' bytes/files/1 2023-07-05T23:35:01.222 INFO:tasks.workunit.client.3.smithi162.stdout:bytes/files/1 4194304 2023-07-05T23:35:01.222 INFO:tasks.workunit.client.3.smithi162.stderr:+ stat '--printf=%n %s\n' bytes/files/2 2023-07-05T23:35:01.222 INFO:tasks.workunit.client.1.smithi162.stdout:bytes/files/1 4194304 2023-07-05T23:35:01.223 INFO:tasks.workunit.client.1.smithi162.stderr:+ stat '--printf=%n %s\n' bytes/files/2 2023-07-05T23:35:01.223 INFO:tasks.workunit.client.3.smithi162.stdout:bytes/files/2 4194304 2023-07-05T23:35:01.223 INFO:tasks.workunit.client.3.smithi162.stderr:+ stat '--printf=%n %s\n' bytes/files/3 2023-07-05T23:35:01.224 INFO:tasks.workunit.client.1.smithi162.stdout:bytes/files/2 4194304 2023-07-05T23:35:01.224 INFO:tasks.workunit.client.1.smithi162.stderr:+ stat '--printf=%n %s\n' bytes/files/3 2023-07-05T23:35:01.224 INFO:tasks.workunit.client.3.smithi162.stdout:bytes/files/3 25165824 2023-07-05T23:35:01.225 INFO:tasks.workunit.client.3.smithi162.stderr:+ stat '--printf=%n %s\n' bytes/files/4 2023-07-05T23:35:01.225 INFO:tasks.workunit.client.1.smithi162.stdout:bytes/files/3 25165824 2023-07-05T23:35:01.225 INFO:tasks.workunit.client.1.smithi162.stderr:+ stat '--printf=%n %s\n' bytes/files/4 2023-07-05T23:35:01.226 INFO:tasks.workunit.client.3.smithi162.stdout:bytes/files/4 0 2023-07-05T23:35:01.226 INFO:tasks.workunit.client.3.smithi162.stderr:+ expect_false stat bytes/files/5 2023-07-05T23:35:01.226 INFO:tasks.workunit.client.3.smithi162.stderr:+ set -x 2023-07-05T23:35:01.226 INFO:tasks.workunit.client.3.smithi162.stderr:+ stat bytes/files/5 2023-07-05T23:35:01.227 INFO:tasks.workunit.client.1.smithi162.stdout:bytes/files/4 0 2023-07-05T23:35:01.227 INFO:tasks.workunit.client.1.smithi162.stderr:+ expect_false stat bytes/files/5 2023-07-05T23:35:01.227 INFO:tasks.workunit.client.1.smithi162.stderr:+ set -x 2023-07-05T23:35:01.228 INFO:tasks.workunit.client.1.smithi162.stderr:+ stat bytes/files/5 2023-07-05T23:35:01.228 INFO:tasks.workunit.client.3.smithi162.stderr:stat: cannot statx 'bytes/files/5': No such file or directory 2023-07-05T23:35:01.228 INFO:tasks.workunit.client.3.smithi162.stderr:+ return 0 2023-07-05T23:35:01.229 INFO:tasks.workunit.client.1.smithi162.stderr:stat: cannot statx 'bytes/files/5': No such file or directory 2023-07-05T23:35:01.229 INFO:tasks.workunit.client.1.smithi162.stderr:+ return 0 2023-07-05T23:35:01.229 INFO:tasks.workunit.client.3.smithi162.stderr:+ rm -rf bytes 2023-07-05T23:35:01.229 INFO:tasks.workunit.client.1.smithi162.stderr:+ rm -rf bytes 2023-07-05T23:35:01.246 INFO:tasks.workunit.client.3.smithi162.stderr:+ mkdir files limit 2023-07-05T23:35:01.248 INFO:tasks.workunit.client.3.smithi162.stderr:+ truncate files/file -s 10G 2023-07-05T23:35:01.250 INFO:tasks.workunit.client.1.smithi162.stderr:+ mkdir files limit 2023-07-05T23:35:01.252 INFO:tasks.workunit.client.1.smithi162.stderr:+ truncate files/file -s 10G 2023-07-05T23:35:01.270 INFO:tasks.workunit.client.1.smithi162.stderr:+ setfattr limit -n ceph.quota.max_bytes -v 1M 2023-07-05T23:35:01.270 INFO:tasks.workunit.client.3.smithi162.stderr:+ setfattr limit -n ceph.quota.max_bytes -v 1M 2023-07-05T23:35:01.279 INFO:tasks.workunit.client.1.smithi162.stderr:+ expect_false mv files limit/ 2023-07-05T23:35:01.279 INFO:tasks.workunit.client.1.smithi162.stderr:+ set -x 2023-07-05T23:35:01.279 INFO:tasks.workunit.client.1.smithi162.stderr:+ mv files limit/ 2023-07-05T23:35:01.280 INFO:tasks.workunit.client.3.smithi162.stderr:+ expect_false mv files limit/ 2023-07-05T23:35:01.280 INFO:tasks.workunit.client.3.smithi162.stderr:+ set -x 2023-07-05T23:35:01.280 INFO:tasks.workunit.client.3.smithi162.stderr:+ mv files limit/ 2023-07-05T23:35:01.286 INFO:tasks.workunit.client.1.smithi162.stderr:mv: error writing 'limit/files/file': Disk quota exceeded 2023-07-05T23:35:01.287 INFO:tasks.workunit.client.3.smithi162.stderr:mv: error writing 'limit/files/file': Disk quota exceeded 2023-07-05T23:35:01.296 INFO:tasks.workunit.client.1.smithi162.stderr:+ return 0 2023-07-05T23:35:01.296 INFO:tasks.workunit.client.1.smithi162.stderr:+ rm -rf files limit 2023-07-05T23:35:01.297 INFO:tasks.workunit.client.3.smithi162.stderr:+ return 0 2023-07-05T23:35:01.299 INFO:tasks.workunit.client.3.smithi162.stderr:+ rm -rf files limit 2023-07-05T23:35:01.336 INFO:tasks.workunit.client.1.smithi162.stderr:+ mkdir -p ancestor/p1/p2/parent/p3 2023-07-05T23:35:01.345 INFO:tasks.workunit.client.3.smithi162.stderr:+ mkdir -p ancestor/p1/p2/parent/p3 2023-07-05T23:35:01.346 INFO:tasks.workunit.client.1.smithi162.stderr:+ setfattr ancestor -n ceph.quota.max_bytes -v 1M 2023-07-05T23:35:01.351 INFO:tasks.workunit.client.3.smithi162.stderr:+ setfattr ancestor -n ceph.quota.max_bytes -v 1M 2023-07-05T23:35:01.361 INFO:tasks.workunit.client.1.smithi162.stderr:+ setfattr ancestor/p1/p2/parent -n ceph.quota.max_bytes -v 1G 2023-07-05T23:35:01.362 INFO:tasks.workunit.client.3.smithi162.stderr:+ setfattr ancestor/p1/p2/parent -n ceph.quota.max_bytes -v 1G 2023-07-05T23:35:01.367 INFO:tasks.workunit.client.1.smithi162.stderr:+ expect_false write_file ancestor/p1/p2/parent/p3/file1 900 2023-07-05T23:35:01.368 INFO:tasks.workunit.client.1.smithi162.stderr:+ set -x 2023-07-05T23:35:01.368 INFO:tasks.workunit.client.1.smithi162.stderr:+ write_file ancestor/p1/p2/parent/p3/file1 900 2023-07-05T23:35:01.368 INFO:tasks.workunit.client.1.smithi162.stderr:+ set +x 2023-07-05T23:35:01.369 INFO:tasks.workunit.client.3.smithi162.stderr:+ expect_false write_file ancestor/p1/p2/parent/p3/file1 900 2023-07-05T23:35:01.369 INFO:tasks.workunit.client.3.smithi162.stderr:+ set -x 2023-07-05T23:35:01.369 INFO:tasks.workunit.client.3.smithi162.stderr:+ write_file ancestor/p1/p2/parent/p3/file1 900 2023-07-05T23:35:01.369 INFO:tasks.workunit.client.3.smithi162.stderr:+ set +x 2023-07-05T23:35:02.349 INFO:tasks.workunit.client.0.smithi027.stdout:Try to write 157286400 2023-07-05T23:35:02.350 INFO:tasks.workunit.client.0.smithi027.stderr:+ return 1 2023-07-05T23:35:02.350 INFO:tasks.workunit.client.0.smithi027.stderr:+ return 0 2023-07-05T23:35:02.350 INFO:tasks.workunit.client.0.smithi027.stderr:+ expect_false write_file second 10 2023-07-05T23:35:02.351 INFO:tasks.workunit.client.0.smithi027.stderr:+ set -x 2023-07-05T23:35:02.351 INFO:tasks.workunit.client.0.smithi027.stderr:+ write_file second 10 2023-07-05T23:35:02.351 INFO:tasks.workunit.client.0.smithi027.stderr:+ set +x 2023-07-05T23:35:02.351 INFO:tasks.workunit.client.0.smithi027.stdout:Try to write 1048576 2023-07-05T23:35:02.352 INFO:tasks.workunit.client.0.smithi027.stderr:+ return 1 2023-07-05T23:35:02.352 INFO:tasks.workunit.client.0.smithi027.stderr:+ return 0 2023-07-05T23:35:02.352 INFO:tasks.workunit.client.0.smithi027.stderr:+ setfattr . -n ceph.quota.max_bytes -v 0 2023-07-05T23:35:02.359 INFO:tasks.workunit.client.0.smithi027.stderr:+ dd if=/dev/zero of=third bs=1M count=10 2023-07-05T23:35:02.363 INFO:tasks.workunit.client.2.smithi027.stdout:Try to write 157286400 2023-07-05T23:35:02.364 INFO:tasks.workunit.client.2.smithi027.stderr:+ return 1 2023-07-05T23:35:02.364 INFO:tasks.workunit.client.2.smithi027.stderr:+ return 0 2023-07-05T23:35:02.364 INFO:tasks.workunit.client.2.smithi027.stderr:+ expect_false write_file second 10 2023-07-05T23:35:02.364 INFO:tasks.workunit.client.2.smithi027.stderr:+ set -x 2023-07-05T23:35:02.364 INFO:tasks.workunit.client.2.smithi027.stderr:+ write_file second 10 2023-07-05T23:35:02.364 INFO:tasks.workunit.client.2.smithi027.stderr:+ set +x 2023-07-05T23:35:02.365 INFO:tasks.workunit.client.2.smithi027.stdout:Try to write 1048576 2023-07-05T23:35:02.365 INFO:tasks.workunit.client.2.smithi027.stderr:+ return 1 2023-07-05T23:35:02.365 INFO:tasks.workunit.client.2.smithi027.stderr:+ return 0 2023-07-05T23:35:02.366 INFO:tasks.workunit.client.2.smithi027.stderr:+ setfattr . -n ceph.quota.max_bytes -v 0 2023-07-05T23:35:02.370 INFO:tasks.workunit.client.0.smithi027.stderr:10+0 records in 2023-07-05T23:35:02.370 INFO:tasks.workunit.client.0.smithi027.stderr:10+0 records out 2023-07-05T23:35:02.370 INFO:tasks.workunit.client.0.smithi027.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00934542 s, 1.1 GB/s 2023-07-05T23:35:02.371 INFO:tasks.workunit.client.0.smithi027.stderr:+ dd if=/dev/zero of=big2 bs=1M count=100 2023-07-05T23:35:02.373 INFO:tasks.workunit.client.2.smithi027.stderr:+ dd if=/dev/zero of=third bs=1M count=10 2023-07-05T23:35:02.384 INFO:tasks.workunit.client.2.smithi027.stderr:10+0 records in 2023-07-05T23:35:02.384 INFO:tasks.workunit.client.2.smithi027.stderr:10+0 records out 2023-07-05T23:35:02.384 INFO:tasks.workunit.client.2.smithi027.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00855111 s, 1.2 GB/s 2023-07-05T23:35:02.384 INFO:tasks.workunit.client.2.smithi027.stderr:+ dd if=/dev/zero of=big2 bs=1M count=100 2023-07-05T23:35:02.422 INFO:tasks.workunit.client.0.smithi027.stderr:100+0 records in 2023-07-05T23:35:02.423 INFO:tasks.workunit.client.0.smithi027.stderr:100+0 records out 2023-07-05T23:35:02.423 INFO:tasks.workunit.client.0.smithi027.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.0499781 s, 2.1 GB/s 2023-07-05T23:35:02.423 INFO:tasks.workunit.client.0.smithi027.stderr:+ rm -rf big big2 second third 2023-07-05T23:35:02.429 INFO:tasks.workunit.client.0.smithi027.stderr:+ setfattr . -n ceph.quota.max_files -v 5 2023-07-05T23:35:02.435 INFO:tasks.workunit.client.0.smithi027.stderr:+ mkdir ok 2023-07-05T23:35:02.437 INFO:tasks.workunit.client.0.smithi027.stderr:+ touch ok/1 2023-07-05T23:35:02.438 INFO:tasks.workunit.client.0.smithi027.stderr:+ touch ok/2 2023-07-05T23:35:02.439 INFO:tasks.workunit.client.0.smithi027.stderr:+ touch 3 2023-07-05T23:35:02.440 INFO:tasks.workunit.client.2.smithi027.stderr:100+0 records in 2023-07-05T23:35:02.440 INFO:tasks.workunit.client.2.smithi027.stderr:100+0 records out 2023-07-05T23:35:02.440 INFO:tasks.workunit.client.2.smithi027.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.0549832 s, 1.9 GB/s 2023-07-05T23:35:02.441 INFO:tasks.workunit.client.0.smithi027.stderr:+ expect_false touch shouldbefail 2023-07-05T23:35:02.441 INFO:tasks.workunit.client.0.smithi027.stderr:+ set -x 2023-07-05T23:35:02.442 INFO:tasks.workunit.client.0.smithi027.stderr:+ touch shouldbefail 2023-07-05T23:35:02.442 INFO:tasks.workunit.client.0.smithi027.stderr:touch: cannot touch 'shouldbefail': Disk quota exceeded 2023-07-05T23:35:02.442 INFO:tasks.workunit.client.0.smithi027.stderr:+ return 0 2023-07-05T23:35:02.443 INFO:tasks.workunit.client.0.smithi027.stderr:+ expect_false touch ok/shouldbefail 2023-07-05T23:35:02.443 INFO:tasks.workunit.client.0.smithi027.stderr:+ set -x 2023-07-05T23:35:02.443 INFO:tasks.workunit.client.0.smithi027.stderr:+ touch ok/shouldbefail 2023-07-05T23:35:02.443 INFO:tasks.workunit.client.2.smithi027.stderr:+ rm -rf big big2 second third 2023-07-05T23:35:02.444 INFO:tasks.workunit.client.0.smithi027.stderr:touch: cannot touch 'ok/shouldbefail': Disk quota exceeded 2023-07-05T23:35:02.444 INFO:tasks.workunit.client.0.smithi027.stderr:+ return 0 2023-07-05T23:35:02.444 INFO:tasks.workunit.client.0.smithi027.stderr:+ setfattr . -n ceph.quota.max_files -v 0 2023-07-05T23:35:02.451 INFO:tasks.workunit.client.0.smithi027.stderr:+ touch shouldbecreated 2023-07-05T23:35:02.453 INFO:tasks.workunit.client.2.smithi027.stderr:+ setfattr . -n ceph.quota.max_files -v 5 2023-07-05T23:35:02.454 INFO:tasks.workunit.client.0.smithi027.stderr:+ touch shouldbecreated2 2023-07-05T23:35:02.461 INFO:tasks.workunit.client.2.smithi027.stderr:+ mkdir ok 2023-07-05T23:35:02.461 INFO:tasks.workunit.client.0.smithi027.stderr:+ rm -rf 3 ok shouldbecreated shouldbecreated2 2023-07-05T23:35:02.462 INFO:tasks.workunit.client.2.smithi027.stderr:+ touch ok/1 2023-07-05T23:35:02.464 INFO:tasks.workunit.client.2.smithi027.stderr:+ touch ok/2 2023-07-05T23:35:02.466 INFO:tasks.workunit.client.2.smithi027.stderr:+ touch 3 2023-07-05T23:35:02.468 INFO:tasks.workunit.client.2.smithi027.stderr:+ expect_false touch shouldbefail 2023-07-05T23:35:02.469 INFO:tasks.workunit.client.2.smithi027.stderr:+ set -x 2023-07-05T23:35:02.469 INFO:tasks.workunit.client.2.smithi027.stderr:+ touch shouldbefail 2023-07-05T23:35:02.470 INFO:tasks.workunit.client.2.smithi027.stderr:touch: cannot touch 'shouldbefail': Disk quota exceeded 2023-07-05T23:35:02.470 INFO:tasks.workunit.client.2.smithi027.stderr:+ return 0 2023-07-05T23:35:02.470 INFO:tasks.workunit.client.2.smithi027.stderr:+ expect_false touch ok/shouldbefail 2023-07-05T23:35:02.470 INFO:tasks.workunit.client.2.smithi027.stderr:+ set -x 2023-07-05T23:35:02.471 INFO:tasks.workunit.client.2.smithi027.stderr:+ touch ok/shouldbefail 2023-07-05T23:35:02.471 INFO:tasks.workunit.client.2.smithi027.stderr:touch: cannot touch 'ok/shouldbefail': Disk quota exceeded 2023-07-05T23:35:02.471 INFO:tasks.workunit.client.2.smithi027.stderr:+ return 0 2023-07-05T23:35:02.471 INFO:tasks.workunit.client.2.smithi027.stderr:+ setfattr . -n ceph.quota.max_files -v 0 2023-07-05T23:35:02.486 INFO:tasks.workunit.client.0.smithi027.stderr:+ mkdir bytes bytes/files 2023-07-05T23:35:02.486 INFO:tasks.workunit.client.2.smithi027.stderr:+ touch shouldbecreated 2023-07-05T23:35:02.487 INFO:tasks.workunit.client.2.smithi027.stderr:+ touch shouldbecreated2 2023-07-05T23:35:02.488 INFO:tasks.workunit.client.0.smithi027.stderr:+ setfattr bytes -n ceph.quota.max_bytes -v 10M 2023-07-05T23:35:02.498 INFO:tasks.workunit.client.2.smithi027.stderr:+ rm -rf 3 ok shouldbecreated shouldbecreated2 2023-07-05T23:35:02.500 INFO:tasks.workunit.client.0.smithi027.stderr:+ setfattr bytes/files -n ceph.quota.max_files -v 5 2023-07-05T23:35:02.517 INFO:tasks.workunit.client.0.smithi027.stderr:+ dd if=/dev/zero of=bytes/files/1 bs=1M count=4 2023-07-05T23:35:02.522 INFO:tasks.workunit.client.0.smithi027.stderr:4+0 records in 2023-07-05T23:35:02.522 INFO:tasks.workunit.client.0.smithi027.stderr:4+0 records out 2023-07-05T23:35:02.522 INFO:tasks.workunit.client.0.smithi027.stderr:4194304 bytes (4.2 MB, 4.0 MiB) copied, 0.0016838 s, 2.5 GB/s 2023-07-05T23:35:02.522 INFO:tasks.workunit.client.0.smithi027.stderr:+ dd if=/dev/zero of=bytes/files/2 bs=1M count=4 2023-07-05T23:35:02.527 INFO:tasks.workunit.client.0.smithi027.stderr:4+0 records in 2023-07-05T23:35:02.528 INFO:tasks.workunit.client.0.smithi027.stderr:4+0 records out 2023-07-05T23:35:02.528 INFO:tasks.workunit.client.0.smithi027.stderr:4194304 bytes (4.2 MB, 4.0 MiB) copied, 0.00197247 s, 2.1 GB/s 2023-07-05T23:35:02.528 INFO:tasks.workunit.client.0.smithi027.stderr:+ expect_false write_file bytes/files/3 1000 2023-07-05T23:35:02.528 INFO:tasks.workunit.client.2.smithi027.stderr:+ mkdir bytes bytes/files 2023-07-05T23:35:02.529 INFO:tasks.workunit.client.0.smithi027.stderr:+ set -x 2023-07-05T23:35:02.529 INFO:tasks.workunit.client.0.smithi027.stderr:+ write_file bytes/files/3 1000 2023-07-05T23:35:02.529 INFO:tasks.workunit.client.0.smithi027.stderr:+ set +x 2023-07-05T23:35:02.532 INFO:tasks.workunit.client.2.smithi027.stderr:+ setfattr bytes -n ceph.quota.max_bytes -v 10M 2023-07-05T23:35:02.552 INFO:tasks.workunit.client.2.smithi027.stderr:+ setfattr bytes/files -n ceph.quota.max_files -v 5 2023-07-05T23:35:02.563 INFO:tasks.workunit.client.2.smithi027.stderr:+ dd if=/dev/zero of=bytes/files/1 bs=1M count=4 2023-07-05T23:35:02.566 INFO:tasks.workunit.client.2.smithi027.stderr:4+0 records in 2023-07-05T23:35:02.566 INFO:tasks.workunit.client.2.smithi027.stderr:4+0 records out 2023-07-05T23:35:02.567 INFO:tasks.workunit.client.2.smithi027.stderr:4194304 bytes (4.2 MB, 4.0 MiB) copied, 0.00150989 s, 2.8 GB/s 2023-07-05T23:35:02.567 INFO:tasks.workunit.client.2.smithi027.stderr:+ dd if=/dev/zero of=bytes/files/2 bs=1M count=4 2023-07-05T23:35:02.571 INFO:tasks.workunit.client.2.smithi027.stderr:4+0 records in 2023-07-05T23:35:02.571 INFO:tasks.workunit.client.2.smithi027.stderr:4+0 records out 2023-07-05T23:35:02.571 INFO:tasks.workunit.client.2.smithi027.stderr:4194304 bytes (4.2 MB, 4.0 MiB) copied, 0.00199998 s, 2.1 GB/s 2023-07-05T23:35:02.571 INFO:tasks.workunit.client.2.smithi027.stderr:+ expect_false write_file bytes/files/3 1000 2023-07-05T23:35:02.571 INFO:tasks.workunit.client.2.smithi027.stderr:+ set -x 2023-07-05T23:35:02.571 INFO:tasks.workunit.client.2.smithi027.stderr:+ write_file bytes/files/3 1000 2023-07-05T23:35:02.571 INFO:tasks.workunit.client.2.smithi027.stderr:+ set +x 2023-07-05T23:35:02.626 INFO:tasks.workunit.client.3.smithi162.stdout:Try to write 26214400 2023-07-05T23:35:02.627 INFO:tasks.workunit.client.3.smithi162.stderr:+ return 1 2023-07-05T23:35:02.627 INFO:tasks.workunit.client.3.smithi162.stderr:+ return 0 2023-07-05T23:35:02.628 INFO:tasks.workunit.client.3.smithi162.stderr:+ stat '--printf=%n %s\n' ancestor/p1/p2/parent/p3/file1 2023-07-05T23:35:02.628 INFO:tasks.workunit.client.1.smithi162.stdout:Try to write 26214400 2023-07-05T23:35:02.628 INFO:tasks.workunit.client.1.smithi162.stderr:+ return 1 2023-07-05T23:35:02.629 INFO:tasks.workunit.client.1.smithi162.stderr:+ return 0 2023-07-05T23:35:02.629 INFO:tasks.workunit.client.1.smithi162.stderr:+ stat '--printf=%n %s\n' ancestor/p1/p2/parent/p3/file1 2023-07-05T23:35:02.629 INFO:tasks.workunit.client.3.smithi162.stdout:ancestor/p1/p2/parent/p3/file1 25165824 2023-07-05T23:35:02.629 INFO:tasks.workunit.client.1.smithi162.stdout:ancestor/p1/p2/parent/p3/file1 25165824 2023-07-05T23:35:02.630 INFO:tasks.workunit.client.3.smithi162.stderr:+ setfattr -n ceph.quota.max_bytes -v 0 . 2023-07-05T23:35:02.630 INFO:tasks.workunit.client.1.smithi162.stderr:+ setfattr -n ceph.quota.max_bytes -v 0 . 2023-07-05T23:35:02.631 INFO:tasks.workunit.client.3.smithi162.stderr:+ setfattr -n ceph.quota.max_bytes -v 1 . 2023-07-05T23:35:02.631 INFO:tasks.workunit.client.1.smithi162.stderr:+ setfattr -n ceph.quota.max_bytes -v 1 . 2023-07-05T23:35:02.631 INFO:tasks.workunit.client.3.smithi162.stderr:setfattr: .: Invalid argument 2023-07-05T23:35:02.632 INFO:tasks.workunit.client.1.smithi162.stderr:setfattr: .: Invalid argument 2023-07-05T23:35:02.632 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-05T23:35:02.633 INFO:tasks.workunit:Stopping ['fs/quota'] on client.3... 2023-07-05T23:35:02.633 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.3 /home/ubuntu/cephtest/clone.client.3 2023-07-05T23:35:02.634 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-05T23:35:02.634 INFO:tasks.workunit:Stopping ['fs/quota'] on client.1... 2023-07-05T23:35:02.635 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2023-07-05T23:35:03.026 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/run_tasks.py", line 84, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_0a781ef0807ae9473fb1306ef07036226ca4f1a6/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph-c_0a781ef0807ae9473fb1306ef07036226ca4f1a6/qa/tasks/workunit.py", line 295, in _spawn_on_all_clients p.spawn(_run_tests, ctx, refspec, role, [unit], env, File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_0a781ef0807ae9473fb1306ef07036226ca4f1a6/qa/tasks/workunit.py", line 424, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test fs/quota/quota.sh) on smithi162 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0a781ef0807ae9473fb1306ef07036226ca4f1a6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/fs/quota/quota.sh' 2023-07-05T23:35:03.097 ERROR:teuthology.run_tasks: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=df72ddf896344e48be4bf8564f082cde Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/run_tasks.py", line 84, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_0a781ef0807ae9473fb1306ef07036226ca4f1a6/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph-c_0a781ef0807ae9473fb1306ef07036226ca4f1a6/qa/tasks/workunit.py", line 295, in _spawn_on_all_clients p.spawn(_run_tests, ctx, refspec, role, [unit], env, File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_0a781ef0807ae9473fb1306ef07036226ca4f1a6/qa/tasks/workunit.py", line 424, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test fs/quota/quota.sh) on smithi162 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0a781ef0807ae9473fb1306ef07036226ca4f1a6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/fs/quota/quota.sh' 2023-07-05T23:35:03.100 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-07-05T23:35:03.109 INFO:tasks.kclient:Unmounting kernel clients... 2023-07-05T23:35:03.109 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-07-05T23:35:03.110 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-05T23:35:03.138 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-07-05T23:35:03.138 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-05T23:35:03.200 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-05T23:35:03.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.410+0000 7ff7cc753700 1 Processor -- start 2023-07-05T23:35:03.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.410+0000 7ff7cc753700 1 -- start start 2023-07-05T23:35:03.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.412+0000 7ff7cc753700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7c40cb390 0x7ff7c40cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:03.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.412+0000 7ff7cc753700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7c4069ef0 con 0x7ff7c40cc260 2023-07-05T23:35:03.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.412+0000 7ff7cc753700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7c415c6e0 con 0x7ff7c415fdd0 2023-07-05T23:35:03.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.412+0000 7ff7cc753700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c40ce330 con 0x7ff7c40cb390 2023-07-05T23:35:03.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.412+0000 7ff7c9cee700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7ff7c40cc260 0x7ff7c40cb760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:53184/0 (socket says 172.21.15.27:53184) 2023-07-05T23:35:03.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.412+0000 7ff7c9cee700 1 -- 172.21.15.27:0/675527383 learned_addr learned my addr 172.21.15.27:0/675527383 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-07-05T23:35:03.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.412+0000 7ff7ca4ef700 1 --2- 172.21.15.27:0/675527383 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7c40cb390 0x7ff7c40cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:03.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.412+0000 7ff7c94ed700 1 -- 172.21.15.27:0/675527383 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3211749652 0 0) 0x7ff7c4069ef0 con 0x7ff7c40cc260 2023-07-05T23:35:03.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.412+0000 7ff7c94ed700 1 -- 172.21.15.27:0/675527383 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7b00035b0 con 0x7ff7c40cc260 2023-07-05T23:35:03.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.412+0000 7ff7c94ed700 1 -- 172.21.15.27:0/675527383 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2627614312 0 0) 0x7ff7c415c6e0 con 0x7ff7c415fdd0 2023-07-05T23:35:03.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.412+0000 7ff7c94ed700 1 -- 172.21.15.27:0/675527383 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7c4069ef0 con 0x7ff7c415fdd0 2023-07-05T23:35:03.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.412+0000 7ff7ca4ef700 1 -- 172.21.15.27:0/675527383 >> v1:172.21.15.162:6789/0 conn(0x7ff7c415fdd0 legacy=0x7ff7c4160250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:03.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.412+0000 7ff7ca4ef700 1 -- 172.21.15.27:0/675527383 >> v1:172.21.15.27:6789/0 conn(0x7ff7c40cc260 legacy=0x7ff7c40cb760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:03.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.412+0000 7ff7ca4ef700 1 -- 172.21.15.27:0/675527383 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c406a140 con 0x7ff7c40cb390 2023-07-05T23:35:03.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.413+0000 7ff7ca4ef700 1 --2- 172.21.15.27:0/675527383 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7c40cb390 0x7ff7c40cdd50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4009870 tx=0x7ff7b4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93afac5d95fe0e8f server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:03.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.413+0000 7ff7c94ed700 1 -- 172.21.15.27:0/675527383 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b4011830 con 0x7ff7c40cb390 2023-07-05T23:35:03.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.413+0000 7ff7c94ed700 1 -- 172.21.15.27:0/675527383 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b4011990 con 0x7ff7c40cb390 2023-07-05T23:35:03.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.413+0000 7ff7c94ed700 1 -- 172.21.15.27:0/675527383 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b4011d20 con 0x7ff7c40cb390 2023-07-05T23:35:03.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.414+0000 7ff7cc753700 1 -- 172.21.15.27:0/675527383 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7c40cb390 msgr2=0x7ff7c40cdd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:03.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.414+0000 7ff7cc753700 1 --2- 172.21.15.27:0/675527383 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7c40cb390 0x7ff7c40cdd50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4009870 tx=0x7ff7b4009b80 comp rx=0 tx=0).stop 2023-07-05T23:35:03.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.414+0000 7ff7cc753700 1 -- 172.21.15.27:0/675527383 shutdown_connections 2023-07-05T23:35:03.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.414+0000 7ff7cc753700 1 --2- 172.21.15.27:0/675527383 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7c40cb390 0x7ff7c40cdd50 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:03.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.414+0000 7ff7cc753700 1 -- 172.21.15.27:0/675527383 >> 172.21.15.27:0/675527383 conn(0x7ff7c40b0260 msgr2=0x7ff7c40b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:03.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.414+0000 7ff7cc753700 1 -- 172.21.15.27:0/675527383 shutdown_connections 2023-07-05T23:35:03.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.415+0000 7ff7cc753700 1 -- 172.21.15.27:0/675527383 wait complete. 2023-07-05T23:35:03.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.417+0000 7ff7cc753700 1 Processor -- start 2023-07-05T23:35:03.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.417+0000 7ff7cc753700 1 -- start start 2023-07-05T23:35:03.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.418+0000 7ff7cc753700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7c40cb390 0x7ff7c41e4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:03.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.418+0000 7ff7cc753700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7c40cc260 0x7ff7c41e54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:03.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.418+0000 7ff7cc753700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7c415fdd0 0x7ff7c40b1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:03.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.418+0000 7ff7cc753700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c41e6750 con 0x7ff7c40cb390 2023-07-05T23:35:03.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.418+0000 7ff7cc753700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c414f4c0 con 0x7ff7c415fdd0 2023-07-05T23:35:03.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.418+0000 7ff7cc753700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c41e5b40 con 0x7ff7c40cc260 2023-07-05T23:35:03.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.418+0000 7ff7ca4ef700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7c40cb390 0x7ff7c41e4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:03.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.418+0000 7ff7ca4ef700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7c40cb390 0x7ff7c41e4f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46022/0 (socket says 172.21.15.27:46022) 2023-07-05T23:35:03.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.418+0000 7ff7ca4ef700 1 -- 172.21.15.27:0/2325369851 learned_addr learned my addr 172.21.15.27:0/2325369851 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:03.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.418+0000 7ff7cacf0700 1 --2- 172.21.15.27:0/2325369851 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7c415fdd0 0x7ff7c40b1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:03.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.418+0000 7ff7c9cee700 1 --2- 172.21.15.27:0/2325369851 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7c40cc260 0x7ff7c41e54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:03.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.418+0000 7ff7cacf0700 1 -- 172.21.15.27:0/2325369851 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7c40cc260 msgr2=0x7ff7c41e54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:03.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.419+0000 7ff7cacf0700 1 --2- 172.21.15.27:0/2325369851 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7c40cc260 0x7ff7c41e54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:03.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.419+0000 7ff7cacf0700 1 -- 172.21.15.27:0/2325369851 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7c40cb390 msgr2=0x7ff7c41e4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:03.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.419+0000 7ff7cacf0700 1 --2- 172.21.15.27:0/2325369851 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7c40cb390 0x7ff7c41e4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:03.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.419+0000 7ff7cacf0700 1 -- 172.21.15.27:0/2325369851 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b40094a0 con 0x7ff7c415fdd0 2023-07-05T23:35:03.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.419+0000 7ff7ca4ef700 1 --2- 172.21.15.27:0/2325369851 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7c40cb390 0x7ff7c41e4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T23:35:03.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.419+0000 7ff7c9cee700 1 --2- 172.21.15.27:0/2325369851 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7c40cc260 0x7ff7c41e54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T23:35:03.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.419+0000 7ff7cacf0700 1 --2- 172.21.15.27:0/2325369851 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7c415fdd0 0x7ff7c40b1560 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff7c000c3c0 tx=0x7ff7c000c6d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:03.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.419+0000 7ff7baffd700 1 -- 172.21.15.27:0/2325369851 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c00052d0 con 0x7ff7c415fdd0 2023-07-05T23:35:03.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.419+0000 7ff7baffd700 1 -- 172.21.15.27:0/2325369851 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c0005430 con 0x7ff7c415fdd0 2023-07-05T23:35:03.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.419+0000 7ff7cc753700 1 -- 172.21.15.27:0/2325369851 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7c41e5e20 con 0x7ff7c415fdd0 2023-07-05T23:35:03.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.419+0000 7ff7baffd700 1 -- 172.21.15.27:0/2325369851 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c00038c0 con 0x7ff7c415fdd0 2023-07-05T23:35:03.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.419+0000 7ff7cc753700 1 -- 172.21.15.27:0/2325369851 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7c41e63e0 con 0x7ff7c415fdd0 2023-07-05T23:35:03.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.421+0000 7ff7cc753700 1 -- 172.21.15.27:0/2325369851 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7c41e6900 con 0x7ff7c415fdd0 2023-07-05T23:35:03.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.421+0000 7ff7baffd700 1 -- 172.21.15.27:0/2325369851 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff7c0003a20 con 0x7ff7c415fdd0 2023-07-05T23:35:03.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.422+0000 7ff7baffd700 1 --2- 172.21.15.27:0/2325369851 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7ff7a806ad30 0x7ff7a806d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:03.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.422+0000 7ff7baffd700 1 -- 172.21.15.27:0/2325369851 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff7c0088ab0 con 0x7ff7c415fdd0 2023-07-05T23:35:03.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.422+0000 7ff7ca4ef700 1 --2- 172.21.15.27:0/2325369851 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7ff7a806ad30 0x7ff7a806d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:03.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.423+0000 7ff7ca4ef700 1 --2- 172.21.15.27:0/2325369851 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7ff7a806ad30 0x7ff7a806d1e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4000c00 tx=0x7ff7b401c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:03.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.428+0000 7ff7baffd700 1 -- 172.21.15.27:0/2325369851 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff7c41e6900 con 0x7ff7c415fdd0 2023-07-05T23:35:03.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.733+0000 7ff7cc753700 1 -- 172.21.15.27:0/2325369851 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff7c41e6900 con 0x7ff7c415fdd0 2023-07-05T23:35:03.737 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.734+0000 7ff7baffd700 1 -- 172.21.15.27:0/2325369851 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20215 (secure 0 0 0) 0x7ff7c41e6900 con 0x7ff7c415fdd0 2023-07-05T23:35:03.738 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:35:03.738 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":30,"fsid":"23eebe48-65f5-4d3c-8c2d-4aa171c055d5","created":"2023-07-05T23:32:27.989612+0000","modified":"2023-07-05T23:33:34.883498+0000","last_up_change":"2023-07-05T23:32:39.601570+0000","last_in_change":"2023-07-05T23:32:30.488261+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-05T23:32:41.624598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-05T23:32:46.481587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-05T23:32:51.025210+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-05T23:32:52.286964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-05T23:32:55.354212+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ac2071e4-394b-4385-b9ba-fad5265efc65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6814","nonce":3766536605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6818","nonce":3766536605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6823","nonce":3766536605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6821","nonce":3766536605}]},"public_addr":"172.21.15.27:6814/3766536605","cluster_addr":"172.21.15.27:6818/3766536605","heartbeat_back_addr":"172.21.15.27:6823/3766536605","heartbeat_front_addr":"172.21.15.27:6821/3766536605","state":["exists","up"]},{"osd":1,"uuid":"8c9b61a0-39d5-46bf-afd6-5add78453ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6801","nonce":1579117455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6803","nonce":1579117455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6807","nonce":1579117455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6805","nonce":1579117455}]},"public_addr":"172.21.15.27:6801/1579117455","cluster_addr":"172.21.15.27:6803/1579117455","heartbeat_back_addr":"172.21.15.27:6807/1579117455","heartbeat_front_addr":"172.21.15.27:6805/1579117455","state":["exists","up"]},{"osd":2,"uuid":"dcd032a2-06b1-4055-b798-b86c71a7107d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6825","nonce":807520271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6827","nonce":807520271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6831","nonce":807520271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6829","nonce":807520271}]},"public_addr":"172.21.15.27:6825/807520271","cluster_addr":"172.21.15.27:6827/807520271","heartbeat_back_addr":"172.21.15.27:6831/807520271","heartbeat_front_addr":"172.21.15.27:6829/807520271","state":["exists","up"]},{"osd":3,"uuid":"b0ffe0fc-47ba-4636-b5ea-6bab637642c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6809","nonce":2125656143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6811","nonce":2125656143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6817","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6819","nonce":2125656143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6813","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6815","nonce":2125656143}]},"public_addr":"172.21.15.27:6809/2125656143","cluster_addr":"172.21.15.27:6811/2125656143","heartbeat_back_addr":"172.21.15.27:6819/2125656143","heartbeat_front_addr":"172.21.15.27:6815/2125656143","state":["exists","up"]},{"osd":4,"uuid":"7fab4e5a-1246-4efe-9562-10c4a6c789ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6801","nonce":2111223016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6803","nonce":2111223016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6807","nonce":2111223016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6805","nonce":2111223016}]},"public_addr":"172.21.15.162:6801/2111223016","cluster_addr":"172.21.15.162:6803/2111223016","heartbeat_back_addr":"172.21.15.162:6807/2111223016","heartbeat_front_addr":"172.21.15.162:6805/2111223016","state":["exists","up"]},{"osd":5,"uuid":"110c4d9f-cef6-48ab-a818-5a81e72372af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6825","nonce":3102609008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6827","nonce":3102609008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6831","nonce":3102609008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6829","nonce":3102609008}]},"public_addr":"172.21.15.162:6825/3102609008","cluster_addr":"172.21.15.162:6827/3102609008","heartbeat_back_addr":"172.21.15.162:6831/3102609008","heartbeat_front_addr":"172.21.15.162:6829/3102609008","state":["exists","up"]},{"osd":6,"uuid":"16803bcc-2c92-4aed-954e-487938c9f24a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6809","nonce":2657688865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6811","nonce":2657688865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6815","nonce":2657688865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6813","nonce":2657688865}]},"public_addr":"172.21.15.162:6809/2657688865","cluster_addr":"172.21.15.162:6811/2657688865","heartbeat_back_addr":"172.21.15.162:6815/2657688865","heartbeat_front_addr":"172.21.15.162:6813/2657688865","state":["exists","up"]},{"osd":7,"uuid":"b7c35377-3cf2-4569-b6b9-72376eb463bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6817","nonce":2096609978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6819","nonce":2096609978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6823","nonce":2096609978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6821","nonce":2096609978}]},"public_addr":"172.21.15.162:6817/2096609978","cluster_addr":"172.21.15.162:6819/2096609978","heartbeat_back_addr":"172.21.15.162:6823/2096609978","heartbeat_front_addr":"172.21.15.162:6821/2096609978","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.735448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.645561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.759120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.682507+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.736228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.694664+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.716002+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.680485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":3,"to":2}]},{"pgid":"4.26","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-05T23:35:03.741 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.738+0000 7ff7cc753700 1 -- 172.21.15.27:0/2325369851 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7ff7a806ad30 msgr2=0x7ff7a806d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:03.741 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.738+0000 7ff7cc753700 1 --2- 172.21.15.27:0/2325369851 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7ff7a806ad30 0x7ff7a806d1e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4000c00 tx=0x7ff7b401c040 comp rx=0 tx=0).stop 2023-07-05T23:35:03.741 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.738+0000 7ff7cc753700 1 -- 172.21.15.27:0/2325369851 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7c415fdd0 msgr2=0x7ff7c40b1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:03.742 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.738+0000 7ff7cc753700 1 --2- 172.21.15.27:0/2325369851 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7c415fdd0 0x7ff7c40b1560 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff7c000c3c0 tx=0x7ff7c000c6d0 comp rx=0 tx=0).stop 2023-07-05T23:35:03.742 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.738+0000 7ff7cc753700 1 -- 172.21.15.27:0/2325369851 shutdown_connections 2023-07-05T23:35:03.742 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.738+0000 7ff7cc753700 1 --2- 172.21.15.27:0/2325369851 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7c415fdd0 0x7ff7c40b1560 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:03.742 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.738+0000 7ff7cc753700 1 --2- 172.21.15.27:0/2325369851 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7ff7a806ad30 0x7ff7a806d1e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:03.742 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.738+0000 7ff7cc753700 1 --2- 172.21.15.27:0/2325369851 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7c40cb390 0x7ff7c41e4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:03.743 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.738+0000 7ff7cc753700 1 --2- 172.21.15.27:0/2325369851 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7c40cc260 0x7ff7c41e54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:03.743 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.738+0000 7ff7cc753700 1 -- 172.21.15.27:0/2325369851 >> 172.21.15.27:0/2325369851 conn(0x7ff7c40b0260 msgr2=0x7ff7c406c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:03.743 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.738+0000 7ff7cc753700 1 -- 172.21.15.27:0/2325369851 shutdown_connections 2023-07-05T23:35:03.743 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.738+0000 7ff7cc753700 1 -- 172.21.15.27:0/2325369851 wait complete. 2023-07-05T23:35:03.758 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-05T23:32:41.624598+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-05T23:32:46.481587+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-05T23:32:51.025210+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-05T23:32:52.286964+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-05T23:32:55.354212+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-05T23:35:03.759 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-05T23:35:03.805 INFO:tasks.workunit.client.0.smithi027.stdout:Try to write 26214400 2023-07-05T23:35:03.805 INFO:tasks.workunit.client.0.smithi027.stderr:+ return 1 2023-07-05T23:35:03.806 INFO:tasks.workunit.client.0.smithi027.stderr:+ return 0 2023-07-05T23:35:03.806 INFO:tasks.workunit.client.0.smithi027.stderr:+ expect_false write_file bytes/files/4 1000 2023-07-05T23:35:03.806 INFO:tasks.workunit.client.0.smithi027.stderr:+ set -x 2023-07-05T23:35:03.807 INFO:tasks.workunit.client.0.smithi027.stderr:+ write_file bytes/files/4 1000 2023-07-05T23:35:03.807 INFO:tasks.workunit.client.0.smithi027.stderr:+ set +x 2023-07-05T23:35:03.807 INFO:tasks.workunit.client.0.smithi027.stdout:Try to write 1048576 2023-07-05T23:35:03.808 INFO:tasks.workunit.client.0.smithi027.stderr:+ return 1 2023-07-05T23:35:03.808 INFO:tasks.workunit.client.0.smithi027.stderr:+ return 0 2023-07-05T23:35:03.809 INFO:tasks.workunit.client.0.smithi027.stderr:+ expect_false write_file bytes/files/5 1000 2023-07-05T23:35:03.809 INFO:tasks.workunit.client.0.smithi027.stderr:+ set -x 2023-07-05T23:35:03.809 INFO:tasks.workunit.client.0.smithi027.stderr:+ write_file bytes/files/5 1000 2023-07-05T23:35:03.809 INFO:tasks.workunit.client.0.smithi027.stderr:+ set +x 2023-07-05T23:35:03.810 INFO:tasks.workunit.client.0.smithi027.stdout:Try to write 1048576 2023-07-05T23:35:03.810 INFO:tasks.workunit.client.0.smithi027.stderr:+ return 1 2023-07-05T23:35:03.810 INFO:tasks.workunit.client.0.smithi027.stderr:+ return 0 2023-07-05T23:35:03.811 INFO:tasks.workunit.client.0.smithi027.stderr:+ stat '--printf=%n %s\n' bytes/files/1 2023-07-05T23:35:03.811 INFO:tasks.workunit.client.0.smithi027.stdout:bytes/files/1 4194304 2023-07-05T23:35:03.812 INFO:tasks.workunit.client.0.smithi027.stderr:+ stat '--printf=%n %s\n' bytes/files/2 2023-07-05T23:35:03.812 INFO:tasks.workunit.client.0.smithi027.stdout:bytes/files/2 4194304 2023-07-05T23:35:03.813 INFO:tasks.workunit.client.0.smithi027.stderr:+ stat '--printf=%n %s\n' bytes/files/3 2023-07-05T23:35:03.817 INFO:tasks.workunit.client.0.smithi027.stdout:bytes/files/3 25165824 2023-07-05T23:35:03.818 INFO:tasks.workunit.client.0.smithi027.stderr:+ stat '--printf=%n %s\n' bytes/files/4 2023-07-05T23:35:03.819 INFO:tasks.workunit.client.0.smithi027.stdout:bytes/files/4 0 2023-07-05T23:35:03.820 INFO:tasks.workunit.client.0.smithi027.stderr:+ expect_false stat bytes/files/5 2023-07-05T23:35:03.820 INFO:tasks.workunit.client.0.smithi027.stderr:+ set -x 2023-07-05T23:35:03.820 INFO:tasks.workunit.client.0.smithi027.stderr:+ stat bytes/files/5 2023-07-05T23:35:03.821 INFO:tasks.workunit.client.0.smithi027.stderr:stat: cannot statx 'bytes/files/5': No such file or directory 2023-07-05T23:35:03.821 INFO:tasks.workunit.client.0.smithi027.stderr:+ return 0 2023-07-05T23:35:03.822 INFO:tasks.workunit.client.0.smithi027.stderr:+ rm -rf bytes 2023-07-05T23:35:03.847 INFO:tasks.workunit.client.2.smithi027.stdout:Try to write 26214400 2023-07-05T23:35:03.848 INFO:tasks.workunit.client.2.smithi027.stderr:+ return 1 2023-07-05T23:35:03.848 INFO:tasks.workunit.client.2.smithi027.stderr:+ return 0 2023-07-05T23:35:03.849 INFO:tasks.workunit.client.2.smithi027.stderr:+ expect_false write_file bytes/files/4 1000 2023-07-05T23:35:03.849 INFO:tasks.workunit.client.2.smithi027.stderr:+ set -x 2023-07-05T23:35:03.849 INFO:tasks.workunit.client.2.smithi027.stderr:+ write_file bytes/files/4 1000 2023-07-05T23:35:03.849 INFO:tasks.workunit.client.2.smithi027.stderr:+ set +x 2023-07-05T23:35:03.851 INFO:tasks.workunit.client.2.smithi027.stdout:Try to write 1048576 2023-07-05T23:35:03.852 INFO:tasks.workunit.client.2.smithi027.stderr:+ return 1 2023-07-05T23:35:03.852 INFO:tasks.workunit.client.2.smithi027.stderr:+ return 0 2023-07-05T23:35:03.852 INFO:tasks.workunit.client.2.smithi027.stderr:+ expect_false write_file bytes/files/5 1000 2023-07-05T23:35:03.852 INFO:tasks.workunit.client.2.smithi027.stderr:+ set -x 2023-07-05T23:35:03.853 INFO:tasks.workunit.client.2.smithi027.stderr:+ write_file bytes/files/5 1000 2023-07-05T23:35:03.853 INFO:tasks.workunit.client.2.smithi027.stderr:+ set +x 2023-07-05T23:35:03.854 INFO:tasks.workunit.client.0.smithi027.stderr:+ mkdir files limit 2023-07-05T23:35:03.854 INFO:tasks.workunit.client.2.smithi027.stdout:Try to write 1048576 2023-07-05T23:35:03.855 INFO:tasks.workunit.client.2.smithi027.stderr:+ return 1 2023-07-05T23:35:03.855 INFO:tasks.workunit.client.2.smithi027.stderr:+ return 0 2023-07-05T23:35:03.855 INFO:tasks.workunit.client.2.smithi027.stderr:+ stat '--printf=%n %s\n' bytes/files/1 2023-07-05T23:35:03.856 INFO:tasks.workunit.client.2.smithi027.stdout:bytes/files/1 4194304 2023-07-05T23:35:03.856 INFO:tasks.workunit.client.2.smithi027.stderr:+ stat '--printf=%n %s\n' bytes/files/2 2023-07-05T23:35:03.856 INFO:tasks.workunit.client.2.smithi027.stdout:bytes/files/2 4194304 2023-07-05T23:35:03.857 INFO:tasks.workunit.client.0.smithi027.stderr:+ truncate files/file -s 10G 2023-07-05T23:35:03.857 INFO:tasks.workunit.client.2.smithi027.stderr:+ stat '--printf=%n %s\n' bytes/files/3 2023-07-05T23:35:03.858 INFO:tasks.workunit.client.2.smithi027.stdout:bytes/files/3 25165824 2023-07-05T23:35:03.858 INFO:tasks.workunit.client.2.smithi027.stderr:+ stat '--printf=%n %s\n' bytes/files/4 2023-07-05T23:35:03.866 INFO:tasks.workunit.client.2.smithi027.stdout:bytes/files/4 0 2023-07-05T23:35:03.867 INFO:tasks.workunit.client.2.smithi027.stderr:+ expect_false stat bytes/files/5 2023-07-05T23:35:03.867 INFO:tasks.workunit.client.2.smithi027.stderr:+ set -x 2023-07-05T23:35:03.867 INFO:tasks.workunit.client.2.smithi027.stderr:+ stat bytes/files/5 2023-07-05T23:35:03.868 INFO:tasks.workunit.client.2.smithi027.stderr:stat: cannot statx 'bytes/files/5': No such file or directory 2023-07-05T23:35:03.868 INFO:tasks.workunit.client.2.smithi027.stderr:+ return 0 2023-07-05T23:35:03.870 INFO:tasks.workunit.client.2.smithi027.stderr:+ rm -rf bytes 2023-07-05T23:35:03.871 INFO:tasks.workunit.client.0.smithi027.stderr:+ setfattr limit -n ceph.quota.max_bytes -v 1M 2023-07-05T23:35:03.891 INFO:tasks.workunit.client.0.smithi027.stderr:+ expect_false mv files limit/ 2023-07-05T23:35:03.891 INFO:tasks.workunit.client.0.smithi027.stderr:+ set -x 2023-07-05T23:35:03.891 INFO:tasks.workunit.client.0.smithi027.stderr:+ mv files limit/ 2023-07-05T23:35:03.902 INFO:tasks.workunit.client.0.smithi027.stderr:mv: error writing 'limit/files/file': Disk quota exceeded 2023-07-05T23:35:03.916 INFO:tasks.workunit.client.0.smithi027.stderr:+ return 0 2023-07-05T23:35:03.919 INFO:tasks.workunit.client.2.smithi027.stderr:+ mkdir files limit 2023-07-05T23:35:03.919 INFO:tasks.workunit.client.0.smithi027.stderr:+ rm -rf files limit 2023-07-05T23:35:03.925 INFO:tasks.workunit.client.2.smithi027.stderr:+ truncate files/file -s 10G 2023-07-05T23:35:03.926 INFO:tasks.workunit.client.2.smithi027.stderr:+ setfattr limit -n ceph.quota.max_bytes -v 1M 2023-07-05T23:35:03.938 INFO:tasks.workunit.client.2.smithi027.stderr:+ expect_false mv files limit/ 2023-07-05T23:35:03.939 INFO:tasks.workunit.client.2.smithi027.stderr:+ set -x 2023-07-05T23:35:03.939 INFO:tasks.workunit.client.2.smithi027.stderr:+ mv files limit/ 2023-07-05T23:35:03.950 INFO:tasks.workunit.client.2.smithi027.stderr:mv: error writing 'limit/files/file': Disk quota exceeded 2023-07-05T23:35:03.956 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.953+0000 7ff6fb42e700 1 Processor -- start 2023-07-05T23:35:03.957 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.954+0000 7ff6fb42e700 1 -- start start 2023-07-05T23:35:03.957 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.955+0000 7ff6fb42e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff6f40b2b40 0x7ff6f40b4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:03.958 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.955+0000 7ff6fb42e700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6f406d130 con 0x7ff6f415a5a0 2023-07-05T23:35:03.958 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.955+0000 7ff6fb42e700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6f406c520 con 0x7ff6f40709f0 2023-07-05T23:35:03.958 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.955+0000 7ff6fb42e700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6f40cf6a0 con 0x7ff6f40b2b40 2023-07-05T23:35:03.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.955+0000 7ff6f91ca700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7ff6f415a5a0 0x7ff6f40702e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:53196/0 (socket says 172.21.15.27:53196) 2023-07-05T23:35:03.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.955+0000 7ff6f99cb700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff6f40b2b40 0x7ff6f40b4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:03.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.955+0000 7ff6f91ca700 1 -- 172.21.15.27:0/2125717262 learned_addr learned my addr 172.21.15.27:0/2125717262 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-07-05T23:35:03.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.955+0000 7ff6f99cb700 1 -- 172.21.15.27:0/2125717262 >> v1:172.21.15.162:6789/0 conn(0x7ff6f40709f0 legacy=0x7ff6f406d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:03.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.955+0000 7ff6f99cb700 1 -- 172.21.15.27:0/2125717262 >> v1:172.21.15.27:6789/0 conn(0x7ff6f415a5a0 legacy=0x7ff6f40702e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:03.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.955+0000 7ff6f99cb700 1 -- 172.21.15.27:0/2125717262 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f406c800 con 0x7ff6f40b2b40 2023-07-05T23:35:03.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.955+0000 7ff6f99cb700 1 --2- 172.21.15.27:0/2125717262 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6f40b2b40 0x7ff6f40b4210 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec009d90 tx=0x7ff6ec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dba3be4947b80f88 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:03.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.956+0000 7ff6ebfff700 1 -- 172.21.15.27:0/2125717262 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec00e070 con 0x7ff6f40b2b40 2023-07-05T23:35:03.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.956+0000 7ff6ebfff700 1 -- 172.21.15.27:0/2125717262 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6ec00bbd0 con 0x7ff6f40b2b40 2023-07-05T23:35:03.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.956+0000 7ff6ebfff700 1 -- 172.21.15.27:0/2125717262 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec012430 con 0x7ff6f40b2b40 2023-07-05T23:35:03.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.957+0000 7ff6fb42e700 1 -- 172.21.15.27:0/2125717262 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6f40b2b40 msgr2=0x7ff6f40b4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:03.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.957+0000 7ff6fb42e700 1 --2- 172.21.15.27:0/2125717262 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6f40b2b40 0x7ff6f40b4210 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec009d90 tx=0x7ff6ec00b330 comp rx=0 tx=0).stop 2023-07-05T23:35:03.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.958+0000 7ff6fb42e700 1 -- 172.21.15.27:0/2125717262 shutdown_connections 2023-07-05T23:35:03.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.958+0000 7ff6fb42e700 1 --2- 172.21.15.27:0/2125717262 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6f40b2b40 0x7ff6f40b4210 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:03.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.958+0000 7ff6fb42e700 1 -- 172.21.15.27:0/2125717262 >> 172.21.15.27:0/2125717262 conn(0x7ff6f406ab80 msgr2=0x7ff6f40ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:03.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.958+0000 7ff6fb42e700 1 -- 172.21.15.27:0/2125717262 shutdown_connections 2023-07-05T23:35:03.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.959+0000 7ff6fb42e700 1 -- 172.21.15.27:0/2125717262 wait complete. 2023-07-05T23:35:03.965 INFO:tasks.workunit.client.2.smithi027.stderr:+ return 0 2023-07-05T23:35:03.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.960+0000 7ff6fb42e700 1 Processor -- start 2023-07-05T23:35:03.966 INFO:tasks.workunit.client.2.smithi027.stderr:+ rm -rf files limit 2023-07-05T23:35:03.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.960+0000 7ff6fb42e700 1 -- start start 2023-07-05T23:35:03.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.961+0000 7ff6fb42e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6f40709f0 0x7ff6f414da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:03.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.962+0000 7ff6fb42e700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff6f40b2b40 0x7ff6f414d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:03.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.962+0000 7ff6fb42e700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff6f415a5a0 0x7ff6f415bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:03.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.962+0000 7ff6fb42e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f415da70 con 0x7ff6f40709f0 2023-07-05T23:35:03.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.962+0000 7ff6fb42e700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f4151020 con 0x7ff6f40b2b40 2023-07-05T23:35:03.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.962+0000 7ff6fb42e700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f414df80 con 0x7ff6f415a5a0 2023-07-05T23:35:03.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.962+0000 7ff6f89c9700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff6f40b2b40 0x7ff6f414d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:03.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.962+0000 7ff6f99cb700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff6f415a5a0 0x7ff6f415bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:03.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.962+0000 7ff6f99cb700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff6f415a5a0 0x7ff6f415bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.27:46072/0 (socket says 172.21.15.27:46072) 2023-07-05T23:35:03.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.962+0000 7ff6f89c9700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff6f40b2b40 0x7ff6f414d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.27:43972/0 (socket says 172.21.15.27:43972) 2023-07-05T23:35:03.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.962+0000 7ff6f99cb700 1 -- 172.21.15.27:0/772700289 learned_addr learned my addr 172.21.15.27:0/772700289 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:03.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.963+0000 7ff6f99cb700 1 -- 172.21.15.27:0/772700289 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff6f40b2b40 msgr2=0x7ff6f414d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:03.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.963+0000 7ff6f99cb700 1 --2- 172.21.15.27:0/772700289 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff6f40b2b40 0x7ff6f414d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:03.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.963+0000 7ff6f99cb700 1 -- 172.21.15.27:0/772700289 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6f40709f0 msgr2=0x7ff6f414da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:03.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.963+0000 7ff6f99cb700 1 --2- 172.21.15.27:0/772700289 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6f40709f0 0x7ff6f414da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:03.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.963+0000 7ff6f99cb700 1 -- 172.21.15.27:0/772700289 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6ec009a70 con 0x7ff6f415a5a0 2023-07-05T23:35:03.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.963+0000 7ff6f99cb700 1 --2- 172.21.15.27:0/772700289 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff6f415a5a0 0x7ff6f415bf70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec013000 tx=0x7ff6ec004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:03.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.964+0000 7ff6e9ffb700 1 -- 172.21.15.27:0/772700289 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec012dd0 con 0x7ff6f415a5a0 2023-07-05T23:35:03.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.964+0000 7ff6e9ffb700 1 -- 172.21.15.27:0/772700289 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6ec020070 con 0x7ff6f415a5a0 2023-07-05T23:35:03.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.964+0000 7ff6e9ffb700 1 -- 172.21.15.27:0/772700289 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec004280 con 0x7ff6f415a5a0 2023-07-05T23:35:03.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.964+0000 7ff6fb42e700 1 -- 172.21.15.27:0/772700289 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6f415d4b0 con 0x7ff6f415a5a0 2023-07-05T23:35:03.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.964+0000 7ff6fb42e700 1 -- 172.21.15.27:0/772700289 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6f4150cb0 con 0x7ff6f415a5a0 2023-07-05T23:35:03.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.965+0000 7ff6fb42e700 1 -- 172.21.15.27:0/772700289 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6f404ea20 con 0x7ff6f415a5a0 2023-07-05T23:35:03.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.967+0000 7ff6e9ffb700 1 -- 172.21.15.27:0/772700289 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff6ec0043e0 con 0x7ff6f415a5a0 2023-07-05T23:35:03.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.967+0000 7ff6e9ffb700 1 --2- 172.21.15.27:0/772700289 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7ff6d806ace0 0x7ff6d806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:03.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.967+0000 7ff6e9ffb700 1 -- 172.21.15.27:0/772700289 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff6ec022070 con 0x7ff6f415a5a0 2023-07-05T23:35:03.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.968+0000 7ff6f91ca700 1 --2- 172.21.15.27:0/772700289 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7ff6d806ace0 0x7ff6d806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:03.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.968+0000 7ff6f91ca700 1 --2- 172.21.15.27:0/772700289 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7ff6d806ace0 0x7ff6d806d190 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff6f00015d0 tx=0x7ff6f0007ad0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:03.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:03.972+0000 7ff6e9ffb700 1 -- 172.21.15.27:0/772700289 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff6ec056c50 con 0x7ff6f415a5a0 2023-07-05T23:35:03.980 INFO:tasks.workunit.client.0.smithi027.stderr:+ mkdir -p ancestor/p1/p2/parent/p3 2023-07-05T23:35:03.988 INFO:tasks.workunit.client.0.smithi027.stderr:+ setfattr ancestor -n ceph.quota.max_bytes -v 1M 2023-07-05T23:35:04.013 INFO:tasks.workunit.client.0.smithi027.stderr:+ setfattr ancestor/p1/p2/parent -n ceph.quota.max_bytes -v 1G 2023-07-05T23:35:04.026 INFO:tasks.workunit.client.0.smithi027.stderr:+ expect_false write_file ancestor/p1/p2/parent/p3/file1 900 2023-07-05T23:35:04.026 INFO:tasks.workunit.client.0.smithi027.stderr:+ set -x 2023-07-05T23:35:04.027 INFO:tasks.workunit.client.0.smithi027.stderr:+ write_file ancestor/p1/p2/parent/p3/file1 900 2023-07-05T23:35:04.027 INFO:tasks.workunit.client.0.smithi027.stderr:+ set +x 2023-07-05T23:35:04.030 INFO:tasks.workunit.client.2.smithi027.stderr:+ mkdir -p ancestor/p1/p2/parent/p3 2023-07-05T23:35:04.037 INFO:tasks.workunit.client.2.smithi027.stderr:+ setfattr ancestor -n ceph.quota.max_bytes -v 1M 2023-07-05T23:35:04.047 INFO:tasks.workunit.client.2.smithi027.stderr:+ setfattr ancestor/p1/p2/parent -n ceph.quota.max_bytes -v 1G 2023-07-05T23:35:04.053 INFO:tasks.workunit.client.2.smithi027.stderr:+ expect_false write_file ancestor/p1/p2/parent/p3/file1 900 2023-07-05T23:35:04.053 INFO:tasks.workunit.client.2.smithi027.stderr:+ set -x 2023-07-05T23:35:04.054 INFO:tasks.workunit.client.2.smithi027.stderr:+ write_file ancestor/p1/p2/parent/p3/file1 900 2023-07-05T23:35:04.054 INFO:tasks.workunit.client.2.smithi027.stderr:+ set +x 2023-07-05T23:35:04.312 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.309+0000 7ff6fb42e700 1 -- 172.21.15.27:0/772700289 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff6f4151160 con 0x7ff6f415a5a0 2023-07-05T23:35:04.313 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.310+0000 7ff6e9ffb700 1 -- 172.21.15.27:0/772700289 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff6f4151160 con 0x7ff6f415a5a0 2023-07-05T23:35:04.313 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2023-07-05T23:35:04.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.313+0000 7ff6fb42e700 1 -- 172.21.15.27:0/772700289 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7ff6d806ace0 msgr2=0x7ff6d806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:04.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.313+0000 7ff6fb42e700 1 --2- 172.21.15.27:0/772700289 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7ff6d806ace0 0x7ff6d806d190 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff6f00015d0 tx=0x7ff6f0007ad0 comp rx=0 tx=0).stop 2023-07-05T23:35:04.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.313+0000 7ff6fb42e700 1 -- 172.21.15.27:0/772700289 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff6f415a5a0 msgr2=0x7ff6f415bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:04.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.313+0000 7ff6fb42e700 1 --2- 172.21.15.27:0/772700289 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff6f415a5a0 0x7ff6f415bf70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec013000 tx=0x7ff6ec004ad0 comp rx=0 tx=0).stop 2023-07-05T23:35:04.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.314+0000 7ff6fb42e700 1 -- 172.21.15.27:0/772700289 shutdown_connections 2023-07-05T23:35:04.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.314+0000 7ff6fb42e700 1 --2- 172.21.15.27:0/772700289 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7ff6d806ace0 0x7ff6d806d190 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:04.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.314+0000 7ff6fb42e700 1 --2- 172.21.15.27:0/772700289 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff6f415a5a0 0x7ff6f415bf70 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:04.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.314+0000 7ff6fb42e700 1 --2- 172.21.15.27:0/772700289 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6f40709f0 0x7ff6f414da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:04.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.314+0000 7ff6fb42e700 1 --2- 172.21.15.27:0/772700289 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff6f40b2b40 0x7ff6f414d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:04.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.314+0000 7ff6fb42e700 1 -- 172.21.15.27:0/772700289 >> 172.21.15.27:0/772700289 conn(0x7ff6f406ab80 msgr2=0x7ff6f40c63e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:04.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.314+0000 7ff6fb42e700 1 -- 172.21.15.27:0/772700289 shutdown_connections 2023-07-05T23:35:04.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.314+0000 7ff6fb42e700 1 -- 172.21.15.27:0/772700289 wait complete. 2023-07-05T23:35:04.342 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-05T23:35:04.528 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.525+0000 7faf89119700 1 Processor -- start 2023-07-05T23:35:04.529 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.525+0000 7faf89119700 1 -- start start 2023-07-05T23:35:04.531 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.526+0000 7faf89119700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7faf840cd5e0 0x7faf840cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:04.531 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.526+0000 7faf89119700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf8406e030 0x7faf8406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:04.531 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.526+0000 7faf89119700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf8406f0e0 con 0x7faf8415cf70 2023-07-05T23:35:04.531 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.526+0000 7faf89119700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf840ce2c0 con 0x7faf840cd5e0 2023-07-05T23:35:04.532 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.526+0000 7faf89119700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf840cdef0 con 0x7faf8406e030 2023-07-05T23:35:04.532 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.526+0000 7faf82d9d700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7faf840cd5e0 0x7faf840cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:04.532 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.526+0000 7faf8259c700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf8406e030 0x7faf8406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:04.532 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.526+0000 7faf82d9d700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7faf840cd5e0 0x7faf840cd9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.27:43980/0 (socket says 172.21.15.27:43980) 2023-07-05T23:35:04.532 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.526+0000 7faf8259c700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf8406e030 0x7faf8406e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.27:46080/0 (socket says 172.21.15.27:46080) 2023-07-05T23:35:04.533 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.526+0000 7faf82d9d700 1 -- 172.21.15.27:0/1282631365 learned_addr learned my addr 172.21.15.27:0/1282631365 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:04.533 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.526+0000 7faf8359e700 1 --1- 172.21.15.27:0/1282631365 >> v1:172.21.15.162:6789/0 conn(0x7faf8415cf70 0x7faf8415d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.27:34180/0 (socket says 172.21.15.27:34180) 2023-07-05T23:35:04.533 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.527+0000 7faf82d9d700 1 -- 172.21.15.27:0/1282631365 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf8406e030 msgr2=0x7faf8406e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:35:04.533 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.527+0000 7faf82d9d700 1 --2- 172.21.15.27:0/1282631365 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf8406e030 0x7faf8406e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:04.533 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.527+0000 7faf82d9d700 1 -- 172.21.15.27:0/1282631365 >> v1:172.21.15.162:6789/0 conn(0x7faf8415cf70 legacy=0x7faf8415d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:04.534 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.527+0000 7faf82d9d700 1 -- 172.21.15.27:0/1282631365 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf8406eb20 con 0x7faf840cd5e0 2023-07-05T23:35:04.534 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.527+0000 7faf81d9b700 1 -- 172.21.15.27:0/1282631365 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 673398180 0 0) 0x7faf8406f0e0 con 0x7faf8415cf70 2023-07-05T23:35:04.534 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.527+0000 7faf8259c700 1 --2- 172.21.15.27:0/1282631365 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf8406e030 0x7faf8406e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T23:35:04.534 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.527+0000 7faf82d9d700 1 --2- 172.21.15.27:0/1282631365 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf840cd5e0 0x7faf840cd9b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7faf78006fd0 tx=0x7faf7800be70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b02c3e4d90ae6ccd server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:04.534 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.527+0000 7faf81d9b700 1 -- 172.21.15.27:0/1282631365 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf78005e30 con 0x7faf840cd5e0 2023-07-05T23:35:04.535 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.527+0000 7faf81d9b700 1 -- 172.21.15.27:0/1282631365 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf78004030 con 0x7faf840cd5e0 2023-07-05T23:35:04.535 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.527+0000 7faf81d9b700 1 -- 172.21.15.27:0/1282631365 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf780043e0 con 0x7faf840cd5e0 2023-07-05T23:35:04.535 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.528+0000 7faf89119700 1 -- 172.21.15.27:0/1282631365 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf840cd5e0 msgr2=0x7faf840cd9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:04.535 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.528+0000 7faf89119700 1 --2- 172.21.15.27:0/1282631365 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf840cd5e0 0x7faf840cd9b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7faf78006fd0 tx=0x7faf7800be70 comp rx=0 tx=0).stop 2023-07-05T23:35:04.535 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.528+0000 7faf89119700 1 -- 172.21.15.27:0/1282631365 shutdown_connections 2023-07-05T23:35:04.536 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.528+0000 7faf89119700 1 --2- 172.21.15.27:0/1282631365 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf840cd5e0 0x7faf840cd9b0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:04.536 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.528+0000 7faf89119700 1 --2- 172.21.15.27:0/1282631365 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf8406e030 0x7faf8406e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:04.536 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.528+0000 7faf89119700 1 -- 172.21.15.27:0/1282631365 >> 172.21.15.27:0/1282631365 conn(0x7faf8406b920 msgr2=0x7faf840cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:04.536 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.528+0000 7faf89119700 1 -- 172.21.15.27:0/1282631365 shutdown_connections 2023-07-05T23:35:04.536 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.528+0000 7faf89119700 1 -- 172.21.15.27:0/1282631365 wait complete. 2023-07-05T23:35:04.538 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.529+0000 7faf89119700 1 Processor -- start 2023-07-05T23:35:04.539 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.529+0000 7faf89119700 1 -- start start 2023-07-05T23:35:04.539 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.530+0000 7faf89119700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf8406e030 0x7faf8409cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:04.539 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.530+0000 7faf89119700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf840cd5e0 0x7faf84143f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:04.539 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.530+0000 7faf89119700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf8415cf70 0x7faf84144490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:04.540 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.530+0000 7faf89119700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf8409d520 con 0x7faf8415cf70 2023-07-05T23:35:04.540 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.530+0000 7faf89119700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf84142eb0 con 0x7faf840cd5e0 2023-07-05T23:35:04.540 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.530+0000 7faf89119700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf84143190 con 0x7faf8406e030 2023-07-05T23:35:04.540 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.530+0000 7faf8359e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf8415cf70 0x7faf84144490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:04.540 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.530+0000 7faf8259c700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf840cd5e0 0x7faf84143f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:04.541 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.530+0000 7faf8359e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf8415cf70 0x7faf84144490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46052/0 (socket says 172.21.15.27:46052) 2023-07-05T23:35:04.541 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.530+0000 7faf8359e700 1 -- 172.21.15.27:0/2785435801 learned_addr learned my addr 172.21.15.27:0/2785435801 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:04.541 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.530+0000 7faf82d9d700 1 --2- 172.21.15.27:0/2785435801 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf8406e030 0x7faf8409cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:04.541 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.530+0000 7faf8359e700 1 -- 172.21.15.27:0/2785435801 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf8406e030 msgr2=0x7faf8409cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:04.541 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.530+0000 7faf8359e700 1 --2- 172.21.15.27:0/2785435801 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf8406e030 0x7faf8409cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:04.542 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.530+0000 7faf8359e700 1 -- 172.21.15.27:0/2785435801 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf840cd5e0 msgr2=0x7faf84143f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:04.542 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.531+0000 7faf8359e700 1 --2- 172.21.15.27:0/2785435801 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf840cd5e0 0x7faf84143f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:04.542 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.531+0000 7faf8359e700 1 -- 172.21.15.27:0/2785435801 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf740094a0 con 0x7faf8415cf70 2023-07-05T23:35:04.542 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.531+0000 7faf82d9d700 1 --2- 172.21.15.27:0/2785435801 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf8406e030 0x7faf8409cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T23:35:04.542 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.531+0000 7faf8259c700 1 --2- 172.21.15.27:0/2785435801 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf840cd5e0 0x7faf84143f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T23:35:04.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.531+0000 7faf8359e700 1 --2- 172.21.15.27:0/2785435801 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf8415cf70 0x7faf84144490 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7faf7c002230 tx=0x7faf7c00cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:04.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.531+0000 7faf6b7fe700 1 -- 172.21.15.27:0/2785435801 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf7c00aac0 con 0x7faf8415cf70 2023-07-05T23:35:04.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.531+0000 7faf6b7fe700 1 -- 172.21.15.27:0/2785435801 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf7c00ac40 con 0x7faf8415cf70 2023-07-05T23:35:04.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.531+0000 7faf89119700 1 -- 172.21.15.27:0/2785435801 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf7800b7a0 con 0x7faf8415cf70 2023-07-05T23:35:04.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.531+0000 7faf6b7fe700 1 -- 172.21.15.27:0/2785435801 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf7c0070d0 con 0x7faf8415cf70 2023-07-05T23:35:04.544 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.531+0000 7faf89119700 1 -- 172.21.15.27:0/2785435801 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf84143750 con 0x7faf8415cf70 2023-07-05T23:35:04.544 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.532+0000 7faf89119700 1 -- 172.21.15.27:0/2785435801 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf84070910 con 0x7faf8415cf70 2023-07-05T23:35:04.544 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.533+0000 7faf6b7fe700 1 -- 172.21.15.27:0/2785435801 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7faf7c007250 con 0x7faf8415cf70 2023-07-05T23:35:04.544 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.533+0000 7faf6b7fe700 1 --2- 172.21.15.27:0/2785435801 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7faf7006ace0 0x7faf7006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:04.544 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.533+0000 7faf6b7fe700 1 -- 172.21.15.27:0/2785435801 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7faf7c089620 con 0x7faf8415cf70 2023-07-05T23:35:04.545 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.533+0000 7faf82d9d700 1 --2- 172.21.15.27:0/2785435801 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7faf7006ace0 0x7faf7006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:04.545 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.534+0000 7faf82d9d700 1 --2- 172.21.15.27:0/2785435801 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7faf7006ace0 0x7faf7006d190 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7faf7800b340 tx=0x7faf7800a000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:04.545 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.537+0000 7faf6b7fe700 1 -- 172.21.15.27:0/2785435801 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7faf7c054310 con 0x7faf8415cf70 2023-07-05T23:35:04.737 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.735+0000 7faf89119700 1 -- 172.21.15.27:0/2785435801 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7faf8404ea20 con 0x7faf8415cf70 2023-07-05T23:35:04.738 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.735+0000 7faf6b7fe700 1 -- 172.21.15.27:0/2785435801 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7faf7c0180a0 con 0x7faf8415cf70 2023-07-05T23:35:04.738 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 8 2023-07-05T23:35:04.740 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.737+0000 7faf89119700 1 -- 172.21.15.27:0/2785435801 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7faf7006ace0 msgr2=0x7faf7006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:04.740 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.737+0000 7faf89119700 1 --2- 172.21.15.27:0/2785435801 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7faf7006ace0 0x7faf7006d190 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7faf7800b340 tx=0x7faf7800a000 comp rx=0 tx=0).stop 2023-07-05T23:35:04.741 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.737+0000 7faf89119700 1 -- 172.21.15.27:0/2785435801 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf8415cf70 msgr2=0x7faf84144490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:04.741 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.737+0000 7faf89119700 1 --2- 172.21.15.27:0/2785435801 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf8415cf70 0x7faf84144490 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7faf7c002230 tx=0x7faf7c00cf50 comp rx=0 tx=0).stop 2023-07-05T23:35:04.741 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.737+0000 7faf89119700 1 -- 172.21.15.27:0/2785435801 shutdown_connections 2023-07-05T23:35:04.741 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.737+0000 7faf89119700 1 --2- 172.21.15.27:0/2785435801 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7faf7006ace0 0x7faf7006d190 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:04.741 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.737+0000 7faf89119700 1 --2- 172.21.15.27:0/2785435801 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf8415cf70 0x7faf84144490 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:04.742 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.737+0000 7faf89119700 1 --2- 172.21.15.27:0/2785435801 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf8406e030 0x7faf8409cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:04.742 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.737+0000 7faf89119700 1 --2- 172.21.15.27:0/2785435801 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf840cd5e0 0x7faf84143f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:04.742 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.737+0000 7faf89119700 1 -- 172.21.15.27:0/2785435801 >> 172.21.15.27:0/2785435801 conn(0x7faf8406b920 msgr2=0x7faf840b1b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:04.742 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.737+0000 7faf89119700 1 -- 172.21.15.27:0/2785435801 shutdown_connections 2023-07-05T23:35:04.742 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.737+0000 7faf89119700 1 -- 172.21.15.27:0/2785435801 wait complete. 2023-07-05T23:35:04.752 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-05T23:35:04.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.878+0000 7f8280322700 1 Processor -- start 2023-07-05T23:35:04.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.878+0000 7f8280322700 1 -- start start 2023-07-05T23:35:04.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.879+0000 7f8280322700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f82780d0a60 0x7f82780b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:04.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.879+0000 7f8280322700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82780cd9d0 con 0x7f82780b51d0 2023-07-05T23:35:04.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.879+0000 7f8280322700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82780b5620 con 0x7f82780cf910 2023-07-05T23:35:04.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.879+0000 7f8280322700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82780d0060 con 0x7f82780d0a60 2023-07-05T23:35:04.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.879+0000 7f827e0be700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f82780d0a60 0x7f82780b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:04.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.879+0000 7f827d8bd700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f82780b51d0 0x7f82780d0e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:53224/0 (socket says 172.21.15.27:53224) 2023-07-05T23:35:04.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.879+0000 7f827d8bd700 1 -- 172.21.15.27:0/1479151752 learned_addr learned my addr 172.21.15.27:0/1479151752 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-07-05T23:35:04.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.880+0000 7f827e0be700 1 -- 172.21.15.27:0/1479151752 >> v1:172.21.15.162:6789/0 conn(0x7f82780cf910 legacy=0x7f82780d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:04.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.880+0000 7f827e0be700 1 -- 172.21.15.27:0/1479151752 >> v1:172.21.15.27:6789/0 conn(0x7f82780b51d0 legacy=0x7f82780d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:04.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.880+0000 7f827e0be700 1 -- 172.21.15.27:0/1479151752 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82780cd410 con 0x7f82780d0a60 2023-07-05T23:35:04.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.880+0000 7f827e0be700 1 --2- 172.21.15.27:0/1479151752 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82780d0a60 0x7f82780b5a70 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8270009d90 tx=0x7f827000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=824fea1b8fe80fa9 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:04.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.880+0000 7f827d0bc700 1 -- 172.21.15.27:0/1479151752 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827000e070 con 0x7f82780d0a60 2023-07-05T23:35:04.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.880+0000 7f827d0bc700 1 -- 172.21.15.27:0/1479151752 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f827000bbd0 con 0x7f82780d0a60 2023-07-05T23:35:04.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.880+0000 7f827d0bc700 1 -- 172.21.15.27:0/1479151752 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8270012430 con 0x7f82780d0a60 2023-07-05T23:35:04.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.880+0000 7f8280322700 1 -- 172.21.15.27:0/1479151752 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82780d0a60 msgr2=0x7f82780b5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:04.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.881+0000 7f8280322700 1 --2- 172.21.15.27:0/1479151752 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82780d0a60 0x7f82780b5a70 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8270009d90 tx=0x7f827000b330 comp rx=0 tx=0).stop 2023-07-05T23:35:04.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.881+0000 7f8280322700 1 -- 172.21.15.27:0/1479151752 shutdown_connections 2023-07-05T23:35:04.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.881+0000 7f8280322700 1 --2- 172.21.15.27:0/1479151752 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82780d0a60 0x7f82780b5a70 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:04.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.881+0000 7f8280322700 1 -- 172.21.15.27:0/1479151752 >> 172.21.15.27:0/1479151752 conn(0x7f8278071620 msgr2=0x7f82780719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:04.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.881+0000 7f8280322700 1 -- 172.21.15.27:0/1479151752 shutdown_connections 2023-07-05T23:35:04.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.881+0000 7f8280322700 1 -- 172.21.15.27:0/1479151752 wait complete. 2023-07-05T23:35:04.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.882+0000 7f8280322700 1 Processor -- start 2023-07-05T23:35:04.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.882+0000 7f8280322700 1 -- start start 2023-07-05T23:35:04.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.883+0000 7f8280322700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82780b51d0 0x7f82780c8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:04.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.883+0000 7f8280322700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82780cf910 0x7f82780b6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:04.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.883+0000 7f8280322700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82780d0a60 0x7f82781e4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:04.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.883+0000 7f8280322700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8278148b20 con 0x7f82780cf910 2023-07-05T23:35:04.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.883+0000 7f8280322700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8278147b70 con 0x7f82780d0a60 2023-07-05T23:35:04.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.883+0000 7f8280322700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8278147ea0 con 0x7f82780b51d0 2023-07-05T23:35:04.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.883+0000 7f827d8bd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82780cf910 0x7f82780b6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:04.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.883+0000 7f827d8bd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82780cf910 0x7f82780b6060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46064/0 (socket says 172.21.15.27:46064) 2023-07-05T23:35:04.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.883+0000 7f827d8bd700 1 -- 172.21.15.27:0/3985881337 learned_addr learned my addr 172.21.15.27:0/3985881337 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:04.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.883+0000 7f827e0be700 1 --2- 172.21.15.27:0/3985881337 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82780b51d0 0x7f82780c8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:04.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.883+0000 7f827e8bf700 1 --2- 172.21.15.27:0/3985881337 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82780d0a60 0x7f82781e4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:04.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.883+0000 7f827d8bd700 1 -- 172.21.15.27:0/3985881337 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82780b51d0 msgr2=0x7f82780c8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:04.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.883+0000 7f827d8bd700 1 --2- 172.21.15.27:0/3985881337 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82780b51d0 0x7f82780c8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:04.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.883+0000 7f827d8bd700 1 -- 172.21.15.27:0/3985881337 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82780d0a60 msgr2=0x7f82781e4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:04.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.883+0000 7f827d8bd700 1 --2- 172.21.15.27:0/3985881337 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82780d0a60 0x7f82781e4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:04.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.883+0000 7f827d8bd700 1 -- 172.21.15.27:0/3985881337 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8270009a70 con 0x7f82780cf910 2023-07-05T23:35:04.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.883+0000 7f827d8bd700 1 --2- 172.21.15.27:0/3985881337 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82780cf910 0x7f82780b6060 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f826800c550 tx=0x7f826800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:04.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.883+0000 7f826effd700 1 -- 172.21.15.27:0/3985881337 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8268005d70 con 0x7f82780cf910 2023-07-05T23:35:04.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.883+0000 7f826effd700 1 -- 172.21.15.27:0/3985881337 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82680070d0 con 0x7f82780cf910 2023-07-05T23:35:04.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.883+0000 7f8280322700 1 -- 172.21.15.27:0/3985881337 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8278148180 con 0x7f82780cf910 2023-07-05T23:35:04.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.883+0000 7f826effd700 1 -- 172.21.15.27:0/3985881337 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8268007440 con 0x7f82780cf910 2023-07-05T23:35:04.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.883+0000 7f8280322700 1 -- 172.21.15.27:0/3985881337 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8278148740 con 0x7f82780cf910 2023-07-05T23:35:04.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.884+0000 7f8280322700 1 -- 172.21.15.27:0/3985881337 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8278148c60 con 0x7f82780cf910 2023-07-05T23:35:04.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.885+0000 7f826effd700 1 -- 172.21.15.27:0/3985881337 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f82680075a0 con 0x7f82780cf910 2023-07-05T23:35:04.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.885+0000 7f826effd700 1 --2- 172.21.15.27:0/3985881337 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f825c06ace0 0x7f825c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:04.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.885+0000 7f826effd700 1 -- 172.21.15.27:0/3985881337 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8268088a00 con 0x7f82780cf910 2023-07-05T23:35:04.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.885+0000 7f827e0be700 1 --2- 172.21.15.27:0/3985881337 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f825c06ace0 0x7f825c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:04.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.886+0000 7f827e0be700 1 --2- 172.21.15.27:0/3985881337 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f825c06ace0 0x7f825c06d190 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8270014040 tx=0x7f8270011000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:04.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:04.890+0000 7f826effd700 1 -- 172.21.15.27:0/3985881337 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8278148c60 con 0x7f82780cf910 2023-07-05T23:35:05.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.087+0000 7f8280322700 1 -- 172.21.15.27:0/3985881337 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8278148c60 con 0x7f82780cf910 2023-07-05T23:35:05.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.087+0000 7f826effd700 1 -- 172.21.15.27:0/3985881337 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8278148c60 con 0x7f82780cf910 2023-07-05T23:35:05.092 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 32 2023-07-05T23:35:05.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.089+0000 7f8280322700 1 -- 172.21.15.27:0/3985881337 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f825c06ace0 msgr2=0x7f825c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:05.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.089+0000 7f8280322700 1 --2- 172.21.15.27:0/3985881337 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f825c06ace0 0x7f825c06d190 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8270014040 tx=0x7f8270011000 comp rx=0 tx=0).stop 2023-07-05T23:35:05.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.089+0000 7f8280322700 1 -- 172.21.15.27:0/3985881337 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82780cf910 msgr2=0x7f82780b6060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:05.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.089+0000 7f8280322700 1 --2- 172.21.15.27:0/3985881337 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82780cf910 0x7f82780b6060 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f826800c550 tx=0x7f826800c860 comp rx=0 tx=0).stop 2023-07-05T23:35:05.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.089+0000 7f8280322700 1 -- 172.21.15.27:0/3985881337 shutdown_connections 2023-07-05T23:35:05.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.089+0000 7f8280322700 1 --2- 172.21.15.27:0/3985881337 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82780d0a60 0x7f82781e4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:05.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.089+0000 7f8280322700 1 --2- 172.21.15.27:0/3985881337 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f825c06ace0 0x7f825c06d190 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:05.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.089+0000 7f8280322700 1 --2- 172.21.15.27:0/3985881337 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82780b51d0 0x7f82780c8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:05.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.089+0000 7f8280322700 1 --2- 172.21.15.27:0/3985881337 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82780cf910 0x7f82780b6060 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:05.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.089+0000 7f8280322700 1 -- 172.21.15.27:0/3985881337 >> 172.21.15.27:0/3985881337 conn(0x7f8278071620 msgr2=0x7f827815e960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:05.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.090+0000 7f8280322700 1 -- 172.21.15.27:0/3985881337 shutdown_connections 2023-07-05T23:35:05.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.090+0000 7f8280322700 1 -- 172.21.15.27:0/3985881337 wait complete. 2023-07-05T23:35:05.104 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-05T23:35:05.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.231+0000 7f358bf50700 1 Processor -- start 2023-07-05T23:35:05.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.231+0000 7f358bf50700 1 -- start start 2023-07-05T23:35:05.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.232+0000 7f358bf50700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f35840d0a60 0x7f35840b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:05.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.232+0000 7f358bf50700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f35840b51d0 0x7f35840cf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:05.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.232+0000 7f358bf50700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f35840d0e30 0x7f35840d12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:05.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.232+0000 7f358bf50700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35840d0060 con 0x7f35840b51d0 2023-07-05T23:35:05.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.232+0000 7f358bf50700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35840cfe50 con 0x7f35840d0a60 2023-07-05T23:35:05.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.232+0000 7f358bf50700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35840cd9d0 con 0x7f35840d0e30 2023-07-05T23:35:05.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.232+0000 7f35894eb700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f35840b51d0 0x7f35840cf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:05.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.232+0000 7f35894eb700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f35840b51d0 0x7f35840cf910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46072/0 (socket says 172.21.15.27:46072) 2023-07-05T23:35:05.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.232+0000 7f35894eb700 1 -- 172.21.15.27:0/2142923789 learned_addr learned my addr 172.21.15.27:0/2142923789 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:05.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.232+0000 7f3589cec700 1 --2- 172.21.15.27:0/2142923789 >> v2:172.21.15.162:3300/0 conn(0x7f35840d0a60 0x7f35840b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:05.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.232+0000 7f358a4ed700 1 --2- 172.21.15.27:0/2142923789 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f35840d0e30 0x7f35840d12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:05.239 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.232+0000 7f35894eb700 1 -- 172.21.15.27:0/2142923789 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f35840d0e30 msgr2=0x7f35840d12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:35:05.239 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.232+0000 7f35894eb700 1 --2- 172.21.15.27:0/2142923789 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f35840d0e30 0x7f35840d12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:05.239 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.233+0000 7f35894eb700 1 -- 172.21.15.27:0/2142923789 >> v2:172.21.15.162:3300/0 conn(0x7f35840d0a60 msgr2=0x7f35840b5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:35:05.239 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.233+0000 7f35894eb700 1 --2- 172.21.15.27:0/2142923789 >> v2:172.21.15.162:3300/0 conn(0x7f35840d0a60 0x7f35840b5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:05.240 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.233+0000 7f35894eb700 1 -- 172.21.15.27:0/2142923789 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35840b5620 con 0x7f35840b51d0 2023-07-05T23:35:05.240 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.233+0000 7f35894eb700 1 --2- 172.21.15.27:0/2142923789 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f35840b51d0 0x7f35840cf910 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f358406c6e0 tx=0x7f3574009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef244819b165ab4e server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:05.240 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.233+0000 7f3588cea700 1 -- 172.21.15.27:0/2142923789 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3574011830 con 0x7f35840b51d0 2023-07-05T23:35:05.240 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.233+0000 7f3588cea700 1 -- 172.21.15.27:0/2142923789 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3574011990 con 0x7f35840b51d0 2023-07-05T23:35:05.241 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.233+0000 7f3588cea700 1 -- 172.21.15.27:0/2142923789 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3574011d20 con 0x7f35840b51d0 2023-07-05T23:35:05.241 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.233+0000 7f358bf50700 1 -- 172.21.15.27:0/2142923789 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f35840b51d0 msgr2=0x7f35840cf910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:05.241 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.233+0000 7f358bf50700 1 --2- 172.21.15.27:0/2142923789 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f35840b51d0 0x7f35840cf910 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f358406c6e0 tx=0x7f3574009bd0 comp rx=0 tx=0).stop 2023-07-05T23:35:05.241 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.233+0000 7f358bf50700 1 -- 172.21.15.27:0/2142923789 shutdown_connections 2023-07-05T23:35:05.241 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.233+0000 7f358bf50700 1 --2- 172.21.15.27:0/2142923789 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f35840d0e30 0x7f35840d12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:05.242 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.233+0000 7f358bf50700 1 --2- 172.21.15.27:0/2142923789 >> v2:172.21.15.162:3300/0 conn(0x7f35840d0a60 0x7f35840b5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:05.242 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.233+0000 7f358bf50700 1 --2- 172.21.15.27:0/2142923789 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f35840b51d0 0x7f35840cf910 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:05.242 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.233+0000 7f358bf50700 1 -- 172.21.15.27:0/2142923789 >> 172.21.15.27:0/2142923789 conn(0x7f3584071620 msgr2=0x7f35840719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:05.242 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.234+0000 7f358bf50700 1 -- 172.21.15.27:0/2142923789 shutdown_connections 2023-07-05T23:35:05.242 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.234+0000 7f358bf50700 1 -- 172.21.15.27:0/2142923789 wait complete. 2023-07-05T23:35:05.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.235+0000 7f358bf50700 1 Processor -- start 2023-07-05T23:35:05.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.235+0000 7f358bf50700 1 -- start start 2023-07-05T23:35:05.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.235+0000 7f358bf50700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f35840b51d0 0x7f358415c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:05.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.235+0000 7f358bf50700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f35840d0a60 0x7f35840c80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:05.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.235+0000 7f358bf50700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35840d0e30 0x7f358415e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:05.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.236+0000 7f358bf50700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f358415c9b0 con 0x7f35840d0a60 2023-07-05T23:35:05.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.236+0000 7f358bf50700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f358415cc90 con 0x7f35840d0e30 2023-07-05T23:35:05.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.236+0000 7f358bf50700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f358415cf70 con 0x7f35840b51d0 2023-07-05T23:35:05.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.236+0000 7f35894eb700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f35840d0a60 0x7f35840c80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:05.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.236+0000 7f35894eb700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f35840d0a60 0x7f35840c80e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46078/0 (socket says 172.21.15.27:46078) 2023-07-05T23:35:05.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.236+0000 7f35894eb700 1 -- 172.21.15.27:0/2836777709 learned_addr learned my addr 172.21.15.27:0/2836777709 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:05.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.236+0000 7f3589cec700 1 --2- 172.21.15.27:0/2836777709 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f35840b51d0 0x7f358415c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:05.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.236+0000 7f358a4ed700 1 --2- 172.21.15.27:0/2836777709 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35840d0e30 0x7f358415e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:05.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.236+0000 7f35894eb700 1 -- 172.21.15.27:0/2836777709 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f35840b51d0 msgr2=0x7f358415c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:05.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.236+0000 7f35894eb700 1 --2- 172.21.15.27:0/2836777709 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f35840b51d0 0x7f358415c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:05.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.236+0000 7f35894eb700 1 -- 172.21.15.27:0/2836777709 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35840d0e30 msgr2=0x7f358415e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:05.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.236+0000 7f35894eb700 1 --2- 172.21.15.27:0/2836777709 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35840d0e30 0x7f358415e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:05.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.236+0000 7f35894eb700 1 -- 172.21.15.27:0/2836777709 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3574009550 con 0x7f35840d0a60 2023-07-05T23:35:05.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.236+0000 7f35894eb700 1 --2- 172.21.15.27:0/2836777709 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f35840d0a60 0x7f35840c80e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3574000c00 tx=0x7f3574004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:05.249 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.236+0000 7f357a7fc700 1 -- 172.21.15.27:0/2836777709 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3574004300 con 0x7f35840d0a60 2023-07-05T23:35:05.249 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.236+0000 7f357a7fc700 1 -- 172.21.15.27:0/2836777709 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f357401f070 con 0x7f35840d0a60 2023-07-05T23:35:05.249 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.236+0000 7f358bf50700 1 -- 172.21.15.27:0/2836777709 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f358415d250 con 0x7f35840d0a60 2023-07-05T23:35:05.249 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.236+0000 7f357a7fc700 1 -- 172.21.15.27:0/2836777709 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35740036a0 con 0x7f35840d0a60 2023-07-05T23:35:05.249 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.236+0000 7f358bf50700 1 -- 172.21.15.27:0/2836777709 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f358415da50 con 0x7f35840d0a60 2023-07-05T23:35:05.250 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.237+0000 7f358bf50700 1 -- 172.21.15.27:0/2836777709 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f358415d770 con 0x7f35840d0a60 2023-07-05T23:35:05.250 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.238+0000 7f357a7fc700 1 -- 172.21.15.27:0/2836777709 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3574021030 con 0x7f35840d0a60 2023-07-05T23:35:05.250 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.238+0000 7f357a7fc700 1 --2- 172.21.15.27:0/2836777709 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f356806ace0 0x7f356806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:05.250 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.238+0000 7f357a7fc700 1 -- 172.21.15.27:0/2836777709 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f357408aa90 con 0x7f35840d0a60 2023-07-05T23:35:05.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.238+0000 7f3589cec700 1 --2- 172.21.15.27:0/2836777709 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f356806ace0 0x7f356806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:05.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.239+0000 7f3589cec700 1 --2- 172.21.15.27:0/2836777709 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f356806ace0 0x7f356806d190 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f357c0074a0 tx=0x7f357c00d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:05.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.243+0000 7f357a7fc700 1 -- 172.21.15.27:0/2836777709 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f358415d770 con 0x7f35840d0a60 2023-07-05T23:35:05.295 INFO:tasks.workunit.client.0.smithi027.stdout:Try to write 26214400 2023-07-05T23:35:05.296 INFO:tasks.workunit.client.0.smithi027.stderr:+ return 1 2023-07-05T23:35:05.296 INFO:tasks.workunit.client.0.smithi027.stderr:+ return 0 2023-07-05T23:35:05.296 INFO:tasks.workunit.client.0.smithi027.stderr:+ stat '--printf=%n %s\n' ancestor/p1/p2/parent/p3/file1 2023-07-05T23:35:05.297 INFO:tasks.workunit.client.0.smithi027.stdout:ancestor/p1/p2/parent/p3/file1 25165824 2023-07-05T23:35:05.297 INFO:tasks.workunit.client.0.smithi027.stderr:+ setfattr -n ceph.quota.max_bytes -v 0 . 2023-07-05T23:35:05.297 INFO:tasks.workunit.client.0.smithi027.stderr:+ setfattr -n ceph.quota.max_bytes -v 1 . 2023-07-05T23:35:05.298 INFO:tasks.workunit.client.0.smithi027.stderr:setfattr: .: Invalid argument 2023-07-05T23:35:05.298 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-05T23:35:05.299 INFO:tasks.workunit:Stopping ['fs/quota'] on client.0... 2023-07-05T23:35:05.299 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-07-05T23:35:05.317 INFO:tasks.workunit.client.2.smithi027.stdout:Try to write 26214400 2023-07-05T23:35:05.317 INFO:tasks.workunit.client.2.smithi027.stderr:+ return 1 2023-07-05T23:35:05.318 INFO:tasks.workunit.client.2.smithi027.stderr:+ return 0 2023-07-05T23:35:05.318 INFO:tasks.workunit.client.2.smithi027.stderr:+ stat '--printf=%n %s\n' ancestor/p1/p2/parent/p3/file1 2023-07-05T23:35:05.318 INFO:tasks.workunit.client.2.smithi027.stdout:ancestor/p1/p2/parent/p3/file1 25165824 2023-07-05T23:35:05.319 INFO:tasks.workunit.client.2.smithi027.stderr:+ setfattr -n ceph.quota.max_bytes -v 0 . 2023-07-05T23:35:05.320 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-05T23:35:05.321 INFO:tasks.workunit.client.2.smithi027.stderr:+ setfattr -n ceph.quota.max_bytes -v 1 . 2023-07-05T23:35:05.321 INFO:tasks.workunit.client.2.smithi027.stderr:setfattr: .: Invalid argument 2023-07-05T23:35:05.321 INFO:tasks.workunit:Stopping ['fs/quota'] on client.2... 2023-07-05T23:35:05.322 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.2 /home/ubuntu/cephtest/clone.client.2 2023-07-05T23:35:05.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.451+0000 7f358bf50700 1 -- 172.21.15.27:0/2836777709 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f358415d770 con 0x7f35840d0a60 2023-07-05T23:35:05.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.451+0000 7f357a7fc700 1 -- 172.21.15.27:0/2836777709 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3574015020 con 0x7f35840d0a60 2023-07-05T23:35:05.455 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2023-07-05T23:35:05.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.453+0000 7f358bf50700 1 -- 172.21.15.27:0/2836777709 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f356806ace0 msgr2=0x7f356806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:05.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.453+0000 7f358bf50700 1 --2- 172.21.15.27:0/2836777709 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f356806ace0 0x7f356806d190 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f357c0074a0 tx=0x7f357c00d040 comp rx=0 tx=0).stop 2023-07-05T23:35:05.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.453+0000 7f358bf50700 1 -- 172.21.15.27:0/2836777709 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f35840d0a60 msgr2=0x7f35840c80e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:05.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.453+0000 7f358bf50700 1 --2- 172.21.15.27:0/2836777709 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f35840d0a60 0x7f35840c80e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3574000c00 tx=0x7f3574004750 comp rx=0 tx=0).stop 2023-07-05T23:35:05.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.453+0000 7f358bf50700 1 -- 172.21.15.27:0/2836777709 shutdown_connections 2023-07-05T23:35:05.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.453+0000 7f358bf50700 1 --2- 172.21.15.27:0/2836777709 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35840d0e30 0x7f358415e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:05.460 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.453+0000 7f358bf50700 1 --2- 172.21.15.27:0/2836777709 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f356806ace0 0x7f356806d190 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:05.460 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.453+0000 7f358bf50700 1 --2- 172.21.15.27:0/2836777709 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f35840b51d0 0x7f358415c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:05.460 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.453+0000 7f358bf50700 1 --2- 172.21.15.27:0/2836777709 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f35840d0a60 0x7f35840c80e0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:05.460 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.453+0000 7f358bf50700 1 -- 172.21.15.27:0/2836777709 >> 172.21.15.27:0/2836777709 conn(0x7f3584071620 msgr2=0x7f35840d1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:05.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.453+0000 7f358bf50700 1 -- 172.21.15.27:0/2836777709 shutdown_connections 2023-07-05T23:35:05.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.453+0000 7f358bf50700 1 -- 172.21.15.27:0/2836777709 wait complete. 2023-07-05T23:35:05.469 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-05T23:35:05.691 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.688+0000 7f0f4f701700 1 Processor -- start 2023-07-05T23:35:05.691 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.688+0000 7f0f4f701700 1 -- start start 2023-07-05T23:35:05.692 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.689+0000 7f0f4f701700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f48160a50 0x7f0f48069ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:05.693 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.689+0000 7f0f4f701700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f481654d0 con 0x7f0f4806da60 2023-07-05T23:35:05.693 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.689+0000 7f0f4f701700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f48071720 con 0x7f0f480c1cd0 2023-07-05T23:35:05.693 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.689+0000 7f0f4f701700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f480cd260 con 0x7f0f48160a50 2023-07-05T23:35:05.693 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.690+0000 7f0f4d49d700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f48160a50 0x7f0f48069ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:05.694 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.690+0000 7f0f4d49d700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f48160a50 0x7f0f48069ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.27:46120/0 (socket says 172.21.15.27:46120) 2023-07-05T23:35:05.694 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.690+0000 7f0f4d49d700 1 -- 172.21.15.27:0/4139522372 learned_addr learned my addr 172.21.15.27:0/4139522372 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:05.695 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.690+0000 7f0f4d49d700 1 -- 172.21.15.27:0/4139522372 >> v1:172.21.15.162:6789/0 conn(0x7f0f480c1cd0 legacy=0x7f0f481646b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-05T23:35:05.695 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.690+0000 7f0f4d49d700 1 -- 172.21.15.27:0/4139522372 >> v1:172.21.15.27:6789/0 conn(0x7f0f4806da60 legacy=0x7f0f48164dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:05.695 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.690+0000 7f0f4d49d700 1 -- 172.21.15.27:0/4139522372 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f480ccba0 con 0x7f0f48160a50 2023-07-05T23:35:05.695 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.691+0000 7f0f4d49d700 1 --2- 172.21.15.27:0/4139522372 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f48160a50 0x7f0f48069ef0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0f44009920 tx=0x7f0f44009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c284da1336021a82 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:05.696 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.693+0000 7f0f3ffff700 1 -- 172.21.15.27:0/4139522372 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f44004230 con 0x7f0f48160a50 2023-07-05T23:35:05.696 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.693+0000 7f0f3ffff700 1 -- 172.21.15.27:0/4139522372 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f44004390 con 0x7f0f48160a50 2023-07-05T23:35:05.697 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.693+0000 7f0f3ffff700 1 -- 172.21.15.27:0/4139522372 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f44009e70 con 0x7f0f48160a50 2023-07-05T23:35:05.697 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.694+0000 7f0f4f701700 1 -- 172.21.15.27:0/4139522372 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f48160a50 msgr2=0x7f0f48069ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:05.698 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.694+0000 7f0f4f701700 1 --2- 172.21.15.27:0/4139522372 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f48160a50 0x7f0f48069ef0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0f44009920 tx=0x7f0f44009c30 comp rx=0 tx=0).stop 2023-07-05T23:35:05.698 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.695+0000 7f0f4f701700 1 -- 172.21.15.27:0/4139522372 shutdown_connections 2023-07-05T23:35:05.698 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.695+0000 7f0f4f701700 1 --2- 172.21.15.27:0/4139522372 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f48160a50 0x7f0f48069ef0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:05.698 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.695+0000 7f0f4f701700 1 -- 172.21.15.27:0/4139522372 >> 172.21.15.27:0/4139522372 conn(0x7f0f480b1580 msgr2=0x7f0f480cedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:05.699 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.695+0000 7f0f4f701700 1 -- 172.21.15.27:0/4139522372 shutdown_connections 2023-07-05T23:35:05.700 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.695+0000 7f0f4f701700 1 -- 172.21.15.27:0/4139522372 wait complete. 2023-07-05T23:35:05.701 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.697+0000 7f0f4f701700 1 Processor -- start 2023-07-05T23:35:05.701 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.697+0000 7f0f4f701700 1 -- start start 2023-07-05T23:35:05.702 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.698+0000 7f0f4f701700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0f4806da60 0x7f0f481eca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:05.702 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.698+0000 7f0f4f701700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f480c1cd0 0x7f0f4814b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:05.702 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.698+0000 7f0f4f701700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f48160a50 0x7f0f480c52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:05.703 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.698+0000 7f0f4f701700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f4814bb10 con 0x7f0f4806da60 2023-07-05T23:35:05.703 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.698+0000 7f0f4f701700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f481eb9f0 con 0x7f0f48160a50 2023-07-05T23:35:05.703 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.698+0000 7f0f4f701700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f481ebcd0 con 0x7f0f480c1cd0 2023-07-05T23:35:05.703 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.699+0000 7f0f4d49d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0f4806da60 0x7f0f481eca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:05.704 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.699+0000 7f0f4d49d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0f4806da60 0x7f0f481eca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46090/0 (socket says 172.21.15.27:46090) 2023-07-05T23:35:05.704 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.699+0000 7f0f4d49d700 1 -- 172.21.15.27:0/1301776462 learned_addr learned my addr 172.21.15.27:0/1301776462 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:05.705 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.699+0000 7f0f4cc9c700 1 --2- 172.21.15.27:0/1301776462 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f480c1cd0 0x7f0f4814b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:05.705 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.700+0000 7f0f4d49d700 1 -- 172.21.15.27:0/1301776462 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f480c1cd0 msgr2=0x7f0f4814b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:05.705 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.700+0000 7f0f4d49d700 1 --2- 172.21.15.27:0/1301776462 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f480c1cd0 0x7f0f4814b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:05.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.700+0000 7f0f4d49d700 1 -- 172.21.15.27:0/1301776462 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f48160a50 msgr2=0x7f0f480c52f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-05T23:35:05.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.700+0000 7f0f4d49d700 1 --2- 172.21.15.27:0/1301776462 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f48160a50 0x7f0f480c52f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:05.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.700+0000 7f0f4d49d700 1 -- 172.21.15.27:0/1301776462 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f44009550 con 0x7f0f4806da60 2023-07-05T23:35:05.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.701+0000 7f0f4d49d700 1 --2- 172.21.15.27:0/1301776462 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0f4806da60 0x7f0f481eca90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f0f44009870 tx=0x7f0f44004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:05.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.701+0000 7f0f3dffb700 1 -- 172.21.15.27:0/1301776462 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4400bdf0 con 0x7f0f4806da60 2023-07-05T23:35:05.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.701+0000 7f0f3dffb700 1 -- 172.21.15.27:0/1301776462 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f440036a0 con 0x7f0f4806da60 2023-07-05T23:35:05.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.701+0000 7f0f4f701700 1 -- 172.21.15.27:0/1301776462 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f481ebfb0 con 0x7f0f4806da60 2023-07-05T23:35:05.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.701+0000 7f0f3dffb700 1 -- 172.21.15.27:0/1301776462 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f44003a50 con 0x7f0f4806da60 2023-07-05T23:35:05.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.702+0000 7f0f4f701700 1 -- 172.21.15.27:0/1301776462 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f481ec570 con 0x7f0f4806da60 2023-07-05T23:35:05.710 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.705+0000 7f0f3dffb700 1 -- 172.21.15.27:0/1301776462 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0f44022070 con 0x7f0f4806da60 2023-07-05T23:35:05.711 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.705+0000 7f0f3dffb700 1 --2- 172.21.15.27:0/1301776462 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f0f2c06ad30 0x7f0f2c06d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:05.711 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.706+0000 7f0f3dffb700 1 -- 172.21.15.27:0/1301776462 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0f4408b240 con 0x7f0f4806da60 2023-07-05T23:35:05.711 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.706+0000 7f0f4cc9c700 1 --2- 172.21.15.27:0/1301776462 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f0f2c06ad30 0x7f0f2c06d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:05.712 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.706+0000 7f0f4f701700 1 -- 172.21.15.27:0/1301776462 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f4804ea20 con 0x7f0f4806da60 2023-07-05T23:35:05.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.716+0000 7f0f4cc9c700 1 --2- 172.21.15.27:0/1301776462 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f0f2c06ad30 0x7f0f2c06d1e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0f480b49f0 tx=0x7f0f380090e0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:05.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:05.716+0000 7f0f3dffb700 1 -- 172.21.15.27:0/1301776462 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0f44056130 con 0x7f0f4806da60 2023-07-05T23:35:06.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.112+0000 7f0f4f701700 1 -- 172.21.15.27:0/1301776462 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f0f48071ad0 con 0x7f0f4806da60 2023-07-05T23:35:06.116 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.113+0000 7f0f3dffb700 1 -- 172.21.15.27:0/1301776462 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7f0f44059750 con 0x7f0f4806da60 2023-07-05T23:35:06.117 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 32 2023-07-05T23:35:06.121 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.118+0000 7f0f4f701700 1 -- 172.21.15.27:0/1301776462 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f0f2c06ad30 msgr2=0x7f0f2c06d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:06.121 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.118+0000 7f0f4f701700 1 --2- 172.21.15.27:0/1301776462 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f0f2c06ad30 0x7f0f2c06d1e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0f480b49f0 tx=0x7f0f380090e0 comp rx=0 tx=0).stop 2023-07-05T23:35:06.121 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.118+0000 7f0f4f701700 1 -- 172.21.15.27:0/1301776462 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0f4806da60 msgr2=0x7f0f481eca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:06.122 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.118+0000 7f0f4f701700 1 --2- 172.21.15.27:0/1301776462 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0f4806da60 0x7f0f481eca90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f0f44009870 tx=0x7f0f44004750 comp rx=0 tx=0).stop 2023-07-05T23:35:06.122 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.118+0000 7f0f4f701700 1 -- 172.21.15.27:0/1301776462 shutdown_connections 2023-07-05T23:35:06.123 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.118+0000 7f0f4f701700 1 --2- 172.21.15.27:0/1301776462 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f48160a50 0x7f0f480c52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:06.123 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.118+0000 7f0f4f701700 1 --2- 172.21.15.27:0/1301776462 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f0f2c06ad30 0x7f0f2c06d1e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:06.123 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.118+0000 7f0f4f701700 1 --2- 172.21.15.27:0/1301776462 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0f4806da60 0x7f0f481eca90 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:06.123 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.118+0000 7f0f4f701700 1 --2- 172.21.15.27:0/1301776462 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f480c1cd0 0x7f0f4814b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:06.123 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.118+0000 7f0f4f701700 1 -- 172.21.15.27:0/1301776462 >> 172.21.15.27:0/1301776462 conn(0x7f0f480b1580 msgr2=0x7f0f480c93d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:06.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.119+0000 7f0f4f701700 1 -- 172.21.15.27:0/1301776462 shutdown_connections 2023-07-05T23:35:06.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.119+0000 7f0f4f701700 1 -- 172.21.15.27:0/1301776462 wait complete. 2023-07-05T23:35:06.144 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-05T23:35:06.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.408+0000 7fc6d165a700 1 Processor -- start 2023-07-05T23:35:06.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.408+0000 7fc6d165a700 1 -- start start 2023-07-05T23:35:06.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.410+0000 7fc6d165a700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc6cc15a0a0 0x7fc6cc0c8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:06.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.410+0000 7fc6d165a700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc6cc0cb350 0x7fc6cc0cb790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:06.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.410+0000 7fc6d165a700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6cc0c9220 con 0x7fc6cc070b70 2023-07-05T23:35:06.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.410+0000 7fc6d165a700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6cc15a470 con 0x7fc6cc15a0a0 2023-07-05T23:35:06.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.410+0000 7fc6d165a700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6cc0cbcd0 con 0x7fc6cc0cb350 2023-07-05T23:35:06.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.410+0000 7fc6caffd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc6cc15a0a0 0x7fc6cc0c8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:06.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.410+0000 7fc6caffd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc6cc15a0a0 0x7fc6cc0c8ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46098/0 (socket says 172.21.15.27:46098) 2023-07-05T23:35:06.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.410+0000 7fc6caffd700 1 -- 172.21.15.27:0/3777926405 learned_addr learned my addr 172.21.15.27:0/3777926405 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:06.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.410+0000 7fc6caffd700 1 -- 172.21.15.27:0/3777926405 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc6cc0cb350 msgr2=0x7fc6cc0cb790 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-05T23:35:06.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.411+0000 7fc6caffd700 1 --2- 172.21.15.27:0/3777926405 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc6cc0cb350 0x7fc6cc0cb790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:06.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.411+0000 7fc6caffd700 1 -- 172.21.15.27:0/3777926405 >> v1:172.21.15.162:6789/0 conn(0x7fc6cc070b70 legacy=0x7fc6cc0ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:35:06.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.411+0000 7fc6caffd700 1 -- 172.21.15.27:0/3777926405 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6cc0caf10 con 0x7fc6cc15a0a0 2023-07-05T23:35:06.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.411+0000 7fc6caffd700 1 --2- 172.21.15.27:0/3777926405 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6cc15a0a0 0x7fc6cc0c8ce0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc0098f0 tx=0x7fc6bc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=181103df29e6d772 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:06.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.412+0000 7fc6ca7fc700 1 -- 172.21.15.27:0/3777926405 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc004230 con 0x7fc6cc15a0a0 2023-07-05T23:35:06.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.412+0000 7fc6ca7fc700 1 -- 172.21.15.27:0/3777926405 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6bc004390 con 0x7fc6cc15a0a0 2023-07-05T23:35:06.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.412+0000 7fc6ca7fc700 1 -- 172.21.15.27:0/3777926405 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc0036a0 con 0x7fc6cc15a0a0 2023-07-05T23:35:06.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.413+0000 7fc6d165a700 1 -- 172.21.15.27:0/3777926405 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6cc15a0a0 msgr2=0x7fc6cc0c8ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:06.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.413+0000 7fc6d165a700 1 --2- 172.21.15.27:0/3777926405 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6cc15a0a0 0x7fc6cc0c8ce0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc0098f0 tx=0x7fc6bc009c00 comp rx=0 tx=0).stop 2023-07-05T23:35:06.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.413+0000 7fc6d165a700 1 -- 172.21.15.27:0/3777926405 shutdown_connections 2023-07-05T23:35:06.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.413+0000 7fc6d165a700 1 --2- 172.21.15.27:0/3777926405 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6cc15a0a0 0x7fc6cc0c8ce0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:06.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.413+0000 7fc6d165a700 1 --2- 172.21.15.27:0/3777926405 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc6cc0cb350 0x7fc6cc0cb790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:06.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.413+0000 7fc6d165a700 1 -- 172.21.15.27:0/3777926405 >> 172.21.15.27:0/3777926405 conn(0x7fc6cc0b0260 msgr2=0x7fc6cc0b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:06.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.413+0000 7fc6d165a700 1 -- 172.21.15.27:0/3777926405 shutdown_connections 2023-07-05T23:35:06.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.413+0000 7fc6d165a700 1 -- 172.21.15.27:0/3777926405 wait complete. 2023-07-05T23:35:06.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.415+0000 7fc6d165a700 1 Processor -- start 2023-07-05T23:35:06.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.416+0000 7fc6d165a700 1 -- start start 2023-07-05T23:35:06.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.417+0000 7fc6d165a700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6cc070b70 0x7fc6cc0c21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:06.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.417+0000 7fc6d165a700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc6cc0cb350 0x7fc6cc155b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:06.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.417+0000 7fc6d165a700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6cc15a0a0 0x7fc6cc0b30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:06.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.417+0000 7fc6d165a700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6cc0c4e40 con 0x7fc6cc070b70 2023-07-05T23:35:06.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.417+0000 7fc6d165a700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6cc0c6230 con 0x7fc6cc15a0a0 2023-07-05T23:35:06.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.417+0000 7fc6d165a700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6cc0c26e0 con 0x7fc6cc0cb350 2023-07-05T23:35:06.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.418+0000 7fc6cb7fe700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6cc15a0a0 0x7fc6cc0b30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:06.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.418+0000 7fc6caffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6cc070b70 0x7fc6cc0c21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:06.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.418+0000 7fc6caffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6cc070b70 0x7fc6cc0c21a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46104/0 (socket says 172.21.15.27:46104) 2023-07-05T23:35:06.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.418+0000 7fc6caffd700 1 -- 172.21.15.27:0/3031999364 learned_addr learned my addr 172.21.15.27:0/3031999364 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:06.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.419+0000 7fc6caffd700 1 -- 172.21.15.27:0/3031999364 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc6cc0cb350 msgr2=0x7fc6cc155b30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-05T23:35:06.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.419+0000 7fc6caffd700 1 --2- 172.21.15.27:0/3031999364 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc6cc0cb350 0x7fc6cc155b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:06.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.419+0000 7fc6caffd700 1 -- 172.21.15.27:0/3031999364 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6cc15a0a0 msgr2=0x7fc6cc0b30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:06.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.419+0000 7fc6caffd700 1 --2- 172.21.15.27:0/3031999364 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6cc15a0a0 0x7fc6cc0b30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:06.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.419+0000 7fc6caffd700 1 -- 172.21.15.27:0/3031999364 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6bc009550 con 0x7fc6cc070b70 2023-07-05T23:35:06.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.419+0000 7fc6caffd700 1 --2- 172.21.15.27:0/3031999364 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6cc070b70 0x7fc6cc0c21a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc0cbfc0 tx=0x7fc6bc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:06.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.420+0000 7fc6c37fe700 1 -- 172.21.15.27:0/3031999364 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc003e90 con 0x7fc6cc070b70 2023-07-05T23:35:06.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.420+0000 7fc6c37fe700 1 -- 172.21.15.27:0/3031999364 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6bc00b660 con 0x7fc6cc070b70 2023-07-05T23:35:06.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.420+0000 7fc6c37fe700 1 -- 172.21.15.27:0/3031999364 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc00b9f0 con 0x7fc6cc070b70 2023-07-05T23:35:06.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.420+0000 7fc6d165a700 1 -- 172.21.15.27:0/3031999364 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6cc0c5900 con 0x7fc6cc070b70 2023-07-05T23:35:06.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.421+0000 7fc6d165a700 1 -- 172.21.15.27:0/3031999364 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6cc0c5ec0 con 0x7fc6cc070b70 2023-07-05T23:35:06.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.422+0000 7fc6d165a700 1 -- 172.21.15.27:0/3031999364 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6cc073910 con 0x7fc6cc070b70 2023-07-05T23:35:06.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.423+0000 7fc6c37fe700 1 -- 172.21.15.27:0/3031999364 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc6bc021070 con 0x7fc6cc070b70 2023-07-05T23:35:06.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.424+0000 7fc6c37fe700 1 --2- 172.21.15.27:0/3031999364 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fc6ac06ace0 0x7fc6ac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:06.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.424+0000 7fc6c37fe700 1 -- 172.21.15.27:0/3031999364 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc6bc08adb0 con 0x7fc6cc070b70 2023-07-05T23:35:06.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.424+0000 7fc6c3fff700 1 --2- 172.21.15.27:0/3031999364 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fc6ac06ace0 0x7fc6ac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:06.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.425+0000 7fc6c3fff700 1 --2- 172.21.15.27:0/3031999364 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fc6ac06ace0 0x7fc6ac06d190 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc0c3f30 tx=0x7fc6b4007a40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:06.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.431+0000 7fc6c37fe700 1 -- 172.21.15.27:0/3031999364 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc6bc055bc0 con 0x7fc6cc070b70 2023-07-05T23:35:06.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.870+0000 7fc6d165a700 1 -- 172.21.15.27:0/3031999364 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc6cc0c9220 con 0x7fc6cc070b70 2023-07-05T23:35:06.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.871+0000 7fc6c37fe700 1 -- 172.21.15.27:0/3031999364 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v30) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc6cc0c9220 con 0x7fc6cc070b70 2023-07-05T23:35:06.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.874+0000 7fc6d165a700 1 -- 172.21.15.27:0/3031999364 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fc6ac06ace0 msgr2=0x7fc6ac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:06.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.874+0000 7fc6d165a700 1 --2- 172.21.15.27:0/3031999364 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fc6ac06ace0 0x7fc6ac06d190 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc0c3f30 tx=0x7fc6b4007a40 comp rx=0 tx=0).stop 2023-07-05T23:35:06.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.875+0000 7fc6d165a700 1 -- 172.21.15.27:0/3031999364 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6cc070b70 msgr2=0x7fc6cc0c21a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:06.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.875+0000 7fc6d165a700 1 --2- 172.21.15.27:0/3031999364 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6cc070b70 0x7fc6cc0c21a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc0cbfc0 tx=0x7fc6bc004750 comp rx=0 tx=0).stop 2023-07-05T23:35:06.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.875+0000 7fc6d165a700 1 -- 172.21.15.27:0/3031999364 shutdown_connections 2023-07-05T23:35:06.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.875+0000 7fc6d165a700 1 --2- 172.21.15.27:0/3031999364 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6cc15a0a0 0x7fc6cc0b30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:06.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.875+0000 7fc6d165a700 1 --2- 172.21.15.27:0/3031999364 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fc6ac06ace0 0x7fc6ac06d190 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:06.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.875+0000 7fc6d165a700 1 --2- 172.21.15.27:0/3031999364 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6cc070b70 0x7fc6cc0c21a0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:06.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.875+0000 7fc6d165a700 1 --2- 172.21.15.27:0/3031999364 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc6cc0cb350 0x7fc6cc155b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:06.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.875+0000 7fc6d165a700 1 -- 172.21.15.27:0/3031999364 >> 172.21.15.27:0/3031999364 conn(0x7fc6cc0b0260 msgr2=0x7fc6cc15aac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:06.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.875+0000 7fc6d165a700 1 -- 172.21.15.27:0/3031999364 shutdown_connections 2023-07-05T23:35:06.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:06.875+0000 7fc6d165a700 1 -- 172.21.15.27:0/3031999364 wait complete. 2023-07-05T23:35:06.881 INFO:teuthology.orchestra.run.smithi027.stderr:listed 0 entries 2023-07-05T23:35:06.898 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-05T23:35:06.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:35:06.899 DEBUG:teuthology.orchestra.run.smithi027:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-05T23:35:07.322 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi027.front.sepia.ceph.com 2023-07-05T23:35:07.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:35:07.323 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-05T23:35:07.366 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-07-05T23:35:07.366 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-05T23:35:07.441 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-07-05T23:35:07.441 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-05T23:35:07.511 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-05T23:35:07.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:07.769+0000 7f2fbb778700 1 Processor -- start 2023-07-05T23:35:07.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:07.769+0000 7f2fbb778700 1 -- start start 2023-07-05T23:35:07.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:07.770+0000 7f2fbb778700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fb4158ef0 0x7f2fb40cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:07.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:07.770+0000 7f2fbb778700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2fb406c060 0x7f2fb40702e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:07.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:07.770+0000 7f2fbb778700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2fb4070820 0x7f2fb40ca290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:07.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:07.770+0000 7f2fbb778700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fb4070c60 con 0x7f2fb406c060 2023-07-05T23:35:07.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:07.771+0000 7f2fbb778700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fb406c4d0 con 0x7f2fb4070820 2023-07-05T23:35:07.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:07.771+0000 7f2fbb778700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb40c9510 con 0x7f2fb4158ef0 2023-07-05T23:35:07.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:07.771+0000 7f2fb8d13700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2fb406c060 0x7f2fb40702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:07.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:07.771+0000 7f2fb8d13700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2fb406c060 0x7f2fb40702e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46108/0 (socket says 172.21.15.27:46108) 2023-07-05T23:35:07.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:07.771+0000 7f2fb8d13700 1 -- 172.21.15.27:0/1629741209 learned_addr learned my addr 172.21.15.27:0/1629741209 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:07.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:07.771+0000 7f2fb9514700 1 --2- 172.21.15.27:0/1629741209 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fb4158ef0 0x7f2fb40cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:07.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:07.771+0000 7f2fb9d15700 1 --2- 172.21.15.27:0/1629741209 >> v2:172.21.15.162:3300/0 conn(0x7f2fb4070820 0x7f2fb40ca290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:07.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:07.771+0000 7f2fb9514700 1 -- 172.21.15.27:0/1629741209 >> v2:172.21.15.162:3300/0 conn(0x7f2fb4070820 msgr2=0x7f2fb40ca290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:35:07.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:07.771+0000 7f2fb9514700 1 --2- 172.21.15.27:0/1629741209 >> v2:172.21.15.162:3300/0 conn(0x7f2fb4070820 0x7f2fb40ca290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:07.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:07.771+0000 7f2fb9514700 1 -- 172.21.15.27:0/1629741209 >> v2:172.21.15.27:3300/0 conn(0x7f2fb406c060 msgr2=0x7f2fb40702e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:35:07.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:07.771+0000 7f2fb9514700 1 --2- 172.21.15.27:0/1629741209 >> v2:172.21.15.27:3300/0 conn(0x7f2fb406c060 0x7f2fb40702e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:07.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:07.771+0000 7f2fb9514700 1 -- 172.21.15.27:0/1629741209 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb40cd6a0 con 0x7f2fb4158ef0 2023-07-05T23:35:07.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:07.772+0000 7f2fb9514700 1 --2- 172.21.15.27:0/1629741209 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fb4158ef0 0x7f2fb40cf1e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2fb415dae0 tx=0x7f2fb0009b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a81fca86ddf081d server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:07.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:07.772+0000 7f2fabfff700 1 -- 172.21.15.27:0/1629741209 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb0011830 con 0x7f2fb4158ef0 2023-07-05T23:35:07.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:07.773+0000 7f2fabfff700 1 -- 172.21.15.27:0/1629741209 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb0011990 con 0x7f2fb4158ef0 2023-07-05T23:35:07.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:07.773+0000 7f2fabfff700 1 -- 172.21.15.27:0/1629741209 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb0011d20 con 0x7f2fb4158ef0 2023-07-05T23:35:07.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:07.773+0000 7f2fbb778700 1 -- 172.21.15.27:0/1629741209 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fb4158ef0 msgr2=0x7f2fb40cf1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:07.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:07.773+0000 7f2fbb778700 1 --2- 172.21.15.27:0/1629741209 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fb4158ef0 0x7f2fb40cf1e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2fb415dae0 tx=0x7f2fb0009b20 comp rx=0 tx=0).stop 2023-07-05T23:35:07.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:07.773+0000 7f2fbb778700 1 -- 172.21.15.27:0/1629741209 shutdown_connections 2023-07-05T23:35:07.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:07.773+0000 7f2fbb778700 1 --2- 172.21.15.27:0/1629741209 >> v2:172.21.15.162:3300/0 conn(0x7f2fb4070820 0x7f2fb40ca290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:07.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:07.773+0000 7f2fbb778700 1 --2- 172.21.15.27:0/1629741209 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fb4158ef0 0x7f2fb40cf1e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:07.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:07.773+0000 7f2fbb778700 1 --2- 172.21.15.27:0/1629741209 >> v2:172.21.15.27:3300/0 conn(0x7f2fb406c060 0x7f2fb40702e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:07.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:07.773+0000 7f2fbb778700 1 -- 172.21.15.27:0/1629741209 >> 172.21.15.27:0/1629741209 conn(0x7f2fb40b0ef0 msgr2=0x7f2fb40ce690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:07.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:07.773+0000 7f2fbb778700 1 -- 172.21.15.27:0/1629741209 shutdown_connections 2023-07-05T23:35:07.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:07.773+0000 7f2fbb778700 1 -- 172.21.15.27:0/1629741209 wait complete. 2023-07-05T23:35:07.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:07.775+0000 7f2fbb778700 1 Processor -- start 2023-07-05T23:35:07.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:07.775+0000 7f2fbb778700 1 -- start start 2023-07-05T23:35:07.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:07.776+0000 7f2fbb778700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fb406c060 0x7f2fb41481f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:07.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:07.776+0000 7f2fbb778700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fb4070820 0x7f2fb414a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:07.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:07.776+0000 7f2fbb778700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2fb4158ef0 0x7f2fb41f7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:07.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:07.776+0000 7f2fbb778700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb41f7e50 con 0x7f2fb4158ef0 2023-07-05T23:35:07.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:07.776+0000 7f2fbb778700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb40c3d70 con 0x7f2fb4070820 2023-07-05T23:35:07.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:07.776+0000 7f2fbb778700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb41487d0 con 0x7f2fb406c060 2023-07-05T23:35:07.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:07.777+0000 7f2fb9514700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fb406c060 0x7f2fb41481f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:07.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:07.777+0000 7f2fb9514700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fb406c060 0x7f2fb41481f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.27:46150/0 (socket says 172.21.15.27:46150) 2023-07-05T23:35:07.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:07.777+0000 7f2fb9514700 1 -- 172.21.15.27:0/1214107087 learned_addr learned my addr 172.21.15.27:0/1214107087 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:07.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:07.778+0000 7f2fb8d13700 1 --2- 172.21.15.27:0/1214107087 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fb4070820 0x7f2fb414a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:07.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:07.778+0000 7f2fb9514700 1 -- 172.21.15.27:0/1214107087 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fb4070820 msgr2=0x7f2fb414a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:07.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:07.778+0000 7f2fb9514700 1 --2- 172.21.15.27:0/1214107087 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fb4070820 0x7f2fb414a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:07.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:07.778+0000 7f2fb9514700 1 -- 172.21.15.27:0/1214107087 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2fb4158ef0 msgr2=0x7f2fb41f7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:07.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:07.778+0000 7f2fb9514700 1 --2- 172.21.15.27:0/1214107087 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2fb4158ef0 0x7f2fb41f7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:07.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:07.778+0000 7f2fb9514700 1 -- 172.21.15.27:0/1214107087 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb00094a0 con 0x7f2fb406c060 2023-07-05T23:35:07.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:07.778+0000 7f2fb8d13700 1 --2- 172.21.15.27:0/1214107087 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fb4070820 0x7f2fb414a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T23:35:07.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:07.779+0000 7f2fb9514700 1 --2- 172.21.15.27:0/1214107087 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fb406c060 0x7f2fb41481f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2fb00090b0 tx=0x7f2fb0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:07.786 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:07.779+0000 7f2fa9ffb700 1 -- 172.21.15.27:0/1214107087 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb00036a0 con 0x7f2fb406c060 2023-07-05T23:35:07.786 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:07.779+0000 7f2fa9ffb700 1 -- 172.21.15.27:0/1214107087 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb0003800 con 0x7f2fb406c060 2023-07-05T23:35:07.786 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:07.779+0000 7f2fa9ffb700 1 -- 172.21.15.27:0/1214107087 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb0003b70 con 0x7f2fb406c060 2023-07-05T23:35:07.786 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:07.779+0000 7f2fbb778700 1 -- 172.21.15.27:0/1214107087 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fb4148ab0 con 0x7f2fb406c060 2023-07-05T23:35:07.787 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:07.779+0000 7f2fbb778700 1 -- 172.21.15.27:0/1214107087 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fb4149070 con 0x7f2fb406c060 2023-07-05T23:35:07.787 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:07.781+0000 7f2fbb778700 1 -- 172.21.15.27:0/1214107087 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fb4149200 con 0x7f2fb406c060 2023-07-05T23:35:07.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:07.781+0000 7f2fa9ffb700 1 -- 172.21.15.27:0/1214107087 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2fb0003cd0 con 0x7f2fb406c060 2023-07-05T23:35:07.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:07.782+0000 7f2fa9ffb700 1 --2- 172.21.15.27:0/1214107087 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f2f9806ad30 0x7f2f9806d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:07.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:07.782+0000 7f2fa9ffb700 1 -- 172.21.15.27:0/1214107087 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2fb008ab30 con 0x7f2fb406c060 2023-07-05T23:35:07.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:07.783+0000 7f2fb8d13700 1 --2- 172.21.15.27:0/1214107087 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f2f9806ad30 0x7f2f9806d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:07.791 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:07.789+0000 7f2fb8d13700 1 --2- 172.21.15.27:0/1214107087 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f2f9806ad30 0x7f2f9806d1e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2fb40cb9c0 tx=0x7f2fa40092c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:07.792 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:07.789+0000 7f2fa9ffb700 1 -- 172.21.15.27:0/1214107087 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2fb0055ab0 con 0x7f2fb406c060 2023-07-05T23:35:08.193 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.190+0000 7f2fbb778700 1 -- 172.21.15.27:0/1214107087 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2fb4073910 con 0x7f2fb406c060 2023-07-05T23:35:08.196 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.192+0000 7f2fa9ffb700 1 -- 172.21.15.27:0/1214107087 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20215 (secure 0 0 0) 0x7f2fb00590d0 con 0x7f2fb406c060 2023-07-05T23:35:08.196 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:35:08.197 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":30,"fsid":"23eebe48-65f5-4d3c-8c2d-4aa171c055d5","created":"2023-07-05T23:32:27.989612+0000","modified":"2023-07-05T23:33:34.883498+0000","last_up_change":"2023-07-05T23:32:39.601570+0000","last_in_change":"2023-07-05T23:32:30.488261+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-05T23:32:41.624598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-05T23:32:46.481587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-05T23:32:51.025210+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-05T23:32:52.286964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-05T23:32:55.354212+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ac2071e4-394b-4385-b9ba-fad5265efc65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6814","nonce":3766536605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6818","nonce":3766536605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6823","nonce":3766536605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6821","nonce":3766536605}]},"public_addr":"172.21.15.27:6814/3766536605","cluster_addr":"172.21.15.27:6818/3766536605","heartbeat_back_addr":"172.21.15.27:6823/3766536605","heartbeat_front_addr":"172.21.15.27:6821/3766536605","state":["exists","up"]},{"osd":1,"uuid":"8c9b61a0-39d5-46bf-afd6-5add78453ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6801","nonce":1579117455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6803","nonce":1579117455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6807","nonce":1579117455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6805","nonce":1579117455}]},"public_addr":"172.21.15.27:6801/1579117455","cluster_addr":"172.21.15.27:6803/1579117455","heartbeat_back_addr":"172.21.15.27:6807/1579117455","heartbeat_front_addr":"172.21.15.27:6805/1579117455","state":["exists","up"]},{"osd":2,"uuid":"dcd032a2-06b1-4055-b798-b86c71a7107d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6825","nonce":807520271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6827","nonce":807520271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6831","nonce":807520271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6829","nonce":807520271}]},"public_addr":"172.21.15.27:6825/807520271","cluster_addr":"172.21.15.27:6827/807520271","heartbeat_back_addr":"172.21.15.27:6831/807520271","heartbeat_front_addr":"172.21.15.27:6829/807520271","state":["exists","up"]},{"osd":3,"uuid":"b0ffe0fc-47ba-4636-b5ea-6bab637642c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6809","nonce":2125656143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6811","nonce":2125656143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6817","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6819","nonce":2125656143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6813","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6815","nonce":2125656143}]},"public_addr":"172.21.15.27:6809/2125656143","cluster_addr":"172.21.15.27:6811/2125656143","heartbeat_back_addr":"172.21.15.27:6819/2125656143","heartbeat_front_addr":"172.21.15.27:6815/2125656143","state":["exists","up"]},{"osd":4,"uuid":"7fab4e5a-1246-4efe-9562-10c4a6c789ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6801","nonce":2111223016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6803","nonce":2111223016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6807","nonce":2111223016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6805","nonce":2111223016}]},"public_addr":"172.21.15.162:6801/2111223016","cluster_addr":"172.21.15.162:6803/2111223016","heartbeat_back_addr":"172.21.15.162:6807/2111223016","heartbeat_front_addr":"172.21.15.162:6805/2111223016","state":["exists","up"]},{"osd":5,"uuid":"110c4d9f-cef6-48ab-a818-5a81e72372af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6825","nonce":3102609008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6827","nonce":3102609008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6831","nonce":3102609008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6829","nonce":3102609008}]},"public_addr":"172.21.15.162:6825/3102609008","cluster_addr":"172.21.15.162:6827/3102609008","heartbeat_back_addr":"172.21.15.162:6831/3102609008","heartbeat_front_addr":"172.21.15.162:6829/3102609008","state":["exists","up"]},{"osd":6,"uuid":"16803bcc-2c92-4aed-954e-487938c9f24a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6809","nonce":2657688865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6811","nonce":2657688865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6815","nonce":2657688865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6813","nonce":2657688865}]},"public_addr":"172.21.15.162:6809/2657688865","cluster_addr":"172.21.15.162:6811/2657688865","heartbeat_back_addr":"172.21.15.162:6815/2657688865","heartbeat_front_addr":"172.21.15.162:6813/2657688865","state":["exists","up"]},{"osd":7,"uuid":"b7c35377-3cf2-4569-b6b9-72376eb463bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6817","nonce":2096609978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6819","nonce":2096609978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6823","nonce":2096609978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6821","nonce":2096609978}]},"public_addr":"172.21.15.162:6817/2096609978","cluster_addr":"172.21.15.162:6819/2096609978","heartbeat_back_addr":"172.21.15.162:6823/2096609978","heartbeat_front_addr":"172.21.15.162:6821/2096609978","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.735448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.645561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.759120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.682507+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.736228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.694664+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.716002+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.680485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":3,"to":2}]},{"pgid":"4.26","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-05T23:35:08.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.197+0000 7f2fbb778700 1 -- 172.21.15.27:0/1214107087 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f2f9806ad30 msgr2=0x7f2f9806d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:08.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.197+0000 7f2fbb778700 1 --2- 172.21.15.27:0/1214107087 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f2f9806ad30 0x7f2f9806d1e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2fb40cb9c0 tx=0x7f2fa40092c0 comp rx=0 tx=0).stop 2023-07-05T23:35:08.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.197+0000 7f2fbb778700 1 -- 172.21.15.27:0/1214107087 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fb406c060 msgr2=0x7f2fb41481f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:08.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.197+0000 7f2fbb778700 1 --2- 172.21.15.27:0/1214107087 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fb406c060 0x7f2fb41481f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2fb00090b0 tx=0x7f2fb0004750 comp rx=0 tx=0).stop 2023-07-05T23:35:08.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.197+0000 7f2fbb778700 1 -- 172.21.15.27:0/1214107087 shutdown_connections 2023-07-05T23:35:08.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.197+0000 7f2fbb778700 1 --2- 172.21.15.27:0/1214107087 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f2f9806ad30 0x7f2f9806d1e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:08.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.197+0000 7f2fbb778700 1 --2- 172.21.15.27:0/1214107087 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2fb4158ef0 0x7f2fb41f7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:08.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.197+0000 7f2fbb778700 1 --2- 172.21.15.27:0/1214107087 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fb406c060 0x7f2fb41481f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:08.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.197+0000 7f2fbb778700 1 --2- 172.21.15.27:0/1214107087 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fb4070820 0x7f2fb414a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:08.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.197+0000 7f2fbb778700 1 -- 172.21.15.27:0/1214107087 >> 172.21.15.27:0/1214107087 conn(0x7f2fb40b0ef0 msgr2=0x7f2fb406db20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:08.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.198+0000 7f2fbb778700 1 -- 172.21.15.27:0/1214107087 shutdown_connections 2023-07-05T23:35:08.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.198+0000 7f2fbb778700 1 -- 172.21.15.27:0/1214107087 wait complete. 2023-07-05T23:35:08.223 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-05T23:32:41.624598+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-05T23:32:46.481587+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-05T23:32:51.025210+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-05T23:32:52.286964+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-05T23:32:55.354212+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-05T23:35:08.224 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-05T23:35:08.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.447+0000 7f198b574700 1 Processor -- start 2023-07-05T23:35:08.451 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.448+0000 7f198b574700 1 -- start start 2023-07-05T23:35:08.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.449+0000 7f198b574700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f19840cd5e0 0x7f19840cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:08.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.449+0000 7f198b574700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f19840adf40 0x7f198406e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:08.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.449+0000 7f198b574700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f198406f0e0 con 0x7f198406e030 2023-07-05T23:35:08.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.449+0000 7f198b574700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19840ce2c0 con 0x7f19840cd5e0 2023-07-05T23:35:08.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.450+0000 7f198b574700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19840cdef0 con 0x7f19840adf40 2023-07-05T23:35:08.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.450+0000 7f1989310700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f19840cd5e0 0x7f19840cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:08.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.450+0000 7f1989b11700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f19840adf40 0x7f198406e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:08.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.450+0000 7f1989b11700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f19840adf40 0x7f198406e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.27:46160/0 (socket says 172.21.15.27:46160) 2023-07-05T23:35:08.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.450+0000 7f1989b11700 1 -- 172.21.15.27:0/2377309308 learned_addr learned my addr 172.21.15.27:0/2377309308 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:08.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.450+0000 7f1989310700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f19840cd5e0 0x7f19840cd9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.27:44060/0 (socket says 172.21.15.27:44060) 2023-07-05T23:35:08.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.450+0000 7f1989310700 1 -- 172.21.15.27:0/2377309308 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f19840adf40 msgr2=0x7f198406e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:35:08.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.450+0000 7f1989310700 1 --2- 172.21.15.27:0/2377309308 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f19840adf40 0x7f198406e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:08.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.450+0000 7f1989310700 1 -- 172.21.15.27:0/2377309308 >> v1:172.21.15.162:6789/0 conn(0x7f198406e030 legacy=0x7f198415cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:35:08.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.450+0000 7f1989310700 1 -- 172.21.15.27:0/2377309308 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f198406eb20 con 0x7f19840cd5e0 2023-07-05T23:35:08.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.451+0000 7f1989310700 1 --2- 172.21.15.27:0/2377309308 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f19840cd5e0 0x7f19840cd9b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f197c00f3c0 tx=0x7f197c00f6d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1045e13676724f99 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:08.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.451+0000 7f197bfff700 1 -- 172.21.15.27:0/2377309308 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197c012070 con 0x7f19840cd5e0 2023-07-05T23:35:08.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.451+0000 7f197bfff700 1 -- 172.21.15.27:0/2377309308 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f197c003a20 con 0x7f19840cd5e0 2023-07-05T23:35:08.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.451+0000 7f197bfff700 1 -- 172.21.15.27:0/2377309308 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197c003dd0 con 0x7f19840cd5e0 2023-07-05T23:35:08.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.452+0000 7f198b574700 1 -- 172.21.15.27:0/2377309308 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f19840cd5e0 msgr2=0x7f19840cd9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:08.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.452+0000 7f198b574700 1 --2- 172.21.15.27:0/2377309308 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f19840cd5e0 0x7f19840cd9b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f197c00f3c0 tx=0x7f197c00f6d0 comp rx=0 tx=0).stop 2023-07-05T23:35:08.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.452+0000 7f198b574700 1 -- 172.21.15.27:0/2377309308 shutdown_connections 2023-07-05T23:35:08.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.452+0000 7f198b574700 1 --2- 172.21.15.27:0/2377309308 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f19840cd5e0 0x7f19840cd9b0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:08.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.452+0000 7f198b574700 1 --2- 172.21.15.27:0/2377309308 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f19840adf40 0x7f198406e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:08.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.452+0000 7f198b574700 1 -- 172.21.15.27:0/2377309308 >> 172.21.15.27:0/2377309308 conn(0x7f198406b920 msgr2=0x7f19840cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:08.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.453+0000 7f198b574700 1 -- 172.21.15.27:0/2377309308 shutdown_connections 2023-07-05T23:35:08.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.453+0000 7f198b574700 1 -- 172.21.15.27:0/2377309308 wait complete. 2023-07-05T23:35:08.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.455+0000 7f198b574700 1 Processor -- start 2023-07-05T23:35:08.460 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.455+0000 7f198b574700 1 -- start start 2023-07-05T23:35:08.460 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.456+0000 7f198b574700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f198406e030 0x7f19840c2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:08.460 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.456+0000 7f198b574700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f19840adf40 0x7f19841f6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:08.460 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.456+0000 7f198b574700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f19840cd5e0 0x7f1984152c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:08.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.456+0000 7f198b574700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19840c2d60 con 0x7f19840cd5e0 2023-07-05T23:35:08.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.456+0000 7f198b574700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1984159f20 con 0x7f198406e030 2023-07-05T23:35:08.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.456+0000 7f198b574700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19840c4020 con 0x7f19840adf40 2023-07-05T23:35:08.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.456+0000 7f1989310700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f198406e030 0x7f19840c2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:08.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.456+0000 7f1989310700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f198406e030 0x7f19840c2820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.27:44066/0 (socket says 172.21.15.27:44066) 2023-07-05T23:35:08.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.456+0000 7f1989310700 1 -- 172.21.15.27:0/680608312 learned_addr learned my addr 172.21.15.27:0/680608312 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:08.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.457+0000 7f1989b11700 1 --2- 172.21.15.27:0/680608312 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f19840cd5e0 0x7f1984152c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:08.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.457+0000 7f1988b0f700 1 --2- 172.21.15.27:0/680608312 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f19840adf40 0x7f19841f6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:08.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.457+0000 7f1989310700 1 -- 172.21.15.27:0/680608312 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f19840adf40 msgr2=0x7f19841f6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:08.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.457+0000 7f1989310700 1 --2- 172.21.15.27:0/680608312 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f19840adf40 0x7f19841f6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:08.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.457+0000 7f1989310700 1 -- 172.21.15.27:0/680608312 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f19840cd5e0 msgr2=0x7f1984152c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:08.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.457+0000 7f1989310700 1 --2- 172.21.15.27:0/680608312 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f19840cd5e0 0x7f1984152c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:08.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.457+0000 7f1989310700 1 -- 172.21.15.27:0/680608312 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f197c00f050 con 0x7f198406e030 2023-07-05T23:35:08.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.457+0000 7f1988b0f700 1 --2- 172.21.15.27:0/680608312 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f19840adf40 0x7f19841f6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T23:35:08.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.457+0000 7f1989b11700 1 --2- 172.21.15.27:0/680608312 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f19840cd5e0 0x7f1984152c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T23:35:08.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.457+0000 7f1989310700 1 --2- 172.21.15.27:0/680608312 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f198406e030 0x7f19840c2820 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f197c000f80 tx=0x7f197c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:08.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.458+0000 7f1979ffb700 1 -- 172.21.15.27:0/680608312 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197c00b940 con 0x7f198406e030 2023-07-05T23:35:08.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.458+0000 7f1979ffb700 1 -- 172.21.15.27:0/680608312 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f197c00bac0 con 0x7f198406e030 2023-07-05T23:35:08.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.458+0000 7f198b574700 1 -- 172.21.15.27:0/680608312 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f198415a170 con 0x7f198406e030 2023-07-05T23:35:08.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.458+0000 7f1979ffb700 1 -- 172.21.15.27:0/680608312 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197c00be70 con 0x7f198406e030 2023-07-05T23:35:08.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.458+0000 7f198b574700 1 -- 172.21.15.27:0/680608312 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f198415a730 con 0x7f198406e030 2023-07-05T23:35:08.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.460+0000 7f198b574700 1 -- 172.21.15.27:0/680608312 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19640052f0 con 0x7f198406e030 2023-07-05T23:35:08.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.461+0000 7f1979ffb700 1 -- 172.21.15.27:0/680608312 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f197c004030 con 0x7f198406e030 2023-07-05T23:35:08.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.461+0000 7f1979ffb700 1 --2- 172.21.15.27:0/680608312 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f196806adb0 0x7f196806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:08.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.461+0000 7f1979ffb700 1 -- 172.21.15.27:0/680608312 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f197c08a8d0 con 0x7f198406e030 2023-07-05T23:35:08.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.461+0000 7f1988b0f700 1 --2- 172.21.15.27:0/680608312 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f196806adb0 0x7f196806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:08.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.462+0000 7f1988b0f700 1 --2- 172.21.15.27:0/680608312 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f196806adb0 0x7f196806d260 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1974007fd0 tx=0x7f1974009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:08.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.468+0000 7f1979ffb700 1 -- 172.21.15.27:0/680608312 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f197c059150 con 0x7f198406e030 2023-07-05T23:35:08.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.867+0000 7f198b574700 1 -- 172.21.15.27:0/680608312 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1964005b20 con 0x7f198406e030 2023-07-05T23:35:08.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.868+0000 7f1979ffb700 1 -- 172.21.15.27:0/680608312 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f197c058ce0 con 0x7f198406e030 2023-07-05T23:35:08.872 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2023-07-05T23:35:08.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.873+0000 7f198b574700 1 -- 172.21.15.27:0/680608312 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f196806adb0 msgr2=0x7f196806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:08.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.873+0000 7f198b574700 1 --2- 172.21.15.27:0/680608312 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f196806adb0 0x7f196806d260 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1974007fd0 tx=0x7f1974009040 comp rx=0 tx=0).stop 2023-07-05T23:35:08.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.873+0000 7f198b574700 1 -- 172.21.15.27:0/680608312 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f198406e030 msgr2=0x7f19840c2820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:08.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.873+0000 7f198b574700 1 --2- 172.21.15.27:0/680608312 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f198406e030 0x7f19840c2820 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f197c000f80 tx=0x7f197c004ad0 comp rx=0 tx=0).stop 2023-07-05T23:35:08.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.874+0000 7f198b574700 1 -- 172.21.15.27:0/680608312 shutdown_connections 2023-07-05T23:35:08.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.874+0000 7f198b574700 1 --2- 172.21.15.27:0/680608312 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f198406e030 0x7f19840c2820 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:08.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.874+0000 7f198b574700 1 --2- 172.21.15.27:0/680608312 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f196806adb0 0x7f196806d260 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:08.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.874+0000 7f198b574700 1 --2- 172.21.15.27:0/680608312 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f19840cd5e0 0x7f1984152c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:08.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.874+0000 7f198b574700 1 --2- 172.21.15.27:0/680608312 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f19840adf40 0x7f19841f6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:08.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.874+0000 7f198b574700 1 -- 172.21.15.27:0/680608312 >> 172.21.15.27:0/680608312 conn(0x7f198406b920 msgr2=0x7f19840afc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:08.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.874+0000 7f198b574700 1 -- 172.21.15.27:0/680608312 shutdown_connections 2023-07-05T23:35:08.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:08.874+0000 7f198b574700 1 -- 172.21.15.27:0/680608312 wait complete. 2023-07-05T23:35:08.897 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-05T23:35:09.132 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.129+0000 7fc3eb970700 1 Processor -- start 2023-07-05T23:35:09.133 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.130+0000 7fc3eb970700 1 -- start start 2023-07-05T23:35:09.133 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.131+0000 7fc3eb970700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc3e406e030 0x7fc3e406e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:09.134 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.131+0000 7fc3eb970700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3e406f0e0 con 0x7fc3e40cd5e0 2023-07-05T23:35:09.134 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.131+0000 7fc3eb970700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3e406eb20 con 0x7fc3e40acf30 2023-07-05T23:35:09.134 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.131+0000 7fc3eb970700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3e40ce2c0 con 0x7fc3e406e030 2023-07-05T23:35:09.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.131+0000 7fc3e8f0b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc3e406e030 0x7fc3e406e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:09.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.131+0000 7fc3e8f0b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc3e406e030 0x7fc3e406e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46136/0 (socket says 172.21.15.27:46136) 2023-07-05T23:35:09.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.131+0000 7fc3e8f0b700 1 -- 172.21.15.27:0/820439068 learned_addr learned my addr 172.21.15.27:0/820439068 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:09.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.131+0000 7fc3e970c700 1 --1- 172.21.15.27:0/820439068 >> v1:172.21.15.27:6789/0 conn(0x7fc3e40cd5e0 0x7fc3e40cd9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:53306/0 (socket says 172.21.15.27:53306) 2023-07-05T23:35:09.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.132+0000 7fc3e8f0b700 1 -- 172.21.15.27:0/820439068 >> v1:172.21.15.162:6789/0 conn(0x7fc3e40acf30 legacy=0x7fc3e40ad350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:09.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.132+0000 7fc3e8f0b700 1 -- 172.21.15.27:0/820439068 >> v1:172.21.15.27:6789/0 conn(0x7fc3e40cd5e0 legacy=0x7fc3e40cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:09.137 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.132+0000 7fc3e8f0b700 1 -- 172.21.15.27:0/820439068 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3e406ee00 con 0x7fc3e406e030 2023-07-05T23:35:09.137 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.134+0000 7fc3e8f0b700 1 --2- 172.21.15.27:0/820439068 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc3e406e030 0x7fc3e406e4d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc3e0009870 tx=0x7fc3e0009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=873c6a8f8200923e server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:09.137 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.134+0000 7fc3dbfff700 1 -- 172.21.15.27:0/820439068 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e0004230 con 0x7fc3e406e030 2023-07-05T23:35:09.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.134+0000 7fc3dbfff700 1 -- 172.21.15.27:0/820439068 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3e0004390 con 0x7fc3e406e030 2023-07-05T23:35:09.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.134+0000 7fc3dbfff700 1 -- 172.21.15.27:0/820439068 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e00036a0 con 0x7fc3e406e030 2023-07-05T23:35:09.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.135+0000 7fc3eb970700 1 -- 172.21.15.27:0/820439068 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc3e406e030 msgr2=0x7fc3e406e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:09.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.135+0000 7fc3eb970700 1 --2- 172.21.15.27:0/820439068 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc3e406e030 0x7fc3e406e4d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc3e0009870 tx=0x7fc3e0009b80 comp rx=0 tx=0).stop 2023-07-05T23:35:09.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.136+0000 7fc3eb970700 1 -- 172.21.15.27:0/820439068 shutdown_connections 2023-07-05T23:35:09.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.136+0000 7fc3eb970700 1 --2- 172.21.15.27:0/820439068 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc3e406e030 0x7fc3e406e4d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:09.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.136+0000 7fc3eb970700 1 -- 172.21.15.27:0/820439068 >> 172.21.15.27:0/820439068 conn(0x7fc3e406b920 msgr2=0x7fc3e40cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:09.140 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.136+0000 7fc3eb970700 1 -- 172.21.15.27:0/820439068 shutdown_connections 2023-07-05T23:35:09.140 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.136+0000 7fc3eb970700 1 -- 172.21.15.27:0/820439068 wait complete. 2023-07-05T23:35:09.140 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.138+0000 7fc3eb970700 1 Processor -- start 2023-07-05T23:35:09.141 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.138+0000 7fc3eb970700 1 -- start start 2023-07-05T23:35:09.142 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.139+0000 7fc3eb970700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3e406e030 0x7fc3e40b0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:09.142 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.139+0000 7fc3eb970700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3e40acf30 0x7fc3e41fed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:09.142 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.139+0000 7fc3eb970700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc3e40cd5e0 0x7fc3e40b4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:09.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.139+0000 7fc3eb970700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e40b0840 con 0x7fc3e40cd5e0 2023-07-05T23:35:09.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.139+0000 7fc3eb970700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e41ff2c0 con 0x7fc3e40acf30 2023-07-05T23:35:09.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.139+0000 7fc3eb970700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e40b17c0 con 0x7fc3e406e030 2023-07-05T23:35:09.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.140+0000 7fc3e9f0d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc3e40cd5e0 0x7fc3e40b4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:09.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.140+0000 7fc3e970c700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3e406e030 0x7fc3e40b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:09.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.140+0000 7fc3e970c700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3e406e030 0x7fc3e40b0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.27:46178/0 (socket says 172.21.15.27:46178) 2023-07-05T23:35:09.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.140+0000 7fc3e970c700 1 -- 172.21.15.27:0/849764592 learned_addr learned my addr 172.21.15.27:0/849764592 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:09.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.140+0000 7fc3e8f0b700 1 --2- 172.21.15.27:0/849764592 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3e40acf30 0x7fc3e41fed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:09.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.140+0000 7fc3e970c700 1 -- 172.21.15.27:0/849764592 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3e40acf30 msgr2=0x7fc3e41fed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:09.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.140+0000 7fc3e970c700 1 --2- 172.21.15.27:0/849764592 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3e40acf30 0x7fc3e41fed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:09.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.140+0000 7fc3e970c700 1 -- 172.21.15.27:0/849764592 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc3e40cd5e0 msgr2=0x7fc3e40b4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:09.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.140+0000 7fc3e970c700 1 --2- 172.21.15.27:0/849764592 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc3e40cd5e0 0x7fc3e40b4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:09.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.140+0000 7fc3e970c700 1 -- 172.21.15.27:0/849764592 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3e0009550 con 0x7fc3e406e030 2023-07-05T23:35:09.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.141+0000 7fc3e970c700 1 --2- 172.21.15.27:0/849764592 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3e406e030 0x7fc3e40b0300 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc00ca70 tx=0x7fc3dc00cd80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:09.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.141+0000 7fc3d9ffb700 1 -- 172.21.15.27:0/849764592 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3dc004dd0 con 0x7fc3e406e030 2023-07-05T23:35:09.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.141+0000 7fc3d9ffb700 1 -- 172.21.15.27:0/849764592 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3dc00a5d0 con 0x7fc3e406e030 2023-07-05T23:35:09.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.141+0000 7fc3eb970700 1 -- 172.21.15.27:0/849764592 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3e40b1aa0 con 0x7fc3e406e030 2023-07-05T23:35:09.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.141+0000 7fc3d9ffb700 1 -- 172.21.15.27:0/849764592 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3dc00a940 con 0x7fc3e406e030 2023-07-05T23:35:09.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.142+0000 7fc3eb970700 1 -- 172.21.15.27:0/849764592 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3e40b2060 con 0x7fc3e406e030 2023-07-05T23:35:09.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.143+0000 7fc3eb970700 1 -- 172.21.15.27:0/849764592 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3e406d330 con 0x7fc3e406e030 2023-07-05T23:35:09.148 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.146+0000 7fc3d9ffb700 1 -- 172.21.15.27:0/849764592 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc3dc00aaa0 con 0x7fc3e406e030 2023-07-05T23:35:09.149 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.146+0000 7fc3d9ffb700 1 --2- 172.21.15.27:0/849764592 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fc3c806ad30 0x7fc3c806d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:09.149 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.146+0000 7fc3d9ffb700 1 -- 172.21.15.27:0/849764592 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc3dc089620 con 0x7fc3e406e030 2023-07-05T23:35:09.151 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.149+0000 7fc3e8f0b700 1 --2- 172.21.15.27:0/849764592 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fc3c806ad30 0x7fc3c806d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:09.154 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.152+0000 7fc3e8f0b700 1 --2- 172.21.15.27:0/849764592 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fc3c806ad30 0x7fc3c806d1e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc3e0000c00 tx=0x7fc3e0008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:09.155 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.152+0000 7fc3d9ffb700 1 -- 172.21.15.27:0/849764592 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc3dc054530 con 0x7fc3e406e030 2023-07-05T23:35:09.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.413+0000 7fc3eb970700 1 -- 172.21.15.27:0/849764592 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc3e404ea20 con 0x7fc3e406e030 2023-07-05T23:35:09.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.413+0000 7fc3d9ffb700 1 -- 172.21.15.27:0/849764592 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc3dc0170a0 con 0x7fc3e406e030 2023-07-05T23:35:09.419 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 8 2023-07-05T23:35:09.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.415+0000 7fc3eb970700 1 -- 172.21.15.27:0/849764592 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fc3c806ad30 msgr2=0x7fc3c806d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:09.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.415+0000 7fc3eb970700 1 --2- 172.21.15.27:0/849764592 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fc3c806ad30 0x7fc3c806d1e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc3e0000c00 tx=0x7fc3e0008030 comp rx=0 tx=0).stop 2023-07-05T23:35:09.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.415+0000 7fc3eb970700 1 -- 172.21.15.27:0/849764592 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3e406e030 msgr2=0x7fc3e40b0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:09.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.415+0000 7fc3eb970700 1 --2- 172.21.15.27:0/849764592 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3e406e030 0x7fc3e40b0300 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc00ca70 tx=0x7fc3dc00cd80 comp rx=0 tx=0).stop 2023-07-05T23:35:09.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.415+0000 7fc3eb970700 1 -- 172.21.15.27:0/849764592 shutdown_connections 2023-07-05T23:35:09.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.415+0000 7fc3eb970700 1 --2- 172.21.15.27:0/849764592 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fc3c806ad30 0x7fc3c806d1e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:09.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.415+0000 7fc3eb970700 1 --2- 172.21.15.27:0/849764592 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc3e40cd5e0 0x7fc3e40b4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:09.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.415+0000 7fc3eb970700 1 --2- 172.21.15.27:0/849764592 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3e406e030 0x7fc3e40b0300 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:09.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.415+0000 7fc3eb970700 1 --2- 172.21.15.27:0/849764592 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3e40acf30 0x7fc3e41fed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:09.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.415+0000 7fc3eb970700 1 -- 172.21.15.27:0/849764592 >> 172.21.15.27:0/849764592 conn(0x7fc3e406b920 msgr2=0x7fc3e40adc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:09.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.416+0000 7fc3eb970700 1 -- 172.21.15.27:0/849764592 shutdown_connections 2023-07-05T23:35:09.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.416+0000 7fc3eb970700 1 -- 172.21.15.27:0/849764592 wait complete. 2023-07-05T23:35:09.430 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-05T23:35:09.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.615+0000 7f70b5c4b700 1 Processor -- start 2023-07-05T23:35:09.619 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.615+0000 7f70b5c4b700 1 -- start start 2023-07-05T23:35:09.619 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.616+0000 7f70b5c4b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f70b00ce3d0 0x7f70b00ce850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:09.619 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.617+0000 7f70b5c4b700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70b00cce30 con 0x7f70b006d7b0 2023-07-05T23:35:09.620 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.617+0000 7f70b5c4b700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70b0160370 con 0x7f70b0069ef0 2023-07-05T23:35:09.620 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.617+0000 7f70b5c4b700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70b00cd360 con 0x7f70b00ce3d0 2023-07-05T23:35:09.621 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.617+0000 7f70aeffd700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f70b006d7b0 0x7f70b0160800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:53316/0 (socket says 172.21.15.27:53316) 2023-07-05T23:35:09.621 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.617+0000 7f70aeffd700 1 -- 172.21.15.27:0/1435759243 learned_addr learned my addr 172.21.15.27:0/1435759243 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-07-05T23:35:09.621 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.617+0000 7f70affff700 1 --2- 172.21.15.27:0/1435759243 >> v2:172.21.15.27:3300/0 conn(0x7f70b00ce3d0 0x7f70b00ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:09.622 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.617+0000 7f70ae7fc700 1 -- 172.21.15.27:0/1435759243 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 299864388 0 0) 0x7f70b00cce30 con 0x7f70b006d7b0 2023-07-05T23:35:09.622 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.617+0000 7f70ae7fc700 1 -- 172.21.15.27:0/1435759243 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f709c0035b0 con 0x7f70b006d7b0 2023-07-05T23:35:09.622 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.618+0000 7f70affff700 1 -- 172.21.15.27:0/1435759243 >> v1:172.21.15.162:6789/0 conn(0x7f70b0069ef0 legacy=0x7f70b006a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:09.622 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.618+0000 7f70affff700 1 -- 172.21.15.27:0/1435759243 >> v1:172.21.15.27:6789/0 conn(0x7f70b006d7b0 legacy=0x7f70b0160800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:09.623 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.618+0000 7f70affff700 1 -- 172.21.15.27:0/1435759243 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b015ca50 con 0x7f70b00ce3d0 2023-07-05T23:35:09.623 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.618+0000 7f70affff700 1 --2- 172.21.15.27:0/1435759243 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f70b00ce3d0 0x7f70b00ce850 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f70a00097c0 tx=0x7f70a0009ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=becf4ab4bb29083c server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:09.623 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.618+0000 7f70ae7fc700 1 -- 172.21.15.27:0/1435759243 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a0004230 con 0x7f70b00ce3d0 2023-07-05T23:35:09.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.618+0000 7f70ae7fc700 1 -- 172.21.15.27:0/1435759243 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70a0004390 con 0x7f70b00ce3d0 2023-07-05T23:35:09.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.618+0000 7f70ae7fc700 1 -- 172.21.15.27:0/1435759243 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a00036a0 con 0x7f70b00ce3d0 2023-07-05T23:35:09.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.619+0000 7f70b5c4b700 1 -- 172.21.15.27:0/1435759243 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f70b00ce3d0 msgr2=0x7f70b00ce850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:09.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.619+0000 7f70b5c4b700 1 --2- 172.21.15.27:0/1435759243 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f70b00ce3d0 0x7f70b00ce850 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f70a00097c0 tx=0x7f70a0009ad0 comp rx=0 tx=0).stop 2023-07-05T23:35:09.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.620+0000 7f70b5c4b700 1 -- 172.21.15.27:0/1435759243 shutdown_connections 2023-07-05T23:35:09.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.620+0000 7f70b5c4b700 1 --2- 172.21.15.27:0/1435759243 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f70b00ce3d0 0x7f70b00ce850 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:09.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.620+0000 7f70b5c4b700 1 -- 172.21.15.27:0/1435759243 >> 172.21.15.27:0/1435759243 conn(0x7f70b006b920 msgr2=0x7f70b00cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:09.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.620+0000 7f70b5c4b700 1 -- 172.21.15.27:0/1435759243 shutdown_connections 2023-07-05T23:35:09.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.620+0000 7f70b5c4b700 1 -- 172.21.15.27:0/1435759243 wait complete. 2023-07-05T23:35:09.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.622+0000 7f70b5c4b700 1 Processor -- start 2023-07-05T23:35:09.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.622+0000 7f70b5c4b700 1 -- start start 2023-07-05T23:35:09.628 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.624+0000 7f70b5c4b700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f70b0069ef0 0x7f70b01520f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:09.628 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.624+0000 7f70b5c4b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f70b006d7b0 0x7f70b00b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:09.628 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.624+0000 7f70b5c4b700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f70b00ce3d0 0x7f70b00b3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:09.628 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.624+0000 7f70b5c4b700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b00b2f20 con 0x7f70b006d7b0 2023-07-05T23:35:09.629 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.624+0000 7f70b5c4b700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b00b0af0 con 0x7f70b0069ef0 2023-07-05T23:35:09.629 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.624+0000 7f70b5c4b700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70b00b2370 con 0x7f70b00ce3d0 2023-07-05T23:35:09.630 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.624+0000 7f70af7fe700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f70b0069ef0 0x7f70b01520f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:09.630 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.624+0000 7f70affff700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f70b00ce3d0 0x7f70b00b3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:09.630 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.624+0000 7f70affff700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f70b00ce3d0 0x7f70b00b3b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.27:46194/0 (socket says 172.21.15.27:46194) 2023-07-05T23:35:09.630 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.624+0000 7f70af7fe700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f70b0069ef0 0x7f70b01520f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.27:44094/0 (socket says 172.21.15.27:44094) 2023-07-05T23:35:09.631 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.624+0000 7f70affff700 1 -- 172.21.15.27:0/2292293143 learned_addr learned my addr 172.21.15.27:0/2292293143 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:09.631 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.624+0000 7f70aeffd700 1 --2- 172.21.15.27:0/2292293143 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f70b006d7b0 0x7f70b00b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:09.631 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.624+0000 7f70aeffd700 1 -- 172.21.15.27:0/2292293143 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f70b00ce3d0 msgr2=0x7f70b00b3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:09.631 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.624+0000 7f70aeffd700 1 --2- 172.21.15.27:0/2292293143 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f70b00ce3d0 0x7f70b00b3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:09.632 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.624+0000 7f70aeffd700 1 -- 172.21.15.27:0/2292293143 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f70b0069ef0 msgr2=0x7f70b01520f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:09.632 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.624+0000 7f70aeffd700 1 --2- 172.21.15.27:0/2292293143 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f70b0069ef0 0x7f70b01520f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:09.633 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.624+0000 7f70aeffd700 1 -- 172.21.15.27:0/2292293143 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a00094a0 con 0x7f70b006d7b0 2023-07-05T23:35:09.634 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.625+0000 7f70aeffd700 1 --2- 172.21.15.27:0/2292293143 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f70b006d7b0 0x7f70b00b1e30 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f709800c410 tx=0x7f709800c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:09.635 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.626+0000 7f70a7fff700 1 -- 172.21.15.27:0/2292293143 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7098004c80 con 0x7f70b006d7b0 2023-07-05T23:35:09.635 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.626+0000 7f70a7fff700 1 -- 172.21.15.27:0/2292293143 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7098004de0 con 0x7f70b006d7b0 2023-07-05T23:35:09.635 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.626+0000 7f70a7fff700 1 -- 172.21.15.27:0/2292293143 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7098007310 con 0x7f70b006d7b0 2023-07-05T23:35:09.635 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.627+0000 7f70b5c4b700 1 -- 172.21.15.27:0/2292293143 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70b00b0d90 con 0x7f70b006d7b0 2023-07-05T23:35:09.636 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.627+0000 7f70b5c4b700 1 -- 172.21.15.27:0/2292293143 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70b00b1350 con 0x7f70b006d7b0 2023-07-05T23:35:09.636 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.629+0000 7f70b5c4b700 1 -- 172.21.15.27:0/2292293143 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70b004ea20 con 0x7f70b006d7b0 2023-07-05T23:35:09.636 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.629+0000 7f70a7fff700 1 -- 172.21.15.27:0/2292293143 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7098007470 con 0x7f70b006d7b0 2023-07-05T23:35:09.636 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.630+0000 7f70a7fff700 1 --2- 172.21.15.27:0/2292293143 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f709006adb0 0x7f709006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:09.636 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.630+0000 7f70a7fff700 1 -- 172.21.15.27:0/2292293143 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7098089410 con 0x7f70b006d7b0 2023-07-05T23:35:09.637 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.630+0000 7f70af7fe700 1 --2- 172.21.15.27:0/2292293143 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f709006adb0 0x7f709006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:09.637 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.631+0000 7f70af7fe700 1 --2- 172.21.15.27:0/2292293143 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f709006adb0 0x7f709006d260 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f70a80012a0 tx=0x7f70a8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:09.643 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:09.640+0000 7f70a7fff700 1 -- 172.21.15.27:0/2292293143 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7098054170 con 0x7f70b006d7b0 2023-07-05T23:35:10.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.038+0000 7f70b5c4b700 1 -- 172.21.15.27:0/2292293143 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f70b006ade0 con 0x7f70b006d7b0 2023-07-05T23:35:10.042 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.038+0000 7f70a7fff700 1 -- 172.21.15.27:0/2292293143 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7098057790 con 0x7f70b006d7b0 2023-07-05T23:35:10.042 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 32 2023-07-05T23:35:10.046 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.042+0000 7f70b5c4b700 1 -- 172.21.15.27:0/2292293143 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f709006adb0 msgr2=0x7f709006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:10.046 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.042+0000 7f70b5c4b700 1 --2- 172.21.15.27:0/2292293143 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f709006adb0 0x7f709006d260 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f70a80012a0 tx=0x7f70a8009040 comp rx=0 tx=0).stop 2023-07-05T23:35:10.047 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.042+0000 7f70b5c4b700 1 -- 172.21.15.27:0/2292293143 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f70b006d7b0 msgr2=0x7f70b00b1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:10.047 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.042+0000 7f70b5c4b700 1 --2- 172.21.15.27:0/2292293143 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f70b006d7b0 0x7f70b00b1e30 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f709800c410 tx=0x7f709800c7d0 comp rx=0 tx=0).stop 2023-07-05T23:35:10.048 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.042+0000 7f70b5c4b700 1 -- 172.21.15.27:0/2292293143 shutdown_connections 2023-07-05T23:35:10.048 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.042+0000 7f70b5c4b700 1 --2- 172.21.15.27:0/2292293143 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f70b0069ef0 0x7f70b01520f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:10.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.042+0000 7f70b5c4b700 1 --2- 172.21.15.27:0/2292293143 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f709006adb0 0x7f709006d260 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:10.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.042+0000 7f70b5c4b700 1 --2- 172.21.15.27:0/2292293143 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f70b00ce3d0 0x7f70b00b3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:10.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.042+0000 7f70b5c4b700 1 --2- 172.21.15.27:0/2292293143 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f70b006d7b0 0x7f70b00b1e30 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:10.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.042+0000 7f70b5c4b700 1 -- 172.21.15.27:0/2292293143 >> 172.21.15.27:0/2292293143 conn(0x7f70b006b920 msgr2=0x7f70b00ac600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:10.051 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.043+0000 7f70b5c4b700 1 -- 172.21.15.27:0/2292293143 shutdown_connections 2023-07-05T23:35:10.051 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.043+0000 7f70b5c4b700 1 -- 172.21.15.27:0/2292293143 wait complete. 2023-07-05T23:35:10.068 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-05T23:35:10.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.293+0000 7fbb5a636700 1 Processor -- start 2023-07-05T23:35:10.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.293+0000 7fbb5a636700 1 -- start start 2023-07-05T23:35:10.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.294+0000 7fbb5a636700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbb54164290 0x7fbb540702e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:10.298 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.294+0000 7fbb5a636700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fbb540c17a0 0x7fbb54070820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:10.298 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.294+0000 7fbb5a636700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fbb540b2090 0x7fbb540b2510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:10.298 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.294+0000 7fbb5a636700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb54164660 con 0x7fbb540c17a0 2023-07-05T23:35:10.299 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.294+0000 7fbb5a636700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb5406cd90 con 0x7fbb540b2090 2023-07-05T23:35:10.299 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.294+0000 7fbb5a636700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5406d070 con 0x7fbb54164290 2023-07-05T23:35:10.300 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.295+0000 7fbb537fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fbb540c17a0 0x7fbb54070820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:10.300 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.295+0000 7fbb537fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fbb540c17a0 0x7fbb54070820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46164/0 (socket says 172.21.15.27:46164) 2023-07-05T23:35:10.301 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.295+0000 7fbb537fe700 1 -- 172.21.15.27:0/3368725194 learned_addr learned my addr 172.21.15.27:0/3368725194 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:10.301 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.295+0000 7fbb58bd3700 1 --2- 172.21.15.27:0/3368725194 >> v2:172.21.15.162:3300/0 conn(0x7fbb540b2090 0x7fbb540b2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:10.301 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.295+0000 7fbb53fff700 1 --2- 172.21.15.27:0/3368725194 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbb54164290 0x7fbb540702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:10.302 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.296+0000 7fbb53fff700 1 -- 172.21.15.27:0/3368725194 >> v2:172.21.15.162:3300/0 conn(0x7fbb540b2090 msgr2=0x7fbb540b2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:35:10.302 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.296+0000 7fbb53fff700 1 --2- 172.21.15.27:0/3368725194 >> v2:172.21.15.162:3300/0 conn(0x7fbb540b2090 0x7fbb540b2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:10.302 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.296+0000 7fbb53fff700 1 -- 172.21.15.27:0/3368725194 >> v2:172.21.15.27:3300/0 conn(0x7fbb540c17a0 msgr2=0x7fbb54070820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:35:10.302 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.296+0000 7fbb53fff700 1 --2- 172.21.15.27:0/3368725194 >> v2:172.21.15.27:3300/0 conn(0x7fbb540c17a0 0x7fbb54070820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:10.303 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.296+0000 7fbb53fff700 1 -- 172.21.15.27:0/3368725194 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb5406d350 con 0x7fbb54164290 2023-07-05T23:35:10.303 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.296+0000 7fbb537fe700 1 --2- 172.21.15.27:0/3368725194 >> v2:172.21.15.27:3300/0 conn(0x7fbb540c17a0 0x7fbb54070820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T23:35:10.303 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.296+0000 7fbb53fff700 1 --2- 172.21.15.27:0/3368725194 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbb54164290 0x7fbb540702e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbb54070270 tx=0x7fbb3c009b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a26de4e72ffd143 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:10.304 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.296+0000 7fbb52ffd700 1 -- 172.21.15.27:0/3368725194 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb3c011830 con 0x7fbb54164290 2023-07-05T23:35:10.304 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.296+0000 7fbb52ffd700 1 -- 172.21.15.27:0/3368725194 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb3c011990 con 0x7fbb54164290 2023-07-05T23:35:10.304 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.296+0000 7fbb52ffd700 1 -- 172.21.15.27:0/3368725194 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb3c011d20 con 0x7fbb54164290 2023-07-05T23:35:10.305 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.297+0000 7fbb5a636700 1 -- 172.21.15.27:0/3368725194 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbb54164290 msgr2=0x7fbb540702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:10.305 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.297+0000 7fbb5a636700 1 --2- 172.21.15.27:0/3368725194 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbb54164290 0x7fbb540702e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbb54070270 tx=0x7fbb3c009b20 comp rx=0 tx=0).stop 2023-07-05T23:35:10.305 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.297+0000 7fbb5a636700 1 -- 172.21.15.27:0/3368725194 shutdown_connections 2023-07-05T23:35:10.305 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.297+0000 7fbb5a636700 1 --2- 172.21.15.27:0/3368725194 >> v2:172.21.15.162:3300/0 conn(0x7fbb540b2090 0x7fbb540b2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:10.306 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.297+0000 7fbb5a636700 1 --2- 172.21.15.27:0/3368725194 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbb54164290 0x7fbb540702e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:10.306 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.297+0000 7fbb5a636700 1 --2- 172.21.15.27:0/3368725194 >> v2:172.21.15.27:3300/0 conn(0x7fbb540c17a0 0x7fbb54070820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:10.306 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.297+0000 7fbb5a636700 1 -- 172.21.15.27:0/3368725194 >> 172.21.15.27:0/3368725194 conn(0x7fbb5406ab80 msgr2=0x7fbb540ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:10.306 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.298+0000 7fbb5a636700 1 -- 172.21.15.27:0/3368725194 shutdown_connections 2023-07-05T23:35:10.308 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.298+0000 7fbb5a636700 1 -- 172.21.15.27:0/3368725194 wait complete. 2023-07-05T23:35:10.308 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.300+0000 7fbb5a636700 1 Processor -- start 2023-07-05T23:35:10.308 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.300+0000 7fbb5a636700 1 -- start start 2023-07-05T23:35:10.308 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.301+0000 7fbb5a636700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbb540b2090 0x7fbb540c4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:10.309 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.301+0000 7fbb5a636700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb540c17a0 0x7fbb540c9230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:10.309 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.301+0000 7fbb5a636700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbb54164290 0x7fbb5415c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:10.309 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.301+0000 7fbb5a636700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb540c9770 con 0x7fbb540b2090 2023-07-05T23:35:10.309 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.301+0000 7fbb5a636700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb54202540 con 0x7fbb540c17a0 2023-07-05T23:35:10.309 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.301+0000 7fbb5a636700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb54202820 con 0x7fbb54164290 2023-07-05T23:35:10.310 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.302+0000 7fbb53fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbb540b2090 0x7fbb540c4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:10.310 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.302+0000 7fbb53fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbb540b2090 0x7fbb540c4310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46170/0 (socket says 172.21.15.27:46170) 2023-07-05T23:35:10.310 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.302+0000 7fbb53fff700 1 -- 172.21.15.27:0/3616100508 learned_addr learned my addr 172.21.15.27:0/3616100508 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:10.310 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.302+0000 7fbb53fff700 1 -- 172.21.15.27:0/3616100508 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbb54164290 msgr2=0x7fbb5415c250 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-05T23:35:10.310 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.302+0000 7fbb53fff700 1 --2- 172.21.15.27:0/3616100508 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbb54164290 0x7fbb5415c250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:10.311 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.302+0000 7fbb53fff700 1 -- 172.21.15.27:0/3616100508 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb540c17a0 msgr2=0x7fbb540c9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:10.311 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.302+0000 7fbb53fff700 1 --2- 172.21.15.27:0/3616100508 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb540c17a0 0x7fbb540c9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:10.311 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.302+0000 7fbb53fff700 1 -- 172.21.15.27:0/3616100508 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb44009550 con 0x7fbb540b2090 2023-07-05T23:35:10.311 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.303+0000 7fbb53fff700 1 --2- 172.21.15.27:0/3616100508 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbb540b2090 0x7fbb540c4310 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c0090b0 tx=0x7fbb3c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:10.312 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.303+0000 7fbb50ff9700 1 -- 172.21.15.27:0/3616100508 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb3c0044d0 con 0x7fbb540b2090 2023-07-05T23:35:10.312 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.303+0000 7fbb5a636700 1 -- 172.21.15.27:0/3616100508 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb3c0094a0 con 0x7fbb540b2090 2023-07-05T23:35:10.312 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.303+0000 7fbb5a636700 1 -- 172.21.15.27:0/3616100508 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb540c4bd0 con 0x7fbb540b2090 2023-07-05T23:35:10.312 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.303+0000 7fbb50ff9700 1 -- 172.21.15.27:0/3616100508 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb3c01f070 con 0x7fbb540b2090 2023-07-05T23:35:10.312 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.303+0000 7fbb50ff9700 1 -- 172.21.15.27:0/3616100508 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb3c0038a0 con 0x7fbb540b2090 2023-07-05T23:35:10.313 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.306+0000 7fbb50ff9700 1 -- 172.21.15.27:0/3616100508 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbb3c003a00 con 0x7fbb540b2090 2023-07-05T23:35:10.313 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.307+0000 7fbb5a636700 1 -- 172.21.15.27:0/3616100508 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb380052f0 con 0x7fbb540b2090 2023-07-05T23:35:10.314 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.307+0000 7fbb50ff9700 1 --2- 172.21.15.27:0/3616100508 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fbb3406ace0 0x7fbb3406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:10.314 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.307+0000 7fbb537fe700 1 --2- 172.21.15.27:0/3616100508 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fbb3406ace0 0x7fbb3406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:10.314 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.308+0000 7fbb50ff9700 1 -- 172.21.15.27:0/3616100508 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fbb3c021070 con 0x7fbb540b2090 2023-07-05T23:35:10.314 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.308+0000 7fbb537fe700 1 --2- 172.21.15.27:0/3616100508 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fbb3406ace0 0x7fbb3406d190 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbb44006fd0 tx=0x7fbb44006f20 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:10.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.314+0000 7fbb50ff9700 1 -- 172.21.15.27:0/3616100508 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbb3c0595d0 con 0x7fbb540b2090 2023-07-05T23:35:10.585 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.580+0000 7fbb5a636700 1 -- 172.21.15.27:0/3616100508 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbb38005b20 con 0x7fbb540b2090 2023-07-05T23:35:10.585 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.580+0000 7fbb50ff9700 1 -- 172.21.15.27:0/3616100508 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbb3c003cb0 con 0x7fbb540b2090 2023-07-05T23:35:10.586 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2023-07-05T23:35:10.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.582+0000 7fbb5a636700 1 -- 172.21.15.27:0/3616100508 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fbb3406ace0 msgr2=0x7fbb3406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:10.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.582+0000 7fbb5a636700 1 --2- 172.21.15.27:0/3616100508 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fbb3406ace0 0x7fbb3406d190 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbb44006fd0 tx=0x7fbb44006f20 comp rx=0 tx=0).stop 2023-07-05T23:35:10.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.582+0000 7fbb5a636700 1 -- 172.21.15.27:0/3616100508 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbb540b2090 msgr2=0x7fbb540c4310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:10.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.582+0000 7fbb5a636700 1 --2- 172.21.15.27:0/3616100508 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbb540b2090 0x7fbb540c4310 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c0090b0 tx=0x7fbb3c004750 comp rx=0 tx=0).stop 2023-07-05T23:35:10.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.582+0000 7fbb5a636700 1 -- 172.21.15.27:0/3616100508 shutdown_connections 2023-07-05T23:35:10.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.582+0000 7fbb5a636700 1 --2- 172.21.15.27:0/3616100508 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fbb3406ace0 0x7fbb3406d190 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:10.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.582+0000 7fbb5a636700 1 --2- 172.21.15.27:0/3616100508 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbb54164290 0x7fbb5415c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:10.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.582+0000 7fbb5a636700 1 --2- 172.21.15.27:0/3616100508 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbb540b2090 0x7fbb540c4310 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:10.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.582+0000 7fbb5a636700 1 --2- 172.21.15.27:0/3616100508 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb540c17a0 0x7fbb540c9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:10.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.582+0000 7fbb5a636700 1 -- 172.21.15.27:0/3616100508 >> 172.21.15.27:0/3616100508 conn(0x7fbb5406ab80 msgr2=0x7fbb540cdb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:10.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.583+0000 7fbb5a636700 1 -- 172.21.15.27:0/3616100508 shutdown_connections 2023-07-05T23:35:10.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.583+0000 7fbb5a636700 1 -- 172.21.15.27:0/3616100508 wait complete. 2023-07-05T23:35:10.598 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-05T23:35:10.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.722+0000 7fa993d4f700 1 Processor -- start 2023-07-05T23:35:10.726 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.723+0000 7fa993d4f700 1 -- start start 2023-07-05T23:35:10.727 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.723+0000 7fa993d4f700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa98c0aecc0 0x7fa98c06a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:10.727 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.723+0000 7fa993d4f700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa98c06e970 0x7fa98c0ac600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:10.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.723+0000 7fa993d4f700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa98c0ce620 con 0x7fa98c15fc60 2023-07-05T23:35:10.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.723+0000 7fa993d4f700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa98c160580 con 0x7fa98c06e970 2023-07-05T23:35:10.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.723+0000 7fa993d4f700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa98c160860 con 0x7fa98c0aecc0 2023-07-05T23:35:10.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.724+0000 7fa9922ec700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa98c06e970 0x7fa98c0ac600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:10.729 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.724+0000 7fa9922ec700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa98c06e970 0x7fa98c0ac600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46182/0 (socket says 172.21.15.27:46182) 2023-07-05T23:35:10.729 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.724+0000 7fa9922ec700 1 -- 172.21.15.27:0/2430586571 learned_addr learned my addr 172.21.15.27:0/2430586571 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:10.729 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.724+0000 7fa9912ea700 1 --2- 172.21.15.27:0/2430586571 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa98c0aecc0 0x7fa98c06a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:10.729 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.724+0000 7fa9922ec700 1 -- 172.21.15.27:0/2430586571 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa98c0aecc0 msgr2=0x7fa98c06a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:35:10.729 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.724+0000 7fa9922ec700 1 --2- 172.21.15.27:0/2430586571 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa98c0aecc0 0x7fa98c06a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:10.730 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.724+0000 7fa9922ec700 1 -- 172.21.15.27:0/2430586571 >> v1:172.21.15.162:6789/0 conn(0x7fa98c15fc60 legacy=0x7fa98c06e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:10.730 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.724+0000 7fa9922ec700 1 -- 172.21.15.27:0/2430586571 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa98c160b40 con 0x7fa98c06e970 2023-07-05T23:35:10.730 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.724+0000 7fa9922ec700 1 --2- 172.21.15.27:0/2430586571 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa98c06e970 0x7fa98c0ac600 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa984009e50 tx=0x7fa98400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e09f2cafe1e471c5 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:10.730 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.724+0000 7fa990ae9700 1 -- 172.21.15.27:0/2430586571 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98400e070 con 0x7fa98c06e970 2023-07-05T23:35:10.730 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.725+0000 7fa990ae9700 1 -- 172.21.15.27:0/2430586571 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa98400b910 con 0x7fa98c06e970 2023-07-05T23:35:10.731 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.725+0000 7fa990ae9700 1 -- 172.21.15.27:0/2430586571 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98400bcc0 con 0x7fa98c06e970 2023-07-05T23:35:10.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.725+0000 7fa993d4f700 1 -- 172.21.15.27:0/2430586571 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa98c06e970 msgr2=0x7fa98c0ac600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:10.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.725+0000 7fa993d4f700 1 --2- 172.21.15.27:0/2430586571 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa98c06e970 0x7fa98c0ac600 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa984009e50 tx=0x7fa98400b330 comp rx=0 tx=0).stop 2023-07-05T23:35:10.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.725+0000 7fa993d4f700 1 -- 172.21.15.27:0/2430586571 shutdown_connections 2023-07-05T23:35:10.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.725+0000 7fa993d4f700 1 --2- 172.21.15.27:0/2430586571 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa98c06e970 0x7fa98c0ac600 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:10.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.725+0000 7fa993d4f700 1 --2- 172.21.15.27:0/2430586571 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa98c0aecc0 0x7fa98c06a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:10.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.725+0000 7fa993d4f700 1 -- 172.21.15.27:0/2430586571 >> 172.21.15.27:0/2430586571 conn(0x7fa98c06b920 msgr2=0x7fa98c0cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:10.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.725+0000 7fa993d4f700 1 -- 172.21.15.27:0/2430586571 shutdown_connections 2023-07-05T23:35:10.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.725+0000 7fa993d4f700 1 -- 172.21.15.27:0/2430586571 wait complete. 2023-07-05T23:35:10.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.726+0000 7fa993d4f700 1 Processor -- start 2023-07-05T23:35:10.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.726+0000 7fa993d4f700 1 -- start start 2023-07-05T23:35:10.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.727+0000 7fa993d4f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa98c06e970 0x7fa98c1e7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:10.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.727+0000 7fa993d4f700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa98c0aecc0 0x7fa98c153aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:10.736 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.727+0000 7fa993d4f700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa98c15fc60 0x7fa98c0b2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:10.736 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.727+0000 7fa993d4f700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa98c0ccec0 con 0x7fa98c06e970 2023-07-05T23:35:10.736 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.727+0000 7fa993d4f700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa98c0b3e10 con 0x7fa98c0aecc0 2023-07-05T23:35:10.736 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.727+0000 7fa993d4f700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa98c1e8540 con 0x7fa98c15fc60 2023-07-05T23:35:10.736 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.727+0000 7fa991aeb700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa98c06e970 0x7fa98c1e7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:10.737 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.727+0000 7fa991aeb700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa98c06e970 0x7fa98c1e7330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46184/0 (socket says 172.21.15.27:46184) 2023-07-05T23:35:10.737 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.727+0000 7fa991aeb700 1 -- 172.21.15.27:0/1652050959 learned_addr learned my addr 172.21.15.27:0/1652050959 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:10.737 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.727+0000 7fa9912ea700 1 --2- 172.21.15.27:0/1652050959 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa98c0aecc0 0x7fa98c153aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:10.737 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.727+0000 7fa9922ec700 1 --2- 172.21.15.27:0/1652050959 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa98c15fc60 0x7fa98c0b2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:10.737 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.728+0000 7fa991aeb700 1 -- 172.21.15.27:0/1652050959 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa98c15fc60 msgr2=0x7fa98c0b2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:10.738 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.728+0000 7fa991aeb700 1 --2- 172.21.15.27:0/1652050959 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa98c15fc60 0x7fa98c0b2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:10.738 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.728+0000 7fa991aeb700 1 -- 172.21.15.27:0/1652050959 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa98c0aecc0 msgr2=0x7fa98c153aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:10.738 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.728+0000 7fa991aeb700 1 --2- 172.21.15.27:0/1652050959 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa98c0aecc0 0x7fa98c153aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:10.738 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.728+0000 7fa991aeb700 1 -- 172.21.15.27:0/1652050959 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa984009b30 con 0x7fa98c06e970 2023-07-05T23:35:10.738 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.728+0000 7fa991aeb700 1 --2- 172.21.15.27:0/1652050959 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa98c06e970 0x7fa98c1e7330 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa98800c4d0 tx=0x7fa98800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:10.739 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.728+0000 7fa97e7fc700 1 -- 172.21.15.27:0/1652050959 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9880052d0 con 0x7fa98c06e970 2023-07-05T23:35:10.739 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.728+0000 7fa97e7fc700 1 -- 172.21.15.27:0/1652050959 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa988005430 con 0x7fa98c06e970 2023-07-05T23:35:10.739 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.728+0000 7fa97e7fc700 1 -- 172.21.15.27:0/1652050959 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9880038f0 con 0x7fa98c06e970 2023-07-05T23:35:10.739 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.728+0000 7fa993d4f700 1 -- 172.21.15.27:0/1652050959 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa98c1e89d0 con 0x7fa98c06e970 2023-07-05T23:35:10.739 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.728+0000 7fa993d4f700 1 -- 172.21.15.27:0/1652050959 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa98c1e7c10 con 0x7fa98c06e970 2023-07-05T23:35:10.740 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.729+0000 7fa993d4f700 1 -- 172.21.15.27:0/1652050959 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa98c04ea20 con 0x7fa98c06e970 2023-07-05T23:35:10.740 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.729+0000 7fa97e7fc700 1 -- 172.21.15.27:0/1652050959 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa988003a50 con 0x7fa98c06e970 2023-07-05T23:35:10.740 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.730+0000 7fa97e7fc700 1 --2- 172.21.15.27:0/1652050959 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fa97006ace0 0x7fa97006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:10.740 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.730+0000 7fa97e7fc700 1 -- 172.21.15.27:0/1652050959 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa988088a80 con 0x7fa98c06e970 2023-07-05T23:35:10.740 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.730+0000 7fa9912ea700 1 --2- 172.21.15.27:0/1652050959 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fa97006ace0 0x7fa97006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:10.741 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.730+0000 7fa9912ea700 1 --2- 172.21.15.27:0/1652050959 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fa97006ace0 0x7fa97006d190 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa98c0cbbf0 tx=0x7fa980009210 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:10.741 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.734+0000 7fa97e7fc700 1 -- 172.21.15.27:0/1652050959 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa988053890 con 0x7fa98c06e970 2023-07-05T23:35:10.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.931+0000 7fa993d4f700 1 -- 172.21.15.27:0/1652050959 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa98c0cd070 con 0x7fa98c06e970 2023-07-05T23:35:10.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.931+0000 7fa97e7fc700 1 -- 172.21.15.27:0/1652050959 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa988056eb0 con 0x7fa98c06e970 2023-07-05T23:35:10.935 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 32 2023-07-05T23:35:10.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.933+0000 7fa993d4f700 1 -- 172.21.15.27:0/1652050959 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fa97006ace0 msgr2=0x7fa97006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:10.937 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.933+0000 7fa993d4f700 1 --2- 172.21.15.27:0/1652050959 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fa97006ace0 0x7fa97006d190 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa98c0cbbf0 tx=0x7fa980009210 comp rx=0 tx=0).stop 2023-07-05T23:35:10.937 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.933+0000 7fa993d4f700 1 -- 172.21.15.27:0/1652050959 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa98c06e970 msgr2=0x7fa98c1e7330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:10.938 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.933+0000 7fa993d4f700 1 --2- 172.21.15.27:0/1652050959 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa98c06e970 0x7fa98c1e7330 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa98800c4d0 tx=0x7fa98800c7e0 comp rx=0 tx=0).stop 2023-07-05T23:35:10.938 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.933+0000 7fa993d4f700 1 -- 172.21.15.27:0/1652050959 shutdown_connections 2023-07-05T23:35:10.938 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.933+0000 7fa993d4f700 1 --2- 172.21.15.27:0/1652050959 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fa97006ace0 0x7fa97006d190 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:10.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.933+0000 7fa993d4f700 1 --2- 172.21.15.27:0/1652050959 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa98c15fc60 0x7fa98c0b2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:10.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.933+0000 7fa993d4f700 1 --2- 172.21.15.27:0/1652050959 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa98c06e970 0x7fa98c1e7330 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:10.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.933+0000 7fa993d4f700 1 --2- 172.21.15.27:0/1652050959 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa98c0aecc0 0x7fa98c153aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:10.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.933+0000 7fa993d4f700 1 -- 172.21.15.27:0/1652050959 >> 172.21.15.27:0/1652050959 conn(0x7fa98c06b920 msgr2=0x7fa98c0b0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:10.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.934+0000 7fa993d4f700 1 -- 172.21.15.27:0/1652050959 shutdown_connections 2023-07-05T23:35:10.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:10.934+0000 7fa993d4f700 1 -- 172.21.15.27:0/1652050959 wait complete. 2023-07-05T23:35:10.949 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-05T23:35:11.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.072+0000 7f47279ed700 1 Processor -- start 2023-07-05T23:35:11.076 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.073+0000 7f47279ed700 1 -- start start 2023-07-05T23:35:11.078 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.073+0000 7f47279ed700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f472006a600 0x7f47200c9df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:11.078 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.073+0000 7f47279ed700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f47200b08d0 0x7f47200ca330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:11.078 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.073+0000 7f47279ed700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47200cf2a0 con 0x7f472015c420 2023-07-05T23:35:11.078 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.073+0000 7f47279ed700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47200ce690 con 0x7f47200b08d0 2023-07-05T23:35:11.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.073+0000 7f47279ed700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47200ce970 con 0x7f472006a600 2023-07-05T23:35:11.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.074+0000 7f4725f8a700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f47200b08d0 0x7f47200ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:11.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.074+0000 7f4725f8a700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f47200b08d0 0x7f47200ca330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46196/0 (socket says 172.21.15.27:46196) 2023-07-05T23:35:11.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.074+0000 7f4725f8a700 1 -- 172.21.15.27:0/2419933650 learned_addr learned my addr 172.21.15.27:0/2419933650 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:11.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.074+0000 7f4724f88700 1 --2- 172.21.15.27:0/2419933650 >> v2:172.21.15.162:3300/0 conn(0x7f472006a600 0x7f47200c9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:11.080 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.074+0000 7f4725f8a700 1 -- 172.21.15.27:0/2419933650 >> v2:172.21.15.162:3300/0 conn(0x7f472006a600 msgr2=0x7f47200c9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:35:11.080 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.074+0000 7f4725f8a700 1 --2- 172.21.15.27:0/2419933650 >> v2:172.21.15.162:3300/0 conn(0x7f472006a600 0x7f47200c9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:11.080 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.074+0000 7f4725f8a700 1 -- 172.21.15.27:0/2419933650 >> v1:172.21.15.162:6789/0 conn(0x7f472015c420 legacy=0x7f4720069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:35:11.080 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.074+0000 7f4725f8a700 1 -- 172.21.15.27:0/2419933650 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47200cec50 con 0x7f47200b08d0 2023-07-05T23:35:11.080 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.074+0000 7f4724f88700 1 --2- 172.21.15.27:0/2419933650 >> v2:172.21.15.162:3300/0 conn(0x7f472006a600 0x7f47200c9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T23:35:11.081 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.074+0000 7f4725f8a700 1 --2- 172.21.15.27:0/2419933650 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f47200b08d0 0x7f47200ca330 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4720070400 tx=0x7f471800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b18c4be01d6765e server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:11.081 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.074+0000 7f4713fff700 1 -- 172.21.15.27:0/2419933650 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471800e070 con 0x7f47200b08d0 2023-07-05T23:35:11.081 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.074+0000 7f4713fff700 1 -- 172.21.15.27:0/2419933650 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4718003a20 con 0x7f47200b08d0 2023-07-05T23:35:11.081 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.074+0000 7f4713fff700 1 -- 172.21.15.27:0/2419933650 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4718003dd0 con 0x7f47200b08d0 2023-07-05T23:35:11.081 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.075+0000 7f47279ed700 1 -- 172.21.15.27:0/2419933650 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f47200b08d0 msgr2=0x7f47200ca330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:11.082 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.075+0000 7f47279ed700 1 --2- 172.21.15.27:0/2419933650 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f47200b08d0 0x7f47200ca330 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4720070400 tx=0x7f471800b330 comp rx=0 tx=0).stop 2023-07-05T23:35:11.082 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.075+0000 7f47279ed700 1 -- 172.21.15.27:0/2419933650 shutdown_connections 2023-07-05T23:35:11.082 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.075+0000 7f47279ed700 1 --2- 172.21.15.27:0/2419933650 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f47200b08d0 0x7f47200ca330 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:11.082 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.075+0000 7f47279ed700 1 --2- 172.21.15.27:0/2419933650 >> v2:172.21.15.162:3300/0 conn(0x7f472006a600 0x7f47200c9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:11.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.075+0000 7f47279ed700 1 -- 172.21.15.27:0/2419933650 >> 172.21.15.27:0/2419933650 conn(0x7f472006b920 msgr2=0x7f47200cf7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:11.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.075+0000 7f47279ed700 1 -- 172.21.15.27:0/2419933650 shutdown_connections 2023-07-05T23:35:11.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.075+0000 7f47279ed700 1 -- 172.21.15.27:0/2419933650 wait complete. 2023-07-05T23:35:11.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.076+0000 7f47279ed700 1 Processor -- start 2023-07-05T23:35:11.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.076+0000 7f47279ed700 1 -- start start 2023-07-05T23:35:11.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.077+0000 7f47279ed700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f472006a600 0x7f472015a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:11.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.077+0000 7f47279ed700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47200b08d0 0x7f47201f1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:11.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.077+0000 7f47279ed700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f472015c420 0x7f47200b3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:11.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.077+0000 7f47279ed700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f472009b090 con 0x7f472006a600 2023-07-05T23:35:11.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.077+0000 7f47279ed700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47201f29a0 con 0x7f47200b08d0 2023-07-05T23:35:11.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.077+0000 7f47279ed700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f472009b590 con 0x7f472015c420 2023-07-05T23:35:11.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.078+0000 7f4725789700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f472006a600 0x7f472015a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:11.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.078+0000 7f4725789700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f472006a600 0x7f472015a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46198/0 (socket says 172.21.15.27:46198) 2023-07-05T23:35:11.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.078+0000 7f4725789700 1 -- 172.21.15.27:0/68798519 learned_addr learned my addr 172.21.15.27:0/68798519 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:11.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.078+0000 7f4724f88700 1 --2- 172.21.15.27:0/68798519 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47200b08d0 0x7f47201f1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:11.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.078+0000 7f4725f8a700 1 --2- 172.21.15.27:0/68798519 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f472015c420 0x7f47200b3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:11.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.078+0000 7f4725789700 1 -- 172.21.15.27:0/68798519 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f472015c420 msgr2=0x7f47200b3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:11.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.078+0000 7f4725789700 1 --2- 172.21.15.27:0/68798519 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f472015c420 0x7f47200b3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:11.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.078+0000 7f4725789700 1 -- 172.21.15.27:0/68798519 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47200b08d0 msgr2=0x7f47201f1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:11.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.078+0000 7f4725789700 1 --2- 172.21.15.27:0/68798519 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47200b08d0 0x7f47201f1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:11.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.078+0000 7f4725789700 1 -- 172.21.15.27:0/68798519 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4718009b30 con 0x7f472006a600 2023-07-05T23:35:11.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.078+0000 7f4725789700 1 --2- 172.21.15.27:0/68798519 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f472006a600 0x7f472015a090 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f471c00c4d0 tx=0x7f471c00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:11.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.078+0000 7f4711ffb700 1 -- 172.21.15.27:0/68798519 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471c011790 con 0x7f472006a600 2023-07-05T23:35:11.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.078+0000 7f4711ffb700 1 -- 172.21.15.27:0/68798519 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f471c0118f0 con 0x7f472006a600 2023-07-05T23:35:11.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.078+0000 7f47279ed700 1 -- 172.21.15.27:0/68798519 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47201f22a0 con 0x7f472006a600 2023-07-05T23:35:11.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.078+0000 7f4711ffb700 1 -- 172.21.15.27:0/68798519 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471c011ca0 con 0x7f472006a600 2023-07-05T23:35:11.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.079+0000 7f47279ed700 1 -- 172.21.15.27:0/68798519 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f472009b810 con 0x7f472006a600 2023-07-05T23:35:11.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.079+0000 7f47279ed700 1 -- 172.21.15.27:0/68798519 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47201f27c0 con 0x7f472006a600 2023-07-05T23:35:11.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.080+0000 7f4711ffb700 1 -- 172.21.15.27:0/68798519 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f471c01c460 con 0x7f472006a600 2023-07-05T23:35:11.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.080+0000 7f4711ffb700 1 --2- 172.21.15.27:0/68798519 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f470406ace0 0x7f470406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:11.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.080+0000 7f4711ffb700 1 -- 172.21.15.27:0/68798519 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f471c0894d0 con 0x7f472006a600 2023-07-05T23:35:11.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.080+0000 7f4724f88700 1 --2- 172.21.15.27:0/68798519 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f470406ace0 0x7f470406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:11.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.081+0000 7f4724f88700 1 --2- 172.21.15.27:0/68798519 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f470406ace0 0x7f470406d190 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f47200aee30 tx=0x7f4714008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:11.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.085+0000 7f4711ffb700 1 -- 172.21.15.27:0/68798519 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f471c054250 con 0x7f472006a600 2023-07-05T23:35:11.302 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.298+0000 7f47279ed700 1 -- 172.21.15.27:0/68798519 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f4720073910 con 0x7f472006a600 2023-07-05T23:35:11.302 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.299+0000 7f4711ffb700 1 -- 172.21.15.27:0/68798519 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v30) v1 ==== 80+0+0 (secure 0 0 0) 0x7f471c057870 con 0x7f472006a600 2023-07-05T23:35:11.304 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.301+0000 7f47279ed700 1 -- 172.21.15.27:0/68798519 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f470406ace0 msgr2=0x7f470406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:11.304 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.301+0000 7f47279ed700 1 --2- 172.21.15.27:0/68798519 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f470406ace0 0x7f470406d190 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f47200aee30 tx=0x7f4714008040 comp rx=0 tx=0).stop 2023-07-05T23:35:11.304 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.301+0000 7f47279ed700 1 -- 172.21.15.27:0/68798519 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f472006a600 msgr2=0x7f472015a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:11.305 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.301+0000 7f47279ed700 1 --2- 172.21.15.27:0/68798519 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f472006a600 0x7f472015a090 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f471c00c4d0 tx=0x7f471c00c7e0 comp rx=0 tx=0).stop 2023-07-05T23:35:11.305 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.301+0000 7f47279ed700 1 -- 172.21.15.27:0/68798519 shutdown_connections 2023-07-05T23:35:11.305 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.301+0000 7f47279ed700 1 --2- 172.21.15.27:0/68798519 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f470406ace0 0x7f470406d190 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:11.305 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.301+0000 7f47279ed700 1 --2- 172.21.15.27:0/68798519 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f472015c420 0x7f47200b3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:11.305 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.301+0000 7f47279ed700 1 --2- 172.21.15.27:0/68798519 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f472006a600 0x7f472015a090 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:11.306 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.301+0000 7f47279ed700 1 --2- 172.21.15.27:0/68798519 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47200b08d0 0x7f47201f1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:11.306 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.301+0000 7f47279ed700 1 -- 172.21.15.27:0/68798519 >> 172.21.15.27:0/68798519 conn(0x7f472006b920 msgr2=0x7f47200cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:11.306 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.301+0000 7f47279ed700 1 -- 172.21.15.27:0/68798519 shutdown_connections 2023-07-05T23:35:11.306 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.301+0000 7f47279ed700 1 -- 172.21.15.27:0/68798519 wait complete. 2023-07-05T23:35:11.307 INFO:teuthology.orchestra.run.smithi027.stderr:listed 0 entries 2023-07-05T23:35:11.316 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-07-05T23:35:11.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:35:11.317 DEBUG:teuthology.orchestra.run.smithi027:> sudo umount /home/ubuntu/cephtest/mnt.2 2023-07-05T23:35:11.463 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi027.front.sepia.ceph.com 2023-07-05T23:35:11.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:35:11.464 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-07-05T23:35:11.505 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-07-05T23:35:11.506 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-05T23:35:11.524 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-07-05T23:35:11.524 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-05T23:35:11.580 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-05T23:35:11.705 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.702+0000 7f097044d700 1 Processor -- start 2023-07-05T23:35:11.705 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.702+0000 7f097044d700 1 -- start start 2023-07-05T23:35:11.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.703+0000 7f097044d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f096815c420 0x7f0968069ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:11.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.703+0000 7f097044d700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09680b08d0 0x7f096806a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:11.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.703+0000 7f097044d700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09680cf2a0 con 0x7f096815c7f0 2023-07-05T23:35:11.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.703+0000 7f097044d700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09680ce690 con 0x7f096815c420 2023-07-05T23:35:11.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.703+0000 7f097044d700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09680ce970 con 0x7f09680b08d0 2023-07-05T23:35:11.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.703+0000 7f096e1e9700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f096815c420 0x7f0968069ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:11.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.703+0000 7f096e1e9700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f096815c420 0x7f0968069ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46206/0 (socket says 172.21.15.27:46206) 2023-07-05T23:35:11.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.703+0000 7f096e1e9700 1 -- 172.21.15.27:0/3637352996 learned_addr learned my addr 172.21.15.27:0/3637352996 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:11.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.703+0000 7f096d9e8700 1 --2- 172.21.15.27:0/3637352996 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09680b08d0 0x7f096806a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:11.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.703+0000 7f096e1e9700 1 -- 172.21.15.27:0/3637352996 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09680b08d0 msgr2=0x7f096806a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:35:11.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.703+0000 7f096e1e9700 1 --2- 172.21.15.27:0/3637352996 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09680b08d0 0x7f096806a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:11.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.703+0000 7f096e1e9700 1 -- 172.21.15.27:0/3637352996 >> v1:172.21.15.27:6789/0 conn(0x7f096815c7f0 legacy=0x7f09680cc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:11.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.703+0000 7f096e1e9700 1 -- 172.21.15.27:0/3637352996 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09680cec50 con 0x7f096815c420 2023-07-05T23:35:11.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.703+0000 7f096d9e8700 1 --2- 172.21.15.27:0/3637352996 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09680b08d0 0x7f096806a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T23:35:11.710 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.704+0000 7f096e1e9700 1 --2- 172.21.15.27:0/3637352996 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f096815c420 0x7f0968069ef0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f09580098f0 tx=0x7f0958009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80f6dec91b5f90ee server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:11.710 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.704+0000 7f096d1e7700 1 -- 172.21.15.27:0/3637352996 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f095800b8a0 con 0x7f096815c420 2023-07-05T23:35:11.710 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.704+0000 7f096d1e7700 1 -- 172.21.15.27:0/3637352996 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f095800ba00 con 0x7f096815c420 2023-07-05T23:35:11.710 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.704+0000 7f096d1e7700 1 -- 172.21.15.27:0/3637352996 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f095800bd90 con 0x7f096815c420 2023-07-05T23:35:11.712 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.704+0000 7f097044d700 1 -- 172.21.15.27:0/3637352996 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f096815c420 msgr2=0x7f0968069ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:11.713 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.704+0000 7f097044d700 1 --2- 172.21.15.27:0/3637352996 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f096815c420 0x7f0968069ef0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f09580098f0 tx=0x7f0958009c00 comp rx=0 tx=0).stop 2023-07-05T23:35:11.713 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.704+0000 7f097044d700 1 -- 172.21.15.27:0/3637352996 shutdown_connections 2023-07-05T23:35:11.713 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.704+0000 7f097044d700 1 --2- 172.21.15.27:0/3637352996 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f096815c420 0x7f0968069ef0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:11.713 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.704+0000 7f097044d700 1 --2- 172.21.15.27:0/3637352996 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09680b08d0 0x7f096806a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:11.713 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.704+0000 7f097044d700 1 -- 172.21.15.27:0/3637352996 >> 172.21.15.27:0/3637352996 conn(0x7f096806b920 msgr2=0x7f09680cf7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:11.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.704+0000 7f097044d700 1 -- 172.21.15.27:0/3637352996 shutdown_connections 2023-07-05T23:35:11.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.704+0000 7f097044d700 1 -- 172.21.15.27:0/3637352996 wait complete. 2023-07-05T23:35:11.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.706+0000 7f097044d700 1 Processor -- start 2023-07-05T23:35:11.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.706+0000 7f097044d700 1 -- start start 2023-07-05T23:35:11.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.706+0000 7f097044d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09680b08d0 0x7f0968157dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:11.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.706+0000 7f097044d700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f096815c420 0x7f096815f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:11.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.706+0000 7f097044d700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f096815c7f0 0x7f096815aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:11.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.706+0000 7f097044d700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09680ad4e0 con 0x7f09680b08d0 2023-07-05T23:35:11.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.706+0000 7f097044d700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f096815d360 con 0x7f096815c420 2023-07-05T23:35:11.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.706+0000 7f097044d700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f096815d080 con 0x7f096815c7f0 2023-07-05T23:35:11.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.706+0000 7f096e1e9700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09680b08d0 0x7f0968157dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:11.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.706+0000 7f096e1e9700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09680b08d0 0x7f0968157dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46212/0 (socket says 172.21.15.27:46212) 2023-07-05T23:35:11.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.706+0000 7f096e1e9700 1 -- 172.21.15.27:0/4130891351 learned_addr learned my addr 172.21.15.27:0/4130891351 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:11.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.707+0000 7f096e1e9700 1 -- 172.21.15.27:0/4130891351 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f096815c7f0 msgr2=0x7f096815aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:11.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.707+0000 7f096e1e9700 1 --2- 172.21.15.27:0/4130891351 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f096815c7f0 0x7f096815aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:11.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.707+0000 7f096e1e9700 1 -- 172.21.15.27:0/4130891351 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f096815c420 msgr2=0x7f096815f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:11.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.707+0000 7f096e1e9700 1 --2- 172.21.15.27:0/4130891351 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f096815c420 0x7f096815f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:11.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.707+0000 7f096e1e9700 1 -- 172.21.15.27:0/4130891351 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0958009550 con 0x7f09680b08d0 2023-07-05T23:35:11.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.707+0000 7f096e1e9700 1 --2- 172.21.15.27:0/4130891351 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09680b08d0 0x7f0968157dd0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f0958000c00 tx=0x7f0958004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:11.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.707+0000 7f095effd700 1 -- 172.21.15.27:0/4130891351 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09580036a0 con 0x7f09680b08d0 2023-07-05T23:35:11.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.707+0000 7f095effd700 1 -- 172.21.15.27:0/4130891351 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0958003800 con 0x7f09680b08d0 2023-07-05T23:35:11.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.707+0000 7f097044d700 1 -- 172.21.15.27:0/4130891351 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09680ace90 con 0x7f09680b08d0 2023-07-05T23:35:11.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.707+0000 7f095effd700 1 -- 172.21.15.27:0/4130891351 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0958003b70 con 0x7f09680b08d0 2023-07-05T23:35:11.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.707+0000 7f097044d700 1 -- 172.21.15.27:0/4130891351 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0968158310 con 0x7f09680b08d0 2023-07-05T23:35:11.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.708+0000 7f097044d700 1 -- 172.21.15.27:0/4130891351 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0968073910 con 0x7f09680b08d0 2023-07-05T23:35:11.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.709+0000 7f095effd700 1 -- 172.21.15.27:0/4130891351 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0958003cd0 con 0x7f09680b08d0 2023-07-05T23:35:11.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.709+0000 7f095effd700 1 --2- 172.21.15.27:0/4130891351 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f094c06ace0 0x7f094c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:11.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.709+0000 7f095effd700 1 -- 172.21.15.27:0/4130891351 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0958021030 con 0x7f09680b08d0 2023-07-05T23:35:11.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.709+0000 7f096d9e8700 1 --2- 172.21.15.27:0/4130891351 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f094c06ace0 0x7f094c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:11.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.710+0000 7f096d9e8700 1 --2- 172.21.15.27:0/4130891351 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f094c06ace0 0x7f094c06d190 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f09680cad60 tx=0x7f0964008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:11.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.714+0000 7f095effd700 1 -- 172.21.15.27:0/4130891351 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0958055dd0 con 0x7f09680b08d0 2023-07-05T23:35:11.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.917+0000 7f097044d700 1 -- 172.21.15.27:0/4130891351 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f09680cb2e0 con 0x7f09680b08d0 2023-07-05T23:35:11.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.918+0000 7f095effd700 1 -- 172.21.15.27:0/4130891351 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20215 (secure 0 0 0) 0x7f0958015020 con 0x7f09680b08d0 2023-07-05T23:35:11.921 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:35:11.922 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":30,"fsid":"23eebe48-65f5-4d3c-8c2d-4aa171c055d5","created":"2023-07-05T23:32:27.989612+0000","modified":"2023-07-05T23:33:34.883498+0000","last_up_change":"2023-07-05T23:32:39.601570+0000","last_in_change":"2023-07-05T23:32:30.488261+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-05T23:32:41.624598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-05T23:32:46.481587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-05T23:32:51.025210+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-05T23:32:52.286964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-05T23:32:55.354212+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ac2071e4-394b-4385-b9ba-fad5265efc65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6814","nonce":3766536605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6818","nonce":3766536605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6823","nonce":3766536605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6821","nonce":3766536605}]},"public_addr":"172.21.15.27:6814/3766536605","cluster_addr":"172.21.15.27:6818/3766536605","heartbeat_back_addr":"172.21.15.27:6823/3766536605","heartbeat_front_addr":"172.21.15.27:6821/3766536605","state":["exists","up"]},{"osd":1,"uuid":"8c9b61a0-39d5-46bf-afd6-5add78453ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6801","nonce":1579117455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6803","nonce":1579117455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6807","nonce":1579117455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6805","nonce":1579117455}]},"public_addr":"172.21.15.27:6801/1579117455","cluster_addr":"172.21.15.27:6803/1579117455","heartbeat_back_addr":"172.21.15.27:6807/1579117455","heartbeat_front_addr":"172.21.15.27:6805/1579117455","state":["exists","up"]},{"osd":2,"uuid":"dcd032a2-06b1-4055-b798-b86c71a7107d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6825","nonce":807520271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6827","nonce":807520271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6831","nonce":807520271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6829","nonce":807520271}]},"public_addr":"172.21.15.27:6825/807520271","cluster_addr":"172.21.15.27:6827/807520271","heartbeat_back_addr":"172.21.15.27:6831/807520271","heartbeat_front_addr":"172.21.15.27:6829/807520271","state":["exists","up"]},{"osd":3,"uuid":"b0ffe0fc-47ba-4636-b5ea-6bab637642c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6809","nonce":2125656143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6811","nonce":2125656143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6817","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6819","nonce":2125656143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6813","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6815","nonce":2125656143}]},"public_addr":"172.21.15.27:6809/2125656143","cluster_addr":"172.21.15.27:6811/2125656143","heartbeat_back_addr":"172.21.15.27:6819/2125656143","heartbeat_front_addr":"172.21.15.27:6815/2125656143","state":["exists","up"]},{"osd":4,"uuid":"7fab4e5a-1246-4efe-9562-10c4a6c789ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6801","nonce":2111223016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6803","nonce":2111223016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6807","nonce":2111223016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6805","nonce":2111223016}]},"public_addr":"172.21.15.162:6801/2111223016","cluster_addr":"172.21.15.162:6803/2111223016","heartbeat_back_addr":"172.21.15.162:6807/2111223016","heartbeat_front_addr":"172.21.15.162:6805/2111223016","state":["exists","up"]},{"osd":5,"uuid":"110c4d9f-cef6-48ab-a818-5a81e72372af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6825","nonce":3102609008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6827","nonce":3102609008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6831","nonce":3102609008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6829","nonce":3102609008}]},"public_addr":"172.21.15.162:6825/3102609008","cluster_addr":"172.21.15.162:6827/3102609008","heartbeat_back_addr":"172.21.15.162:6831/3102609008","heartbeat_front_addr":"172.21.15.162:6829/3102609008","state":["exists","up"]},{"osd":6,"uuid":"16803bcc-2c92-4aed-954e-487938c9f24a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6809","nonce":2657688865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6811","nonce":2657688865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6815","nonce":2657688865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6813","nonce":2657688865}]},"public_addr":"172.21.15.162:6809/2657688865","cluster_addr":"172.21.15.162:6811/2657688865","heartbeat_back_addr":"172.21.15.162:6815/2657688865","heartbeat_front_addr":"172.21.15.162:6813/2657688865","state":["exists","up"]},{"osd":7,"uuid":"b7c35377-3cf2-4569-b6b9-72376eb463bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6817","nonce":2096609978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6819","nonce":2096609978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6823","nonce":2096609978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6821","nonce":2096609978}]},"public_addr":"172.21.15.162:6817/2096609978","cluster_addr":"172.21.15.162:6819/2096609978","heartbeat_back_addr":"172.21.15.162:6823/2096609978","heartbeat_front_addr":"172.21.15.162:6821/2096609978","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.735448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.645561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.759120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.682507+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.736228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.694664+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.716002+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.680485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":3,"to":2}]},{"pgid":"4.26","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-05T23:35:11.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.920+0000 7f097044d700 1 -- 172.21.15.27:0/4130891351 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f094c06ace0 msgr2=0x7f094c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:11.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.920+0000 7f097044d700 1 --2- 172.21.15.27:0/4130891351 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f094c06ace0 0x7f094c06d190 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f09680cad60 tx=0x7f0964008040 comp rx=0 tx=0).stop 2023-07-05T23:35:11.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.920+0000 7f097044d700 1 -- 172.21.15.27:0/4130891351 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09680b08d0 msgr2=0x7f0968157dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:11.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.920+0000 7f097044d700 1 --2- 172.21.15.27:0/4130891351 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09680b08d0 0x7f0968157dd0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f0958000c00 tx=0x7f0958004750 comp rx=0 tx=0).stop 2023-07-05T23:35:11.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.920+0000 7f097044d700 1 -- 172.21.15.27:0/4130891351 shutdown_connections 2023-07-05T23:35:11.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.920+0000 7f097044d700 1 --2- 172.21.15.27:0/4130891351 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f094c06ace0 0x7f094c06d190 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:11.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.920+0000 7f097044d700 1 --2- 172.21.15.27:0/4130891351 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f096815c7f0 0x7f096815aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:11.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.920+0000 7f097044d700 1 --2- 172.21.15.27:0/4130891351 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09680b08d0 0x7f0968157dd0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:11.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.920+0000 7f097044d700 1 --2- 172.21.15.27:0/4130891351 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f096815c420 0x7f096815f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:11.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.920+0000 7f097044d700 1 -- 172.21.15.27:0/4130891351 >> 172.21.15.27:0/4130891351 conn(0x7f096806b920 msgr2=0x7f096806de10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:11.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.920+0000 7f097044d700 1 -- 172.21.15.27:0/4130891351 shutdown_connections 2023-07-05T23:35:11.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:11.920+0000 7f097044d700 1 -- 172.21.15.27:0/4130891351 wait complete. 2023-07-05T23:35:11.936 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-05T23:32:41.624598+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-05T23:32:46.481587+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-05T23:32:51.025210+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-05T23:32:52.286964+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-05T23:32:55.354212+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-05T23:35:11.937 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-05T23:35:12.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.062+0000 7ff12fa9b700 1 Processor -- start 2023-07-05T23:35:12.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.062+0000 7ff12fa9b700 1 -- start start 2023-07-05T23:35:12.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.063+0000 7ff12fa9b700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff1280aecc0 0x7ff12806a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:12.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.063+0000 7ff12fa9b700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff12806e970 0x7ff1280ac600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:12.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.063+0000 7ff12fa9b700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1280ce620 con 0x7ff12815fc60 2023-07-05T23:35:12.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.063+0000 7ff12fa9b700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff128160580 con 0x7ff1280aecc0 2023-07-05T23:35:12.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.063+0000 7ff12fa9b700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff128160860 con 0x7ff12806e970 2023-07-05T23:35:12.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.063+0000 7ff12d036700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff1280aecc0 0x7ff12806a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:12.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.063+0000 7ff12e038700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff12806e970 0x7ff1280ac600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:12.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.063+0000 7ff12e038700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff12806e970 0x7ff1280ac600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.27:46260/0 (socket says 172.21.15.27:46260) 2023-07-05T23:35:12.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.063+0000 7ff12d036700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff1280aecc0 0x7ff12806a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.27:44160/0 (socket says 172.21.15.27:44160) 2023-07-05T23:35:12.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.063+0000 7ff12e038700 1 -- 172.21.15.27:0/892274968 learned_addr learned my addr 172.21.15.27:0/892274968 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:12.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.063+0000 7ff12d837700 1 --1- 172.21.15.27:0/892274968 >> v1:172.21.15.162:6789/0 conn(0x7ff12815fc60 0x7ff12806e260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.27:34354/0 (socket says 172.21.15.27:34354) 2023-07-05T23:35:12.071 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.063+0000 7ff12c835700 1 -- 172.21.15.27:0/892274968 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2600728834 0 0) 0x7ff1280ce620 con 0x7ff12815fc60 2023-07-05T23:35:12.071 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.064+0000 7ff12e038700 1 -- 172.21.15.27:0/892274968 >> v2:172.21.15.162:3300/0 conn(0x7ff1280aecc0 msgr2=0x7ff12806a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:35:12.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.064+0000 7ff12e038700 1 --2- 172.21.15.27:0/892274968 >> v2:172.21.15.162:3300/0 conn(0x7ff1280aecc0 0x7ff12806a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:12.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.064+0000 7ff12e038700 1 -- 172.21.15.27:0/892274968 >> v1:172.21.15.162:6789/0 conn(0x7ff12815fc60 legacy=0x7ff12806e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:12.073 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.064+0000 7ff12e038700 1 -- 172.21.15.27:0/892274968 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff128160b40 con 0x7ff12806e970 2023-07-05T23:35:12.073 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.064+0000 7ff12d036700 1 --2- 172.21.15.27:0/892274968 >> v2:172.21.15.162:3300/0 conn(0x7ff1280aecc0 0x7ff12806a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T23:35:12.073 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.064+0000 7ff12e038700 1 --2- 172.21.15.27:0/892274968 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff12806e970 0x7ff1280ac600 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff120009e50 tx=0x7ff12000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7659d52fae10f185 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:12.073 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.064+0000 7ff12c835700 1 -- 172.21.15.27:0/892274968 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff12000e070 con 0x7ff12806e970 2023-07-05T23:35:12.074 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.064+0000 7ff12c835700 1 -- 172.21.15.27:0/892274968 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff12000b910 con 0x7ff12806e970 2023-07-05T23:35:12.074 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.064+0000 7ff12c835700 1 -- 172.21.15.27:0/892274968 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff12000bcc0 con 0x7ff12806e970 2023-07-05T23:35:12.074 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.064+0000 7ff12fa9b700 1 -- 172.21.15.27:0/892274968 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff12806e970 msgr2=0x7ff1280ac600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:12.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.064+0000 7ff12fa9b700 1 --2- 172.21.15.27:0/892274968 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff12806e970 0x7ff1280ac600 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff120009e50 tx=0x7ff12000b330 comp rx=0 tx=0).stop 2023-07-05T23:35:12.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.064+0000 7ff12fa9b700 1 -- 172.21.15.27:0/892274968 shutdown_connections 2023-07-05T23:35:12.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.064+0000 7ff12fa9b700 1 --2- 172.21.15.27:0/892274968 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff12806e970 0x7ff1280ac600 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:12.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.064+0000 7ff12fa9b700 1 --2- 172.21.15.27:0/892274968 >> v2:172.21.15.162:3300/0 conn(0x7ff1280aecc0 0x7ff12806a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:12.076 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.064+0000 7ff12fa9b700 1 -- 172.21.15.27:0/892274968 >> 172.21.15.27:0/892274968 conn(0x7ff12806b920 msgr2=0x7ff1280cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:12.076 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.065+0000 7ff12fa9b700 1 -- 172.21.15.27:0/892274968 shutdown_connections 2023-07-05T23:35:12.076 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.065+0000 7ff12fa9b700 1 -- 172.21.15.27:0/892274968 wait complete. 2023-07-05T23:35:12.076 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.066+0000 7ff12fa9b700 1 Processor -- start 2023-07-05T23:35:12.076 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.066+0000 7ff12fa9b700 1 -- start start 2023-07-05T23:35:12.077 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.066+0000 7ff12fa9b700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff12806e970 0x7ff128153f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:12.077 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.066+0000 7ff12fa9b700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1280aecc0 0x7ff1280c9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:12.077 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.066+0000 7ff12fa9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff12815fc60 0x7ff1280b3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:12.077 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.066+0000 7ff12fa9b700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1280c9a80 con 0x7ff12815fc60 2023-07-05T23:35:12.077 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.066+0000 7ff12fa9b700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1280b4360 con 0x7ff1280aecc0 2023-07-05T23:35:12.078 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.066+0000 7ff12fa9b700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1280cb090 con 0x7ff12806e970 2023-07-05T23:35:12.078 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.067+0000 7ff12e038700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff12815fc60 0x7ff1280b3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:12.078 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.067+0000 7ff12e038700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff12815fc60 0x7ff1280b3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46230/0 (socket says 172.21.15.27:46230) 2023-07-05T23:35:12.078 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.067+0000 7ff12e038700 1 -- 172.21.15.27:0/1941703935 learned_addr learned my addr 172.21.15.27:0/1941703935 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:12.078 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.067+0000 7ff12d036700 1 --2- 172.21.15.27:0/1941703935 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1280aecc0 0x7ff1280c9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:12.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.067+0000 7ff12d837700 1 --2- 172.21.15.27:0/1941703935 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff12806e970 0x7ff128153f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:12.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.067+0000 7ff12e038700 1 -- 172.21.15.27:0/1941703935 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff12806e970 msgr2=0x7ff128153f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:12.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.067+0000 7ff12e038700 1 --2- 172.21.15.27:0/1941703935 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff12806e970 0x7ff128153f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:12.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.067+0000 7ff12e038700 1 -- 172.21.15.27:0/1941703935 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1280aecc0 msgr2=0x7ff1280c9540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:12.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.067+0000 7ff12e038700 1 --2- 172.21.15.27:0/1941703935 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1280aecc0 0x7ff1280c9540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:12.080 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.067+0000 7ff12e038700 1 -- 172.21.15.27:0/1941703935 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1240094a0 con 0x7ff12815fc60 2023-07-05T23:35:12.080 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.067+0000 7ff12d036700 1 --2- 172.21.15.27:0/1941703935 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1280aecc0 0x7ff1280c9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T23:35:12.080 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.067+0000 7ff12d837700 1 --2- 172.21.15.27:0/1941703935 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff12806e970 0x7ff128153f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T23:35:12.080 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.067+0000 7ff12e038700 1 --2- 172.21.15.27:0/1941703935 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff12815fc60 0x7ff1280b3e20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff1281609a0 tx=0x7ff120004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:12.080 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.067+0000 7ff11e7fc700 1 -- 172.21.15.27:0/1941703935 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1200099b0 con 0x7ff12815fc60 2023-07-05T23:35:12.081 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.067+0000 7ff11e7fc700 1 -- 172.21.15.27:0/1941703935 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1200092e0 con 0x7ff12815fc60 2023-07-05T23:35:12.081 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.067+0000 7ff12fa9b700 1 -- 172.21.15.27:0/1941703935 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff120009b30 con 0x7ff12815fc60 2023-07-05T23:35:12.081 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.067+0000 7ff11e7fc700 1 -- 172.21.15.27:0/1941703935 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff12001c660 con 0x7ff12815fc60 2023-07-05T23:35:12.081 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.067+0000 7ff12fa9b700 1 -- 172.21.15.27:0/1941703935 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1281f3820 con 0x7ff12815fc60 2023-07-05T23:35:12.081 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.068+0000 7ff12fa9b700 1 -- 172.21.15.27:0/1941703935 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1280cb240 con 0x7ff12815fc60 2023-07-05T23:35:12.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.069+0000 7ff11e7fc700 1 -- 172.21.15.27:0/1941703935 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff12001c7c0 con 0x7ff12815fc60 2023-07-05T23:35:12.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.069+0000 7ff11e7fc700 1 --2- 172.21.15.27:0/1941703935 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7ff10c06ace0 0x7ff10c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:12.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.069+0000 7ff11e7fc700 1 -- 172.21.15.27:0/1941703935 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff12008b4a0 con 0x7ff12815fc60 2023-07-05T23:35:12.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.070+0000 7ff12d837700 1 --2- 172.21.15.27:0/1941703935 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7ff10c06ace0 0x7ff10c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:12.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.070+0000 7ff12d837700 1 --2- 172.21.15.27:0/1941703935 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7ff10c06ace0 0x7ff10c06d190 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff118007fd0 tx=0x7ff118007d80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:12.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.074+0000 7ff11e7fc700 1 -- 172.21.15.27:0/1941703935 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff1280cb240 con 0x7ff12815fc60 2023-07-05T23:35:12.276 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.273+0000 7ff12fa9b700 1 -- 172.21.15.27:0/1941703935 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff1280cb200 con 0x7ff12815fc60 2023-07-05T23:35:12.276 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.273+0000 7ff11e7fc700 1 -- 172.21.15.27:0/1941703935 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff120056230 con 0x7ff12815fc60 2023-07-05T23:35:12.277 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2023-07-05T23:35:12.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.275+0000 7ff12fa9b700 1 -- 172.21.15.27:0/1941703935 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7ff10c06ace0 msgr2=0x7ff10c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:12.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.275+0000 7ff12fa9b700 1 --2- 172.21.15.27:0/1941703935 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7ff10c06ace0 0x7ff10c06d190 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff118007fd0 tx=0x7ff118007d80 comp rx=0 tx=0).stop 2023-07-05T23:35:12.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.275+0000 7ff12fa9b700 1 -- 172.21.15.27:0/1941703935 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff12815fc60 msgr2=0x7ff1280b3e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:12.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.275+0000 7ff12fa9b700 1 --2- 172.21.15.27:0/1941703935 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff12815fc60 0x7ff1280b3e20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff1281609a0 tx=0x7ff120004ad0 comp rx=0 tx=0).stop 2023-07-05T23:35:12.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.275+0000 7ff12fa9b700 1 -- 172.21.15.27:0/1941703935 shutdown_connections 2023-07-05T23:35:12.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.275+0000 7ff12fa9b700 1 --2- 172.21.15.27:0/1941703935 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7ff10c06ace0 0x7ff10c06d190 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:12.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.275+0000 7ff12fa9b700 1 --2- 172.21.15.27:0/1941703935 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff12815fc60 0x7ff1280b3e20 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:12.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.275+0000 7ff12fa9b700 1 --2- 172.21.15.27:0/1941703935 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff12806e970 0x7ff128153f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:12.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.275+0000 7ff12fa9b700 1 --2- 172.21.15.27:0/1941703935 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1280aecc0 0x7ff1280c9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:12.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.275+0000 7ff12fa9b700 1 -- 172.21.15.27:0/1941703935 >> 172.21.15.27:0/1941703935 conn(0x7ff12806b920 msgr2=0x7ff1280b1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:12.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.275+0000 7ff12fa9b700 1 -- 172.21.15.27:0/1941703935 shutdown_connections 2023-07-05T23:35:12.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.275+0000 7ff12fa9b700 1 -- 172.21.15.27:0/1941703935 wait complete. 2023-07-05T23:35:12.290 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-05T23:35:12.536 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.531+0000 7f8960494700 1 Processor -- start 2023-07-05T23:35:12.537 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.531+0000 7f8960494700 1 -- start start 2023-07-05T23:35:12.537 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.533+0000 7f8960494700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89580d0a60 0x7f89580b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:12.537 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.533+0000 7f8960494700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89580cd9d0 con 0x7f89580b51d0 2023-07-05T23:35:12.537 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.533+0000 7f8960494700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89580b5640 con 0x7f89580cf910 2023-07-05T23:35:12.538 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.533+0000 7f8960494700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89580d0060 con 0x7f89580d0a60 2023-07-05T23:35:12.538 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.534+0000 7f895da2f700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f89580b51d0 0x7f89580d0e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:53402/0 (socket says 172.21.15.27:53402) 2023-07-05T23:35:12.539 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.534+0000 7f895da2f700 1 -- 172.21.15.27:0/1070957665 learned_addr learned my addr 172.21.15.27:0/1070957665 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-07-05T23:35:12.539 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.534+0000 7f895d22e700 1 -- 172.21.15.27:0/1070957665 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 237083049 0 0) 0x7f89580cd9d0 con 0x7f89580b51d0 2023-07-05T23:35:12.539 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.534+0000 7f895d22e700 1 -- 172.21.15.27:0/1070957665 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89440035b0 con 0x7f89580b51d0 2023-07-05T23:35:12.539 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.534+0000 7f895e230700 1 --2- 172.21.15.27:0/1070957665 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89580d0a60 0x7f89580b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:12.539 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.535+0000 7f895d22e700 1 -- 172.21.15.27:0/1070957665 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3656382986 0 0) 0x7f89440035b0 con 0x7f89580b51d0 2023-07-05T23:35:12.540 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.535+0000 7f895d22e700 1 -- 172.21.15.27:0/1070957665 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89580d0a60 msgr2=0x7f89580b5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:35:12.540 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.535+0000 7f895d22e700 1 --2- 172.21.15.27:0/1070957665 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89580d0a60 0x7f89580b5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:12.540 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.535+0000 7f895d22e700 1 -- 172.21.15.27:0/1070957665 >> v1:172.21.15.162:6789/0 conn(0x7f89580cf910 legacy=0x7f89580d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:35:12.540 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.535+0000 7f895d22e700 1 -- 172.21.15.27:0/1070957665 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89580cfd90 con 0x7f89580b51d0 2023-07-05T23:35:12.540 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.535+0000 7f895d22e700 1 -- 172.21.15.27:0/1070957665 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1246168953 0 0) 0x7f8948001670 con 0x7f89580b51d0 2023-07-05T23:35:12.541 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.535+0000 7f895d22e700 1 -- 172.21.15.27:0/1070957665 >> v1:172.21.15.27:6789/0 conn(0x7f89580b51d0 legacy=0x7f89580d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:12.541 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.535+0000 7f895d22e700 1 --2- 172.21.15.27:0/1070957665 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8944003a30 0x7f8944003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:12.541 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.535+0000 7f895d22e700 1 --2- 172.21.15.27:0/1070957665 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89580d0a60 0x7f8944004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:12.541 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.535+0000 7f895d22e700 1 --2- 172.21.15.27:0/1070957665 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8944004d90 0x7f8944005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:12.541 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.535+0000 7f895d22e700 1 -- 172.21.15.27:0/1070957665 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89580d0060 con 0x7f8944004d90 2023-07-05T23:35:12.542 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.535+0000 7f895d22e700 1 -- 172.21.15.27:0/1070957665 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f894400bac0 con 0x7f8944003a30 2023-07-05T23:35:12.542 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.535+0000 7f895d22e700 1 -- 172.21.15.27:0/1070957665 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f894400bc80 con 0x7f89580d0a60 2023-07-05T23:35:12.542 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.535+0000 7f895ea31700 1 --2- 172.21.15.27:0/1070957665 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8944004d90 0x7f8944005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:12.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.536+0000 7f895da2f700 1 --2- 172.21.15.27:0/1070957665 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89580d0a60 0x7f8944004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:12.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.536+0000 7f895ea31700 1 -- 172.21.15.27:0/1070957665 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89580d0a60 msgr2=0x7f8944004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:35:12.544 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.536+0000 7f895ea31700 1 --2- 172.21.15.27:0/1070957665 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89580d0a60 0x7f8944004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:12.544 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.536+0000 7f895ea31700 1 -- 172.21.15.27:0/1070957665 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8944003a30 msgr2=0x7f8944003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:35:12.544 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.536+0000 7f895ea31700 1 --2- 172.21.15.27:0/1070957665 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8944003a30 0x7f8944003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:12.544 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.536+0000 7f895ea31700 1 -- 172.21.15.27:0/1070957665 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89440035b0 con 0x7f8944004d90 2023-07-05T23:35:12.544 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.537+0000 7f895ea31700 1 --2- 172.21.15.27:0/1070957665 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8944004d90 0x7f8944005200 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8950001db0 tx=0x7f8944005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5643c0d79b7afc7 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:12.545 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.537+0000 7f895d22e700 1 -- 172.21.15.27:0/1070957665 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8950001850 con 0x7f8944004d90 2023-07-05T23:35:12.545 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.537+0000 7f895d22e700 1 -- 172.21.15.27:0/1070957665 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8950003c20 con 0x7f8944004d90 2023-07-05T23:35:12.545 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.537+0000 7f895d22e700 1 -- 172.21.15.27:0/1070957665 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89500050d0 con 0x7f8944004d90 2023-07-05T23:35:12.545 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.538+0000 7f8960494700 1 -- 172.21.15.27:0/1070957665 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8944004d90 msgr2=0x7f8944005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:12.545 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.538+0000 7f8960494700 1 --2- 172.21.15.27:0/1070957665 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8944004d90 0x7f8944005200 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8950001db0 tx=0x7f8944005880 comp rx=0 tx=0).stop 2023-07-05T23:35:12.546 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.538+0000 7f895ea31700 1 -- 172.21.15.27:0/1070957665 reap_dead start 2023-07-05T23:35:12.546 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.539+0000 7f8960494700 1 -- 172.21.15.27:0/1070957665 shutdown_connections 2023-07-05T23:35:12.546 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.539+0000 7f8960494700 1 -- 172.21.15.27:0/1070957665 >> 172.21.15.27:0/1070957665 conn(0x7f8958071620 msgr2=0x7f89580719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:12.546 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.539+0000 7f8960494700 1 -- 172.21.15.27:0/1070957665 shutdown_connections 2023-07-05T23:35:12.546 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.539+0000 7f8960494700 1 -- 172.21.15.27:0/1070957665 wait complete. 2023-07-05T23:35:12.547 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.541+0000 7f8960494700 1 Processor -- start 2023-07-05T23:35:12.547 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.541+0000 7f8960494700 1 -- start start 2023-07-05T23:35:12.548 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.543+0000 7f8960494700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8944004d90 0x7f8958153600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:12.548 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.543+0000 7f8960494700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8958152380 0x7f8958151c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:12.548 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.543+0000 7f8960494700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8958155190 0x7f8958155610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:12.548 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.543+0000 7f8960494700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8958155b50 con 0x7f8958152380 2023-07-05T23:35:12.549 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.543+0000 7f8960494700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8958153c90 con 0x7f8944004d90 2023-07-05T23:35:12.549 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.543+0000 7f8960494700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89581521a0 con 0x7f8958155190 2023-07-05T23:35:12.549 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.543+0000 7f895da2f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8958152380 0x7f8958151c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:12.549 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.543+0000 7f895da2f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8958152380 0x7f8958151c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46246/0 (socket says 172.21.15.27:46246) 2023-07-05T23:35:12.549 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.543+0000 7f895da2f700 1 -- 172.21.15.27:0/1496143863 learned_addr learned my addr 172.21.15.27:0/1496143863 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:12.550 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.544+0000 7f895da2f700 1 -- 172.21.15.27:0/1496143863 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8958155190 msgr2=0x7f8958155610 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-05T23:35:12.550 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.544+0000 7f895da2f700 1 --2- 172.21.15.27:0/1496143863 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8958155190 0x7f8958155610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:12.550 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.544+0000 7f895da2f700 1 -- 172.21.15.27:0/1496143863 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8944004d90 msgr2=0x7f8958153600 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-05T23:35:12.550 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.544+0000 7f895da2f700 1 --2- 172.21.15.27:0/1496143863 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8944004d90 0x7f8958153600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:12.550 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.544+0000 7f895da2f700 1 -- 172.21.15.27:0/1496143863 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f895815e3c0 con 0x7f8958152380 2023-07-05T23:35:12.550 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.544+0000 7f895da2f700 1 --2- 172.21.15.27:0/1496143863 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8958152380 0x7f8958151c60 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8948000fb0 tx=0x7f894800ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:12.551 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.545+0000 7f894effd700 1 -- 172.21.15.27:0/1496143863 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894800ee90 con 0x7f8958152380 2023-07-05T23:35:12.551 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.545+0000 7f894effd700 1 -- 172.21.15.27:0/1496143863 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f894800c760 con 0x7f8958152380 2023-07-05T23:35:12.552 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.545+0000 7f8960494700 1 -- 172.21.15.27:0/1496143863 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f895815e6a0 con 0x7f8958152380 2023-07-05T23:35:12.552 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.546+0000 7f894effd700 1 -- 172.21.15.27:0/1496143863 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894800caf0 con 0x7f8958152380 2023-07-05T23:35:12.552 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.546+0000 7f8960494700 1 -- 172.21.15.27:0/1496143863 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8958155f10 con 0x7f8958152380 2023-07-05T23:35:12.555 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.549+0000 7f894effd700 1 -- 172.21.15.27:0/1496143863 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f894800cc50 con 0x7f8958152380 2023-07-05T23:35:12.555 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.550+0000 7f894effd700 1 --2- 172.21.15.27:0/1496143863 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f893c06ace0 0x7f893c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:12.555 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.550+0000 7f894effd700 1 -- 172.21.15.27:0/1496143863 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8948089660 con 0x7f8958152380 2023-07-05T23:35:12.555 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.550+0000 7f8960494700 1 -- 172.21.15.27:0/1496143863 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89580b6980 con 0x7f8958152380 2023-07-05T23:35:12.556 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.553+0000 7f895e230700 1 --2- 172.21.15.27:0/1496143863 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f893c06ace0 0x7f893c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:12.562 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.559+0000 7f895e230700 1 --2- 172.21.15.27:0/1496143863 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f893c06ace0 0x7f893c06d190 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8954004840 tx=0x7f8954006ab0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:12.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.564+0000 7f894effd700 1 -- 172.21.15.27:0/1496143863 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f89480543e0 con 0x7f8958152380 2023-07-05T23:35:12.834 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.832+0000 7f8960494700 1 -- 172.21.15.27:0/1496143863 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f895804ea20 con 0x7f8958152380 2023-07-05T23:35:12.835 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.832+0000 7f894effd700 1 -- 172.21.15.27:0/1496143863 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8948057a00 con 0x7f8958152380 2023-07-05T23:35:12.835 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 8 2023-07-05T23:35:12.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.834+0000 7f8960494700 1 -- 172.21.15.27:0/1496143863 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f893c06ace0 msgr2=0x7f893c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:12.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.834+0000 7f8960494700 1 --2- 172.21.15.27:0/1496143863 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f893c06ace0 0x7f893c06d190 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8954004840 tx=0x7f8954006ab0 comp rx=0 tx=0).stop 2023-07-05T23:35:12.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.834+0000 7f8960494700 1 -- 172.21.15.27:0/1496143863 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8958152380 msgr2=0x7f8958151c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:12.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.834+0000 7f8960494700 1 --2- 172.21.15.27:0/1496143863 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8958152380 0x7f8958151c60 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8948000fb0 tx=0x7f894800ec50 comp rx=0 tx=0).stop 2023-07-05T23:35:12.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.834+0000 7f8960494700 1 -- 172.21.15.27:0/1496143863 shutdown_connections 2023-07-05T23:35:12.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.834+0000 7f8960494700 1 --2- 172.21.15.27:0/1496143863 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8944004d90 0x7f8958153600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:12.839 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.834+0000 7f8960494700 1 --2- 172.21.15.27:0/1496143863 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f893c06ace0 0x7f893c06d190 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:12.839 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.834+0000 7f8960494700 1 --2- 172.21.15.27:0/1496143863 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8958155190 0x7f8958155610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:12.839 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.834+0000 7f8960494700 1 --2- 172.21.15.27:0/1496143863 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8958152380 0x7f8958151c60 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:12.839 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.834+0000 7f8960494700 1 -- 172.21.15.27:0/1496143863 >> 172.21.15.27:0/1496143863 conn(0x7f8958071620 msgr2=0x7f89580cee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:12.839 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.834+0000 7f8960494700 1 -- 172.21.15.27:0/1496143863 shutdown_connections 2023-07-05T23:35:12.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.834+0000 7f8960494700 1 -- 172.21.15.27:0/1496143863 wait complete. 2023-07-05T23:35:12.849 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-05T23:35:12.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.980+0000 7f2f0e629700 1 Processor -- start 2023-07-05T23:35:12.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.980+0000 7f2f0e629700 1 -- start start 2023-07-05T23:35:12.985 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.981+0000 7f2f0e629700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2f080cd5e0 0x7f2f080cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:12.985 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.981+0000 7f2f0e629700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2f0806e030 0x7f2f0806e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:12.986 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.981+0000 7f2f0e629700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2f0815cf70 0x7f2f0815d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:12.986 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.981+0000 7f2f0e629700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f080ce2c0 con 0x7f2f080cd5e0 2023-07-05T23:35:12.986 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.981+0000 7f2f0e629700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f0806f0e0 con 0x7f2f0806e030 2023-07-05T23:35:12.986 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.981+0000 7f2f0e629700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f080cdef0 con 0x7f2f0815cf70 2023-07-05T23:35:12.986 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.981+0000 7f2f07fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2f080cd5e0 0x7f2f080cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:12.987 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.981+0000 7f2f07fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2f080cd5e0 0x7f2f080cd9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46254/0 (socket says 172.21.15.27:46254) 2023-07-05T23:35:12.987 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.981+0000 7f2f07fff700 1 -- 172.21.15.27:0/2053536965 learned_addr learned my addr 172.21.15.27:0/2053536965 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:12.987 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.981+0000 7f2f077fe700 1 --2- 172.21.15.27:0/2053536965 >> v2:172.21.15.162:3300/0 conn(0x7f2f0806e030 0x7f2f0806e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:12.987 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.981+0000 7f2f0cbc6700 1 --2- 172.21.15.27:0/2053536965 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2f0815cf70 0x7f2f0815d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:12.987 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.981+0000 7f2f07fff700 1 -- 172.21.15.27:0/2053536965 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2f0815cf70 msgr2=0x7f2f0815d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:35:12.988 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.981+0000 7f2f07fff700 1 --2- 172.21.15.27:0/2053536965 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2f0815cf70 0x7f2f0815d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:12.988 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.981+0000 7f2f07fff700 1 -- 172.21.15.27:0/2053536965 >> v2:172.21.15.162:3300/0 conn(0x7f2f0806e030 msgr2=0x7f2f0806e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:35:12.988 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.981+0000 7f2f07fff700 1 --2- 172.21.15.27:0/2053536965 >> v2:172.21.15.162:3300/0 conn(0x7f2f0806e030 0x7f2f0806e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:12.988 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.981+0000 7f2f07fff700 1 -- 172.21.15.27:0/2053536965 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f0806eb20 con 0x7f2f080cd5e0 2023-07-05T23:35:12.988 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.981+0000 7f2f07fff700 1 --2- 172.21.15.27:0/2053536965 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2f080cd5e0 0x7f2f080cd9b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f2f0815ced0 tx=0x7f2ef8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee1ff5a8aff60299 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:12.989 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.982+0000 7f2f06ffd700 1 -- 172.21.15.27:0/2053536965 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef8005e30 con 0x7f2f080cd5e0 2023-07-05T23:35:12.989 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.982+0000 7f2f06ffd700 1 -- 172.21.15.27:0/2053536965 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ef8004030 con 0x7f2f080cd5e0 2023-07-05T23:35:12.989 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.982+0000 7f2f06ffd700 1 -- 172.21.15.27:0/2053536965 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef80043e0 con 0x7f2f080cd5e0 2023-07-05T23:35:12.989 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.982+0000 7f2f0e629700 1 -- 172.21.15.27:0/2053536965 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2f080cd5e0 msgr2=0x7f2f080cd9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:12.989 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.982+0000 7f2f0e629700 1 --2- 172.21.15.27:0/2053536965 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2f080cd5e0 0x7f2f080cd9b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f2f0815ced0 tx=0x7f2ef8009bd0 comp rx=0 tx=0).stop 2023-07-05T23:35:12.990 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.982+0000 7f2f0e629700 1 -- 172.21.15.27:0/2053536965 shutdown_connections 2023-07-05T23:35:12.990 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.982+0000 7f2f0e629700 1 --2- 172.21.15.27:0/2053536965 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2f0815cf70 0x7f2f0815d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:12.990 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.982+0000 7f2f0e629700 1 --2- 172.21.15.27:0/2053536965 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2f080cd5e0 0x7f2f080cd9b0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:12.990 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.982+0000 7f2f0e629700 1 --2- 172.21.15.27:0/2053536965 >> v2:172.21.15.162:3300/0 conn(0x7f2f0806e030 0x7f2f0806e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:12.990 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.982+0000 7f2f0e629700 1 -- 172.21.15.27:0/2053536965 >> 172.21.15.27:0/2053536965 conn(0x7f2f0806b920 msgr2=0x7f2f080cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:12.991 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.982+0000 7f2f0e629700 1 -- 172.21.15.27:0/2053536965 shutdown_connections 2023-07-05T23:35:12.991 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.982+0000 7f2f0e629700 1 -- 172.21.15.27:0/2053536965 wait complete. 2023-07-05T23:35:12.993 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.983+0000 7f2f0e629700 1 Processor -- start 2023-07-05T23:35:12.993 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.984+0000 7f2f0e629700 1 -- start start 2023-07-05T23:35:12.994 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.984+0000 7f2f0e629700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2f0806e030 0x7f2f08141200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:12.994 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.984+0000 7f2f0e629700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f080cd5e0 0x7f2f080c3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:12.994 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.984+0000 7f2f0e629700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2f0815cf70 0x7f2f0815c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:12.994 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.984+0000 7f2f0e629700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f080c3aa0 con 0x7f2f0815cf70 2023-07-05T23:35:12.994 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.984+0000 7f2f0e629700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f080c59a0 con 0x7f2f080cd5e0 2023-07-05T23:35:12.995 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.984+0000 7f2f0e629700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f080c64e0 con 0x7f2f0806e030 2023-07-05T23:35:12.995 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.984+0000 7f2f0cbc6700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2f0815cf70 0x7f2f0815c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:12.995 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.984+0000 7f2f0cbc6700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2f0815cf70 0x7f2f0815c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46264/0 (socket says 172.21.15.27:46264) 2023-07-05T23:35:12.995 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.984+0000 7f2f0cbc6700 1 -- 172.21.15.27:0/1742510553 learned_addr learned my addr 172.21.15.27:0/1742510553 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:12.995 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.985+0000 7f2f077fe700 1 --2- 172.21.15.27:0/1742510553 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f080cd5e0 0x7f2f080c3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:12.996 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.985+0000 7f2f07fff700 1 --2- 172.21.15.27:0/1742510553 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2f0806e030 0x7f2f08141200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:12.996 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.985+0000 7f2f0cbc6700 1 -- 172.21.15.27:0/1742510553 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2f0806e030 msgr2=0x7f2f08141200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:12.996 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.985+0000 7f2f0cbc6700 1 --2- 172.21.15.27:0/1742510553 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2f0806e030 0x7f2f08141200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:12.996 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.985+0000 7f2f0cbc6700 1 -- 172.21.15.27:0/1742510553 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f080cd5e0 msgr2=0x7f2f080c3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:12.996 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.985+0000 7f2f0cbc6700 1 --2- 172.21.15.27:0/1742510553 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f080cd5e0 0x7f2f080c3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:12.997 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.985+0000 7f2f0cbc6700 1 -- 172.21.15.27:0/1742510553 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef8009500 con 0x7f2f0815cf70 2023-07-05T23:35:12.997 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.985+0000 7f2f07fff700 1 --2- 172.21.15.27:0/1742510553 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2f0806e030 0x7f2f08141200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T23:35:12.997 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.985+0000 7f2f0cbc6700 1 --2- 172.21.15.27:0/1742510553 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2f0815cf70 0x7f2f0815c160 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2f00009d30 tx=0x7f2f0000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:12.997 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.985+0000 7f2f04ff9700 1 -- 172.21.15.27:0/1742510553 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f00009ba0 con 0x7f2f0815cf70 2023-07-05T23:35:12.997 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.985+0000 7f2f04ff9700 1 -- 172.21.15.27:0/1742510553 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f0000f040 con 0x7f2f0815cf70 2023-07-05T23:35:12.998 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.985+0000 7f2f04ff9700 1 -- 172.21.15.27:0/1742510553 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f00014480 con 0x7f2f0815cf70 2023-07-05T23:35:12.998 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.985+0000 7f2f0e629700 1 -- 172.21.15.27:0/1742510553 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f080c37d0 con 0x7f2f0815cf70 2023-07-05T23:35:12.998 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.985+0000 7f2f0e629700 1 -- 172.21.15.27:0/1742510553 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f080c5e90 con 0x7f2f0815cf70 2023-07-05T23:35:12.998 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.986+0000 7f2f0e629700 1 -- 172.21.15.27:0/1742510553 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f08156530 con 0x7f2f0815cf70 2023-07-05T23:35:12.998 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.986+0000 7f2f04ff9700 1 -- 172.21.15.27:0/1742510553 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2f000145e0 con 0x7f2f0815cf70 2023-07-05T23:35:12.998 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.987+0000 7f2f04ff9700 1 --2- 172.21.15.27:0/1742510553 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f2ee806ace0 0x7f2ee806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:12.999 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.987+0000 7f2f04ff9700 1 -- 172.21.15.27:0/1742510553 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2f0008a4e0 con 0x7f2f0815cf70 2023-07-05T23:35:12.999 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.987+0000 7f2f07fff700 1 --2- 172.21.15.27:0/1742510553 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f2ee806ace0 0x7f2ee806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:12.999 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.988+0000 7f2f07fff700 1 --2- 172.21.15.27:0/1742510553 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f2ee806ace0 0x7f2ee806d190 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2ef8014040 tx=0x7f2ef8008070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:13.000 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:12.991+0000 7f2f04ff9700 1 -- 172.21.15.27:0/1742510553 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2f08156530 con 0x7f2f0815cf70 2023-07-05T23:35:13.194 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.191+0000 7f2f0e629700 1 -- 172.21.15.27:0/1742510553 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2f08156530 con 0x7f2f0815cf70 2023-07-05T23:35:13.194 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.191+0000 7f2f04ff9700 1 -- 172.21.15.27:0/1742510553 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2f00018020 con 0x7f2f0815cf70 2023-07-05T23:35:13.195 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 32 2023-07-05T23:35:13.196 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.193+0000 7f2f0e629700 1 -- 172.21.15.27:0/1742510553 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f2ee806ace0 msgr2=0x7f2ee806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:13.196 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.193+0000 7f2f0e629700 1 --2- 172.21.15.27:0/1742510553 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f2ee806ace0 0x7f2ee806d190 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2ef8014040 tx=0x7f2ef8008070 comp rx=0 tx=0).stop 2023-07-05T23:35:13.197 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.193+0000 7f2f0e629700 1 -- 172.21.15.27:0/1742510553 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2f0815cf70 msgr2=0x7f2f0815c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:13.197 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.193+0000 7f2f0e629700 1 --2- 172.21.15.27:0/1742510553 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2f0815cf70 0x7f2f0815c160 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2f00009d30 tx=0x7f2f0000c3a0 comp rx=0 tx=0).stop 2023-07-05T23:35:13.197 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.193+0000 7f2f0e629700 1 -- 172.21.15.27:0/1742510553 shutdown_connections 2023-07-05T23:35:13.197 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.193+0000 7f2f0e629700 1 --2- 172.21.15.27:0/1742510553 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f2ee806ace0 0x7f2ee806d190 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:13.198 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.193+0000 7f2f0e629700 1 --2- 172.21.15.27:0/1742510553 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2f0815cf70 0x7f2f0815c160 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:13.198 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.193+0000 7f2f0e629700 1 --2- 172.21.15.27:0/1742510553 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2f0806e030 0x7f2f08141200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:13.198 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.193+0000 7f2f0e629700 1 --2- 172.21.15.27:0/1742510553 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f080cd5e0 0x7f2f080c3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:13.198 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.193+0000 7f2f0e629700 1 -- 172.21.15.27:0/1742510553 >> 172.21.15.27:0/1742510553 conn(0x7f2f0806b920 msgr2=0x7f2f08069ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:13.198 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.193+0000 7f2f0e629700 1 -- 172.21.15.27:0/1742510553 shutdown_connections 2023-07-05T23:35:13.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.193+0000 7f2f0e629700 1 -- 172.21.15.27:0/1742510553 wait complete. 2023-07-05T23:35:13.209 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-05T23:35:13.337 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.334+0000 7f65432dd700 1 Processor -- start 2023-07-05T23:35:13.337 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.334+0000 7f65432dd700 1 -- start start 2023-07-05T23:35:13.339 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.335+0000 7f65432dd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f653c06e030 0x7f653c06e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:13.339 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.335+0000 7f65432dd700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f653c06f0e0 con 0x7f653c0cd5e0 2023-07-05T23:35:13.339 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.335+0000 7f65432dd700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f653c06eb20 con 0x7f653c0acf30 2023-07-05T23:35:13.339 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.335+0000 7f65432dd700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f653c0ce2c0 con 0x7f653c06e030 2023-07-05T23:35:13.340 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.335+0000 7f6540878700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f653c06e030 0x7f653c06e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:13.340 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.335+0000 7f6540878700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f653c06e030 0x7f653c06e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46270/0 (socket says 172.21.15.27:46270) 2023-07-05T23:35:13.340 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.335+0000 7f6540878700 1 -- 172.21.15.27:0/775943471 learned_addr learned my addr 172.21.15.27:0/775943471 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:13.340 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.335+0000 7f6540878700 1 -- 172.21.15.27:0/775943471 >> v1:172.21.15.162:6789/0 conn(0x7f653c0acf30 legacy=0x7f653c0ad350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:35:13.340 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.335+0000 7f6540878700 1 -- 172.21.15.27:0/775943471 >> v1:172.21.15.27:6789/0 conn(0x7f653c0cd5e0 legacy=0x7f653c0cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:13.341 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.335+0000 7f6540878700 1 -- 172.21.15.27:0/775943471 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f653c06ee00 con 0x7f653c06e030 2023-07-05T23:35:13.341 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.335+0000 7f6540878700 1 --2- 172.21.15.27:0/775943471 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f653c06e030 0x7f653c06e4d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f65380098f0 tx=0x7f6538009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c4cef63acbed498 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:13.341 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.336+0000 7f6533fff700 1 -- 172.21.15.27:0/775943471 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6538004230 con 0x7f653c06e030 2023-07-05T23:35:13.341 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.336+0000 7f6533fff700 1 -- 172.21.15.27:0/775943471 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6538004390 con 0x7f653c06e030 2023-07-05T23:35:13.341 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.336+0000 7f6533fff700 1 -- 172.21.15.27:0/775943471 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65380036a0 con 0x7f653c06e030 2023-07-05T23:35:13.342 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.336+0000 7f65432dd700 1 -- 172.21.15.27:0/775943471 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f653c06e030 msgr2=0x7f653c06e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:13.342 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.336+0000 7f65432dd700 1 --2- 172.21.15.27:0/775943471 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f653c06e030 0x7f653c06e4d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f65380098f0 tx=0x7f6538009c00 comp rx=0 tx=0).stop 2023-07-05T23:35:13.344 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.336+0000 7f65432dd700 1 -- 172.21.15.27:0/775943471 shutdown_connections 2023-07-05T23:35:13.344 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.336+0000 7f65432dd700 1 --2- 172.21.15.27:0/775943471 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f653c06e030 0x7f653c06e4d0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:13.345 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.336+0000 7f65432dd700 1 -- 172.21.15.27:0/775943471 >> 172.21.15.27:0/775943471 conn(0x7f653c06b920 msgr2=0x7f653c0cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:13.345 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.336+0000 7f65432dd700 1 -- 172.21.15.27:0/775943471 shutdown_connections 2023-07-05T23:35:13.345 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.336+0000 7f65432dd700 1 -- 172.21.15.27:0/775943471 wait complete. 2023-07-05T23:35:13.345 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.338+0000 7f65432dd700 1 Processor -- start 2023-07-05T23:35:13.345 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.338+0000 7f65432dd700 1 -- start start 2023-07-05T23:35:13.346 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.338+0000 7f65432dd700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f653c06e030 0x7f653c1527c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:13.346 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.338+0000 7f65432dd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f653c0acf30 0x7f653c1f2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:13.346 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.338+0000 7f65432dd700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f653c0cd5e0 0x7f653c14d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:13.346 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.338+0000 7f65432dd700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f653c1f3230 con 0x7f653c0acf30 2023-07-05T23:35:13.346 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.338+0000 7f65432dd700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f653c14cc00 con 0x7f653c06e030 2023-07-05T23:35:13.347 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.338+0000 7f65432dd700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f653c1f3460 con 0x7f653c0cd5e0 2023-07-05T23:35:13.347 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.338+0000 7f6540878700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f653c0acf30 0x7f653c1f2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:13.347 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.338+0000 7f6540878700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f653c0acf30 0x7f653c1f2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46276/0 (socket says 172.21.15.27:46276) 2023-07-05T23:35:13.347 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.338+0000 7f6540878700 1 -- 172.21.15.27:0/3408525214 learned_addr learned my addr 172.21.15.27:0/3408525214 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:13.347 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.339+0000 7f6541079700 1 --2- 172.21.15.27:0/3408525214 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f653c06e030 0x7f653c1527c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:13.348 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.339+0000 7f654187a700 1 --2- 172.21.15.27:0/3408525214 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f653c0cd5e0 0x7f653c14d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:13.348 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.339+0000 7f6540878700 1 -- 172.21.15.27:0/3408525214 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f653c0cd5e0 msgr2=0x7f653c14d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:13.348 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.339+0000 7f6540878700 1 --2- 172.21.15.27:0/3408525214 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f653c0cd5e0 0x7f653c14d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:13.348 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.339+0000 7f6540878700 1 -- 172.21.15.27:0/3408525214 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f653c06e030 msgr2=0x7f653c1527c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:13.348 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.339+0000 7f6540878700 1 --2- 172.21.15.27:0/3408525214 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f653c06e030 0x7f653c1527c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:13.349 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.339+0000 7f6540878700 1 -- 172.21.15.27:0/3408525214 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6538009550 con 0x7f653c0acf30 2023-07-05T23:35:13.349 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.339+0000 7f6541079700 1 --2- 172.21.15.27:0/3408525214 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f653c06e030 0x7f653c1527c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T23:35:13.349 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.339+0000 7f654187a700 1 --2- 172.21.15.27:0/3408525214 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f653c0cd5e0 0x7f653c14d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T23:35:13.349 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.339+0000 7f6540878700 1 --2- 172.21.15.27:0/3408525214 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f653c0acf30 0x7f653c1f2cf0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f653c06fca0 tx=0x7f6538004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:13.349 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.339+0000 7f6531ffb700 1 -- 172.21.15.27:0/3408525214 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f653800b6a0 con 0x7f653c0acf30 2023-07-05T23:35:13.350 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.339+0000 7f6531ffb700 1 -- 172.21.15.27:0/3408525214 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f653800b820 con 0x7f653c0acf30 2023-07-05T23:35:13.350 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.339+0000 7f65432dd700 1 -- 172.21.15.27:0/3408525214 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f653c1f3740 con 0x7f653c0acf30 2023-07-05T23:35:13.350 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.339+0000 7f6531ffb700 1 -- 172.21.15.27:0/3408525214 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f653800bbd0 con 0x7f653c0acf30 2023-07-05T23:35:13.350 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.339+0000 7f65432dd700 1 -- 172.21.15.27:0/3408525214 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f653c14ce50 con 0x7f653c0acf30 2023-07-05T23:35:13.350 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.340+0000 7f65432dd700 1 -- 172.21.15.27:0/3408525214 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f653c04ea20 con 0x7f653c0acf30 2023-07-05T23:35:13.351 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.341+0000 7f6531ffb700 1 -- 172.21.15.27:0/3408525214 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f653800bd30 con 0x7f653c0acf30 2023-07-05T23:35:13.351 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.341+0000 7f6531ffb700 1 --2- 172.21.15.27:0/3408525214 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f652006ace0 0x7f652006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:13.351 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.341+0000 7f6531ffb700 1 -- 172.21.15.27:0/3408525214 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f653808b2e0 con 0x7f653c0acf30 2023-07-05T23:35:13.351 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.342+0000 7f6541079700 1 --2- 172.21.15.27:0/3408525214 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f652006ace0 0x7f652006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:13.352 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.342+0000 7f6541079700 1 --2- 172.21.15.27:0/3408525214 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f652006ace0 0x7f652006d190 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f652c000fd0 tx=0x7f652c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:13.352 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.346+0000 7f6531ffb700 1 -- 172.21.15.27:0/3408525214 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6538056050 con 0x7f653c0acf30 2023-07-05T23:35:13.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.593+0000 7f65432dd700 1 -- 172.21.15.27:0/3408525214 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f653c067970 con 0x7f653c0acf30 2023-07-05T23:35:13.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.593+0000 7f6531ffb700 1 -- 172.21.15.27:0/3408525214 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6538059670 con 0x7f653c0acf30 2023-07-05T23:35:13.597 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2023-07-05T23:35:13.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.595+0000 7f65432dd700 1 -- 172.21.15.27:0/3408525214 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f652006ace0 msgr2=0x7f652006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:13.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.595+0000 7f65432dd700 1 --2- 172.21.15.27:0/3408525214 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f652006ace0 0x7f652006d190 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f652c000fd0 tx=0x7f652c009040 comp rx=0 tx=0).stop 2023-07-05T23:35:13.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.595+0000 7f65432dd700 1 -- 172.21.15.27:0/3408525214 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f653c0acf30 msgr2=0x7f653c1f2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:13.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.596+0000 7f65432dd700 1 --2- 172.21.15.27:0/3408525214 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f653c0acf30 0x7f653c1f2cf0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f653c06fca0 tx=0x7f6538004750 comp rx=0 tx=0).stop 2023-07-05T23:35:13.601 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.596+0000 7f65432dd700 1 -- 172.21.15.27:0/3408525214 shutdown_connections 2023-07-05T23:35:13.601 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.596+0000 7f65432dd700 1 --2- 172.21.15.27:0/3408525214 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f653c06e030 0x7f653c1527c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:13.602 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.596+0000 7f65432dd700 1 --2- 172.21.15.27:0/3408525214 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f652006ace0 0x7f652006d190 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:13.602 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.596+0000 7f65432dd700 1 --2- 172.21.15.27:0/3408525214 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f653c0cd5e0 0x7f653c14d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:13.602 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.596+0000 7f65432dd700 1 --2- 172.21.15.27:0/3408525214 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f653c0acf30 0x7f653c1f2cf0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:13.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.596+0000 7f65432dd700 1 -- 172.21.15.27:0/3408525214 >> 172.21.15.27:0/3408525214 conn(0x7f653c06b920 msgr2=0x7f653c0b0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:13.604 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.596+0000 7f65432dd700 1 -- 172.21.15.27:0/3408525214 shutdown_connections 2023-07-05T23:35:13.604 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.596+0000 7f65432dd700 1 -- 172.21.15.27:0/3408525214 wait complete. 2023-07-05T23:35:13.611 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-05T23:35:13.739 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.735+0000 7fbd22c86700 1 Processor -- start 2023-07-05T23:35:13.740 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.736+0000 7fbd22c86700 1 -- start start 2023-07-05T23:35:13.742 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.736+0000 7fbd22c86700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fbd1c0b23a0 0x7fbd1c06cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:13.742 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.736+0000 7fbd22c86700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fbd1c15d2d0 0x7fbd1c0b2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:13.742 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.736+0000 7fbd22c86700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd1c15c720 con 0x7fbd1c15fe40 2023-07-05T23:35:13.742 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.736+0000 7fbd22c86700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd1c15d820 con 0x7fbd1c15d2d0 2023-07-05T23:35:13.743 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.736+0000 7fbd22c86700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd1c0d03a0 con 0x7fbd1c0b23a0 2023-07-05T23:35:13.743 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.736+0000 7fbd1bfff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fbd1c15d2d0 0x7fbd1c0b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:13.743 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.737+0000 7fbd1bfff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fbd1c15d2d0 0x7fbd1c0b2770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46284/0 (socket says 172.21.15.27:46284) 2023-07-05T23:35:13.743 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.737+0000 7fbd1bfff700 1 -- 172.21.15.27:0/2178365226 learned_addr learned my addr 172.21.15.27:0/2178365226 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:13.744 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.737+0000 7fbd20a22700 1 --2- 172.21.15.27:0/2178365226 >> v2:172.21.15.162:3300/0 conn(0x7fbd1c0b23a0 0x7fbd1c06cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:13.744 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.737+0000 7fbd1bfff700 1 -- 172.21.15.27:0/2178365226 >> v2:172.21.15.162:3300/0 conn(0x7fbd1c0b23a0 msgr2=0x7fbd1c06cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:35:13.744 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.737+0000 7fbd1bfff700 1 --2- 172.21.15.27:0/2178365226 >> v2:172.21.15.162:3300/0 conn(0x7fbd1c0b23a0 0x7fbd1c06cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:13.744 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.737+0000 7fbd1bfff700 1 -- 172.21.15.27:0/2178365226 >> v1:172.21.15.27:6789/0 conn(0x7fbd1c15fe40 legacy=0x7fbd1c1602c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:13.744 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.737+0000 7fbd1b7fe700 1 -- 172.21.15.27:0/2178365226 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1532880526 0 0) 0x7fbd14001490 con 0x7fbd1c15fe40 2023-07-05T23:35:13.745 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.737+0000 7fbd1bfff700 1 -- 172.21.15.27:0/2178365226 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd1c0b2cb0 con 0x7fbd1c15d2d0 2023-07-05T23:35:13.745 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.737+0000 7fbd1bfff700 1 --2- 172.21.15.27:0/2178365226 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbd1c15d2d0 0x7fbd1c0b2770 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c0723c0 tx=0x7fbd08009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f048ab78a4c402f0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:13.745 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.737+0000 7fbd1b7fe700 1 -- 172.21.15.27:0/2178365226 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd08011830 con 0x7fbd1c15d2d0 2023-07-05T23:35:13.745 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.737+0000 7fbd1b7fe700 1 -- 172.21.15.27:0/2178365226 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd08011990 con 0x7fbd1c15d2d0 2023-07-05T23:35:13.745 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.737+0000 7fbd1b7fe700 1 -- 172.21.15.27:0/2178365226 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd08011d20 con 0x7fbd1c15d2d0 2023-07-05T23:35:13.745 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.738+0000 7fbd22c86700 1 -- 172.21.15.27:0/2178365226 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbd1c15d2d0 msgr2=0x7fbd1c0b2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:13.746 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.738+0000 7fbd22c86700 1 --2- 172.21.15.27:0/2178365226 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbd1c15d2d0 0x7fbd1c0b2770 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c0723c0 tx=0x7fbd08009bd0 comp rx=0 tx=0).stop 2023-07-05T23:35:13.746 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.738+0000 7fbd22c86700 1 -- 172.21.15.27:0/2178365226 shutdown_connections 2023-07-05T23:35:13.746 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.738+0000 7fbd22c86700 1 --2- 172.21.15.27:0/2178365226 >> v2:172.21.15.162:3300/0 conn(0x7fbd1c0b23a0 0x7fbd1c06cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:13.746 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.738+0000 7fbd22c86700 1 --2- 172.21.15.27:0/2178365226 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbd1c15d2d0 0x7fbd1c0b2770 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:13.747 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.738+0000 7fbd22c86700 1 -- 172.21.15.27:0/2178365226 >> 172.21.15.27:0/2178365226 conn(0x7fbd1c06e5c0 msgr2=0x7fbd1c06e990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:13.747 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.738+0000 7fbd22c86700 1 -- 172.21.15.27:0/2178365226 shutdown_connections 2023-07-05T23:35:13.747 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.738+0000 7fbd22c86700 1 -- 172.21.15.27:0/2178365226 wait complete. 2023-07-05T23:35:13.747 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.739+0000 7fbd22c86700 1 Processor -- start 2023-07-05T23:35:13.747 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.739+0000 7fbd22c86700 1 -- start start 2023-07-05T23:35:13.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.740+0000 7fbd22c86700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbd1c0b23a0 0x7fbd1c1f5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:13.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.740+0000 7fbd22c86700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd1c15d2d0 0x7fbd1c1f1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:13.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.740+0000 7fbd22c86700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd1c15fe40 0x7fbd1c1e6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:13.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.740+0000 7fbd22c86700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1c1546c0 con 0x7fbd1c0b23a0 2023-07-05T23:35:13.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.740+0000 7fbd22c86700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1c1e76b0 con 0x7fbd1c15d2d0 2023-07-05T23:35:13.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.740+0000 7fbd22c86700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1c0b4e60 con 0x7fbd1c15fe40 2023-07-05T23:35:13.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.740+0000 7fbd20a22700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbd1c0b23a0 0x7fbd1c1f5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:13.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.740+0000 7fbd20a22700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbd1c0b23a0 0x7fbd1c1f5850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46288/0 (socket says 172.21.15.27:46288) 2023-07-05T23:35:13.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.740+0000 7fbd20a22700 1 -- 172.21.15.27:0/4067619976 learned_addr learned my addr 172.21.15.27:0/4067619976 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:13.752 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.740+0000 7fbd1bfff700 1 --2- 172.21.15.27:0/4067619976 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd1c15d2d0 0x7fbd1c1f1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:13.752 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.740+0000 7fbd21223700 1 --2- 172.21.15.27:0/4067619976 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd1c15fe40 0x7fbd1c1e6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:13.752 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.740+0000 7fbd20a22700 1 -- 172.21.15.27:0/4067619976 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd1c15fe40 msgr2=0x7fbd1c1e6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:13.752 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.740+0000 7fbd20a22700 1 --2- 172.21.15.27:0/4067619976 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd1c15fe40 0x7fbd1c1e6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:13.752 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.740+0000 7fbd20a22700 1 -- 172.21.15.27:0/4067619976 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd1c15d2d0 msgr2=0x7fbd1c1f1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:13.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.740+0000 7fbd20a22700 1 --2- 172.21.15.27:0/4067619976 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd1c15d2d0 0x7fbd1c1f1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:13.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.740+0000 7fbd20a22700 1 -- 172.21.15.27:0/4067619976 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd08009550 con 0x7fbd1c0b23a0 2023-07-05T23:35:13.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.740+0000 7fbd1bfff700 1 --2- 172.21.15.27:0/4067619976 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd1c15d2d0 0x7fbd1c1f1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T23:35:13.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.740+0000 7fbd21223700 1 --2- 172.21.15.27:0/4067619976 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd1c15fe40 0x7fbd1c1e6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T23:35:13.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.741+0000 7fbd20a22700 1 --2- 172.21.15.27:0/4067619976 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbd1c0b23a0 0x7fbd1c1f5850 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fbd1000e9b0 tx=0x7fbd1000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:13.754 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.741+0000 7fbd197fa700 1 -- 172.21.15.27:0/4067619976 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd10009710 con 0x7fbd1c0b23a0 2023-07-05T23:35:13.754 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.741+0000 7fbd197fa700 1 -- 172.21.15.27:0/4067619976 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd1000c850 con 0x7fbd1c0b23a0 2023-07-05T23:35:13.754 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.741+0000 7fbd22c86700 1 -- 172.21.15.27:0/4067619976 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd1c0b5140 con 0x7fbd1c0b23a0 2023-07-05T23:35:13.754 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.741+0000 7fbd197fa700 1 -- 172.21.15.27:0/4067619976 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd1000cbc0 con 0x7fbd1c0b23a0 2023-07-05T23:35:13.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.741+0000 7fbd22c86700 1 -- 172.21.15.27:0/4067619976 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd1c0b5700 con 0x7fbd1c0b23a0 2023-07-05T23:35:13.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.742+0000 7fbd22c86700 1 -- 172.21.15.27:0/4067619976 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd1c0b58f0 con 0x7fbd1c0b23a0 2023-07-05T23:35:13.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.742+0000 7fbd197fa700 1 -- 172.21.15.27:0/4067619976 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbd1000cd20 con 0x7fbd1c0b23a0 2023-07-05T23:35:13.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.742+0000 7fbd197fa700 1 --2- 172.21.15.27:0/4067619976 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fbd0006ace0 0x7fbd0006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:13.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.743+0000 7fbd197fa700 1 -- 172.21.15.27:0/4067619976 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fbd10089830 con 0x7fbd1c0b23a0 2023-07-05T23:35:13.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.743+0000 7fbd1bfff700 1 --2- 172.21.15.27:0/4067619976 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fbd0006ace0 0x7fbd0006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:13.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.743+0000 7fbd1bfff700 1 --2- 172.21.15.27:0/4067619976 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fbd0006ace0 0x7fbd0006d190 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fbd08000c00 tx=0x7fbd08008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:13.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.747+0000 7fbd197fa700 1 -- 172.21.15.27:0/4067619976 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbd100580d0 con 0x7fbd1c0b23a0 2023-07-05T23:35:13.944 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.941+0000 7fbd22c86700 1 -- 172.21.15.27:0/4067619976 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fbd1c04ea20 con 0x7fbd1c0b23a0 2023-07-05T23:35:13.944 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.941+0000 7fbd197fa700 1 -- 172.21.15.27:0/4067619976 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7fbd10057c60 con 0x7fbd1c0b23a0 2023-07-05T23:35:13.945 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 32 2023-07-05T23:35:13.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.943+0000 7fbd22c86700 1 -- 172.21.15.27:0/4067619976 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fbd0006ace0 msgr2=0x7fbd0006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:13.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.943+0000 7fbd22c86700 1 --2- 172.21.15.27:0/4067619976 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fbd0006ace0 0x7fbd0006d190 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fbd08000c00 tx=0x7fbd08008030 comp rx=0 tx=0).stop 2023-07-05T23:35:13.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.943+0000 7fbd22c86700 1 -- 172.21.15.27:0/4067619976 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbd1c0b23a0 msgr2=0x7fbd1c1f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:13.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.943+0000 7fbd22c86700 1 --2- 172.21.15.27:0/4067619976 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbd1c0b23a0 0x7fbd1c1f5850 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fbd1000e9b0 tx=0x7fbd1000ed70 comp rx=0 tx=0).stop 2023-07-05T23:35:13.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.944+0000 7fbd22c86700 1 -- 172.21.15.27:0/4067619976 shutdown_connections 2023-07-05T23:35:13.948 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.944+0000 7fbd22c86700 1 --2- 172.21.15.27:0/4067619976 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fbd0006ace0 0x7fbd0006d190 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:13.948 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.944+0000 7fbd22c86700 1 --2- 172.21.15.27:0/4067619976 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd1c15fe40 0x7fbd1c1e6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:13.948 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.944+0000 7fbd22c86700 1 --2- 172.21.15.27:0/4067619976 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbd1c0b23a0 0x7fbd1c1f5850 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:13.949 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.944+0000 7fbd22c86700 1 --2- 172.21.15.27:0/4067619976 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd1c15d2d0 0x7fbd1c1f1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:13.949 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.944+0000 7fbd22c86700 1 -- 172.21.15.27:0/4067619976 >> 172.21.15.27:0/4067619976 conn(0x7fbd1c06e5c0 msgr2=0x7fbd1c0b18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:13.949 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.944+0000 7fbd22c86700 1 -- 172.21.15.27:0/4067619976 shutdown_connections 2023-07-05T23:35:13.949 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:13.944+0000 7fbd22c86700 1 -- 172.21.15.27:0/4067619976 wait complete. 2023-07-05T23:35:13.959 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-05T23:35:14.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.083+0000 7effa7dd1700 1 Processor -- start 2023-07-05T23:35:14.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.084+0000 7effa7dd1700 1 -- start start 2023-07-05T23:35:14.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.084+0000 7effa7dd1700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7effa00aed30 0x7effa0160580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:14.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.084+0000 7effa7dd1700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7effa00cc1d0 0x7effa00cc650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:14.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.084+0000 7effa7dd1700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effa00cee80 con 0x7effa0156880 2023-07-05T23:35:14.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.084+0000 7effa7dd1700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effa00ccb90 con 0x7effa00aed30 2023-07-05T23:35:14.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.084+0000 7effa7dd1700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effa00cf100 con 0x7effa00cc1d0 2023-07-05T23:35:14.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.085+0000 7effa536c700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7effa00aed30 0x7effa0160580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:14.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.085+0000 7effa636e700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7effa00cc1d0 0x7effa00cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:14.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.085+0000 7effa536c700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7effa00aed30 0x7effa0160580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.27:44236/0 (socket says 172.21.15.27:44236) 2023-07-05T23:35:14.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.085+0000 7effa536c700 1 -- 172.21.15.27:0/2381060824 learned_addr learned my addr 172.21.15.27:0/2381060824 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:14.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.085+0000 7effa636e700 1 -- 172.21.15.27:0/2381060824 >> v2:172.21.15.162:3300/0 conn(0x7effa00aed30 msgr2=0x7effa0160580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:35:14.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.085+0000 7effa636e700 1 --2- 172.21.15.27:0/2381060824 >> v2:172.21.15.162:3300/0 conn(0x7effa00aed30 0x7effa0160580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:14.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.085+0000 7effa636e700 1 -- 172.21.15.27:0/2381060824 >> v1:172.21.15.162:6789/0 conn(0x7effa0156880 legacy=0x7effa0069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:14.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.085+0000 7effa636e700 1 -- 172.21.15.27:0/2381060824 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa00cf3e0 con 0x7effa00cc1d0 2023-07-05T23:35:14.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.085+0000 7effa536c700 1 --2- 172.21.15.27:0/2381060824 >> v2:172.21.15.162:3300/0 conn(0x7effa00aed30 0x7effa0160580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T23:35:14.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.085+0000 7effa636e700 1 --2- 172.21.15.27:0/2381060824 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7effa00cc1d0 0x7effa00cc650 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7eff98009d90 tx=0x7eff9800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36e819f9a4632be3 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:14.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.086+0000 7effa4b6b700 1 -- 172.21.15.27:0/2381060824 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9800e070 con 0x7effa00cc1d0 2023-07-05T23:35:14.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.086+0000 7effa4b6b700 1 -- 172.21.15.27:0/2381060824 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff9800bb20 con 0x7effa00cc1d0 2023-07-05T23:35:14.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.086+0000 7effa4b6b700 1 -- 172.21.15.27:0/2381060824 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff98012430 con 0x7effa00cc1d0 2023-07-05T23:35:14.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.086+0000 7effa7dd1700 1 -- 172.21.15.27:0/2381060824 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7effa00cc1d0 msgr2=0x7effa00cc650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:14.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.086+0000 7effa7dd1700 1 --2- 172.21.15.27:0/2381060824 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7effa00cc1d0 0x7effa00cc650 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7eff98009d90 tx=0x7eff9800b330 comp rx=0 tx=0).stop 2023-07-05T23:35:14.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.086+0000 7effa7dd1700 1 -- 172.21.15.27:0/2381060824 shutdown_connections 2023-07-05T23:35:14.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.086+0000 7effa7dd1700 1 --2- 172.21.15.27:0/2381060824 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7effa00cc1d0 0x7effa00cc650 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:14.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.086+0000 7effa7dd1700 1 --2- 172.21.15.27:0/2381060824 >> v2:172.21.15.162:3300/0 conn(0x7effa00aed30 0x7effa0160580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:14.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.086+0000 7effa7dd1700 1 -- 172.21.15.27:0/2381060824 >> 172.21.15.27:0/2381060824 conn(0x7effa006d4a0 msgr2=0x7effa006d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:14.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.086+0000 7effa7dd1700 1 -- 172.21.15.27:0/2381060824 shutdown_connections 2023-07-05T23:35:14.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.086+0000 7effa7dd1700 1 -- 172.21.15.27:0/2381060824 wait complete. 2023-07-05T23:35:14.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.087+0000 7effa7dd1700 1 Processor -- start 2023-07-05T23:35:14.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.088+0000 7effa7dd1700 1 -- start start 2023-07-05T23:35:14.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.088+0000 7effa7dd1700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7effa00aed30 0x7effa00b5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:14.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.088+0000 7effa7dd1700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7effa00cc1d0 0x7effa00ab8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:14.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.088+0000 7effa7dd1700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7effa0156880 0x7effa01555b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:14.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.088+0000 7effa7dd1700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa00ad540 con 0x7effa00aed30 2023-07-05T23:35:14.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.088+0000 7effa7dd1700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa00abe10 con 0x7effa00cc1d0 2023-07-05T23:35:14.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.088+0000 7effa7dd1700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effa00ac040 con 0x7effa0156880 2023-07-05T23:35:14.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.088+0000 7effa5b6d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7effa00aed30 0x7effa00b5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:14.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.088+0000 7effa5b6d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7effa00aed30 0x7effa00b5070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46302/0 (socket says 172.21.15.27:46302) 2023-07-05T23:35:14.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.088+0000 7effa5b6d700 1 -- 172.21.15.27:0/3378594505 learned_addr learned my addr 172.21.15.27:0/3378594505 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:14.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.089+0000 7effa636e700 1 --2- 172.21.15.27:0/3378594505 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7effa0156880 0x7effa01555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:14.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.089+0000 7effa536c700 1 --2- 172.21.15.27:0/3378594505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7effa00cc1d0 0x7effa00ab8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:14.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.089+0000 7effa5b6d700 1 -- 172.21.15.27:0/3378594505 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7effa0156880 msgr2=0x7effa01555b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:14.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.089+0000 7effa5b6d700 1 --2- 172.21.15.27:0/3378594505 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7effa0156880 0x7effa01555b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:14.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.089+0000 7effa5b6d700 1 -- 172.21.15.27:0/3378594505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7effa00cc1d0 msgr2=0x7effa00ab8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:14.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.089+0000 7effa5b6d700 1 --2- 172.21.15.27:0/3378594505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7effa00cc1d0 0x7effa00ab8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:14.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.089+0000 7effa5b6d700 1 -- 172.21.15.27:0/3378594505 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff9c009550 con 0x7effa00aed30 2023-07-05T23:35:14.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.089+0000 7effa5b6d700 1 --2- 172.21.15.27:0/3378594505 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7effa00aed30 0x7effa00b5070 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7eff9000c450 tx=0x7eff9000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:14.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.089+0000 7eff967fc700 1 -- 172.21.15.27:0/3378594505 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff900052d0 con 0x7effa00aed30 2023-07-05T23:35:14.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.089+0000 7eff967fc700 1 -- 172.21.15.27:0/3378594505 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff90005430 con 0x7effa00aed30 2023-07-05T23:35:14.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.089+0000 7effa7dd1700 1 -- 172.21.15.27:0/3378594505 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff98009a70 con 0x7effa00aed30 2023-07-05T23:35:14.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.089+0000 7eff967fc700 1 -- 172.21.15.27:0/3378594505 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff900038c0 con 0x7effa00aed30 2023-07-05T23:35:14.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.089+0000 7effa7dd1700 1 -- 172.21.15.27:0/3378594505 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effa00ad770 con 0x7effa00aed30 2023-07-05T23:35:14.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.090+0000 7effa7dd1700 1 -- 172.21.15.27:0/3378594505 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effa0073910 con 0x7effa00aed30 2023-07-05T23:35:14.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.091+0000 7eff967fc700 1 -- 172.21.15.27:0/3378594505 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7eff90003a20 con 0x7effa00aed30 2023-07-05T23:35:14.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.091+0000 7eff967fc700 1 --2- 172.21.15.27:0/3378594505 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7eff8406ace0 0x7eff8406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:14.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.091+0000 7eff967fc700 1 -- 172.21.15.27:0/3378594505 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7eff90088b10 con 0x7effa00aed30 2023-07-05T23:35:14.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.091+0000 7effa536c700 1 --2- 172.21.15.27:0/3378594505 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7eff8406ace0 0x7eff8406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:14.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.092+0000 7effa536c700 1 --2- 172.21.15.27:0/3378594505 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7eff8406ace0 0x7eff8406d190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7effa00c5c10 tx=0x7eff9c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:14.106 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.095+0000 7eff967fc700 1 -- 172.21.15.27:0/3378594505 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7eff900538a0 con 0x7effa00aed30 2023-07-05T23:35:14.315 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.312+0000 7effa7dd1700 1 -- 172.21.15.27:0/3378594505 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7effa00cbd10 con 0x7effa00aed30 2023-07-05T23:35:14.315 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.312+0000 7eff967fc700 1 -- 172.21.15.27:0/3378594505 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v30) v1 ==== 80+0+0 (secure 0 0 0) 0x7eff90056ec0 con 0x7effa00aed30 2023-07-05T23:35:14.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.315+0000 7effa7dd1700 1 -- 172.21.15.27:0/3378594505 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7eff8406ace0 msgr2=0x7eff8406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:14.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.315+0000 7effa7dd1700 1 --2- 172.21.15.27:0/3378594505 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7eff8406ace0 0x7eff8406d190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7effa00c5c10 tx=0x7eff9c008040 comp rx=0 tx=0).stop 2023-07-05T23:35:14.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.315+0000 7effa7dd1700 1 -- 172.21.15.27:0/3378594505 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7effa00aed30 msgr2=0x7effa00b5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:14.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.315+0000 7effa7dd1700 1 --2- 172.21.15.27:0/3378594505 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7effa00aed30 0x7effa00b5070 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7eff9000c450 tx=0x7eff9000c810 comp rx=0 tx=0).stop 2023-07-05T23:35:14.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.315+0000 7effa7dd1700 1 -- 172.21.15.27:0/3378594505 shutdown_connections 2023-07-05T23:35:14.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.315+0000 7effa7dd1700 1 --2- 172.21.15.27:0/3378594505 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7eff8406ace0 0x7eff8406d190 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:14.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.315+0000 7effa7dd1700 1 --2- 172.21.15.27:0/3378594505 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7effa0156880 0x7effa01555b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:14.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.315+0000 7effa7dd1700 1 --2- 172.21.15.27:0/3378594505 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7effa00aed30 0x7effa00b5070 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:14.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.315+0000 7effa7dd1700 1 --2- 172.21.15.27:0/3378594505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7effa00cc1d0 0x7effa00ab8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:14.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.315+0000 7effa7dd1700 1 -- 172.21.15.27:0/3378594505 >> 172.21.15.27:0/3378594505 conn(0x7effa006d4a0 msgr2=0x7effa006b070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:14.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.315+0000 7effa7dd1700 1 -- 172.21.15.27:0/3378594505 shutdown_connections 2023-07-05T23:35:14.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.315+0000 7effa7dd1700 1 -- 172.21.15.27:0/3378594505 wait complete. 2023-07-05T23:35:14.320 INFO:teuthology.orchestra.run.smithi027.stderr:listed 0 entries 2023-07-05T23:35:14.330 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-07-05T23:35:14.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:35:14.331 DEBUG:teuthology.orchestra.run.smithi162:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-07-05T23:35:14.494 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi162.front.sepia.ceph.com 2023-07-05T23:35:14.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:35:14.495 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-05T23:35:14.530 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-07-05T23:35:14.530 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-05T23:35:14.587 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-07-05T23:35:14.588 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-05T23:35:14.644 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-05T23:35:14.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.767+0000 7ff7a21a1700 1 Processor -- start 2023-07-05T23:35:14.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.767+0000 7ff7a21a1700 1 -- start start 2023-07-05T23:35:14.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.768+0000 7ff7a21a1700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff79c0cd390 0x7ff79c15cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:14.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.768+0000 7ff7a21a1700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff79c1601c0 con 0x7ff79c15cb10 2023-07-05T23:35:14.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.768+0000 7ff7a21a1700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff79c0cedf0 con 0x7ff79c15d420 2023-07-05T23:35:14.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.768+0000 7ff7a21a1700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff79c0cf3b0 con 0x7ff79c0cd390 2023-07-05T23:35:14.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.768+0000 7ff7a119f700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7ff79c15cb10 0x7ff79c160650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:53476/0 (socket says 172.21.15.27:53476) 2023-07-05T23:35:14.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.768+0000 7ff7a119f700 1 -- 172.21.15.27:0/3566262921 learned_addr learned my addr 172.21.15.27:0/3566262921 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-07-05T23:35:14.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.768+0000 7ff7a099e700 1 --2- 172.21.15.27:0/3566262921 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff79c0cd390 0x7ff79c15cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:14.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.768+0000 7ff793fff700 1 -- 172.21.15.27:0/3566262921 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1262794655 0 0) 0x7ff79c1601c0 con 0x7ff79c15cb10 2023-07-05T23:35:14.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.768+0000 7ff793fff700 1 -- 172.21.15.27:0/3566262921 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7880035b0 con 0x7ff79c15cb10 2023-07-05T23:35:14.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.768+0000 7ff793fff700 1 -- 172.21.15.27:0/3566262921 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2464372025 0 0) 0x7ff79c0cedf0 con 0x7ff79c15d420 2023-07-05T23:35:14.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.768+0000 7ff793fff700 1 -- 172.21.15.27:0/3566262921 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff79c1601c0 con 0x7ff79c15d420 2023-07-05T23:35:14.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.768+0000 7ff7a099e700 1 -- 172.21.15.27:0/3566262921 >> v1:172.21.15.162:6789/0 conn(0x7ff79c15d420 legacy=0x7ff79c069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:14.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.768+0000 7ff7a099e700 1 -- 172.21.15.27:0/3566262921 >> v1:172.21.15.27:6789/0 conn(0x7ff79c15cb10 legacy=0x7ff79c160650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:14.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.768+0000 7ff7a099e700 1 -- 172.21.15.27:0/3566262921 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff79c0cf0d0 con 0x7ff79c0cd390 2023-07-05T23:35:14.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.769+0000 7ff7a099e700 1 --2- 172.21.15.27:0/3566262921 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff79c0cd390 0x7ff79c15cee0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff78c009870 tx=0x7ff78c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c68173ed9fd4a2f server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:14.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.769+0000 7ff793fff700 1 -- 172.21.15.27:0/3566262921 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78c011830 con 0x7ff79c0cd390 2023-07-05T23:35:14.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.769+0000 7ff793fff700 1 -- 172.21.15.27:0/3566262921 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff78c011990 con 0x7ff79c0cd390 2023-07-05T23:35:14.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.769+0000 7ff793fff700 1 -- 172.21.15.27:0/3566262921 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78c011d20 con 0x7ff79c0cd390 2023-07-05T23:35:14.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.769+0000 7ff7a21a1700 1 -- 172.21.15.27:0/3566262921 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff79c0cd390 msgr2=0x7ff79c15cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:14.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.769+0000 7ff7a21a1700 1 --2- 172.21.15.27:0/3566262921 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff79c0cd390 0x7ff79c15cee0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff78c009870 tx=0x7ff78c009b80 comp rx=0 tx=0).stop 2023-07-05T23:35:14.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.769+0000 7ff7a21a1700 1 -- 172.21.15.27:0/3566262921 shutdown_connections 2023-07-05T23:35:14.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.769+0000 7ff7a21a1700 1 --2- 172.21.15.27:0/3566262921 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff79c0cd390 0x7ff79c15cee0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:14.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.769+0000 7ff7a21a1700 1 -- 172.21.15.27:0/3566262921 >> 172.21.15.27:0/3566262921 conn(0x7ff79c06b000 msgr2=0x7ff79c06b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:14.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.769+0000 7ff7a21a1700 1 -- 172.21.15.27:0/3566262921 shutdown_connections 2023-07-05T23:35:14.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.769+0000 7ff7a21a1700 1 -- 172.21.15.27:0/3566262921 wait complete. 2023-07-05T23:35:14.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.771+0000 7ff7a21a1700 1 Processor -- start 2023-07-05T23:35:14.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.771+0000 7ff7a21a1700 1 -- start start 2023-07-05T23:35:14.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.771+0000 7ff7a21a1700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff79c0cd390 0x7ff79c151600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:14.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.771+0000 7ff7a21a1700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff79c15cb10 0x7ff79c0aeef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:14.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.771+0000 7ff7a21a1700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff79c15d420 0x7ff79c0af430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:14.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.771+0000 7ff7a21a1700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff79c1f1de0 con 0x7ff79c15d420 2023-07-05T23:35:14.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.771+0000 7ff7a21a1700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff79c0c3b90 con 0x7ff79c15cb10 2023-07-05T23:35:14.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.771+0000 7ff7a21a1700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff79c151b40 con 0x7ff79c0cd390 2023-07-05T23:35:14.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.771+0000 7ff7a19a0700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff79c15d420 0x7ff79c0af430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:14.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.771+0000 7ff7a19a0700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff79c15d420 0x7ff79c0af430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46320/0 (socket says 172.21.15.27:46320) 2023-07-05T23:35:14.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.771+0000 7ff7a19a0700 1 -- 172.21.15.27:0/402845093 learned_addr learned my addr 172.21.15.27:0/402845093 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:14.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.772+0000 7ff7a119f700 1 --2- 172.21.15.27:0/402845093 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff79c0cd390 0x7ff79c151600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:14.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.772+0000 7ff7a099e700 1 --2- 172.21.15.27:0/402845093 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff79c15cb10 0x7ff79c0aeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:14.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.772+0000 7ff7a19a0700 1 -- 172.21.15.27:0/402845093 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff79c0cd390 msgr2=0x7ff79c151600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:14.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.772+0000 7ff7a19a0700 1 --2- 172.21.15.27:0/402845093 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff79c0cd390 0x7ff79c151600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:14.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.772+0000 7ff7a19a0700 1 -- 172.21.15.27:0/402845093 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff79c15cb10 msgr2=0x7ff79c0aeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:14.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.772+0000 7ff7a19a0700 1 --2- 172.21.15.27:0/402845093 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff79c15cb10 0x7ff79c0aeef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:14.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.772+0000 7ff7a19a0700 1 -- 172.21.15.27:0/402845093 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff78c0094a0 con 0x7ff79c15d420 2023-07-05T23:35:14.786 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.772+0000 7ff7a099e700 1 --2- 172.21.15.27:0/402845093 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff79c15cb10 0x7ff79c0aeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T23:35:14.787 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.772+0000 7ff7a19a0700 1 --2- 172.21.15.27:0/402845093 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff79c15d420 0x7ff79c0af430 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff79400cbc0 tx=0x7ff79400ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:14.787 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.772+0000 7ff791ffb700 1 -- 172.21.15.27:0/402845093 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff794003c00 con 0x7ff79c15d420 2023-07-05T23:35:14.787 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.772+0000 7ff791ffb700 1 -- 172.21.15.27:0/402845093 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff794003d60 con 0x7ff79c15d420 2023-07-05T23:35:14.787 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.772+0000 7ff7a21a1700 1 -- 172.21.15.27:0/402845093 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff79c0c3260 con 0x7ff79c15d420 2023-07-05T23:35:14.787 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.772+0000 7ff791ffb700 1 -- 172.21.15.27:0/402845093 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79400ab00 con 0x7ff79c15d420 2023-07-05T23:35:14.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.772+0000 7ff7a21a1700 1 -- 172.21.15.27:0/402845093 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff79c0c3820 con 0x7ff79c15d420 2023-07-05T23:35:14.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.773+0000 7ff7a21a1700 1 -- 172.21.15.27:0/402845093 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff79c0c3d20 con 0x7ff79c15d420 2023-07-05T23:35:14.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.774+0000 7ff791ffb700 1 -- 172.21.15.27:0/402845093 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff79400ac60 con 0x7ff79c15d420 2023-07-05T23:35:14.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.774+0000 7ff791ffb700 1 --2- 172.21.15.27:0/402845093 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7ff78006ad10 0x7ff78006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:14.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.774+0000 7ff791ffb700 1 -- 172.21.15.27:0/402845093 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff7940897f0 con 0x7ff79c15d420 2023-07-05T23:35:14.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.774+0000 7ff7a119f700 1 --2- 172.21.15.27:0/402845093 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7ff78006ad10 0x7ff78006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:14.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.775+0000 7ff7a119f700 1 --2- 172.21.15.27:0/402845093 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7ff78006ad10 0x7ff78006d1c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff798007fd0 tx=0x7ff798007dc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:14.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.778+0000 7ff791ffb700 1 -- 172.21.15.27:0/402845093 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff794054570 con 0x7ff79c15d420 2023-07-05T23:35:14.981 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.978+0000 7ff7a21a1700 1 -- 172.21.15.27:0/402845093 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff79c04ea20 con 0x7ff79c15d420 2023-07-05T23:35:14.982 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.979+0000 7ff791ffb700 1 -- 172.21.15.27:0/402845093 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20215 (secure 0 0 0) 0x7ff794057b90 con 0x7ff79c15d420 2023-07-05T23:35:14.983 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:35:14.984 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":30,"fsid":"23eebe48-65f5-4d3c-8c2d-4aa171c055d5","created":"2023-07-05T23:32:27.989612+0000","modified":"2023-07-05T23:33:34.883498+0000","last_up_change":"2023-07-05T23:32:39.601570+0000","last_in_change":"2023-07-05T23:32:30.488261+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-05T23:32:41.624598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-05T23:32:46.481587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-05T23:32:51.025210+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-05T23:32:52.286964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-05T23:32:55.354212+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ac2071e4-394b-4385-b9ba-fad5265efc65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6814","nonce":3766536605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6818","nonce":3766536605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6823","nonce":3766536605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6821","nonce":3766536605}]},"public_addr":"172.21.15.27:6814/3766536605","cluster_addr":"172.21.15.27:6818/3766536605","heartbeat_back_addr":"172.21.15.27:6823/3766536605","heartbeat_front_addr":"172.21.15.27:6821/3766536605","state":["exists","up"]},{"osd":1,"uuid":"8c9b61a0-39d5-46bf-afd6-5add78453ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6801","nonce":1579117455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6803","nonce":1579117455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6807","nonce":1579117455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6805","nonce":1579117455}]},"public_addr":"172.21.15.27:6801/1579117455","cluster_addr":"172.21.15.27:6803/1579117455","heartbeat_back_addr":"172.21.15.27:6807/1579117455","heartbeat_front_addr":"172.21.15.27:6805/1579117455","state":["exists","up"]},{"osd":2,"uuid":"dcd032a2-06b1-4055-b798-b86c71a7107d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6825","nonce":807520271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6827","nonce":807520271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6831","nonce":807520271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6829","nonce":807520271}]},"public_addr":"172.21.15.27:6825/807520271","cluster_addr":"172.21.15.27:6827/807520271","heartbeat_back_addr":"172.21.15.27:6831/807520271","heartbeat_front_addr":"172.21.15.27:6829/807520271","state":["exists","up"]},{"osd":3,"uuid":"b0ffe0fc-47ba-4636-b5ea-6bab637642c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6809","nonce":2125656143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6811","nonce":2125656143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6817","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6819","nonce":2125656143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6813","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6815","nonce":2125656143}]},"public_addr":"172.21.15.27:6809/2125656143","cluster_addr":"172.21.15.27:6811/2125656143","heartbeat_back_addr":"172.21.15.27:6819/2125656143","heartbeat_front_addr":"172.21.15.27:6815/2125656143","state":["exists","up"]},{"osd":4,"uuid":"7fab4e5a-1246-4efe-9562-10c4a6c789ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6801","nonce":2111223016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6803","nonce":2111223016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6807","nonce":2111223016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6805","nonce":2111223016}]},"public_addr":"172.21.15.162:6801/2111223016","cluster_addr":"172.21.15.162:6803/2111223016","heartbeat_back_addr":"172.21.15.162:6807/2111223016","heartbeat_front_addr":"172.21.15.162:6805/2111223016","state":["exists","up"]},{"osd":5,"uuid":"110c4d9f-cef6-48ab-a818-5a81e72372af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6825","nonce":3102609008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6827","nonce":3102609008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6831","nonce":3102609008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6829","nonce":3102609008}]},"public_addr":"172.21.15.162:6825/3102609008","cluster_addr":"172.21.15.162:6827/3102609008","heartbeat_back_addr":"172.21.15.162:6831/3102609008","heartbeat_front_addr":"172.21.15.162:6829/3102609008","state":["exists","up"]},{"osd":6,"uuid":"16803bcc-2c92-4aed-954e-487938c9f24a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6809","nonce":2657688865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6811","nonce":2657688865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6815","nonce":2657688865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6813","nonce":2657688865}]},"public_addr":"172.21.15.162:6809/2657688865","cluster_addr":"172.21.15.162:6811/2657688865","heartbeat_back_addr":"172.21.15.162:6815/2657688865","heartbeat_front_addr":"172.21.15.162:6813/2657688865","state":["exists","up"]},{"osd":7,"uuid":"b7c35377-3cf2-4569-b6b9-72376eb463bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6817","nonce":2096609978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6819","nonce":2096609978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6823","nonce":2096609978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6821","nonce":2096609978}]},"public_addr":"172.21.15.162:6817/2096609978","cluster_addr":"172.21.15.162:6819/2096609978","heartbeat_back_addr":"172.21.15.162:6823/2096609978","heartbeat_front_addr":"172.21.15.162:6821/2096609978","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.735448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.645561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.759120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.682507+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.736228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.694664+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.716002+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.680485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":3,"to":2}]},{"pgid":"4.26","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-05T23:35:14.985 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.981+0000 7ff7a21a1700 1 -- 172.21.15.27:0/402845093 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7ff78006ad10 msgr2=0x7ff78006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:14.985 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.981+0000 7ff7a21a1700 1 --2- 172.21.15.27:0/402845093 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7ff78006ad10 0x7ff78006d1c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff798007fd0 tx=0x7ff798007dc0 comp rx=0 tx=0).stop 2023-07-05T23:35:14.985 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.981+0000 7ff7a21a1700 1 -- 172.21.15.27:0/402845093 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff79c15d420 msgr2=0x7ff79c0af430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:14.986 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.981+0000 7ff7a21a1700 1 --2- 172.21.15.27:0/402845093 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff79c15d420 0x7ff79c0af430 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff79400cbc0 tx=0x7ff79400ced0 comp rx=0 tx=0).stop 2023-07-05T23:35:14.986 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.981+0000 7ff7a21a1700 1 -- 172.21.15.27:0/402845093 shutdown_connections 2023-07-05T23:35:14.986 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.981+0000 7ff7a21a1700 1 --2- 172.21.15.27:0/402845093 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7ff78006ad10 0x7ff78006d1c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:14.986 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.981+0000 7ff7a21a1700 1 --2- 172.21.15.27:0/402845093 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff79c15d420 0x7ff79c0af430 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:14.987 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.981+0000 7ff7a21a1700 1 --2- 172.21.15.27:0/402845093 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff79c0cd390 0x7ff79c151600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:14.987 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.981+0000 7ff7a21a1700 1 --2- 172.21.15.27:0/402845093 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff79c15cb10 0x7ff79c0aeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:14.987 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.981+0000 7ff7a21a1700 1 -- 172.21.15.27:0/402845093 >> 172.21.15.27:0/402845093 conn(0x7ff79c06b000 msgr2=0x7ff79c0c9b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:14.987 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.982+0000 7ff7a21a1700 1 -- 172.21.15.27:0/402845093 shutdown_connections 2023-07-05T23:35:14.987 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:14.982+0000 7ff7a21a1700 1 -- 172.21.15.27:0/402845093 wait complete. 2023-07-05T23:35:14.997 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-05T23:32:41.624598+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-05T23:32:46.481587+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-05T23:32:51.025210+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-05T23:32:52.286964+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-05T23:32:55.354212+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-05T23:35:14.998 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-05T23:35:15.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.123+0000 7f37f0ba9700 1 Processor -- start 2023-07-05T23:35:15.126 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.123+0000 7f37f0ba9700 1 -- start start 2023-07-05T23:35:15.127 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.124+0000 7f37f0ba9700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f37ec0aecc0 0x7f37ec06a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:15.127 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.124+0000 7f37f0ba9700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37ec0ce620 con 0x7f37ec06e970 2023-07-05T23:35:15.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.124+0000 7f37f0ba9700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37ec160580 con 0x7f37ec15fc60 2023-07-05T23:35:15.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.124+0000 7f37f0ba9700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37ec160860 con 0x7f37ec0aecc0 2023-07-05T23:35:15.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.124+0000 7f37e9d9b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f37ec0aecc0 0x7f37ec06a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:15.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.124+0000 7f37e9d9b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f37ec0aecc0 0x7f37ec06a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46326/0 (socket says 172.21.15.27:46326) 2023-07-05T23:35:15.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.124+0000 7f37e9d9b700 1 -- 172.21.15.27:0/3991976832 learned_addr learned my addr 172.21.15.27:0/3991976832 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:15.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.124+0000 7f37e9d9b700 1 -- 172.21.15.27:0/3991976832 >> v1:172.21.15.162:6789/0 conn(0x7f37ec15fc60 legacy=0x7f37ec06e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:35:15.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.124+0000 7f37e9d9b700 1 -- 172.21.15.27:0/3991976832 >> v1:172.21.15.27:6789/0 conn(0x7f37ec06e970 legacy=0x7f37ec0cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:15.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.124+0000 7f37e9d9b700 1 -- 172.21.15.27:0/3991976832 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37ec160b40 con 0x7f37ec0aecc0 2023-07-05T23:35:15.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.124+0000 7f37e9d9b700 1 --2- 172.21.15.27:0/3991976832 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f37ec0aecc0 0x7f37ec06a900 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f37e00098f0 tx=0x7f37e0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a85d447064fe13e9 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:15.130 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.124+0000 7f37e959a700 1 -- 172.21.15.27:0/3991976832 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e0004230 con 0x7f37ec0aecc0 2023-07-05T23:35:15.130 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.124+0000 7f37e959a700 1 -- 172.21.15.27:0/3991976832 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37e0004390 con 0x7f37ec0aecc0 2023-07-05T23:35:15.130 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.124+0000 7f37e959a700 1 -- 172.21.15.27:0/3991976832 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e00036a0 con 0x7f37ec0aecc0 2023-07-05T23:35:15.132 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.125+0000 7f37f0ba9700 1 -- 172.21.15.27:0/3991976832 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f37ec0aecc0 msgr2=0x7f37ec06a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:15.132 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.125+0000 7f37f0ba9700 1 --2- 172.21.15.27:0/3991976832 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f37ec0aecc0 0x7f37ec06a900 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f37e00098f0 tx=0x7f37e0009c00 comp rx=0 tx=0).stop 2023-07-05T23:35:15.133 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.125+0000 7f37f0ba9700 1 -- 172.21.15.27:0/3991976832 shutdown_connections 2023-07-05T23:35:15.133 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.125+0000 7f37f0ba9700 1 --2- 172.21.15.27:0/3991976832 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f37ec0aecc0 0x7f37ec06a900 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:15.133 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.125+0000 7f37f0ba9700 1 -- 172.21.15.27:0/3991976832 >> 172.21.15.27:0/3991976832 conn(0x7f37ec06b920 msgr2=0x7f37ec0cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:15.133 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.125+0000 7f37f0ba9700 1 -- 172.21.15.27:0/3991976832 shutdown_connections 2023-07-05T23:35:15.133 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.125+0000 7f37f0ba9700 1 -- 172.21.15.27:0/3991976832 wait complete. 2023-07-05T23:35:15.134 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.127+0000 7f37f0ba9700 1 Processor -- start 2023-07-05T23:35:15.134 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.127+0000 7f37f0ba9700 1 -- start start 2023-07-05T23:35:15.134 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.128+0000 7f37f0ba9700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37ec06e970 0x7f37ec1473e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:15.134 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.128+0000 7f37f0ba9700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f37ec0aecc0 0x7f37ec0b3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:15.134 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.128+0000 7f37f0ba9700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37ec15fc60 0x7f37ec149c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:15.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.128+0000 7f37f0ba9700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37ec0b4e10 con 0x7f37ec0aecc0 2023-07-05T23:35:15.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.128+0000 7f37f0ba9700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37ec147920 con 0x7f37ec15fc60 2023-07-05T23:35:15.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.128+0000 7f37f0ba9700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37ec0b4190 con 0x7f37ec06e970 2023-07-05T23:35:15.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.128+0000 7f37e9d9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f37ec0aecc0 0x7f37ec0b3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:15.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.128+0000 7f37e9d9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f37ec0aecc0 0x7f37ec0b3890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46332/0 (socket says 172.21.15.27:46332) 2023-07-05T23:35:15.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.128+0000 7f37e9d9b700 1 -- 172.21.15.27:0/153871632 learned_addr learned my addr 172.21.15.27:0/153871632 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:15.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.128+0000 7f37ead9d700 1 --2- 172.21.15.27:0/153871632 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37ec15fc60 0x7f37ec149c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:15.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.128+0000 7f37ea59c700 1 --2- 172.21.15.27:0/153871632 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37ec06e970 0x7f37ec1473e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:15.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.128+0000 7f37e9d9b700 1 -- 172.21.15.27:0/153871632 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37ec06e970 msgr2=0x7f37ec1473e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:15.137 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.128+0000 7f37e9d9b700 1 --2- 172.21.15.27:0/153871632 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37ec06e970 0x7f37ec1473e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:15.137 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.128+0000 7f37e9d9b700 1 -- 172.21.15.27:0/153871632 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37ec15fc60 msgr2=0x7f37ec149c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:15.137 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.128+0000 7f37e9d9b700 1 --2- 172.21.15.27:0/153871632 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37ec15fc60 0x7f37ec149c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:15.137 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.128+0000 7f37e9d9b700 1 -- 172.21.15.27:0/153871632 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37e0009550 con 0x7f37ec0aecc0 2023-07-05T23:35:15.137 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.128+0000 7f37e9d9b700 1 --2- 172.21.15.27:0/153871632 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f37ec0aecc0 0x7f37ec0b3890 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f37ec071470 tx=0x7f37e0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:15.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.129+0000 7f37daffd700 1 -- 172.21.15.27:0/153871632 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e0003cd0 con 0x7f37ec0aecc0 2023-07-05T23:35:15.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.129+0000 7f37daffd700 1 -- 172.21.15.27:0/153871632 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37e001f070 con 0x7f37ec0aecc0 2023-07-05T23:35:15.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.129+0000 7f37f0ba9700 1 -- 172.21.15.27:0/153871632 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37ec0b4470 con 0x7f37ec0aecc0 2023-07-05T23:35:15.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.129+0000 7f37daffd700 1 -- 172.21.15.27:0/153871632 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e000b8a0 con 0x7f37ec0aecc0 2023-07-05T23:35:15.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.129+0000 7f37f0ba9700 1 -- 172.21.15.27:0/153871632 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37ec0b4a30 con 0x7f37ec0aecc0 2023-07-05T23:35:15.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.130+0000 7f37f0ba9700 1 -- 172.21.15.27:0/153871632 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37ec0b4f50 con 0x7f37ec0aecc0 2023-07-05T23:35:15.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.130+0000 7f37daffd700 1 -- 172.21.15.27:0/153871632 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f37e0021030 con 0x7f37ec0aecc0 2023-07-05T23:35:15.140 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.131+0000 7f37daffd700 1 --2- 172.21.15.27:0/153871632 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f37cc06ace0 0x7f37cc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:15.140 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.131+0000 7f37daffd700 1 -- 172.21.15.27:0/153871632 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f37e008ad60 con 0x7f37ec0aecc0 2023-07-05T23:35:15.140 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.131+0000 7f37ea59c700 1 --2- 172.21.15.27:0/153871632 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f37cc06ace0 0x7f37cc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:15.140 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.131+0000 7f37ea59c700 1 --2- 172.21.15.27:0/153871632 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f37cc06ace0 0x7f37cc06d190 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f37dc006fd0 tx=0x7f37dc0090e0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:15.141 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.135+0000 7f37daffd700 1 -- 172.21.15.27:0/153871632 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f37ec0b4f50 con 0x7f37ec0aecc0 2023-07-05T23:35:15.334 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.331+0000 7f37f0ba9700 1 -- 172.21.15.27:0/153871632 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f37ec0b4f50 con 0x7f37ec0aecc0 2023-07-05T23:35:15.335 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.332+0000 7f37daffd700 1 -- 172.21.15.27:0/153871632 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f37ec0b4f50 con 0x7f37ec0aecc0 2023-07-05T23:35:15.335 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2023-07-05T23:35:15.337 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.334+0000 7f37f0ba9700 1 -- 172.21.15.27:0/153871632 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f37cc06ace0 msgr2=0x7f37cc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:15.337 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.334+0000 7f37f0ba9700 1 --2- 172.21.15.27:0/153871632 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f37cc06ace0 0x7f37cc06d190 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f37dc006fd0 tx=0x7f37dc0090e0 comp rx=0 tx=0).stop 2023-07-05T23:35:15.337 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.334+0000 7f37f0ba9700 1 -- 172.21.15.27:0/153871632 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f37ec0aecc0 msgr2=0x7f37ec0b3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:15.337 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.334+0000 7f37f0ba9700 1 --2- 172.21.15.27:0/153871632 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f37ec0aecc0 0x7f37ec0b3890 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f37ec071470 tx=0x7f37e0004750 comp rx=0 tx=0).stop 2023-07-05T23:35:15.338 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.334+0000 7f37f0ba9700 1 -- 172.21.15.27:0/153871632 shutdown_connections 2023-07-05T23:35:15.338 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.334+0000 7f37f0ba9700 1 --2- 172.21.15.27:0/153871632 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37ec15fc60 0x7f37ec149c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:15.338 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.334+0000 7f37f0ba9700 1 --2- 172.21.15.27:0/153871632 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f37cc06ace0 0x7f37cc06d190 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:15.338 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.334+0000 7f37f0ba9700 1 --2- 172.21.15.27:0/153871632 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37ec06e970 0x7f37ec1473e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:15.339 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.334+0000 7f37f0ba9700 1 --2- 172.21.15.27:0/153871632 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f37ec0aecc0 0x7f37ec0b3890 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:15.339 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.334+0000 7f37f0ba9700 1 -- 172.21.15.27:0/153871632 >> 172.21.15.27:0/153871632 conn(0x7f37ec06b920 msgr2=0x7f37ec0b0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:15.339 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.334+0000 7f37f0ba9700 1 -- 172.21.15.27:0/153871632 shutdown_connections 2023-07-05T23:35:15.339 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.334+0000 7f37f0ba9700 1 -- 172.21.15.27:0/153871632 wait complete. 2023-07-05T23:35:15.349 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-05T23:35:15.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.474+0000 7f1b6b192700 1 Processor -- start 2023-07-05T23:35:15.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.474+0000 7f1b6b192700 1 -- start start 2023-07-05T23:35:15.479 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.475+0000 7f1b6b192700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f1b640cd5e0 0x7f1b640cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:15.479 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.475+0000 7f1b6b192700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f1b6406e030 0x7f1b6406e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:15.480 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.475+0000 7f1b6b192700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1b6415cf70 0x7f1b6415d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:15.480 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.475+0000 7f1b6b192700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b640ce2c0 con 0x7f1b640cd5e0 2023-07-05T23:35:15.480 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.475+0000 7f1b6b192700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b6406f0e0 con 0x7f1b6406e030 2023-07-05T23:35:15.480 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.475+0000 7f1b6b192700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b640cdef0 con 0x7f1b6415cf70 2023-07-05T23:35:15.480 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.475+0000 7f1b68f2e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f1b640cd5e0 0x7f1b640cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:15.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.475+0000 7f1b68f2e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f1b640cd5e0 0x7f1b640cd9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46338/0 (socket says 172.21.15.27:46338) 2023-07-05T23:35:15.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.475+0000 7f1b68f2e700 1 -- 172.21.15.27:0/1578887193 learned_addr learned my addr 172.21.15.27:0/1578887193 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:15.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.475+0000 7f1b63fff700 1 --2- 172.21.15.27:0/1578887193 >> v2:172.21.15.162:3300/0 conn(0x7f1b6406e030 0x7f1b6406e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:15.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.475+0000 7f1b6972f700 1 --2- 172.21.15.27:0/1578887193 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1b6415cf70 0x7f1b6415d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:15.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.475+0000 7f1b68f2e700 1 -- 172.21.15.27:0/1578887193 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1b6415cf70 msgr2=0x7f1b6415d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:35:15.482 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.475+0000 7f1b68f2e700 1 --2- 172.21.15.27:0/1578887193 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1b6415cf70 0x7f1b6415d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:15.482 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.475+0000 7f1b68f2e700 1 -- 172.21.15.27:0/1578887193 >> v2:172.21.15.162:3300/0 conn(0x7f1b6406e030 msgr2=0x7f1b6406e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:35:15.482 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.475+0000 7f1b68f2e700 1 --2- 172.21.15.27:0/1578887193 >> v2:172.21.15.162:3300/0 conn(0x7f1b6406e030 0x7f1b6406e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:15.482 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.475+0000 7f1b68f2e700 1 -- 172.21.15.27:0/1578887193 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b6406eb20 con 0x7f1b640cd5e0 2023-07-05T23:35:15.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.475+0000 7f1b68f2e700 1 --2- 172.21.15.27:0/1578887193 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1b640cd5e0 0x7f1b640cd9b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f1b6415ced0 tx=0x7f1b5800be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=317bb8c81d5277de server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:15.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.476+0000 7f1b637fe700 1 -- 172.21.15.27:0/1578887193 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b58005e30 con 0x7f1b640cd5e0 2023-07-05T23:35:15.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.476+0000 7f1b637fe700 1 -- 172.21.15.27:0/1578887193 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b58004030 con 0x7f1b640cd5e0 2023-07-05T23:35:15.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.476+0000 7f1b637fe700 1 -- 172.21.15.27:0/1578887193 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b580043e0 con 0x7f1b640cd5e0 2023-07-05T23:35:15.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.476+0000 7f1b6b192700 1 -- 172.21.15.27:0/1578887193 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1b640cd5e0 msgr2=0x7f1b640cd9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:15.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.476+0000 7f1b6b192700 1 --2- 172.21.15.27:0/1578887193 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1b640cd5e0 0x7f1b640cd9b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f1b6415ced0 tx=0x7f1b5800be70 comp rx=0 tx=0).stop 2023-07-05T23:35:15.484 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.476+0000 7f1b6b192700 1 -- 172.21.15.27:0/1578887193 shutdown_connections 2023-07-05T23:35:15.484 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.476+0000 7f1b6b192700 1 --2- 172.21.15.27:0/1578887193 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1b6415cf70 0x7f1b6415d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:15.484 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.476+0000 7f1b6b192700 1 --2- 172.21.15.27:0/1578887193 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1b640cd5e0 0x7f1b640cd9b0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:15.484 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.476+0000 7f1b6b192700 1 --2- 172.21.15.27:0/1578887193 >> v2:172.21.15.162:3300/0 conn(0x7f1b6406e030 0x7f1b6406e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:15.484 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.476+0000 7f1b6b192700 1 -- 172.21.15.27:0/1578887193 >> 172.21.15.27:0/1578887193 conn(0x7f1b6406b920 msgr2=0x7f1b640cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:15.485 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.476+0000 7f1b6b192700 1 -- 172.21.15.27:0/1578887193 shutdown_connections 2023-07-05T23:35:15.485 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.476+0000 7f1b6b192700 1 -- 172.21.15.27:0/1578887193 wait complete. 2023-07-05T23:35:15.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.478+0000 7f1b6b192700 1 Processor -- start 2023-07-05T23:35:15.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.478+0000 7f1b6b192700 1 -- start start 2023-07-05T23:35:15.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.479+0000 7f1b6b192700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1b6406e030 0x7f1b641ed960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:15.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.479+0000 7f1b6b192700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1b640cd5e0 0x7f1b6415b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:15.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.479+0000 7f1b6b192700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1b6415cf70 0x7f1b640ad2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:15.488 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.479+0000 7f1b6b192700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b64152810 con 0x7f1b6406e030 2023-07-05T23:35:15.488 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.479+0000 7f1b6b192700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b6415b7d0 con 0x7f1b6415cf70 2023-07-05T23:35:15.488 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.479+0000 7f1b6b192700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b640c4240 con 0x7f1b640cd5e0 2023-07-05T23:35:15.488 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.479+0000 7f1b68f2e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1b6406e030 0x7f1b641ed960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:15.488 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.479+0000 7f1b68f2e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1b6406e030 0x7f1b641ed960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46344/0 (socket says 172.21.15.27:46344) 2023-07-05T23:35:15.489 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.479+0000 7f1b68f2e700 1 -- 172.21.15.27:0/3575916697 learned_addr learned my addr 172.21.15.27:0/3575916697 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:15.489 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.479+0000 7f1b63fff700 1 --2- 172.21.15.27:0/3575916697 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1b640cd5e0 0x7f1b6415b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:15.489 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.479+0000 7f1b6972f700 1 --2- 172.21.15.27:0/3575916697 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1b6415cf70 0x7f1b640ad2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:15.489 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.480+0000 7f1b68f2e700 1 -- 172.21.15.27:0/3575916697 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1b640cd5e0 msgr2=0x7f1b6415b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:15.489 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.480+0000 7f1b68f2e700 1 --2- 172.21.15.27:0/3575916697 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1b640cd5e0 0x7f1b6415b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:15.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.480+0000 7f1b68f2e700 1 -- 172.21.15.27:0/3575916697 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1b6415cf70 msgr2=0x7f1b640ad2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:15.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.480+0000 7f1b68f2e700 1 --2- 172.21.15.27:0/3575916697 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1b6415cf70 0x7f1b640ad2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:15.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.480+0000 7f1b68f2e700 1 -- 172.21.15.27:0/3575916697 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b5800b7a0 con 0x7f1b6406e030 2023-07-05T23:35:15.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.480+0000 7f1b68f2e700 1 --2- 172.21.15.27:0/3575916697 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1b6406e030 0x7f1b641ed960 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1b5800b340 tx=0x7f1b58004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:15.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.481+0000 7f1b617fa700 1 -- 172.21.15.27:0/3575916697 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b580038a0 con 0x7f1b6406e030 2023-07-05T23:35:15.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.481+0000 7f1b617fa700 1 -- 172.21.15.27:0/3575916697 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b58003a00 con 0x7f1b6406e030 2023-07-05T23:35:15.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.481+0000 7f1b617fa700 1 -- 172.21.15.27:0/3575916697 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b58003df0 con 0x7f1b6406e030 2023-07-05T23:35:15.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.482+0000 7f1b6b192700 1 -- 172.21.15.27:0/3575916697 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b640c4520 con 0x7f1b6406e030 2023-07-05T23:35:15.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.482+0000 7f1b6b192700 1 -- 172.21.15.27:0/3575916697 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b640c4ae0 con 0x7f1b6406e030 2023-07-05T23:35:15.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.483+0000 7f1b6b192700 1 -- 172.21.15.27:0/3575916697 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b64071960 con 0x7f1b6406e030 2023-07-05T23:35:15.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.484+0000 7f1b617fa700 1 -- 172.21.15.27:0/3575916697 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1b58023560 con 0x7f1b6406e030 2023-07-05T23:35:15.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.484+0000 7f1b617fa700 1 --2- 172.21.15.27:0/3575916697 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f1b4806ace0 0x7f1b4806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:15.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.484+0000 7f1b617fa700 1 -- 172.21.15.27:0/3575916697 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1b5808ee30 con 0x7f1b6406e030 2023-07-05T23:35:15.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.484+0000 7f1b63fff700 1 --2- 172.21.15.27:0/3575916697 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f1b4806ace0 0x7f1b4806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:15.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.486+0000 7f1b63fff700 1 --2- 172.21.15.27:0/3575916697 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f1b4806ace0 0x7f1b4806d190 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1b641590c0 tx=0x7f1b50009210 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:15.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.492+0000 7f1b617fa700 1 -- 172.21.15.27:0/3575916697 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1b58059ba0 con 0x7f1b6406e030 2023-07-05T23:35:15.699 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.697+0000 7f1b6b192700 1 -- 172.21.15.27:0/3575916697 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1b6404ea20 con 0x7f1b6406e030 2023-07-05T23:35:15.700 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.697+0000 7f1b617fa700 1 -- 172.21.15.27:0/3575916697 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1b5805d1c0 con 0x7f1b6406e030 2023-07-05T23:35:15.701 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 8 2023-07-05T23:35:15.704 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.699+0000 7f1b6b192700 1 -- 172.21.15.27:0/3575916697 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f1b4806ace0 msgr2=0x7f1b4806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:15.704 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.699+0000 7f1b6b192700 1 --2- 172.21.15.27:0/3575916697 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f1b4806ace0 0x7f1b4806d190 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1b641590c0 tx=0x7f1b50009210 comp rx=0 tx=0).stop 2023-07-05T23:35:15.705 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.699+0000 7f1b6b192700 1 -- 172.21.15.27:0/3575916697 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1b6406e030 msgr2=0x7f1b641ed960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:15.705 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.699+0000 7f1b6b192700 1 --2- 172.21.15.27:0/3575916697 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1b6406e030 0x7f1b641ed960 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1b5800b340 tx=0x7f1b58004750 comp rx=0 tx=0).stop 2023-07-05T23:35:15.705 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.699+0000 7f1b6b192700 1 -- 172.21.15.27:0/3575916697 shutdown_connections 2023-07-05T23:35:15.705 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.699+0000 7f1b6b192700 1 --2- 172.21.15.27:0/3575916697 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1b6415cf70 0x7f1b640ad2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:15.705 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.699+0000 7f1b6b192700 1 --2- 172.21.15.27:0/3575916697 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f1b4806ace0 0x7f1b4806d190 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:15.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.699+0000 7f1b6b192700 1 --2- 172.21.15.27:0/3575916697 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1b6406e030 0x7f1b641ed960 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:15.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.699+0000 7f1b6b192700 1 --2- 172.21.15.27:0/3575916697 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1b640cd5e0 0x7f1b6415b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:15.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.699+0000 7f1b6b192700 1 -- 172.21.15.27:0/3575916697 >> 172.21.15.27:0/3575916697 conn(0x7f1b6406b920 msgr2=0x7f1b640b3840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:15.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.699+0000 7f1b6b192700 1 -- 172.21.15.27:0/3575916697 shutdown_connections 2023-07-05T23:35:15.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.699+0000 7f1b6b192700 1 -- 172.21.15.27:0/3575916697 wait complete. 2023-07-05T23:35:15.714 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-05T23:35:15.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.839+0000 7f8c2d90f700 1 Processor -- start 2023-07-05T23:35:15.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.839+0000 7f8c2d90f700 1 -- start start 2023-07-05T23:35:15.845 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.840+0000 7f8c2d90f700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c2806ccd0 0x7f8c2815b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:15.846 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.840+0000 7f8c2d90f700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c280cb380 con 0x7f8c280cfd80 2023-07-05T23:35:15.846 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.840+0000 7f8c2d90f700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c280c97f0 con 0x7f8c28069ef0 2023-07-05T23:35:15.846 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.840+0000 7f8c2d90f700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2815b7a0 con 0x7f8c2806ccd0 2023-07-05T23:35:15.846 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.840+0000 7f8c267fc700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f8c280cfd80 0x7f8c2806d0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:53522/0 (socket says 172.21.15.27:53522) 2023-07-05T23:35:15.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.840+0000 7f8c267fc700 1 -- 172.21.15.27:0/3589861741 learned_addr learned my addr 172.21.15.27:0/3589861741 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-07-05T23:35:15.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.841+0000 7f8c26ffd700 1 --2- 172.21.15.27:0/3589861741 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c2806ccd0 0x7f8c2815b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:15.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.841+0000 7f8c25ffb700 1 -- 172.21.15.27:0/3589861741 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3330578203 0 0) 0x7f8c280cb380 con 0x7f8c280cfd80 2023-07-05T23:35:15.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.841+0000 7f8c25ffb700 1 -- 172.21.15.27:0/3589861741 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c100035b0 con 0x7f8c280cfd80 2023-07-05T23:35:15.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.841+0000 7f8c25ffb700 1 -- 172.21.15.27:0/3589861741 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 585894885 0 0) 0x7f8c100035b0 con 0x7f8c280cfd80 2023-07-05T23:35:15.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.841+0000 7f8c25ffb700 1 -- 172.21.15.27:0/3589861741 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c2806ccd0 msgr2=0x7f8c2815b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:35:15.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.841+0000 7f8c25ffb700 1 --2- 172.21.15.27:0/3589861741 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c2806ccd0 0x7f8c2815b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:15.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.841+0000 7f8c25ffb700 1 -- 172.21.15.27:0/3589861741 >> v1:172.21.15.162:6789/0 conn(0x7f8c28069ef0 legacy=0x7f8c2806a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:15.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.841+0000 7f8c25ffb700 1 -- 172.21.15.27:0/3589861741 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c280cb620 con 0x7f8c280cfd80 2023-07-05T23:35:15.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.841+0000 7f8c25ffb700 1 -- 172.21.15.27:0/3589861741 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1246168953 0 0) 0x7f8c18001670 con 0x7f8c280cfd80 2023-07-05T23:35:15.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.841+0000 7f8c25ffb700 1 -- 172.21.15.27:0/3589861741 >> v1:172.21.15.27:6789/0 conn(0x7f8c280cfd80 legacy=0x7f8c2806d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:15.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.841+0000 7f8c25ffb700 1 --2- 172.21.15.27:0/3589861741 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c2806ccd0 0x7f8c10003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:15.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.841+0000 7f8c25ffb700 1 --2- 172.21.15.27:0/3589861741 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c10003f70 0x7f8c10004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:15.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.841+0000 7f8c25ffb700 1 --2- 172.21.15.27:0/3589861741 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c10004d90 0x7f8c10005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:15.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.841+0000 7f8c25ffb700 1 -- 172.21.15.27:0/3589861741 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2815b7a0 con 0x7f8c10003f70 2023-07-05T23:35:15.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.841+0000 7f8c25ffb700 1 -- 172.21.15.27:0/3589861741 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1000ba40 con 0x7f8c10004d90 2023-07-05T23:35:15.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.841+0000 7f8c25ffb700 1 -- 172.21.15.27:0/3589861741 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1000bc00 con 0x7f8c2806ccd0 2023-07-05T23:35:15.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.841+0000 7f8c267fc700 1 --2- 172.21.15.27:0/3589861741 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c10003f70 0x7f8c10004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:15.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.841+0000 7f8c26ffd700 1 --2- 172.21.15.27:0/3589861741 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c2806ccd0 0x7f8c10003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:15.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.841+0000 7f8c277fe700 1 --2- 172.21.15.27:0/3589861741 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c10004d90 0x7f8c10005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:15.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.841+0000 7f8c267fc700 1 -- 172.21.15.27:0/3589861741 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c2806ccd0 msgr2=0x7f8c10003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:35:15.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.841+0000 7f8c267fc700 1 --2- 172.21.15.27:0/3589861741 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c2806ccd0 0x7f8c10003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:15.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.841+0000 7f8c267fc700 1 -- 172.21.15.27:0/3589861741 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c10004d90 msgr2=0x7f8c10005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:35:15.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.841+0000 7f8c267fc700 1 --2- 172.21.15.27:0/3589861741 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c10004d90 0x7f8c10005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:15.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.841+0000 7f8c267fc700 1 -- 172.21.15.27:0/3589861741 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c100035b0 con 0x7f8c10003f70 2023-07-05T23:35:15.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.841+0000 7f8c277fe700 1 --2- 172.21.15.27:0/3589861741 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c10004d90 0x7f8c10005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T23:35:15.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.842+0000 7f8c267fc700 1 --2- 172.21.15.27:0/3589861741 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c10003f70 0x7f8c10004850 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8c1800c240 tx=0x7f8c10005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13f17d8d570e0983 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:15.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.842+0000 7f8c25ffb700 1 -- 172.21.15.27:0/3589861741 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1800cde0 con 0x7f8c10003f70 2023-07-05T23:35:15.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.842+0000 7f8c25ffb700 1 -- 172.21.15.27:0/3589861741 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c18007ba0 con 0x7f8c10003f70 2023-07-05T23:35:15.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.842+0000 7f8c25ffb700 1 -- 172.21.15.27:0/3589861741 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c18005ba0 con 0x7f8c10003f70 2023-07-05T23:35:15.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.842+0000 7f8c2d90f700 1 -- 172.21.15.27:0/3589861741 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c10003f70 msgr2=0x7f8c10004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:15.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.842+0000 7f8c2d90f700 1 --2- 172.21.15.27:0/3589861741 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c10003f70 0x7f8c10004850 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8c1800c240 tx=0x7f8c10005880 comp rx=0 tx=0).stop 2023-07-05T23:35:15.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.842+0000 7f8c277fe700 1 -- 172.21.15.27:0/3589861741 reap_dead start 2023-07-05T23:35:15.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.842+0000 7f8c2d90f700 1 -- 172.21.15.27:0/3589861741 shutdown_connections 2023-07-05T23:35:15.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.842+0000 7f8c2d90f700 1 -- 172.21.15.27:0/3589861741 >> 172.21.15.27:0/3589861741 conn(0x7f8c280b1990 msgr2=0x7f8c280cf1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:15.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.842+0000 7f8c2d90f700 1 -- 172.21.15.27:0/3589861741 shutdown_connections 2023-07-05T23:35:15.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.842+0000 7f8c2d90f700 1 -- 172.21.15.27:0/3589861741 wait complete. 2023-07-05T23:35:15.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.844+0000 7f8c2d90f700 1 Processor -- start 2023-07-05T23:35:15.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.844+0000 7f8c2d90f700 1 -- start start 2023-07-05T23:35:15.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.844+0000 7f8c2d90f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c10003f70 0x7f8c280c6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:15.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.844+0000 7f8c2d90f700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c280c71c0 0x7f8c280afee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:15.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.845+0000 7f8c2d90f700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c280b0420 0x7f8c280c7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:15.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.845+0000 7f8c2d90f700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c280afac0 con 0x7f8c10003f70 2023-07-05T23:35:15.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.845+0000 7f8c2d90f700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c280aee40 con 0x7f8c280b0420 2023-07-05T23:35:15.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.845+0000 7f8c2d90f700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c280af120 con 0x7f8c280c71c0 2023-07-05T23:35:15.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.845+0000 7f8c26ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c10003f70 0x7f8c280c6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:15.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.845+0000 7f8c26ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c10003f70 0x7f8c280c6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46364/0 (socket says 172.21.15.27:46364) 2023-07-05T23:35:15.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.845+0000 7f8c26ffd700 1 -- 172.21.15.27:0/3004512913 learned_addr learned my addr 172.21.15.27:0/3004512913 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:15.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.845+0000 7f8c267fc700 1 --2- 172.21.15.27:0/3004512913 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c280c71c0 0x7f8c280afee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:15.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.845+0000 7f8c277fe700 1 --2- 172.21.15.27:0/3004512913 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c280b0420 0x7f8c280c7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:15.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.845+0000 7f8c26ffd700 1 -- 172.21.15.27:0/3004512913 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c280c71c0 msgr2=0x7f8c280afee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:15.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.845+0000 7f8c26ffd700 1 --2- 172.21.15.27:0/3004512913 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c280c71c0 0x7f8c280afee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:15.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.845+0000 7f8c26ffd700 1 -- 172.21.15.27:0/3004512913 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c280b0420 msgr2=0x7f8c280c7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:15.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.845+0000 7f8c26ffd700 1 --2- 172.21.15.27:0/3004512913 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c280b0420 0x7f8c280c7740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:15.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.845+0000 7f8c26ffd700 1 -- 172.21.15.27:0/3004512913 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c280af400 con 0x7f8c10003f70 2023-07-05T23:35:15.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.845+0000 7f8c26ffd700 1 --2- 172.21.15.27:0/3004512913 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c10003f70 0x7f8c280c6c80 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c011aa0 tx=0x7f8c1c011db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:15.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.845+0000 7f8c0ffff700 1 -- 172.21.15.27:0/3004512913 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1c011ee0 con 0x7f8c10003f70 2023-07-05T23:35:15.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.845+0000 7f8c0ffff700 1 -- 172.21.15.27:0/3004512913 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c1c00f940 con 0x7f8c10003f70 2023-07-05T23:35:15.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.845+0000 7f8c2d90f700 1 -- 172.21.15.27:0/3004512913 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c280af6e0 con 0x7f8c10003f70 2023-07-05T23:35:15.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.845+0000 7f8c0ffff700 1 -- 172.21.15.27:0/3004512913 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1c00fcf0 con 0x7f8c10003f70 2023-07-05T23:35:15.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.845+0000 7f8c2d90f700 1 -- 172.21.15.27:0/3004512913 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c28157960 con 0x7f8c10003f70 2023-07-05T23:35:15.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.846+0000 7f8c2d90f700 1 -- 172.21.15.27:0/3004512913 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c2804ea20 con 0x7f8c10003f70 2023-07-05T23:35:15.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.847+0000 7f8c0ffff700 1 -- 172.21.15.27:0/3004512913 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8c1c014440 con 0x7f8c10003f70 2023-07-05T23:35:15.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.847+0000 7f8c0ffff700 1 --2- 172.21.15.27:0/3004512913 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f8c1406ace0 0x7f8c1406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:15.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.847+0000 7f8c0ffff700 1 -- 172.21.15.27:0/3004512913 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8c1c089dc0 con 0x7f8c10003f70 2023-07-05T23:35:15.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.847+0000 7f8c267fc700 1 --2- 172.21.15.27:0/3004512913 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f8c1406ace0 0x7f8c1406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:15.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.848+0000 7f8c267fc700 1 --2- 172.21.15.27:0/3004512913 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f8c1406ace0 0x7f8c1406d190 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8c18007d50 tx=0x7f8c18007000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:15.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:15.852+0000 7f8c0ffff700 1 -- 172.21.15.27:0/3004512913 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8c1c058720 con 0x7f8c10003f70 2023-07-05T23:35:16.051 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.048+0000 7f8c2d90f700 1 -- 172.21.15.27:0/3004512913 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8c2815d800 con 0x7f8c10003f70 2023-07-05T23:35:16.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.049+0000 7f8c0ffff700 1 -- 172.21.15.27:0/3004512913 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8c1c0582b0 con 0x7f8c10003f70 2023-07-05T23:35:16.052 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 32 2023-07-05T23:35:16.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.051+0000 7f8c2d90f700 1 -- 172.21.15.27:0/3004512913 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f8c1406ace0 msgr2=0x7f8c1406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:16.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.051+0000 7f8c2d90f700 1 --2- 172.21.15.27:0/3004512913 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f8c1406ace0 0x7f8c1406d190 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8c18007d50 tx=0x7f8c18007000 comp rx=0 tx=0).stop 2023-07-05T23:35:16.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.051+0000 7f8c2d90f700 1 -- 172.21.15.27:0/3004512913 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c10003f70 msgr2=0x7f8c280c6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:16.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.051+0000 7f8c2d90f700 1 --2- 172.21.15.27:0/3004512913 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c10003f70 0x7f8c280c6c80 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c011aa0 tx=0x7f8c1c011db0 comp rx=0 tx=0).stop 2023-07-05T23:35:16.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.051+0000 7f8c2d90f700 1 -- 172.21.15.27:0/3004512913 shutdown_connections 2023-07-05T23:35:16.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.051+0000 7f8c2d90f700 1 --2- 172.21.15.27:0/3004512913 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c280b0420 0x7f8c280c7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:16.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.051+0000 7f8c2d90f700 1 --2- 172.21.15.27:0/3004512913 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f8c1406ace0 0x7f8c1406d190 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:16.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.051+0000 7f8c2d90f700 1 --2- 172.21.15.27:0/3004512913 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c10003f70 0x7f8c280c6c80 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:16.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.051+0000 7f8c2d90f700 1 --2- 172.21.15.27:0/3004512913 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c280c71c0 0x7f8c280afee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:16.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.051+0000 7f8c2d90f700 1 -- 172.21.15.27:0/3004512913 >> 172.21.15.27:0/3004512913 conn(0x7f8c280b1990 msgr2=0x7f8c281545a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:16.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.051+0000 7f8c2d90f700 1 -- 172.21.15.27:0/3004512913 shutdown_connections 2023-07-05T23:35:16.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.051+0000 7f8c2d90f700 1 -- 172.21.15.27:0/3004512913 wait complete. 2023-07-05T23:35:16.067 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-05T23:35:16.196 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.193+0000 7ff889b6e700 1 Processor -- start 2023-07-05T23:35:16.197 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.193+0000 7ff889b6e700 1 -- start start 2023-07-05T23:35:16.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.194+0000 7ff889b6e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff8840cd330 0x7ff884070980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:16.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.194+0000 7ff889b6e700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff8840afc40 0x7ff88415dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:16.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.194+0000 7ff889b6e700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8840caf70 con 0x7ff88415a330 2023-07-05T23:35:16.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.194+0000 7ff889b6e700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8840cb210 con 0x7ff8840cd330 2023-07-05T23:35:16.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.194+0000 7ff889b6e700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8840ccc20 con 0x7ff8840afc40 2023-07-05T23:35:16.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.194+0000 7ff8837fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff8840cd330 0x7ff884070980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:16.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.194+0000 7ff8837fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff8840cd330 0x7ff884070980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46372/0 (socket says 172.21.15.27:46372) 2023-07-05T23:35:16.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.194+0000 7ff8837fe700 1 -- 172.21.15.27:0/4221052792 learned_addr learned my addr 172.21.15.27:0/4221052792 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:16.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.194+0000 7ff883fff700 1 --2- 172.21.15.27:0/4221052792 >> v2:172.21.15.162:3300/0 conn(0x7ff8840afc40 0x7ff88415dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:16.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.194+0000 7ff8837fe700 1 -- 172.21.15.27:0/4221052792 >> v2:172.21.15.162:3300/0 conn(0x7ff8840afc40 msgr2=0x7ff88415dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:35:16.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.194+0000 7ff8837fe700 1 --2- 172.21.15.27:0/4221052792 >> v2:172.21.15.162:3300/0 conn(0x7ff8840afc40 0x7ff88415dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:16.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.194+0000 7ff8837fe700 1 -- 172.21.15.27:0/4221052792 >> v1:172.21.15.162:6789/0 conn(0x7ff88415a330 legacy=0x7ff8840cd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:35:16.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.194+0000 7ff8837fe700 1 -- 172.21.15.27:0/4221052792 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8840ccf00 con 0x7ff8840cd330 2023-07-05T23:35:16.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.194+0000 7ff883fff700 1 --2- 172.21.15.27:0/4221052792 >> v2:172.21.15.162:3300/0 conn(0x7ff8840afc40 0x7ff88415dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T23:35:16.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.194+0000 7ff8837fe700 1 --2- 172.21.15.27:0/4221052792 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff8840cd330 0x7ff884070980 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff8840c43d0 tx=0x7ff874009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df060c4e100f2f73 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:16.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.194+0000 7ff8827fc700 1 -- 172.21.15.27:0/4221052792 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff874004230 con 0x7ff8840cd330 2023-07-05T23:35:16.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.194+0000 7ff8827fc700 1 -- 172.21.15.27:0/4221052792 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff874004390 con 0x7ff8840cd330 2023-07-05T23:35:16.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.194+0000 7ff8827fc700 1 -- 172.21.15.27:0/4221052792 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8740036a0 con 0x7ff8840cd330 2023-07-05T23:35:16.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.195+0000 7ff889b6e700 1 -- 172.21.15.27:0/4221052792 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff8840cd330 msgr2=0x7ff884070980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:16.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.195+0000 7ff889b6e700 1 --2- 172.21.15.27:0/4221052792 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff8840cd330 0x7ff884070980 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff8840c43d0 tx=0x7ff874009bd0 comp rx=0 tx=0).stop 2023-07-05T23:35:16.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.195+0000 7ff889b6e700 1 -- 172.21.15.27:0/4221052792 shutdown_connections 2023-07-05T23:35:16.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.195+0000 7ff889b6e700 1 --2- 172.21.15.27:0/4221052792 >> v2:172.21.15.162:3300/0 conn(0x7ff8840afc40 0x7ff88415dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:16.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.195+0000 7ff889b6e700 1 --2- 172.21.15.27:0/4221052792 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff8840cd330 0x7ff884070980 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:16.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.195+0000 7ff889b6e700 1 -- 172.21.15.27:0/4221052792 >> 172.21.15.27:0/4221052792 conn(0x7ff88406e5c0 msgr2=0x7ff88406e990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:16.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.195+0000 7ff889b6e700 1 -- 172.21.15.27:0/4221052792 shutdown_connections 2023-07-05T23:35:16.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.195+0000 7ff889b6e700 1 -- 172.21.15.27:0/4221052792 wait complete. 2023-07-05T23:35:16.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.197+0000 7ff889b6e700 1 Processor -- start 2023-07-05T23:35:16.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.197+0000 7ff889b6e700 1 -- start start 2023-07-05T23:35:16.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.198+0000 7ff889b6e700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff8840afc40 0x7ff884155220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:16.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.198+0000 7ff889b6e700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8840cd330 0x7ff88415cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:16.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.198+0000 7ff889b6e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff88415a330 0x7ff88415d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:16.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.198+0000 7ff889b6e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff884155dc0 con 0x7ff88415a330 2023-07-05T23:35:16.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.198+0000 7ff889b6e700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8841f37f0 con 0x7ff8840cd330 2023-07-05T23:35:16.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.198+0000 7ff889b6e700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8841f3a90 con 0x7ff8840afc40 2023-07-05T23:35:16.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.198+0000 7ff883fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff88415a330 0x7ff88415d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:16.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.198+0000 7ff883fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff88415a330 0x7ff88415d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46382/0 (socket says 172.21.15.27:46382) 2023-07-05T23:35:16.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.198+0000 7ff883fff700 1 -- 172.21.15.27:0/3413953604 learned_addr learned my addr 172.21.15.27:0/3413953604 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:16.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.198+0000 7ff8837fe700 1 --2- 172.21.15.27:0/3413953604 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff8840afc40 0x7ff884155220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:16.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.198+0000 7ff882ffd700 1 --2- 172.21.15.27:0/3413953604 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8840cd330 0x7ff88415cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:16.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.198+0000 7ff883fff700 1 -- 172.21.15.27:0/3413953604 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff8840afc40 msgr2=0x7ff884155220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:16.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.198+0000 7ff883fff700 1 --2- 172.21.15.27:0/3413953604 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff8840afc40 0x7ff884155220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:16.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.198+0000 7ff883fff700 1 -- 172.21.15.27:0/3413953604 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8840cd330 msgr2=0x7ff88415cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:16.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.198+0000 7ff883fff700 1 --2- 172.21.15.27:0/3413953604 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8840cd330 0x7ff88415cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:16.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.198+0000 7ff883fff700 1 -- 172.21.15.27:0/3413953604 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff874009550 con 0x7ff88415a330 2023-07-05T23:35:16.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.198+0000 7ff883fff700 1 --2- 172.21.15.27:0/3413953604 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff88415a330 0x7ff88415d110 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff87c00cd50 tx=0x7ff87c00a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:16.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.199+0000 7ff86bfff700 1 -- 172.21.15.27:0/3413953604 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff87c00cea0 con 0x7ff88415a330 2023-07-05T23:35:16.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.199+0000 7ff86bfff700 1 -- 172.21.15.27:0/3413953604 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff87c00f480 con 0x7ff88415a330 2023-07-05T23:35:16.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.199+0000 7ff889b6e700 1 -- 172.21.15.27:0/3413953604 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8841f3d70 con 0x7ff88415a330 2023-07-05T23:35:16.213 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.199+0000 7ff86bfff700 1 -- 172.21.15.27:0/3413953604 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff87c00f830 con 0x7ff88415a330 2023-07-05T23:35:16.213 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.199+0000 7ff889b6e700 1 -- 172.21.15.27:0/3413953604 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff884155760 con 0x7ff88415a330 2023-07-05T23:35:16.213 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.200+0000 7ff889b6e700 1 -- 172.21.15.27:0/3413953604 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8841f4290 con 0x7ff88415a330 2023-07-05T23:35:16.213 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.200+0000 7ff86bfff700 1 -- 172.21.15.27:0/3413953604 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff87c00b040 con 0x7ff88415a330 2023-07-05T23:35:16.213 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.200+0000 7ff86bfff700 1 --2- 172.21.15.27:0/3413953604 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7ff87006ace0 0x7ff87006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:16.214 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.201+0000 7ff86bfff700 1 -- 172.21.15.27:0/3413953604 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff87c089e30 con 0x7ff88415a330 2023-07-05T23:35:16.214 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.201+0000 7ff8837fe700 1 --2- 172.21.15.27:0/3413953604 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7ff87006ace0 0x7ff87006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:16.214 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.201+0000 7ff8837fe700 1 --2- 172.21.15.27:0/3413953604 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7ff87006ace0 0x7ff87006d190 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff874009130 tx=0x7ff874008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:16.214 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.205+0000 7ff86bfff700 1 -- 172.21.15.27:0/3413953604 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff8841f4290 con 0x7ff88415a330 2023-07-05T23:35:16.403 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.401+0000 7ff889b6e700 1 -- 172.21.15.27:0/3413953604 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff8841f4290 con 0x7ff88415a330 2023-07-05T23:35:16.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.401+0000 7ff86bfff700 1 -- 172.21.15.27:0/3413953604 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff8841f4290 con 0x7ff88415a330 2023-07-05T23:35:16.405 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2023-07-05T23:35:16.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.403+0000 7ff889b6e700 1 -- 172.21.15.27:0/3413953604 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7ff87006ace0 msgr2=0x7ff87006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:16.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.403+0000 7ff889b6e700 1 --2- 172.21.15.27:0/3413953604 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7ff87006ace0 0x7ff87006d190 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff874009130 tx=0x7ff874008030 comp rx=0 tx=0).stop 2023-07-05T23:35:16.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.403+0000 7ff889b6e700 1 -- 172.21.15.27:0/3413953604 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff88415a330 msgr2=0x7ff88415d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:16.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.403+0000 7ff889b6e700 1 --2- 172.21.15.27:0/3413953604 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff88415a330 0x7ff88415d110 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff87c00cd50 tx=0x7ff87c00a560 comp rx=0 tx=0).stop 2023-07-05T23:35:16.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.403+0000 7ff889b6e700 1 -- 172.21.15.27:0/3413953604 shutdown_connections 2023-07-05T23:35:16.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.403+0000 7ff889b6e700 1 --2- 172.21.15.27:0/3413953604 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7ff87006ace0 0x7ff87006d190 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:16.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.403+0000 7ff889b6e700 1 --2- 172.21.15.27:0/3413953604 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff88415a330 0x7ff88415d110 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:16.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.403+0000 7ff889b6e700 1 --2- 172.21.15.27:0/3413953604 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff8840afc40 0x7ff884155220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:16.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.403+0000 7ff889b6e700 1 --2- 172.21.15.27:0/3413953604 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8840cd330 0x7ff88415cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:16.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.403+0000 7ff889b6e700 1 -- 172.21.15.27:0/3413953604 >> 172.21.15.27:0/3413953604 conn(0x7ff88406e5c0 msgr2=0x7ff8840cfa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:16.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.403+0000 7ff889b6e700 1 -- 172.21.15.27:0/3413953604 shutdown_connections 2023-07-05T23:35:16.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.403+0000 7ff889b6e700 1 -- 172.21.15.27:0/3413953604 wait complete. 2023-07-05T23:35:16.418 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-05T23:35:16.548 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.545+0000 7fb03a177700 1 Processor -- start 2023-07-05T23:35:16.548 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.545+0000 7fb03a177700 1 -- start start 2023-07-05T23:35:16.552 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.546+0000 7fb03a177700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb03415fc60 0x7fb03406a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:16.552 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.546+0000 7fb03a177700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb03406e970 0x7fb0340ac600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:16.552 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.546+0000 7fb03a177700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0340ce620 con 0x7fb0340aecc0 2023-07-05T23:35:16.553 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.546+0000 7fb03a177700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb034160580 con 0x7fb03406e970 2023-07-05T23:35:16.553 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.546+0000 7fb03a177700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb034160860 con 0x7fb03415fc60 2023-07-05T23:35:16.553 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.546+0000 7fb033fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb03406e970 0x7fb0340ac600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:16.553 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.546+0000 7fb033fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb03406e970 0x7fb0340ac600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46390/0 (socket says 172.21.15.27:46390) 2023-07-05T23:35:16.553 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.546+0000 7fb033fff700 1 -- 172.21.15.27:0/1212471744 learned_addr learned my addr 172.21.15.27:0/1212471744 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:16.554 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.546+0000 7fb0337fe700 1 --2- 172.21.15.27:0/1212471744 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb03415fc60 0x7fb03406a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:16.554 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.546+0000 7fb033fff700 1 -- 172.21.15.27:0/1212471744 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb03415fc60 msgr2=0x7fb03406a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:35:16.554 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.546+0000 7fb033fff700 1 --2- 172.21.15.27:0/1212471744 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb03415fc60 0x7fb03406a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:16.555 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.546+0000 7fb033fff700 1 -- 172.21.15.27:0/1212471744 >> v1:172.21.15.162:6789/0 conn(0x7fb0340aecc0 legacy=0x7fb03406e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:16.555 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.546+0000 7fb033fff700 1 -- 172.21.15.27:0/1212471744 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb034160b40 con 0x7fb03406e970 2023-07-05T23:35:16.555 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.546+0000 7fb0337fe700 1 --2- 172.21.15.27:0/1212471744 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb03415fc60 0x7fb03406a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T23:35:16.555 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.547+0000 7fb033fff700 1 --2- 172.21.15.27:0/1212471744 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb03406e970 0x7fb0340ac600 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb02c009e50 tx=0x7fb02c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6078028f4c019588 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:16.555 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.547+0000 7fb0327fc700 1 -- 172.21.15.27:0/1212471744 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02c00e070 con 0x7fb03406e970 2023-07-05T23:35:16.556 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.547+0000 7fb0327fc700 1 -- 172.21.15.27:0/1212471744 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb02c00b9c0 con 0x7fb03406e970 2023-07-05T23:35:16.556 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.547+0000 7fb0327fc700 1 -- 172.21.15.27:0/1212471744 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02c00bd70 con 0x7fb03406e970 2023-07-05T23:35:16.556 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.547+0000 7fb03a177700 1 -- 172.21.15.27:0/1212471744 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb03406e970 msgr2=0x7fb0340ac600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:16.556 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.547+0000 7fb03a177700 1 --2- 172.21.15.27:0/1212471744 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb03406e970 0x7fb0340ac600 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb02c009e50 tx=0x7fb02c00b330 comp rx=0 tx=0).stop 2023-07-05T23:35:16.557 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.547+0000 7fb03a177700 1 -- 172.21.15.27:0/1212471744 shutdown_connections 2023-07-05T23:35:16.557 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.547+0000 7fb03a177700 1 --2- 172.21.15.27:0/1212471744 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb03406e970 0x7fb0340ac600 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:16.557 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.547+0000 7fb03a177700 1 --2- 172.21.15.27:0/1212471744 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb03415fc60 0x7fb03406a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:16.557 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.547+0000 7fb03a177700 1 -- 172.21.15.27:0/1212471744 >> 172.21.15.27:0/1212471744 conn(0x7fb03406b920 msgr2=0x7fb0340cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:16.558 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.547+0000 7fb03a177700 1 -- 172.21.15.27:0/1212471744 shutdown_connections 2023-07-05T23:35:16.558 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.547+0000 7fb03a177700 1 -- 172.21.15.27:0/1212471744 wait complete. 2023-07-05T23:35:16.558 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.549+0000 7fb03a177700 1 Processor -- start 2023-07-05T23:35:16.559 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.549+0000 7fb03a177700 1 -- start start 2023-07-05T23:35:16.561 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.549+0000 7fb03a177700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb03406e970 0x7fb034159d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:16.561 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.549+0000 7fb03a177700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb0340aecc0 0x7fb0340b5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:16.561 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.549+0000 7fb03a177700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb03415fc60 0x7fb0340ae050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:16.562 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.549+0000 7fb03a177700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0340b3db0 con 0x7fb0340aecc0 2023-07-05T23:35:16.562 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.549+0000 7fb03a177700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0340b37f0 con 0x7fb03415fc60 2023-07-05T23:35:16.562 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.549+0000 7fb03a177700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0340b3ad0 con 0x7fb03406e970 2023-07-05T23:35:16.563 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.550+0000 7fb032ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb0340aecc0 0x7fb0340b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:16.563 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.550+0000 7fb032ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb0340aecc0 0x7fb0340b5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46394/0 (socket says 172.21.15.27:46394) 2023-07-05T23:35:16.563 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.550+0000 7fb032ffd700 1 -- 172.21.15.27:0/1776739235 learned_addr learned my addr 172.21.15.27:0/1776739235 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:16.563 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.550+0000 7fb032ffd700 1 -- 172.21.15.27:0/1776739235 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb03406e970 msgr2=0x7fb034159d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:16.563 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.550+0000 7fb0337fe700 1 --2- 172.21.15.27:0/1776739235 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb03406e970 0x7fb034159d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:16.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.550+0000 7fb033fff700 1 --2- 172.21.15.27:0/1776739235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb03415fc60 0x7fb0340ae050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:16.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.550+0000 7fb032ffd700 1 --2- 172.21.15.27:0/1776739235 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb03406e970 0x7fb034159d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:16.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.550+0000 7fb032ffd700 1 -- 172.21.15.27:0/1776739235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb03415fc60 msgr2=0x7fb0340ae050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:16.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.550+0000 7fb032ffd700 1 --2- 172.21.15.27:0/1776739235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb03415fc60 0x7fb0340ae050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:16.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.550+0000 7fb032ffd700 1 -- 172.21.15.27:0/1776739235 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb02c009b30 con 0x7fb0340aecc0 2023-07-05T23:35:16.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.550+0000 7fb032ffd700 1 --2- 172.21.15.27:0/1776739235 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb0340aecc0 0x7fb0340b5050 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb01c00c4b0 tx=0x7fb01c00c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:16.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.550+0000 7fb02bfff700 1 -- 172.21.15.27:0/1776739235 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01c0052d0 con 0x7fb0340aecc0 2023-07-05T23:35:16.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.550+0000 7fb02bfff700 1 -- 172.21.15.27:0/1776739235 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb01c005430 con 0x7fb0340aecc0 2023-07-05T23:35:16.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.550+0000 7fb03a177700 1 -- 172.21.15.27:0/1776739235 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0340b4850 con 0x7fb0340aecc0 2023-07-05T23:35:16.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.550+0000 7fb02bfff700 1 -- 172.21.15.27:0/1776739235 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01c0038c0 con 0x7fb0340aecc0 2023-07-05T23:35:16.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.550+0000 7fb03a177700 1 -- 172.21.15.27:0/1776739235 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb03415a2d0 con 0x7fb0340aecc0 2023-07-05T23:35:16.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.551+0000 7fb03a177700 1 -- 172.21.15.27:0/1776739235 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0340b46b0 con 0x7fb0340aecc0 2023-07-05T23:35:16.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.552+0000 7fb02bfff700 1 -- 172.21.15.27:0/1776739235 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb01c003a20 con 0x7fb0340aecc0 2023-07-05T23:35:16.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.552+0000 7fb02bfff700 1 --2- 172.21.15.27:0/1776739235 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fb01406ace0 0x7fb01406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:16.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.552+0000 7fb02bfff700 1 -- 172.21.15.27:0/1776739235 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb01c088c00 con 0x7fb0340aecc0 2023-07-05T23:35:16.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.552+0000 7fb0337fe700 1 --2- 172.21.15.27:0/1776739235 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fb01406ace0 0x7fb01406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:16.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.553+0000 7fb0337fe700 1 --2- 172.21.15.27:0/1776739235 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fb01406ace0 0x7fb01406d190 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb02400d8b0 tx=0x7fb024008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:16.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.556+0000 7fb02bfff700 1 -- 172.21.15.27:0/1776739235 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb0340b46b0 con 0x7fb0340aecc0 2023-07-05T23:35:16.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.750+0000 7fb03a177700 1 -- 172.21.15.27:0/1776739235 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fb0340b4d70 con 0x7fb0340aecc0 2023-07-05T23:35:16.754 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.751+0000 7fb02bfff700 1 -- 172.21.15.27:0/1776739235 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb01c017020 con 0x7fb0340aecc0 2023-07-05T23:35:16.754 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 32 2023-07-05T23:35:16.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.753+0000 7fb03a177700 1 -- 172.21.15.27:0/1776739235 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fb01406ace0 msgr2=0x7fb01406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:16.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.753+0000 7fb03a177700 1 --2- 172.21.15.27:0/1776739235 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fb01406ace0 0x7fb01406d190 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb02400d8b0 tx=0x7fb024008040 comp rx=0 tx=0).stop 2023-07-05T23:35:16.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.753+0000 7fb03a177700 1 -- 172.21.15.27:0/1776739235 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb0340aecc0 msgr2=0x7fb0340b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:16.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.753+0000 7fb03a177700 1 --2- 172.21.15.27:0/1776739235 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb0340aecc0 0x7fb0340b5050 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb01c00c4b0 tx=0x7fb01c00c870 comp rx=0 tx=0).stop 2023-07-05T23:35:16.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.753+0000 7fb03a177700 1 -- 172.21.15.27:0/1776739235 shutdown_connections 2023-07-05T23:35:16.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.753+0000 7fb03a177700 1 --2- 172.21.15.27:0/1776739235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb03415fc60 0x7fb0340ae050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:16.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.753+0000 7fb03a177700 1 --2- 172.21.15.27:0/1776739235 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fb01406ace0 0x7fb01406d190 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:16.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.753+0000 7fb03a177700 1 --2- 172.21.15.27:0/1776739235 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb03406e970 0x7fb034159d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:16.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.753+0000 7fb03a177700 1 --2- 172.21.15.27:0/1776739235 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb0340aecc0 0x7fb0340b5050 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:16.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.753+0000 7fb03a177700 1 -- 172.21.15.27:0/1776739235 >> 172.21.15.27:0/1776739235 conn(0x7fb03406b920 msgr2=0x7fb0340b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:16.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.753+0000 7fb03a177700 1 -- 172.21.15.27:0/1776739235 shutdown_connections 2023-07-05T23:35:16.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.753+0000 7fb03a177700 1 -- 172.21.15.27:0/1776739235 wait complete. 2023-07-05T23:35:16.769 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-05T23:35:16.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.892+0000 7effdf0ea700 1 Processor -- start 2023-07-05T23:35:16.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.892+0000 7effdf0ea700 1 -- start start 2023-07-05T23:35:16.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.892+0000 7effdf0ea700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7effd8156880 0x7effd8069ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:16.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.892+0000 7effdf0ea700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7effd80aed30 0x7effd8160580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:16.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.892+0000 7effdf0ea700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effd80cee80 con 0x7effd80cc1d0 2023-07-05T23:35:16.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.892+0000 7effdf0ea700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effd80cf100 con 0x7effd8156880 2023-07-05T23:35:16.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.892+0000 7effdf0ea700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effd80cf3e0 con 0x7effd80aed30 2023-07-05T23:35:16.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.893+0000 7effd7fff700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7effd80aed30 0x7effd8160580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:16.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.893+0000 7effdce86700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7effd8156880 0x7effd8069ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:16.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.893+0000 7effd7fff700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7effd80aed30 0x7effd8160580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.27:46438/0 (socket says 172.21.15.27:46438) 2023-07-05T23:35:16.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.893+0000 7effdce86700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7effd8156880 0x7effd8069ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.27:44338/0 (socket says 172.21.15.27:44338) 2023-07-05T23:35:16.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.893+0000 7effd7fff700 1 -- 172.21.15.27:0/2721940533 learned_addr learned my addr 172.21.15.27:0/2721940533 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:16.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.893+0000 7effdd687700 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7effd80cc1d0 0x7effd815cb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.27:34538/0 (socket says 172.21.15.27:34538) 2023-07-05T23:35:16.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.893+0000 7effd7fff700 1 -- 172.21.15.27:0/2721940533 >> v2:172.21.15.162:3300/0 conn(0x7effd8156880 msgr2=0x7effd8069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:35:16.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.893+0000 7effd7fff700 1 --2- 172.21.15.27:0/2721940533 >> v2:172.21.15.162:3300/0 conn(0x7effd8156880 0x7effd8069ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:16.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.893+0000 7effd7fff700 1 -- 172.21.15.27:0/2721940533 >> v1:172.21.15.162:6789/0 conn(0x7effd80cc1d0 legacy=0x7effd815cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:16.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.893+0000 7effd7fff700 1 -- 172.21.15.27:0/2721940533 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effd80cd390 con 0x7effd80aed30 2023-07-05T23:35:16.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.893+0000 7effd77fe700 1 -- 172.21.15.27:0/2721940533 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 770516113 0 0) 0x7effd80cee80 con 0x7effd80cc1d0 2023-07-05T23:35:16.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.893+0000 7effdce86700 1 --2- 172.21.15.27:0/2721940533 >> v2:172.21.15.162:3300/0 conn(0x7effd8156880 0x7effd8069ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T23:35:16.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.893+0000 7effd7fff700 1 --2- 172.21.15.27:0/2721940533 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7effd80aed30 0x7effd8160580 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7effc40098f0 tx=0x7effc4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=604940d25159ddb6 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:16.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.894+0000 7effd77fe700 1 -- 172.21.15.27:0/2721940533 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc4011830 con 0x7effd80aed30 2023-07-05T23:35:16.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.894+0000 7effd77fe700 1 -- 172.21.15.27:0/2721940533 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effc4011990 con 0x7effd80aed30 2023-07-05T23:35:16.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.894+0000 7effd77fe700 1 -- 172.21.15.27:0/2721940533 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc4011d20 con 0x7effd80aed30 2023-07-05T23:35:16.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.894+0000 7effdf0ea700 1 -- 172.21.15.27:0/2721940533 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7effd80aed30 msgr2=0x7effd8160580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:16.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.894+0000 7effdf0ea700 1 --2- 172.21.15.27:0/2721940533 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7effd80aed30 0x7effd8160580 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7effc40098f0 tx=0x7effc4009c00 comp rx=0 tx=0).stop 2023-07-05T23:35:16.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.894+0000 7effdf0ea700 1 -- 172.21.15.27:0/2721940533 shutdown_connections 2023-07-05T23:35:16.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.894+0000 7effdf0ea700 1 --2- 172.21.15.27:0/2721940533 >> v2:172.21.15.162:3300/0 conn(0x7effd8156880 0x7effd8069ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:16.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.894+0000 7effdf0ea700 1 --2- 172.21.15.27:0/2721940533 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7effd80aed30 0x7effd8160580 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:16.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.894+0000 7effdf0ea700 1 -- 172.21.15.27:0/2721940533 >> 172.21.15.27:0/2721940533 conn(0x7effd806d4a0 msgr2=0x7effd806d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:16.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.894+0000 7effdf0ea700 1 -- 172.21.15.27:0/2721940533 shutdown_connections 2023-07-05T23:35:16.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.894+0000 7effdf0ea700 1 -- 172.21.15.27:0/2721940533 wait complete. 2023-07-05T23:35:16.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.895+0000 7effdf0ea700 1 Processor -- start 2023-07-05T23:35:16.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.895+0000 7effdf0ea700 1 -- start start 2023-07-05T23:35:16.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.896+0000 7effdf0ea700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7effd80aed30 0x7effd814fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:16.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.896+0000 7effdf0ea700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7effd80cc1d0 0x7effd80c51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:16.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.896+0000 7effdf0ea700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7effd8156880 0x7effd815c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:16.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.896+0000 7effdf0ea700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd81f25e0 con 0x7effd8156880 2023-07-05T23:35:16.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.896+0000 7effdf0ea700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd80c46d0 con 0x7effd80cc1d0 2023-07-05T23:35:16.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.896+0000 7effdf0ea700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effd80c49b0 con 0x7effd80aed30 2023-07-05T23:35:16.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.896+0000 7effdd687700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7effd8156880 0x7effd815c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:16.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.896+0000 7effdd687700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7effd8156880 0x7effd815c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46410/0 (socket says 172.21.15.27:46410) 2023-07-05T23:35:16.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.897+0000 7effdd687700 1 -- 172.21.15.27:0/1835477828 learned_addr learned my addr 172.21.15.27:0/1835477828 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:16.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.897+0000 7effdce86700 1 --2- 172.21.15.27:0/1835477828 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7effd80aed30 0x7effd814fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:16.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.897+0000 7effd7fff700 1 --2- 172.21.15.27:0/1835477828 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7effd80cc1d0 0x7effd80c51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:16.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.897+0000 7effdd687700 1 -- 172.21.15.27:0/1835477828 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7effd80aed30 msgr2=0x7effd814fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:16.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.897+0000 7effdd687700 1 --2- 172.21.15.27:0/1835477828 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7effd80aed30 0x7effd814fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:16.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.897+0000 7effdd687700 1 -- 172.21.15.27:0/1835477828 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7effd80cc1d0 msgr2=0x7effd80c51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:16.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.897+0000 7effdd687700 1 --2- 172.21.15.27:0/1835477828 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7effd80cc1d0 0x7effd80c51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:16.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.897+0000 7effdd687700 1 -- 172.21.15.27:0/1835477828 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effcc0094a0 con 0x7effd8156880 2023-07-05T23:35:16.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.897+0000 7effd7fff700 1 --2- 172.21.15.27:0/1835477828 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7effd80cc1d0 0x7effd80c51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T23:35:16.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.897+0000 7effdd687700 1 --2- 172.21.15.27:0/1835477828 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7effd8156880 0x7effd815c950 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7effd0002230 tx=0x7effd000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:16.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.897+0000 7effd57fa700 1 -- 172.21.15.27:0/1835477828 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd000ac20 con 0x7effd8156880 2023-07-05T23:35:16.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.897+0000 7effd57fa700 1 -- 172.21.15.27:0/1835477828 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effd000ada0 con 0x7effd8156880 2023-07-05T23:35:16.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.897+0000 7effdf0ea700 1 -- 172.21.15.27:0/1835477828 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effc4009550 con 0x7effd8156880 2023-07-05T23:35:16.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.897+0000 7effd57fa700 1 -- 172.21.15.27:0/1835477828 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd0007310 con 0x7effd8156880 2023-07-05T23:35:16.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.897+0000 7effdf0ea700 1 -- 172.21.15.27:0/1835477828 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effd80c56f0 con 0x7effd8156880 2023-07-05T23:35:16.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.898+0000 7effdf0ea700 1 -- 172.21.15.27:0/1835477828 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effd80c4510 con 0x7effd8156880 2023-07-05T23:35:16.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.899+0000 7effd57fa700 1 -- 172.21.15.27:0/1835477828 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7effd0007470 con 0x7effd8156880 2023-07-05T23:35:16.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.899+0000 7effd57fa700 1 --2- 172.21.15.27:0/1835477828 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7effbc06ace0 0x7effbc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:16.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.899+0000 7effd57fa700 1 -- 172.21.15.27:0/1835477828 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7effd0089640 con 0x7effd8156880 2023-07-05T23:35:16.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.899+0000 7effdce86700 1 --2- 172.21.15.27:0/1835477828 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7effbc06ace0 0x7effbc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:16.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.900+0000 7effdce86700 1 --2- 172.21.15.27:0/1835477828 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7effbc06ace0 0x7effbc06d190 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7effd81ef430 tx=0x7effcc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:16.916 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:16.904+0000 7effd57fa700 1 -- 172.21.15.27:0/1835477828 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7effd0054450 con 0x7effd8156880 2023-07-05T23:35:17.121 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:17.118+0000 7effdf0ea700 1 -- 172.21.15.27:0/1835477828 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7effd8073910 con 0x7effd8156880 2023-07-05T23:35:17.121 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:17.118+0000 7effd57fa700 1 -- 172.21.15.27:0/1835477828 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v30) v1 ==== 80+0+0 (secure 0 0 0) 0x7effd0057a70 con 0x7effd8156880 2023-07-05T23:35:17.123 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:17.120+0000 7effdf0ea700 1 -- 172.21.15.27:0/1835477828 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7effbc06ace0 msgr2=0x7effbc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:17.123 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:17.120+0000 7effdf0ea700 1 --2- 172.21.15.27:0/1835477828 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7effbc06ace0 0x7effbc06d190 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7effd81ef430 tx=0x7effcc008040 comp rx=0 tx=0).stop 2023-07-05T23:35:17.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:17.120+0000 7effdf0ea700 1 -- 172.21.15.27:0/1835477828 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7effd8156880 msgr2=0x7effd815c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:17.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:17.120+0000 7effdf0ea700 1 --2- 172.21.15.27:0/1835477828 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7effd8156880 0x7effd815c950 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7effd0002230 tx=0x7effd000a060 comp rx=0 tx=0).stop 2023-07-05T23:35:17.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:17.120+0000 7effdf0ea700 1 -- 172.21.15.27:0/1835477828 shutdown_connections 2023-07-05T23:35:17.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:17.120+0000 7effdf0ea700 1 --2- 172.21.15.27:0/1835477828 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7effbc06ace0 0x7effbc06d190 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:17.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:17.120+0000 7effdf0ea700 1 --2- 172.21.15.27:0/1835477828 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7effd8156880 0x7effd815c950 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:17.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:17.120+0000 7effdf0ea700 1 --2- 172.21.15.27:0/1835477828 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7effd80aed30 0x7effd814fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:17.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:17.120+0000 7effdf0ea700 1 --2- 172.21.15.27:0/1835477828 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7effd80cc1d0 0x7effd80c51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:17.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:17.120+0000 7effdf0ea700 1 -- 172.21.15.27:0/1835477828 >> 172.21.15.27:0/1835477828 conn(0x7effd806d4a0 msgr2=0x7effd80b0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:17.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:17.120+0000 7effdf0ea700 1 -- 172.21.15.27:0/1835477828 shutdown_connections 2023-07-05T23:35:17.126 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:17.120+0000 7effdf0ea700 1 -- 172.21.15.27:0/1835477828 wait complete. 2023-07-05T23:35:17.126 INFO:teuthology.orchestra.run.smithi027.stderr:listed 0 entries 2023-07-05T23:35:17.136 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-07-05T23:35:17.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:35:17.136 DEBUG:teuthology.orchestra.run.smithi162:> sudo umount /home/ubuntu/cephtest/mnt.3 2023-07-05T23:35:17.265 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi162.front.sepia.ceph.com 2023-07-05T23:35:17.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:35:17.266 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-07-05T23:35:17.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:35:17.301 DEBUG:teuthology.orchestra.run.smithi027:> ip netns list 2023-07-05T23:35:17.318 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-05T23:35:17.319 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-05T23:35:17.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:35:17.320 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-05T23:35:17.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:35:17.404 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-05T23:35:17.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:35:17.488 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link delete ceph-brx 2023-07-05T23:35:17.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:35:17.599 DEBUG:teuthology.orchestra.run.smithi027:> ip netns list 2023-07-05T23:35:17.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:35:17.618 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link delete ceph-brx 2023-07-05T23:35:17.688 INFO:teuthology.orchestra.run.smithi027.stderr:Cannot find device "ceph-brx" 2023-07-05T23:35:17.689 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-05T23:35:17.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:35:17.690 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2023-07-05T23:35:17.708 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-07-05T23:35:17.709 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-05T23:35:17.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:35:17.709 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-07-05T23:35:17.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:35:17.787 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-05T23:35:17.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:35:17.873 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link delete ceph-brx 2023-07-05T23:35:17.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:35:17.976 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2023-07-05T23:35:17.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-05T23:35:17.994 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link delete ceph-brx 2023-07-05T23:35:18.064 INFO:teuthology.orchestra.run.smithi162.stderr:Cannot find device "ceph-brx" 2023-07-05T23:35:18.065 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-05T23:35:18.066 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-07-05T23:35:18.076 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-07-05T23:35:18.077 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-05T23:35:18.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.202+0000 7f5644a06700 1 Processor -- start 2023-07-05T23:35:18.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.202+0000 7f5644a06700 1 -- start start 2023-07-05T23:35:18.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.203+0000 7f5644a06700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5640158ef0 0x7f56400cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:18.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.203+0000 7f5644a06700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f56400709f0 0x7f56400ca290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:18.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.203+0000 7f5644a06700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f564006c4d0 con 0x7f564006c060 2023-07-05T23:35:18.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.203+0000 7f5644a06700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56400c9510 con 0x7f56400709f0 2023-07-05T23:35:18.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.203+0000 7f5644a06700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56400cd6a0 con 0x7f5640158ef0 2023-07-05T23:35:18.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.203+0000 7f563dd9b700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f564006c060 0x7f56400702e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:53580/0 (socket says 172.21.15.27:53580) 2023-07-05T23:35:18.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.203+0000 7f563dd9b700 1 -- 172.21.15.27:0/2449180644 learned_addr learned my addr 172.21.15.27:0/2449180644 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-07-05T23:35:18.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.203+0000 7f563e59c700 1 --2- 172.21.15.27:0/2449180644 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5640158ef0 0x7f56400cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:18.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.203+0000 7f563ed9d700 1 --2- 172.21.15.27:0/2449180644 >> v2:172.21.15.162:3300/0 conn(0x7f56400709f0 0x7f56400ca290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:18.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.204+0000 7f563d59a700 1 -- 172.21.15.27:0/2449180644 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 277490149 0 0) 0x7f564006c4d0 con 0x7f564006c060 2023-07-05T23:35:18.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.204+0000 7f563d59a700 1 -- 172.21.15.27:0/2449180644 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56280035b0 con 0x7f564006c060 2023-07-05T23:35:18.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.204+0000 7f563e59c700 1 -- 172.21.15.27:0/2449180644 >> v2:172.21.15.162:3300/0 conn(0x7f56400709f0 msgr2=0x7f56400ca290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:35:18.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.204+0000 7f563e59c700 1 --2- 172.21.15.27:0/2449180644 >> v2:172.21.15.162:3300/0 conn(0x7f56400709f0 0x7f56400ca290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:18.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.204+0000 7f563e59c700 1 -- 172.21.15.27:0/2449180644 >> v1:172.21.15.27:6789/0 conn(0x7f564006c060 legacy=0x7f56400702e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:18.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.204+0000 7f563e59c700 1 -- 172.21.15.27:0/2449180644 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56400cd980 con 0x7f5640158ef0 2023-07-05T23:35:18.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.204+0000 7f563ed9d700 1 --2- 172.21.15.27:0/2449180644 >> v2:172.21.15.162:3300/0 conn(0x7f56400709f0 0x7f56400ca290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T23:35:18.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.204+0000 7f563e59c700 1 --2- 172.21.15.27:0/2449180644 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5640158ef0 0x7f56400cf1e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5630009840 tx=0x7f5630009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a7dfd8201262096 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:18.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.204+0000 7f563d59a700 1 -- 172.21.15.27:0/2449180644 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5630011830 con 0x7f5640158ef0 2023-07-05T23:35:18.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.204+0000 7f563d59a700 1 -- 172.21.15.27:0/2449180644 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5630011990 con 0x7f5640158ef0 2023-07-05T23:35:18.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.204+0000 7f563d59a700 1 -- 172.21.15.27:0/2449180644 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5630011d20 con 0x7f5640158ef0 2023-07-05T23:35:18.213 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.205+0000 7f5644a06700 1 -- 172.21.15.27:0/2449180644 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5640158ef0 msgr2=0x7f56400cf1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:18.214 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.205+0000 7f5644a06700 1 --2- 172.21.15.27:0/2449180644 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5640158ef0 0x7f56400cf1e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5630009840 tx=0x7f5630009b50 comp rx=0 tx=0).stop 2023-07-05T23:35:18.214 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.205+0000 7f5644a06700 1 -- 172.21.15.27:0/2449180644 shutdown_connections 2023-07-05T23:35:18.214 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.205+0000 7f5644a06700 1 --2- 172.21.15.27:0/2449180644 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5640158ef0 0x7f56400cf1e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:18.214 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.205+0000 7f5644a06700 1 --2- 172.21.15.27:0/2449180644 >> v2:172.21.15.162:3300/0 conn(0x7f56400709f0 0x7f56400ca290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:18.214 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.205+0000 7f5644a06700 1 -- 172.21.15.27:0/2449180644 >> 172.21.15.27:0/2449180644 conn(0x7f56400b0ef0 msgr2=0x7f56400ce690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:18.215 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.205+0000 7f5644a06700 1 -- 172.21.15.27:0/2449180644 shutdown_connections 2023-07-05T23:35:18.215 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.205+0000 7f5644a06700 1 -- 172.21.15.27:0/2449180644 wait complete. 2023-07-05T23:35:18.215 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.206+0000 7f5644a06700 1 Processor -- start 2023-07-05T23:35:18.215 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.206+0000 7f5644a06700 1 -- start start 2023-07-05T23:35:18.215 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.208+0000 7f5644a06700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f564006c060 0x7f56400c6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:18.216 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.208+0000 7f5644a06700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56400709f0 0x7f5640151ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:18.216 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.208+0000 7f5644a06700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5640158ef0 0x7f56400ac9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:18.216 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.208+0000 7f5644a06700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56400c7230 con 0x7f5640158ef0 2023-07-05T23:35:18.216 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.208+0000 7f5644a06700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56400c5970 con 0x7f56400709f0 2023-07-05T23:35:18.216 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.208+0000 7f5644a06700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56400c5c50 con 0x7f564006c060 2023-07-05T23:35:18.217 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.208+0000 7f563ed9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5640158ef0 0x7f56400ac9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:18.217 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.208+0000 7f563ed9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5640158ef0 0x7f56400ac9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46424/0 (socket says 172.21.15.27:46424) 2023-07-05T23:35:18.217 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.208+0000 7f563ed9d700 1 -- 172.21.15.27:0/2292236405 learned_addr learned my addr 172.21.15.27:0/2292236405 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:18.217 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.208+0000 7f563e59c700 1 --2- 172.21.15.27:0/2292236405 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f564006c060 0x7f56400c6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:18.217 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.208+0000 7f563dd9b700 1 --2- 172.21.15.27:0/2292236405 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56400709f0 0x7f5640151ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:18.218 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.208+0000 7f563ed9d700 1 -- 172.21.15.27:0/2292236405 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f564006c060 msgr2=0x7f56400c6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:18.218 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.208+0000 7f563ed9d700 1 --2- 172.21.15.27:0/2292236405 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f564006c060 0x7f56400c6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:18.218 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.208+0000 7f563ed9d700 1 -- 172.21.15.27:0/2292236405 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56400709f0 msgr2=0x7f5640151ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:18.218 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.208+0000 7f563ed9d700 1 --2- 172.21.15.27:0/2292236405 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56400709f0 0x7f5640151ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:18.218 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.208+0000 7f563ed9d700 1 -- 172.21.15.27:0/2292236405 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5638009a70 con 0x7f5640158ef0 2023-07-05T23:35:18.219 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.208+0000 7f563ed9d700 1 --2- 172.21.15.27:0/2292236405 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5640158ef0 0x7f56400ac9a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f563800ef90 tx=0x7f563800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:18.219 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.208+0000 7f562effd700 1 -- 172.21.15.27:0/2292236405 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563800cc90 con 0x7f5640158ef0 2023-07-05T23:35:18.219 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.208+0000 7f562effd700 1 -- 172.21.15.27:0/2292236405 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f563800f040 con 0x7f5640158ef0 2023-07-05T23:35:18.219 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.208+0000 7f5644a06700 1 -- 172.21.15.27:0/2292236405 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56300094a0 con 0x7f5640158ef0 2023-07-05T23:35:18.219 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.208+0000 7f562effd700 1 -- 172.21.15.27:0/2292236405 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56380146c0 con 0x7f5640158ef0 2023-07-05T23:35:18.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.208+0000 7f5644a06700 1 -- 172.21.15.27:0/2292236405 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56400c6210 con 0x7f5640158ef0 2023-07-05T23:35:18.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.209+0000 7f5644a06700 1 -- 172.21.15.27:0/2292236405 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56400abe00 con 0x7f5640158ef0 2023-07-05T23:35:18.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.209+0000 7f562effd700 1 -- 172.21.15.27:0/2292236405 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5638014820 con 0x7f5640158ef0 2023-07-05T23:35:18.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.210+0000 7f562effd700 1 --2- 172.21.15.27:0/2292236405 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f562006ace0 0x7f562006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:18.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.210+0000 7f562effd700 1 -- 172.21.15.27:0/2292236405 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f563808a340 con 0x7f5640158ef0 2023-07-05T23:35:18.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.210+0000 7f563e59c700 1 --2- 172.21.15.27:0/2292236405 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f562006ace0 0x7f562006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:18.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.210+0000 7f563e59c700 1 --2- 172.21.15.27:0/2292236405 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f562006ace0 0x7f562006d190 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5630000c00 tx=0x7f5630008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:18.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.215+0000 7f562effd700 1 -- 172.21.15.27:0/2292236405 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5638058be0 con 0x7f5640158ef0 2023-07-05T23:35:18.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.407+0000 7f5644a06700 1 -- 172.21.15.27:0/2292236405 --> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f56400c9a90 con 0x7f562006ace0 2023-07-05T23:35:18.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.419+0000 7f562effd700 1 -- 172.21.15.27:0/2292236405 <== mgr.4105 v2:172.21.15.162:6832/3790028097 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+391924 (secure 0 0 0) 0x7f5630011b00 con 0x7f562006ace0 2023-07-05T23:35:18.426 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:35:18.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.423+0000 7f5644a06700 1 -- 172.21.15.27:0/2292236405 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f562006ace0 msgr2=0x7f562006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:18.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.423+0000 7f5644a06700 1 --2- 172.21.15.27:0/2292236405 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f562006ace0 0x7f562006d190 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5630000c00 tx=0x7f5630008030 comp rx=0 tx=0).stop 2023-07-05T23:35:18.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.423+0000 7f5644a06700 1 -- 172.21.15.27:0/2292236405 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5640158ef0 msgr2=0x7f56400ac9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:18.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.423+0000 7f5644a06700 1 --2- 172.21.15.27:0/2292236405 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5640158ef0 0x7f56400ac9a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f563800ef90 tx=0x7f563800c3a0 comp rx=0 tx=0).stop 2023-07-05T23:35:18.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.423+0000 7f5644a06700 1 -- 172.21.15.27:0/2292236405 shutdown_connections 2023-07-05T23:35:18.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.423+0000 7f5644a06700 1 --2- 172.21.15.27:0/2292236405 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f562006ace0 0x7f562006d190 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:18.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.423+0000 7f5644a06700 1 --2- 172.21.15.27:0/2292236405 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5640158ef0 0x7f56400ac9a0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:18.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.423+0000 7f5644a06700 1 --2- 172.21.15.27:0/2292236405 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f564006c060 0x7f56400c6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:18.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.423+0000 7f5644a06700 1 --2- 172.21.15.27:0/2292236405 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56400709f0 0x7f5640151ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:18.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.423+0000 7f5644a06700 1 -- 172.21.15.27:0/2292236405 >> 172.21.15.27:0/2292236405 conn(0x7f56400b0ef0 msgr2=0x7f564006db20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:18.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.423+0000 7f5644a06700 1 -- 172.21.15.27:0/2292236405 shutdown_connections 2023-07-05T23:35:18.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.423+0000 7f5644a06700 1 -- 172.21.15.27:0/2292236405 wait complete. 2023-07-05T23:35:18.432 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2023-07-05T23:35:18.437 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":102,"stamp":"2023-07-05T23:35:17.675366+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":157223512,"num_objects":62,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":130,"num_read_kb":116,"num_write":1174,"num_write_kb":1241107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17140,"ondisk_log_size":17140,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":687112,"kb_used_data":430536,"kb_used_omap":0,"kb_used_meta":256512,"kb_avail":754287608,"statfs":{"total":773094113280,"available":772390510592,"internally_reserved":0,"allocated":440868864,"data_stored":439289651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":262668288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1,0,0,0,3,4],"upper_bound":128},"perf_stat":{"commit_latency_ms":105,"apply_latency_ms":105,"commit_latency_ns":105000000,"apply_latency_ns":105000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-249284625,"num_objects":-61,"num_object_clones":0,"num_object_copies":-244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-61,"num_whiteouts":0,"num_read":10,"num_read_kb":12,"num_write":579,"num_write_kb":842061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003167"},"pg_stats":[{"pgid":"4.3f","version":"30'17","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.504698+0000","last_change":"2023-07-05T23:32:53.342316+0000","last_active":"2023-07-05T23:35:14.504698+0000","last_peered":"2023-07-05T23:35:14.504698+0000","last_clean":"2023-07-05T23:35:14.504698+0000","last_became_active":"2023-07-05T23:32:53.342061+0000","last_became_peered":"2023-07-05T23:32:53.342061+0000","last_unstale":"2023-07-05T23:35:14.504698+0000","last_undegraded":"2023-07-05T23:35:14.504698+0000","last_fullsized":"2023-07-05T23:35:14.504698+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:27:59.144444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"30'19","reported_seq":43,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.510265+0000","last_change":"2023-07-05T23:32:53.343107+0000","last_active":"2023-07-05T23:35:14.510265+0000","last_peered":"2023-07-05T23:35:14.510265+0000","last_clean":"2023-07-05T23:35:14.510265+0000","last_became_active":"2023-07-05T23:32:53.342843+0000","last_became_peered":"2023-07-05T23:32:53.342843+0000","last_unstale":"2023-07-05T23:35:14.510265+0000","last_undegraded":"2023-07-05T23:35:14.510265+0000","last_fullsized":"2023-07-05T23:35:14.510265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:34:18.782861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"30'35","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.520965+0000","last_change":"2023-07-05T23:32:53.339304+0000","last_active":"2023-07-05T23:35:14.520965+0000","last_peered":"2023-07-05T23:35:14.520965+0000","last_clean":"2023-07-05T23:35:14.520965+0000","last_became_active":"2023-07-05T23:32:53.338973+0000","last_became_peered":"2023-07-05T23:32:53.338973+0000","last_unstale":"2023-07-05T23:35:14.520965+0000","last_undegraded":"2023-07-05T23:35:14.520965+0000","last_fullsized":"2023-07-05T23:35:14.520965+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:28:30.568393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"30'17","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.504477+0000","last_change":"2023-07-05T23:32:53.334788+0000","last_active":"2023-07-05T23:35:14.504477+0000","last_peered":"2023-07-05T23:35:14.504477+0000","last_clean":"2023-07-05T23:35:14.504477+0000","last_became_active":"2023-07-05T23:32:53.334473+0000","last_became_peered":"2023-07-05T23:32:53.334473+0000","last_unstale":"2023-07-05T23:35:14.504477+0000","last_undegraded":"2023-07-05T23:35:14.504477+0000","last_fullsized":"2023-07-05T23:35:14.504477+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:32:19.839362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"30'25","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.517731+0000","last_change":"2023-07-05T23:32:53.346034+0000","last_active":"2023-07-05T23:35:14.517731+0000","last_peered":"2023-07-05T23:35:14.517731+0000","last_clean":"2023-07-05T23:35:14.517731+0000","last_became_active":"2023-07-05T23:32:53.345743+0000","last_became_peered":"2023-07-05T23:32:53.345743+0000","last_unstale":"2023-07-05T23:35:14.517731+0000","last_undegraded":"2023-07-05T23:35:14.517731+0000","last_fullsized":"2023-07-05T23:35:14.517731+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:09:06.821067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"30'27","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.514654+0000","last_change":"2023-07-05T23:32:53.335744+0000","last_active":"2023-07-05T23:35:14.514654+0000","last_peered":"2023-07-05T23:35:14.514654+0000","last_clean":"2023-07-05T23:35:14.514654+0000","last_became_active":"2023-07-05T23:32:53.335456+0000","last_became_peered":"2023-07-05T23:32:53.335456+0000","last_unstale":"2023-07-05T23:35:14.514654+0000","last_undegraded":"2023-07-05T23:35:14.514654+0000","last_fullsized":"2023-07-05T23:35:14.514654+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:29:41.800131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"30'21","reported_seq":44,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.510034+0000","last_change":"2023-07-05T23:32:53.341154+0000","last_active":"2023-07-05T23:35:14.510034+0000","last_peered":"2023-07-05T23:35:14.510034+0000","last_clean":"2023-07-05T23:35:14.510034+0000","last_became_active":"2023-07-05T23:32:53.340639+0000","last_became_peered":"2023-07-05T23:32:53.340639+0000","last_unstale":"2023-07-05T23:35:14.510034+0000","last_undegraded":"2023-07-05T23:35:14.510034+0000","last_fullsized":"2023-07-05T23:35:14.510034+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:06:29.575306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"30'24","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.514718+0000","last_change":"2023-07-05T23:32:53.336514+0000","last_active":"2023-07-05T23:35:14.514718+0000","last_peered":"2023-07-05T23:35:14.514718+0000","last_clean":"2023-07-05T23:35:14.514718+0000","last_became_active":"2023-07-05T23:32:53.336216+0000","last_became_peered":"2023-07-05T23:32:53.336216+0000","last_unstale":"2023-07-05T23:35:14.514718+0000","last_undegraded":"2023-07-05T23:35:14.514718+0000","last_fullsized":"2023-07-05T23:35:14.514718+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:09:56.721492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"30'31","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.516947+0000","last_change":"2023-07-05T23:32:53.348265+0000","last_active":"2023-07-05T23:35:14.516947+0000","last_peered":"2023-07-05T23:35:14.516947+0000","last_clean":"2023-07-05T23:35:14.516947+0000","last_became_active":"2023-07-05T23:32:53.347948+0000","last_became_peered":"2023-07-05T23:32:53.347948+0000","last_unstale":"2023-07-05T23:35:14.516947+0000","last_undegraded":"2023-07-05T23:35:14.516947+0000","last_fullsized":"2023-07-05T23:35:14.516947+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:30:02.990759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"30'36","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.518332+0000","last_change":"2023-07-05T23:32:53.330422+0000","last_active":"2023-07-05T23:35:14.518332+0000","last_peered":"2023-07-05T23:35:14.518332+0000","last_clean":"2023-07-05T23:35:14.518332+0000","last_became_active":"2023-07-05T23:32:53.330135+0000","last_became_peered":"2023-07-05T23:32:53.330135+0000","last_unstale":"2023-07-05T23:35:14.518332+0000","last_undegraded":"2023-07-05T23:35:14.518332+0000","last_fullsized":"2023-07-05T23:35:14.518332+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:32:03.040658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"30'21","reported_seq":44,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.521160+0000","last_change":"2023-07-05T23:32:53.341815+0000","last_active":"2023-07-05T23:35:14.521160+0000","last_peered":"2023-07-05T23:35:14.521160+0000","last_clean":"2023-07-05T23:35:14.521160+0000","last_became_active":"2023-07-05T23:32:53.341526+0000","last_became_peered":"2023-07-05T23:32:53.341526+0000","last_unstale":"2023-07-05T23:35:14.521160+0000","last_undegraded":"2023-07-05T23:35:14.521160+0000","last_fullsized":"2023-07-05T23:35:14.521160+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:28:47.019912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"30'21","reported_seq":44,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.522342+0000","last_change":"2023-07-05T23:32:53.337552+0000","last_active":"2023-07-05T23:35:14.522342+0000","last_peered":"2023-07-05T23:35:14.522342+0000","last_clean":"2023-07-05T23:35:14.522342+0000","last_became_active":"2023-07-05T23:32:53.337279+0000","last_became_peered":"2023-07-05T23:32:53.337279+0000","last_unstale":"2023-07-05T23:35:14.522342+0000","last_undegraded":"2023-07-05T23:35:14.522342+0000","last_fullsized":"2023-07-05T23:35:14.522342+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:24:31.034513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"30'26","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.505213+0000","last_change":"2023-07-05T23:32:53.336366+0000","last_active":"2023-07-05T23:35:14.505213+0000","last_peered":"2023-07-05T23:35:14.505213+0000","last_clean":"2023-07-05T23:35:14.505213+0000","last_became_active":"2023-07-05T23:32:53.336083+0000","last_became_peered":"2023-07-05T23:32:53.336083+0000","last_unstale":"2023-07-05T23:35:14.505213+0000","last_undegraded":"2023-07-05T23:35:14.505213+0000","last_fullsized":"2023-07-05T23:35:14.505213+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:32:24.944898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"30'23","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.509476+0000","last_change":"2023-07-05T23:32:53.328235+0000","last_active":"2023-07-05T23:35:14.509476+0000","last_peered":"2023-07-05T23:35:14.509476+0000","last_clean":"2023-07-05T23:35:14.509476+0000","last_became_active":"2023-07-05T23:32:53.327918+0000","last_became_peered":"2023-07-05T23:32:53.327918+0000","last_unstale":"2023-07-05T23:35:14.509476+0000","last_undegraded":"2023-07-05T23:35:14.509476+0000","last_fullsized":"2023-07-05T23:35:14.509476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:00:42.415370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"30'25","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.510439+0000","last_change":"2023-07-05T23:32:53.340929+0000","last_active":"2023-07-05T23:35:14.510439+0000","last_peered":"2023-07-05T23:35:14.510439+0000","last_clean":"2023-07-05T23:35:14.510439+0000","last_became_active":"2023-07-05T23:32:53.340246+0000","last_became_peered":"2023-07-05T23:32:53.340246+0000","last_unstale":"2023-07-05T23:35:14.510439+0000","last_undegraded":"2023-07-05T23:35:14.510439+0000","last_fullsized":"2023-07-05T23:35:14.510439+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:48:30.276766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"30'31","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.520820+0000","last_change":"2023-07-05T23:32:53.336278+0000","last_active":"2023-07-05T23:35:14.520820+0000","last_peered":"2023-07-05T23:35:14.520820+0000","last_clean":"2023-07-05T23:35:14.520820+0000","last_became_active":"2023-07-05T23:32:53.336006+0000","last_became_peered":"2023-07-05T23:32:53.336006+0000","last_unstale":"2023-07-05T23:35:14.520820+0000","last_undegraded":"2023-07-05T23:35:14.520820+0000","last_fullsized":"2023-07-05T23:35:14.520820+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:28:30.623573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"30'26","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.517502+0000","last_change":"2023-07-05T23:32:53.346115+0000","last_active":"2023-07-05T23:35:14.517502+0000","last_peered":"2023-07-05T23:35:14.517502+0000","last_clean":"2023-07-05T23:35:14.517502+0000","last_became_active":"2023-07-05T23:32:53.345848+0000","last_became_peered":"2023-07-05T23:32:53.345848+0000","last_unstale":"2023-07-05T23:35:14.517502+0000","last_undegraded":"2023-07-05T23:35:14.517502+0000","last_fullsized":"2023-07-05T23:35:14.517502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:27:22.570990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"30'23","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.520608+0000","last_change":"2023-07-05T23:32:53.339001+0000","last_active":"2023-07-05T23:35:14.520608+0000","last_peered":"2023-07-05T23:35:14.520608+0000","last_clean":"2023-07-05T23:35:14.520608+0000","last_became_active":"2023-07-05T23:32:53.335535+0000","last_became_peered":"2023-07-05T23:32:53.335535+0000","last_unstale":"2023-07-05T23:35:14.520608+0000","last_undegraded":"2023-07-05T23:35:14.520608+0000","last_fullsized":"2023-07-05T23:35:14.520608+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:40:11.653019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"30'22","reported_seq":46,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.504890+0000","last_change":"2023-07-05T23:32:53.338403+0000","last_active":"2023-07-05T23:35:14.504890+0000","last_peered":"2023-07-05T23:35:14.504890+0000","last_clean":"2023-07-05T23:35:14.504890+0000","last_became_active":"2023-07-05T23:32:53.338095+0000","last_became_peered":"2023-07-05T23:32:53.338095+0000","last_unstale":"2023-07-05T23:35:14.504890+0000","last_undegraded":"2023-07-05T23:35:14.504890+0000","last_fullsized":"2023-07-05T23:35:14.504890+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:52:25.342366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"30'25","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.521479+0000","last_change":"2023-07-05T23:32:53.341961+0000","last_active":"2023-07-05T23:35:14.521479+0000","last_peered":"2023-07-05T23:35:14.521479+0000","last_clean":"2023-07-05T23:35:14.521479+0000","last_became_active":"2023-07-05T23:32:53.341783+0000","last_became_peered":"2023-07-05T23:32:53.341783+0000","last_unstale":"2023-07-05T23:35:14.521479+0000","last_undegraded":"2023-07-05T23:35:14.521479+0000","last_fullsized":"2023-07-05T23:35:14.521479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:42:23.689201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"30'33","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.505439+0000","last_change":"2023-07-05T23:32:53.348405+0000","last_active":"2023-07-05T23:35:14.505439+0000","last_peered":"2023-07-05T23:35:14.505439+0000","last_clean":"2023-07-05T23:35:14.505439+0000","last_became_active":"2023-07-05T23:32:53.348108+0000","last_became_peered":"2023-07-05T23:32:53.348108+0000","last_unstale":"2023-07-05T23:35:14.505439+0000","last_undegraded":"2023-07-05T23:35:14.505439+0000","last_fullsized":"2023-07-05T23:35:14.505439+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:09:56.721492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"30'24","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.512155+0000","last_change":"2023-07-05T23:32:53.340963+0000","last_active":"2023-07-05T23:35:14.512155+0000","last_peered":"2023-07-05T23:35:14.512155+0000","last_clean":"2023-07-05T23:35:14.512155+0000","last_became_active":"2023-07-05T23:32:53.340698+0000","last_became_peered":"2023-07-05T23:32:53.340698+0000","last_unstale":"2023-07-05T23:35:14.512155+0000","last_undegraded":"2023-07-05T23:35:14.512155+0000","last_fullsized":"2023-07-05T23:35:14.512155+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:34:43.735212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"30'28","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.510476+0000","last_change":"2023-07-05T23:32:53.345981+0000","last_active":"2023-07-05T23:35:14.510476+0000","last_peered":"2023-07-05T23:35:14.510476+0000","last_clean":"2023-07-05T23:35:14.510476+0000","last_became_active":"2023-07-05T23:32:53.345403+0000","last_became_peered":"2023-07-05T23:32:53.345403+0000","last_unstale":"2023-07-05T23:35:14.510476+0000","last_undegraded":"2023-07-05T23:35:14.510476+0000","last_fullsized":"2023-07-05T23:35:14.510476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:09:56.721492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"30'20","reported_seq":44,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.509712+0000","last_change":"2023-07-05T23:32:53.348335+0000","last_active":"2023-07-05T23:35:14.509712+0000","last_peered":"2023-07-05T23:35:14.509712+0000","last_clean":"2023-07-05T23:35:14.509712+0000","last_became_active":"2023-07-05T23:32:53.348053+0000","last_became_peered":"2023-07-05T23:32:53.348053+0000","last_unstale":"2023-07-05T23:35:14.509712+0000","last_undegraded":"2023-07-05T23:35:14.509712+0000","last_fullsized":"2023-07-05T23:35:14.509712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:03:45.831512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"30'19","reported_seq":43,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.505480+0000","last_change":"2023-07-05T23:32:53.339227+0000","last_active":"2023-07-05T23:35:14.505480+0000","last_peered":"2023-07-05T23:35:14.505480+0000","last_clean":"2023-07-05T23:35:14.505480+0000","last_became_active":"2023-07-05T23:32:53.338935+0000","last_became_peered":"2023-07-05T23:32:53.338935+0000","last_unstale":"2023-07-05T23:35:14.505480+0000","last_undegraded":"2023-07-05T23:35:14.505480+0000","last_fullsized":"2023-07-05T23:35:14.505480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:38:49.816055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"30'32","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.506682+0000","last_change":"2023-07-05T23:33:34.898632+0000","last_active":"2023-07-05T23:35:14.506682+0000","last_peered":"2023-07-05T23:35:14.506682+0000","last_clean":"2023-07-05T23:35:14.506682+0000","last_became_active":"2023-07-05T23:33:34.898383+0000","last_became_peered":"2023-07-05T23:33:34.898383+0000","last_unstale":"2023-07-05T23:35:14.506682+0000","last_undegraded":"2023-07-05T23:35:14.506682+0000","last_fullsized":"2023-07-05T23:35:14.506682+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:19:45.125125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.25","version":"30'21","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.510795+0000","last_change":"2023-07-05T23:32:53.336623+0000","last_active":"2023-07-05T23:35:14.510795+0000","last_peered":"2023-07-05T23:35:14.510795+0000","last_clean":"2023-07-05T23:35:14.510795+0000","last_became_active":"2023-07-05T23:32:53.335857+0000","last_became_peered":"2023-07-05T23:32:53.335857+0000","last_unstale":"2023-07-05T23:35:14.510795+0000","last_undegraded":"2023-07-05T23:35:14.510795+0000","last_fullsized":"2023-07-05T23:35:14.510795+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:53:37.219658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"30'478","reported_seq":495,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:13.488796+0000","last_change":"2023-07-05T23:32:57.365825+0000","last_active":"2023-07-05T23:35:13.488796+0000","last_peered":"2023-07-05T23:35:13.488796+0000","last_clean":"2023-07-05T23:35:13.488796+0000","last_became_active":"2023-07-05T23:32:57.365409+0000","last_became_peered":"2023-07-05T23:32:57.365409+0000","last_unstale":"2023-07-05T23:35:13.488796+0000","last_undegraded":"2023-07-05T23:35:13.488796+0000","last_fullsized":"2023-07-05T23:35:13.488796+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:43:38.161766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.205650+0000","last_change":"2023-07-05T23:32:52.901348+0000","last_active":"2023-07-05T23:33:35.205650+0000","last_peered":"2023-07-05T23:33:35.205650+0000","last_clean":"2023-07-05T23:33:35.205650+0000","last_became_active":"2023-07-05T23:32:52.901080+0000","last_became_peered":"2023-07-05T23:32:52.901080+0000","last_unstale":"2023-07-05T23:33:35.205650+0000","last_undegraded":"2023-07-05T23:33:35.205650+0000","last_fullsized":"2023-07-05T23:33:35.205650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:43:25.294641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'32","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.507557+0000","last_change":"2023-07-05T23:32:53.339739+0000","last_active":"2023-07-05T23:35:14.507557+0000","last_peered":"2023-07-05T23:35:14.507557+0000","last_clean":"2023-07-05T23:35:14.507557+0000","last_became_active":"2023-07-05T23:32:53.339464+0000","last_became_peered":"2023-07-05T23:32:53.339464+0000","last_unstale":"2023-07-05T23:35:14.507557+0000","last_undegraded":"2023-07-05T23:35:14.507557+0000","last_fullsized":"2023-07-05T23:35:14.507557+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:53:37.219658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"30'446","reported_seq":464,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:13.540073+0000","last_change":"2023-07-05T23:32:57.354002+0000","last_active":"2023-07-05T23:35:13.540073+0000","last_peered":"2023-07-05T23:35:13.540073+0000","last_clean":"2023-07-05T23:35:13.540073+0000","last_became_active":"2023-07-05T23:32:57.353465+0000","last_became_peered":"2023-07-05T23:32:57.353465+0000","last_unstale":"2023-07-05T23:35:13.540073+0000","last_undegraded":"2023-07-05T23:35:13.540073+0000","last_fullsized":"2023-07-05T23:35:13.540073+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:14:15.951550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.228609+0000","last_change":"2023-07-05T23:32:52.909685+0000","last_active":"2023-07-05T23:33:35.228609+0000","last_peered":"2023-07-05T23:33:35.228609+0000","last_clean":"2023-07-05T23:33:35.228609+0000","last_became_active":"2023-07-05T23:32:52.909347+0000","last_became_peered":"2023-07-05T23:32:52.909347+0000","last_unstale":"2023-07-05T23:33:35.228609+0000","last_undegraded":"2023-07-05T23:33:35.228609+0000","last_fullsized":"2023-07-05T23:33:35.228609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:06:28.570968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"30'21","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.510356+0000","last_change":"2023-07-05T23:32:53.339219+0000","last_active":"2023-07-05T23:35:14.510356+0000","last_peered":"2023-07-05T23:35:14.510356+0000","last_clean":"2023-07-05T23:35:14.510356+0000","last_became_active":"2023-07-05T23:32:53.338825+0000","last_became_peered":"2023-07-05T23:32:53.338825+0000","last_unstale":"2023-07-05T23:35:14.510356+0000","last_undegraded":"2023-07-05T23:35:14.510356+0000","last_fullsized":"2023-07-05T23:35:14.510356+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:09:56.721492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"30'460","reported_seq":478,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:13.557186+0000","last_change":"2023-07-05T23:32:57.359406+0000","last_active":"2023-07-05T23:35:13.557186+0000","last_peered":"2023-07-05T23:35:13.557186+0000","last_clean":"2023-07-05T23:35:13.557186+0000","last_became_active":"2023-07-05T23:32:57.358965+0000","last_became_peered":"2023-07-05T23:32:57.358965+0000","last_unstale":"2023-07-05T23:35:13.557186+0000","last_undegraded":"2023-07-05T23:35:13.557186+0000","last_fullsized":"2023-07-05T23:35:13.557186+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:00:45.855064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"30'1","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.230210+0000","last_change":"2023-07-05T23:32:52.909226+0000","last_active":"2023-07-05T23:33:35.230210+0000","last_peered":"2023-07-05T23:33:35.230210+0000","last_clean":"2023-07-05T23:33:35.230210+0000","last_became_active":"2023-07-05T23:32:52.908756+0000","last_became_peered":"2023-07-05T23:32:52.908756+0000","last_unstale":"2023-07-05T23:33:35.230210+0000","last_undegraded":"2023-07-05T23:33:35.230210+0000","last_fullsized":"2023-07-05T23:33:35.230210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:11:59.892651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"30'20","reported_seq":44,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.500303+0000","last_change":"2023-07-05T23:32:53.337872+0000","last_active":"2023-07-05T23:35:14.500303+0000","last_peered":"2023-07-05T23:35:14.500303+0000","last_clean":"2023-07-05T23:35:14.500303+0000","last_became_active":"2023-07-05T23:32:53.337480+0000","last_became_peered":"2023-07-05T23:32:53.337480+0000","last_unstale":"2023-07-05T23:35:14.500303+0000","last_undegraded":"2023-07-05T23:35:14.500303+0000","last_fullsized":"2023-07-05T23:35:14.500303+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:19:33.519319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"30'473","reported_seq":490,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:13.537060+0000","last_change":"2023-07-05T23:32:57.356296+0000","last_active":"2023-07-05T23:35:13.537060+0000","last_peered":"2023-07-05T23:35:13.537060+0000","last_clean":"2023-07-05T23:35:13.537060+0000","last_became_active":"2023-07-05T23:32:57.355940+0000","last_became_peered":"2023-07-05T23:32:57.355940+0000","last_unstale":"2023-07-05T23:35:13.537060+0000","last_undegraded":"2023-07-05T23:35:13.537060+0000","last_fullsized":"2023-07-05T23:35:13.537060+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:37:49.101240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"30'1","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.229859+0000","last_change":"2023-07-05T23:32:52.904533+0000","last_active":"2023-07-05T23:33:35.229859+0000","last_peered":"2023-07-05T23:33:35.229859+0000","last_clean":"2023-07-05T23:33:35.229859+0000","last_became_active":"2023-07-05T23:32:52.904140+0000","last_became_peered":"2023-07-05T23:32:52.904140+0000","last_unstale":"2023-07-05T23:33:35.229859+0000","last_undegraded":"2023-07-05T23:33:35.229859+0000","last_fullsized":"2023-07-05T23:33:35.229859+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:47:23.267517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"30'19","reported_seq":43,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.508009+0000","last_change":"2023-07-05T23:32:53.338517+0000","last_active":"2023-07-05T23:35:14.508009+0000","last_peered":"2023-07-05T23:35:14.508009+0000","last_clean":"2023-07-05T23:35:14.508009+0000","last_became_active":"2023-07-05T23:32:53.338248+0000","last_became_peered":"2023-07-05T23:32:53.338248+0000","last_unstale":"2023-07-05T23:35:14.508009+0000","last_undegraded":"2023-07-05T23:35:14.508009+0000","last_fullsized":"2023-07-05T23:35:14.508009+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:27:22.570990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"30'451","reported_seq":468,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:15.486573+0000","last_change":"2023-07-05T23:32:57.357483+0000","last_active":"2023-07-05T23:35:15.486573+0000","last_peered":"2023-07-05T23:35:15.486573+0000","last_clean":"2023-07-05T23:35:15.486573+0000","last_became_active":"2023-07-05T23:32:57.357039+0000","last_became_peered":"2023-07-05T23:32:57.357039+0000","last_unstale":"2023-07-05T23:35:15.486573+0000","last_undegraded":"2023-07-05T23:35:15.486573+0000","last_fullsized":"2023-07-05T23:35:15.486573+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:34:47.174905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:34.897995+0000","last_change":"2023-07-05T23:32:52.900665+0000","last_active":"2023-07-05T23:33:34.897995+0000","last_peered":"2023-07-05T23:33:34.897995+0000","last_clean":"2023-07-05T23:33:34.897995+0000","last_became_active":"2023-07-05T23:32:52.900352+0000","last_became_peered":"2023-07-05T23:32:52.900352+0000","last_unstale":"2023-07-05T23:33:34.897995+0000","last_undegraded":"2023-07-05T23:33:34.897995+0000","last_fullsized":"2023-07-05T23:33:34.897995+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:30:46.205291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"30'26","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.515920+0000","last_change":"2023-07-05T23:32:53.346621+0000","last_active":"2023-07-05T23:35:14.515920+0000","last_peered":"2023-07-05T23:35:14.515920+0000","last_clean":"2023-07-05T23:35:14.515920+0000","last_became_active":"2023-07-05T23:32:53.346373+0000","last_became_peered":"2023-07-05T23:32:53.346373+0000","last_unstale":"2023-07-05T23:35:14.515920+0000","last_undegraded":"2023-07-05T23:35:14.515920+0000","last_fullsized":"2023-07-05T23:35:14.515920+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:19:45.125125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"30'482","reported_seq":499,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:13.529931+0000","last_change":"2023-07-05T23:32:57.365669+0000","last_active":"2023-07-05T23:35:13.529931+0000","last_peered":"2023-07-05T23:35:13.529931+0000","last_clean":"2023-07-05T23:35:13.529931+0000","last_became_active":"2023-07-05T23:32:57.365200+0000","last_became_peered":"2023-07-05T23:32:57.365200+0000","last_unstale":"2023-07-05T23:35:13.529931+0000","last_undegraded":"2023-07-05T23:35:13.529931+0000","last_fullsized":"2023-07-05T23:35:13.529931+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:29:56.164375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"30'12","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:13.572510+0000","last_change":"2023-07-05T23:32:52.913055+0000","last_active":"2023-07-05T23:35:13.572510+0000","last_peered":"2023-07-05T23:35:13.572510+0000","last_clean":"2023-07-05T23:35:13.572510+0000","last_became_active":"2023-07-05T23:32:52.912749+0000","last_became_peered":"2023-07-05T23:32:52.912749+0000","last_unstale":"2023-07-05T23:35:13.572510+0000","last_undegraded":"2023-07-05T23:35:13.572510+0000","last_fullsized":"2023-07-05T23:35:13.572510+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:30:01.986422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"30'33","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.506424+0000","last_change":"2023-07-05T23:32:53.339331+0000","last_active":"2023-07-05T23:35:14.506424+0000","last_peered":"2023-07-05T23:35:14.506424+0000","last_clean":"2023-07-05T23:35:14.506424+0000","last_became_active":"2023-07-05T23:32:53.339001+0000","last_became_peered":"2023-07-05T23:32:53.339001+0000","last_unstale":"2023-07-05T23:35:14.506424+0000","last_undegraded":"2023-07-05T23:35:14.506424+0000","last_fullsized":"2023-07-05T23:35:14.506424+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:55:46.508107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"30'473","reported_seq":490,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:13.539863+0000","last_change":"2023-07-05T23:32:57.354307+0000","last_active":"2023-07-05T23:35:13.539863+0000","last_peered":"2023-07-05T23:35:13.539863+0000","last_clean":"2023-07-05T23:35:13.539863+0000","last_became_active":"2023-07-05T23:32:57.353848+0000","last_became_peered":"2023-07-05T23:32:57.353848+0000","last_unstale":"2023-07-05T23:35:13.539863+0000","last_undegraded":"2023-07-05T23:35:13.539863+0000","last_fullsized":"2023-07-05T23:35:13.539863+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:13:40.247704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"30'357","reported_seq":383,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.523946+0000","last_change":"2023-07-05T23:32:52.904627+0000","last_active":"2023-07-05T23:35:14.523946+0000","last_peered":"2023-07-05T23:35:14.523946+0000","last_clean":"2023-07-05T23:35:14.523946+0000","last_became_active":"2023-07-05T23:32:52.904318+0000","last_became_peered":"2023-07-05T23:32:52.904318+0000","last_unstale":"2023-07-05T23:35:14.523946+0000","last_undegraded":"2023-07-05T23:35:14.523946+0000","last_fullsized":"2023-07-05T23:35:14.523946+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:14:59.460164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1435455,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":356,"num_write_kb":1651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"30'31","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.521545+0000","last_change":"2023-07-05T23:32:53.339884+0000","last_active":"2023-07-05T23:35:14.521545+0000","last_peered":"2023-07-05T23:35:14.521545+0000","last_clean":"2023-07-05T23:35:14.521545+0000","last_became_active":"2023-07-05T23:32:53.339583+0000","last_became_peered":"2023-07-05T23:32:53.339583+0000","last_unstale":"2023-07-05T23:35:14.521545+0000","last_undegraded":"2023-07-05T23:35:14.521545+0000","last_fullsized":"2023-07-05T23:35:14.521545+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:41:33.847577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"30'438","reported_seq":455,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:11.489691+0000","last_change":"2023-07-05T23:32:57.365703+0000","last_active":"2023-07-05T23:35:11.489691+0000","last_peered":"2023-07-05T23:35:11.489691+0000","last_clean":"2023-07-05T23:35:11.489691+0000","last_became_active":"2023-07-05T23:32:57.365204+0000","last_became_peered":"2023-07-05T23:32:57.365204+0000","last_unstale":"2023-07-05T23:35:11.489691+0000","last_undegraded":"2023-07-05T23:35:11.489691+0000","last_fullsized":"2023-07-05T23:35:11.489691+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:10:37.483135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"30'3","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:06.836727+0000","last_change":"2023-07-05T23:32:52.908276+0000","last_active":"2023-07-05T23:35:06.836727+0000","last_peered":"2023-07-05T23:35:06.836727+0000","last_clean":"2023-07-05T23:35:06.836727+0000","last_became_active":"2023-07-05T23:32:52.907970+0000","last_became_peered":"2023-07-05T23:32:52.907970+0000","last_unstale":"2023-07-05T23:35:06.836727+0000","last_undegraded":"2023-07-05T23:35:06.836727+0000","last_fullsized":"2023-07-05T23:35:06.836727+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:09:05.816729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"30'23","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.508678+0000","last_change":"2023-07-05T23:32:53.340093+0000","last_active":"2023-07-05T23:35:14.508678+0000","last_peered":"2023-07-05T23:35:14.508678+0000","last_clean":"2023-07-05T23:35:14.508678+0000","last_became_active":"2023-07-05T23:32:53.339827+0000","last_became_peered":"2023-07-05T23:32:53.339827+0000","last_unstale":"2023-07-05T23:35:14.508678+0000","last_undegraded":"2023-07-05T23:35:14.508678+0000","last_fullsized":"2023-07-05T23:35:14.508678+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:10:34.043441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"30'469","reported_seq":486,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:13.536188+0000","last_change":"2023-07-05T23:32:57.354664+0000","last_active":"2023-07-05T23:35:13.536188+0000","last_peered":"2023-07-05T23:35:13.536188+0000","last_clean":"2023-07-05T23:35:13.536188+0000","last_became_active":"2023-07-05T23:32:57.354235+0000","last_became_peered":"2023-07-05T23:32:57.354235+0000","last_unstale":"2023-07-05T23:35:13.536188+0000","last_undegraded":"2023-07-05T23:35:13.536188+0000","last_fullsized":"2023-07-05T23:35:13.536188+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:35:51.306550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.228314+0000","last_change":"2023-07-05T23:32:52.900677+0000","last_active":"2023-07-05T23:33:35.228314+0000","last_peered":"2023-07-05T23:33:35.228314+0000","last_clean":"2023-07-05T23:33:35.228314+0000","last_became_active":"2023-07-05T23:32:52.900387+0000","last_became_peered":"2023-07-05T23:32:52.900387+0000","last_unstale":"2023-07-05T23:33:35.228314+0000","last_undegraded":"2023-07-05T23:33:35.228314+0000","last_fullsized":"2023-07-05T23:33:35.228314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:02:05.581169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"30'25","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.510890+0000","last_change":"2023-07-05T23:32:53.335865+0000","last_active":"2023-07-05T23:35:14.510890+0000","last_peered":"2023-07-05T23:35:14.510890+0000","last_clean":"2023-07-05T23:35:14.510890+0000","last_became_active":"2023-07-05T23:32:53.335513+0000","last_became_peered":"2023-07-05T23:32:53.335513+0000","last_unstale":"2023-07-05T23:35:14.510890+0000","last_undegraded":"2023-07-05T23:35:14.510890+0000","last_fullsized":"2023-07-05T23:35:14.510890+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:29:52.724682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"30'450","reported_seq":467,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:13.488697+0000","last_change":"2023-07-05T23:32:57.362840+0000","last_active":"2023-07-05T23:35:13.488697+0000","last_peered":"2023-07-05T23:35:13.488697+0000","last_clean":"2023-07-05T23:35:13.488697+0000","last_became_active":"2023-07-05T23:32:57.362407+0000","last_became_peered":"2023-07-05T23:32:57.362407+0000","last_unstale":"2023-07-05T23:35:13.488697+0000","last_undegraded":"2023-07-05T23:35:13.488697+0000","last_fullsized":"2023-07-05T23:35:13.488697+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:30:50.649322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"30'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:06.833400+0000","last_change":"2023-07-05T23:32:52.905899+0000","last_active":"2023-07-05T23:35:06.833400+0000","last_peered":"2023-07-05T23:35:06.833400+0000","last_clean":"2023-07-05T23:35:06.833400+0000","last_became_active":"2023-07-05T23:32:52.905595+0000","last_became_peered":"2023-07-05T23:32:52.905595+0000","last_unstale":"2023-07-05T23:35:06.833400+0000","last_undegraded":"2023-07-05T23:35:06.833400+0000","last_fullsized":"2023-07-05T23:35:06.833400+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:55:45.503769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"30'26","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.516579+0000","last_change":"2023-07-05T23:32:53.342284+0000","last_active":"2023-07-05T23:35:14.516579+0000","last_peered":"2023-07-05T23:35:14.516579+0000","last_clean":"2023-07-05T23:35:14.516579+0000","last_became_active":"2023-07-05T23:32:53.342033+0000","last_became_peered":"2023-07-05T23:32:53.342033+0000","last_unstale":"2023-07-05T23:35:14.516579+0000","last_undegraded":"2023-07-05T23:35:14.516579+0000","last_fullsized":"2023-07-05T23:35:14.516579+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:19:45.125125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"30'490","reported_seq":507,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:13.525283+0000","last_change":"2023-07-05T23:32:57.360505+0000","last_active":"2023-07-05T23:35:13.525283+0000","last_peered":"2023-07-05T23:35:13.525283+0000","last_clean":"2023-07-05T23:35:13.525283+0000","last_became_active":"2023-07-05T23:32:57.359532+0000","last_became_peered":"2023-07-05T23:32:57.359532+0000","last_unstale":"2023-07-05T23:35:13.525283+0000","last_undegraded":"2023-07-05T23:35:13.525283+0000","last_fullsized":"2023-07-05T23:35:13.525283+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:48:54.916611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":41984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.228388+0000","last_change":"2023-07-05T23:32:52.903656+0000","last_active":"2023-07-05T23:33:35.228388+0000","last_peered":"2023-07-05T23:33:35.228388+0000","last_clean":"2023-07-05T23:33:35.228388+0000","last_became_active":"2023-07-05T23:32:52.903419+0000","last_became_peered":"2023-07-05T23:32:52.903419+0000","last_unstale":"2023-07-05T23:33:35.228388+0000","last_undegraded":"2023-07-05T23:33:35.228388+0000","last_fullsized":"2023-07-05T23:33:35.228388+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:32:23.940560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"30'26","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.513247+0000","last_change":"2023-07-05T23:32:53.341509+0000","last_active":"2023-07-05T23:35:14.513247+0000","last_peered":"2023-07-05T23:35:14.513247+0000","last_clean":"2023-07-05T23:35:14.513247+0000","last_became_active":"2023-07-05T23:32:53.341162+0000","last_became_peered":"2023-07-05T23:32:53.341162+0000","last_unstale":"2023-07-05T23:35:14.513247+0000","last_undegraded":"2023-07-05T23:35:14.513247+0000","last_fullsized":"2023-07-05T23:35:14.513247+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:34:18.782861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"30'444","reported_seq":462,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:15.488893+0000","last_change":"2023-07-05T23:32:57.358009+0000","last_active":"2023-07-05T23:35:15.488893+0000","last_peered":"2023-07-05T23:35:15.488893+0000","last_clean":"2023-07-05T23:35:15.488893+0000","last_became_active":"2023-07-05T23:32:57.357082+0000","last_became_peered":"2023-07-05T23:32:57.357082+0000","last_unstale":"2023-07-05T23:35:15.488893+0000","last_undegraded":"2023-07-05T23:35:15.488893+0000","last_fullsized":"2023-07-05T23:35:15.488893+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:37:40.938898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.011998+0000","last_change":"2023-07-05T23:32:52.907916+0000","last_active":"2023-07-05T23:33:35.011998+0000","last_peered":"2023-07-05T23:33:35.011998+0000","last_clean":"2023-07-05T23:33:35.011998+0000","last_became_active":"2023-07-05T23:32:52.907397+0000","last_became_peered":"2023-07-05T23:32:52.907397+0000","last_unstale":"2023-07-05T23:33:35.011998+0000","last_undegraded":"2023-07-05T23:33:35.011998+0000","last_fullsized":"2023-07-05T23:33:35.011998+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:34:31.075112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"30'22","reported_seq":46,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.505088+0000","last_change":"2023-07-05T23:32:53.334487+0000","last_active":"2023-07-05T23:35:14.505088+0000","last_peered":"2023-07-05T23:35:14.505088+0000","last_clean":"2023-07-05T23:35:14.505088+0000","last_became_active":"2023-07-05T23:32:53.333978+0000","last_became_peered":"2023-07-05T23:32:53.333978+0000","last_unstale":"2023-07-05T23:35:14.505088+0000","last_undegraded":"2023-07-05T23:35:14.505088+0000","last_fullsized":"2023-07-05T23:35:14.505088+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:09:06.821067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"30'423","reported_seq":441,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:15.493883+0000","last_change":"2023-07-05T23:32:57.362413+0000","last_active":"2023-07-05T23:35:15.493883+0000","last_peered":"2023-07-05T23:35:15.493883+0000","last_clean":"2023-07-05T23:35:15.493883+0000","last_became_active":"2023-07-05T23:32:57.361892+0000","last_became_peered":"2023-07-05T23:32:57.361892+0000","last_unstale":"2023-07-05T23:35:15.493883+0000","last_undegraded":"2023-07-05T23:35:15.493883+0000","last_fullsized":"2023-07-05T23:35:15.493883+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:23:07.824943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.011790+0000","last_change":"2023-07-05T23:32:52.908261+0000","last_active":"2023-07-05T23:33:35.011790+0000","last_peered":"2023-07-05T23:33:35.011790+0000","last_clean":"2023-07-05T23:33:35.011790+0000","last_became_active":"2023-07-05T23:32:52.907975+0000","last_became_peered":"2023-07-05T23:32:52.907975+0000","last_unstale":"2023-07-05T23:33:35.011790+0000","last_undegraded":"2023-07-05T23:33:35.011790+0000","last_fullsized":"2023-07-05T23:33:35.011790+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:27:21.566652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"30'20","reported_seq":44,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.520367+0000","last_change":"2023-07-05T23:32:53.339917+0000","last_active":"2023-07-05T23:35:14.520367+0000","last_peered":"2023-07-05T23:35:14.520367+0000","last_clean":"2023-07-05T23:35:14.520367+0000","last_became_active":"2023-07-05T23:32:53.339543+0000","last_became_peered":"2023-07-05T23:32:53.339543+0000","last_unstale":"2023-07-05T23:35:14.520367+0000","last_undegraded":"2023-07-05T23:35:14.520367+0000","last_fullsized":"2023-07-05T23:35:14.520367+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:49:46.894720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"30'469","reported_seq":487,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:15.500248+0000","last_change":"2023-07-05T23:32:57.361110+0000","last_active":"2023-07-05T23:35:15.500248+0000","last_peered":"2023-07-05T23:35:15.500248+0000","last_clean":"2023-07-05T23:35:15.500248+0000","last_became_active":"2023-07-05T23:32:57.360614+0000","last_became_peered":"2023-07-05T23:32:57.360614+0000","last_unstale":"2023-07-05T23:35:15.500248+0000","last_undegraded":"2023-07-05T23:35:15.500248+0000","last_fullsized":"2023-07-05T23:35:15.500248+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:11:32.788099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.011936+0000","last_change":"2023-07-05T23:32:52.907840+0000","last_active":"2023-07-05T23:33:35.011936+0000","last_peered":"2023-07-05T23:33:35.011936+0000","last_clean":"2023-07-05T23:33:35.011936+0000","last_became_active":"2023-07-05T23:32:52.907441+0000","last_became_peered":"2023-07-05T23:32:52.907441+0000","last_unstale":"2023-07-05T23:33:35.011936+0000","last_undegraded":"2023-07-05T23:33:35.011936+0000","last_fullsized":"2023-07-05T23:33:35.011936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:55:01.034913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"30'26","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.508688+0000","last_change":"2023-07-05T23:32:53.343984+0000","last_active":"2023-07-05T23:35:14.508688+0000","last_peered":"2023-07-05T23:35:14.508688+0000","last_clean":"2023-07-05T23:35:14.508688+0000","last_became_active":"2023-07-05T23:32:53.343566+0000","last_became_peered":"2023-07-05T23:32:53.343566+0000","last_unstale":"2023-07-05T23:35:14.508688+0000","last_undegraded":"2023-07-05T23:35:14.508688+0000","last_fullsized":"2023-07-05T23:35:14.508688+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:27:59.144444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"30'484","reported_seq":502,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:13.553221+0000","last_change":"2023-07-05T23:32:57.356615+0000","last_active":"2023-07-05T23:35:13.553221+0000","last_peered":"2023-07-05T23:35:13.553221+0000","last_clean":"2023-07-05T23:35:13.553221+0000","last_became_active":"2023-07-05T23:32:57.356091+0000","last_became_peered":"2023-07-05T23:32:57.356091+0000","last_unstale":"2023-07-05T23:35:13.553221+0000","last_undegraded":"2023-07-05T23:35:13.553221+0000","last_fullsized":"2023-07-05T23:35:13.553221+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:10:51.090665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"30'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:02.479617+0000","last_change":"2023-07-05T23:32:52.906210+0000","last_active":"2023-07-05T23:35:02.479617+0000","last_peered":"2023-07-05T23:35:02.479617+0000","last_clean":"2023-07-05T23:35:02.479617+0000","last_became_active":"2023-07-05T23:32:52.905988+0000","last_became_peered":"2023-07-05T23:32:52.905988+0000","last_unstale":"2023-07-05T23:35:02.479617+0000","last_undegraded":"2023-07-05T23:35:02.479617+0000","last_fullsized":"2023-07-05T23:35:02.479617+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:30:01.986422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"30'24","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.516810+0000","last_change":"2023-07-05T23:32:53.339662+0000","last_active":"2023-07-05T23:35:14.516810+0000","last_peered":"2023-07-05T23:35:14.516810+0000","last_clean":"2023-07-05T23:35:14.516810+0000","last_became_active":"2023-07-05T23:32:53.339382+0000","last_became_peered":"2023-07-05T23:32:53.339382+0000","last_unstale":"2023-07-05T23:35:14.516810+0000","last_undegraded":"2023-07-05T23:35:14.516810+0000","last_fullsized":"2023-07-05T23:35:14.516810+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:06:29.575306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"30'468","reported_seq":486,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:13.538250+0000","last_change":"2023-07-05T23:32:57.354958+0000","last_active":"2023-07-05T23:35:13.538250+0000","last_peered":"2023-07-05T23:35:13.538250+0000","last_clean":"2023-07-05T23:35:13.538250+0000","last_became_active":"2023-07-05T23:32:57.354576+0000","last_became_peered":"2023-07-05T23:32:57.354576+0000","last_unstale":"2023-07-05T23:35:13.538250+0000","last_undegraded":"2023-07-05T23:35:13.538250+0000","last_fullsized":"2023-07-05T23:35:13.538250+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:32:54.986804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":27648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"30'4","reported_seq":30,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:05.478083+0000","last_change":"2023-07-05T23:32:52.906470+0000","last_active":"2023-07-05T23:35:05.478083+0000","last_peered":"2023-07-05T23:35:05.478083+0000","last_clean":"2023-07-05T23:35:05.478083+0000","last_became_active":"2023-07-05T23:32:52.906187+0000","last_became_peered":"2023-07-05T23:32:52.906187+0000","last_unstale":"2023-07-05T23:35:05.478083+0000","last_undegraded":"2023-07-05T23:35:05.478083+0000","last_fullsized":"2023-07-05T23:35:05.478083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:34:31.075112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"30'21","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.520529+0000","last_change":"2023-07-05T23:32:53.344178+0000","last_active":"2023-07-05T23:35:14.520529+0000","last_peered":"2023-07-05T23:35:14.520529+0000","last_clean":"2023-07-05T23:35:14.520529+0000","last_became_active":"2023-07-05T23:32:53.343393+0000","last_became_peered":"2023-07-05T23:32:53.343393+0000","last_unstale":"2023-07-05T23:35:14.520529+0000","last_undegraded":"2023-07-05T23:35:14.520529+0000","last_fullsized":"2023-07-05T23:35:14.520529+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:26:46.815538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"30'457","reported_seq":475,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:13.558128+0000","last_change":"2023-07-05T23:32:57.362812+0000","last_active":"2023-07-05T23:35:13.558128+0000","last_peered":"2023-07-05T23:35:13.558128+0000","last_clean":"2023-07-05T23:35:13.558128+0000","last_became_active":"2023-07-05T23:32:57.362431+0000","last_became_peered":"2023-07-05T23:32:57.362431+0000","last_unstale":"2023-07-05T23:35:13.558128+0000","last_undegraded":"2023-07-05T23:35:13.558128+0000","last_fullsized":"2023-07-05T23:35:13.558128+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:37:40.938898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"30'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:05.621978+0000","last_change":"2023-07-05T23:32:52.908272+0000","last_active":"2023-07-05T23:35:05.621978+0000","last_peered":"2023-07-05T23:35:05.621978+0000","last_clean":"2023-07-05T23:35:05.621978+0000","last_became_active":"2023-07-05T23:32:52.907983+0000","last_became_peered":"2023-07-05T23:32:52.907983+0000","last_unstale":"2023-07-05T23:35:05.621978+0000","last_undegraded":"2023-07-05T23:35:05.621978+0000","last_fullsized":"2023-07-05T23:35:05.621978+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:01:15.727729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"30'23","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.521028+0000","last_change":"2023-07-05T23:32:53.339766+0000","last_active":"2023-07-05T23:35:14.521028+0000","last_peered":"2023-07-05T23:35:14.521028+0000","last_clean":"2023-07-05T23:35:14.521028+0000","last_became_active":"2023-07-05T23:32:53.338903+0000","last_became_peered":"2023-07-05T23:32:53.338903+0000","last_unstale":"2023-07-05T23:35:14.521028+0000","last_undegraded":"2023-07-05T23:35:14.521028+0000","last_fullsized":"2023-07-05T23:35:14.521028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:21:39.351826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'490","reported_seq":508,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:15.503713+0000","last_change":"2023-07-05T23:32:57.357001+0000","last_active":"2023-07-05T23:35:15.503713+0000","last_peered":"2023-07-05T23:35:15.503713+0000","last_clean":"2023-07-05T23:35:15.503713+0000","last_became_active":"2023-07-05T23:32:57.356611+0000","last_became_peered":"2023-07-05T23:32:57.356611+0000","last_unstale":"2023-07-05T23:35:15.503713+0000","last_undegraded":"2023-07-05T23:35:15.503713+0000","last_fullsized":"2023-07-05T23:35:15.503713+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:18:00.591410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.205209+0000","last_change":"2023-07-05T23:32:52.907064+0000","last_active":"2023-07-05T23:33:35.205209+0000","last_peered":"2023-07-05T23:33:35.205209+0000","last_clean":"2023-07-05T23:33:35.205209+0000","last_became_active":"2023-07-05T23:32:52.906779+0000","last_became_peered":"2023-07-05T23:32:52.906779+0000","last_unstale":"2023-07-05T23:33:35.205209+0000","last_undegraded":"2023-07-05T23:33:35.205209+0000","last_fullsized":"2023-07-05T23:33:35.205209+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:21:56.357294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"30'12","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.521818+0000","last_change":"2023-07-05T23:32:53.341824+0000","last_active":"2023-07-05T23:35:14.521818+0000","last_peered":"2023-07-05T23:35:14.521818+0000","last_clean":"2023-07-05T23:35:14.521818+0000","last_became_active":"2023-07-05T23:32:53.339869+0000","last_became_peered":"2023-07-05T23:32:53.339869+0000","last_unstale":"2023-07-05T23:35:14.521818+0000","last_undegraded":"2023-07-05T23:35:14.521818+0000","last_fullsized":"2023-07-05T23:35:14.521818+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:06:11.729572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"30'495","reported_seq":513,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:13.554741+0000","last_change":"2023-07-05T23:32:57.363813+0000","last_active":"2023-07-05T23:35:13.554741+0000","last_peered":"2023-07-05T23:35:13.554741+0000","last_clean":"2023-07-05T23:35:13.554741+0000","last_became_active":"2023-07-05T23:32:57.363409+0000","last_became_peered":"2023-07-05T23:32:57.363409+0000","last_unstale":"2023-07-05T23:35:13.554741+0000","last_undegraded":"2023-07-05T23:35:13.554741+0000","last_fullsized":"2023-07-05T23:35:13.554741+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:07:41.069844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.229959+0000","last_change":"2023-07-05T23:32:52.910057+0000","last_active":"2023-07-05T23:33:35.229959+0000","last_peered":"2023-07-05T23:33:35.229959+0000","last_clean":"2023-07-05T23:33:35.229959+0000","last_became_active":"2023-07-05T23:32:52.909169+0000","last_became_peered":"2023-07-05T23:32:52.909169+0000","last_unstale":"2023-07-05T23:33:35.229959+0000","last_undegraded":"2023-07-05T23:33:35.229959+0000","last_fullsized":"2023-07-05T23:33:35.229959+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:30:01.986422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"30'24","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.506964+0000","last_change":"2023-07-05T23:32:53.342851+0000","last_active":"2023-07-05T23:35:14.506964+0000","last_peered":"2023-07-05T23:35:14.506964+0000","last_clean":"2023-07-05T23:35:14.506964+0000","last_became_active":"2023-07-05T23:32:53.342420+0000","last_became_peered":"2023-07-05T23:32:53.342420+0000","last_unstale":"2023-07-05T23:35:14.506964+0000","last_undegraded":"2023-07-05T23:35:14.506964+0000","last_fullsized":"2023-07-05T23:35:14.506964+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:48:30.276766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"30'501","reported_seq":519,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.469204+0000","last_change":"2023-07-05T23:32:57.358997+0000","last_active":"2023-07-05T23:35:14.469204+0000","last_peered":"2023-07-05T23:35:14.469204+0000","last_clean":"2023-07-05T23:35:14.469204+0000","last_became_active":"2023-07-05T23:32:57.358647+0000","last_became_peered":"2023-07-05T23:32:57.358647+0000","last_unstale":"2023-07-05T23:35:14.469204+0000","last_undegraded":"2023-07-05T23:35:14.469204+0000","last_fullsized":"2023-07-05T23:35:14.469204+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:48:33.716459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.229445+0000","last_change":"2023-07-05T23:32:47.790871+0000","last_active":"2023-07-05T23:33:35.229445+0000","last_peered":"2023-07-05T23:33:35.229445+0000","last_clean":"2023-07-05T23:33:35.229445+0000","last_became_active":"2023-07-05T23:32:47.790546+0000","last_became_peered":"2023-07-05T23:32:47.790546+0000","last_unstale":"2023-07-05T23:33:35.229445+0000","last_undegraded":"2023-07-05T23:33:35.229445+0000","last_fullsized":"2023-07-05T23:33:35.229445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_clean_scrub_stamp":"2023-07-05T23:32:46.741565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:28:20.777630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"30'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:00.632835+0000","last_change":"2023-07-05T23:32:52.912985+0000","last_active":"2023-07-05T23:35:00.632835+0000","last_peered":"2023-07-05T23:35:00.632835+0000","last_clean":"2023-07-05T23:35:00.632835+0000","last_became_active":"2023-07-05T23:32:52.912682+0000","last_became_peered":"2023-07-05T23:32:52.912682+0000","last_unstale":"2023-07-05T23:35:00.632835+0000","last_undegraded":"2023-07-05T23:35:00.632835+0000","last_fullsized":"2023-07-05T23:35:00.632835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:19:27.040484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"30'22","reported_seq":46,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.511330+0000","last_change":"2023-07-05T23:32:53.335398+0000","last_active":"2023-07-05T23:35:14.511330+0000","last_peered":"2023-07-05T23:35:14.511330+0000","last_clean":"2023-07-05T23:35:14.511330+0000","last_became_active":"2023-07-05T23:32:53.335073+0000","last_became_peered":"2023-07-05T23:32:53.335073+0000","last_unstale":"2023-07-05T23:35:14.511330+0000","last_undegraded":"2023-07-05T23:35:14.511330+0000","last_fullsized":"2023-07-05T23:35:14.511330+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:02:06.585507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"30'448","reported_seq":466,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:15.486442+0000","last_change":"2023-07-05T23:32:57.368301+0000","last_active":"2023-07-05T23:35:15.486442+0000","last_peered":"2023-07-05T23:35:15.486442+0000","last_clean":"2023-07-05T23:35:15.486442+0000","last_became_active":"2023-07-05T23:32:57.368030+0000","last_became_peered":"2023-07-05T23:32:57.368030+0000","last_unstale":"2023-07-05T23:35:15.486442+0000","last_undegraded":"2023-07-05T23:35:15.486442+0000","last_fullsized":"2023-07-05T23:35:15.486442+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:55:49.947801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:34.897517+0000","last_change":"2023-07-05T23:32:47.762370+0000","last_active":"2023-07-05T23:33:34.897517+0000","last_peered":"2023-07-05T23:33:34.897517+0000","last_clean":"2023-07-05T23:33:34.897517+0000","last_became_active":"2023-07-05T23:32:47.761996+0000","last_became_peered":"2023-07-05T23:32:47.761996+0000","last_unstale":"2023-07-05T23:33:34.897517+0000","last_undegraded":"2023-07-05T23:33:34.897517+0000","last_fullsized":"2023-07-05T23:33:34.897517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_clean_scrub_stamp":"2023-07-05T23:32:46.741565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:27:16.430272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.206217+0000","last_change":"2023-07-05T23:32:52.904472+0000","last_active":"2023-07-05T23:33:35.206217+0000","last_peered":"2023-07-05T23:33:35.206217+0000","last_clean":"2023-07-05T23:33:35.206217+0000","last_became_active":"2023-07-05T23:32:52.904202+0000","last_became_peered":"2023-07-05T23:32:52.904202+0000","last_unstale":"2023-07-05T23:33:35.206217+0000","last_undegraded":"2023-07-05T23:33:35.206217+0000","last_fullsized":"2023-07-05T23:33:35.206217+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:21:26.927343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"30'24","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.506926+0000","last_change":"2023-07-05T23:32:53.341847+0000","last_active":"2023-07-05T23:35:14.506926+0000","last_peered":"2023-07-05T23:35:14.506926+0000","last_clean":"2023-07-05T23:35:14.506926+0000","last_became_active":"2023-07-05T23:32:53.338626+0000","last_became_peered":"2023-07-05T23:32:53.338626+0000","last_unstale":"2023-07-05T23:35:14.506926+0000","last_undegraded":"2023-07-05T23:35:14.506926+0000","last_fullsized":"2023-07-05T23:35:14.506926+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:09:06.821067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"30'487","reported_seq":505,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.469505+0000","last_change":"2023-07-05T23:32:57.356351+0000","last_active":"2023-07-05T23:35:14.469505+0000","last_peered":"2023-07-05T23:35:14.469505+0000","last_clean":"2023-07-05T23:35:14.469505+0000","last_became_active":"2023-07-05T23:32:57.355882+0000","last_became_peered":"2023-07-05T23:32:57.355882+0000","last_unstale":"2023-07-05T23:35:14.469505+0000","last_undegraded":"2023-07-05T23:35:14.469505+0000","last_fullsized":"2023-07-05T23:35:14.469505+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:53:02.594417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":55296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:34.894615+0000","last_change":"2023-07-05T23:32:47.979611+0000","last_active":"2023-07-05T23:33:34.894615+0000","last_peered":"2023-07-05T23:33:34.894615+0000","last_clean":"2023-07-05T23:33:34.894615+0000","last_became_active":"2023-07-05T23:32:47.979348+0000","last_became_peered":"2023-07-05T23:32:47.979348+0000","last_unstale":"2023-07-05T23:33:34.894615+0000","last_undegraded":"2023-07-05T23:33:34.894615+0000","last_fullsized":"2023-07-05T23:33:34.894615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_clean_scrub_stamp":"2023-07-05T23:32:46.741565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:49:32.444450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.228652+0000","last_change":"2023-07-05T23:32:52.907652+0000","last_active":"2023-07-05T23:33:35.228652+0000","last_peered":"2023-07-05T23:33:35.228652+0000","last_clean":"2023-07-05T23:33:35.228652+0000","last_became_active":"2023-07-05T23:32:52.907307+0000","last_became_peered":"2023-07-05T23:32:52.907307+0000","last_unstale":"2023-07-05T23:33:35.228652+0000","last_undegraded":"2023-07-05T23:33:35.228652+0000","last_fullsized":"2023-07-05T23:33:35.228652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:50:56.145233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"30'23","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.511242+0000","last_change":"2023-07-05T23:32:53.338185+0000","last_active":"2023-07-05T23:35:14.511242+0000","last_peered":"2023-07-05T23:35:14.511242+0000","last_clean":"2023-07-05T23:35:14.511242+0000","last_became_active":"2023-07-05T23:32:53.337896+0000","last_became_peered":"2023-07-05T23:32:53.337896+0000","last_unstale":"2023-07-05T23:35:14.511242+0000","last_undegraded":"2023-07-05T23:35:14.511242+0000","last_fullsized":"2023-07-05T23:35:14.511242+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:34:43.735212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"30'477","reported_seq":495,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.465963+0000","last_change":"2023-07-05T23:32:57.355885+0000","last_active":"2023-07-05T23:35:14.465963+0000","last_peered":"2023-07-05T23:35:14.465963+0000","last_clean":"2023-07-05T23:35:14.465963+0000","last_became_active":"2023-07-05T23:32:57.355475+0000","last_became_peered":"2023-07-05T23:32:57.355475+0000","last_unstale":"2023-07-05T23:35:14.465963+0000","last_undegraded":"2023-07-05T23:35:14.465963+0000","last_fullsized":"2023-07-05T23:35:14.465963+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:19:48.564819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:34.897784+0000","last_change":"2023-07-05T23:32:47.761727+0000","last_active":"2023-07-05T23:33:34.897784+0000","last_peered":"2023-07-05T23:33:34.897784+0000","last_clean":"2023-07-05T23:33:34.897784+0000","last_became_active":"2023-07-05T23:32:47.761392+0000","last_became_peered":"2023-07-05T23:32:47.761392+0000","last_unstale":"2023-07-05T23:33:34.897784+0000","last_undegraded":"2023-07-05T23:33:34.897784+0000","last_fullsized":"2023-07-05T23:33:34.897784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_clean_scrub_stamp":"2023-07-05T23:32:46.741565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:35:41.726138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":188,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.011378+0000","last_change":"2023-07-05T23:32:42.737690+0000","last_active":"2023-07-05T23:33:35.011378+0000","last_peered":"2023-07-05T23:33:35.011378+0000","last_clean":"2023-07-05T23:33:35.011378+0000","last_became_active":"2023-07-05T23:32:42.736736+0000","last_became_peered":"2023-07-05T23:32:42.736736+0000","last_unstale":"2023-07-05T23:33:35.011378+0000","last_undegraded":"2023-07-05T23:33:35.011378+0000","last_fullsized":"2023-07-05T23:33:35.011378+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:41.674741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:41.674741+0000","last_clean_scrub_stamp":"2023-07-05T23:32:41.674741+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:28:15.710806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.230450+0000","last_change":"2023-07-05T23:32:52.912999+0000","last_active":"2023-07-05T23:33:35.230450+0000","last_peered":"2023-07-05T23:33:35.230450+0000","last_clean":"2023-07-05T23:33:35.230450+0000","last_became_active":"2023-07-05T23:32:52.912684+0000","last_became_peered":"2023-07-05T23:32:52.912684+0000","last_unstale":"2023-07-05T23:33:35.230450+0000","last_undegraded":"2023-07-05T23:33:35.230450+0000","last_fullsized":"2023-07-05T23:33:35.230450+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:17:56.147379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"30'25","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.522426+0000","last_change":"2023-07-05T23:32:53.344142+0000","last_active":"2023-07-05T23:35:14.522426+0000","last_peered":"2023-07-05T23:35:14.522426+0000","last_clean":"2023-07-05T23:35:14.522426+0000","last_became_active":"2023-07-05T23:32:53.343848+0000","last_became_peered":"2023-07-05T23:32:53.343848+0000","last_unstale":"2023-07-05T23:35:14.522426+0000","last_undegraded":"2023-07-05T23:35:14.522426+0000","last_fullsized":"2023-07-05T23:35:14.522426+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:21:04.019035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"30'449","reported_seq":467,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.459786+0000","last_change":"2023-07-05T23:32:57.366415+0000","last_active":"2023-07-05T23:35:14.459786+0000","last_peered":"2023-07-05T23:35:14.459786+0000","last_clean":"2023-07-05T23:35:14.459786+0000","last_became_active":"2023-07-05T23:32:57.365013+0000","last_became_peered":"2023-07-05T23:32:57.365013+0000","last_unstale":"2023-07-05T23:35:14.459786+0000","last_undegraded":"2023-07-05T23:35:14.459786+0000","last_fullsized":"2023-07-05T23:35:14.459786+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:12:04.336682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.011554+0000","last_change":"2023-07-05T23:32:47.767600+0000","last_active":"2023-07-05T23:33:35.011554+0000","last_peered":"2023-07-05T23:33:35.011554+0000","last_clean":"2023-07-05T23:33:35.011554+0000","last_became_active":"2023-07-05T23:32:47.767297+0000","last_became_peered":"2023-07-05T23:32:47.767297+0000","last_unstale":"2023-07-05T23:33:35.011554+0000","last_undegraded":"2023-07-05T23:33:35.011554+0000","last_fullsized":"2023-07-05T23:33:35.011554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_clean_scrub_stamp":"2023-07-05T23:32:46.741565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:00:36.274653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"30'15","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:15.480517+0000","last_change":"2023-07-05T23:32:52.906517+0000","last_active":"2023-07-05T23:35:15.480517+0000","last_peered":"2023-07-05T23:35:15.480517+0000","last_clean":"2023-07-05T23:35:15.480517+0000","last_became_active":"2023-07-05T23:32:52.906204+0000","last_became_peered":"2023-07-05T23:32:52.906204+0000","last_unstale":"2023-07-05T23:35:15.480517+0000","last_undegraded":"2023-07-05T23:35:15.480517+0000","last_fullsized":"2023-07-05T23:35:15.480517+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:38:48.811718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7643,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":16,"num_write":14,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"30'21","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.507187+0000","last_change":"2023-07-05T23:32:53.340334+0000","last_active":"2023-07-05T23:35:14.507187+0000","last_peered":"2023-07-05T23:35:14.507187+0000","last_clean":"2023-07-05T23:35:14.507187+0000","last_became_active":"2023-07-05T23:32:53.340061+0000","last_became_peered":"2023-07-05T23:32:53.340061+0000","last_unstale":"2023-07-05T23:35:14.507187+0000","last_undegraded":"2023-07-05T23:35:14.507187+0000","last_fullsized":"2023-07-05T23:35:14.507187+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:37:37.499204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"30'501","reported_seq":519,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:13.554516+0000","last_change":"2023-07-05T23:32:57.362424+0000","last_active":"2023-07-05T23:35:13.554516+0000","last_peered":"2023-07-05T23:35:13.554516+0000","last_clean":"2023-07-05T23:35:13.554516+0000","last_became_active":"2023-07-05T23:32:57.361941+0000","last_became_peered":"2023-07-05T23:32:57.361941+0000","last_unstale":"2023-07-05T23:35:13.554516+0000","last_undegraded":"2023-07-05T23:35:13.554516+0000","last_fullsized":"2023-07-05T23:35:13.554516+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:11:35.842714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.011798+0000","last_change":"2023-07-05T23:32:47.790754+0000","last_active":"2023-07-05T23:33:35.011798+0000","last_peered":"2023-07-05T23:33:35.011798+0000","last_clean":"2023-07-05T23:33:35.011798+0000","last_became_active":"2023-07-05T23:32:47.790408+0000","last_became_peered":"2023-07-05T23:32:47.790408+0000","last_unstale":"2023-07-05T23:33:35.011798+0000","last_undegraded":"2023-07-05T23:33:35.011798+0000","last_fullsized":"2023-07-05T23:33:35.011798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_clean_scrub_stamp":"2023-07-05T23:32:46.741565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:47:18.131137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"30'2","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:04.468711+0000","last_change":"2023-07-05T23:32:52.908711+0000","last_active":"2023-07-05T23:35:04.468711+0000","last_peered":"2023-07-05T23:35:04.468711+0000","last_clean":"2023-07-05T23:35:04.468711+0000","last_became_active":"2023-07-05T23:32:52.908379+0000","last_became_peered":"2023-07-05T23:32:52.908379+0000","last_unstale":"2023-07-05T23:35:04.468711+0000","last_undegraded":"2023-07-05T23:35:04.468711+0000","last_fullsized":"2023-07-05T23:35:04.468711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:19:44.120787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"30'22","reported_seq":46,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.515358+0000","last_change":"2023-07-05T23:32:53.331042+0000","last_active":"2023-07-05T23:35:14.515358+0000","last_peered":"2023-07-05T23:35:14.515358+0000","last_clean":"2023-07-05T23:35:14.515358+0000","last_became_active":"2023-07-05T23:32:53.330771+0000","last_became_peered":"2023-07-05T23:32:53.330771+0000","last_unstale":"2023-07-05T23:35:14.515358+0000","last_undegraded":"2023-07-05T23:35:14.515358+0000","last_fullsized":"2023-07-05T23:35:14.515358+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:28:26.918347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"30'486","reported_seq":504,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:13.526033+0000","last_change":"2023-07-05T23:32:57.357223+0000","last_active":"2023-07-05T23:35:13.526033+0000","last_peered":"2023-07-05T23:35:13.526033+0000","last_clean":"2023-07-05T23:35:13.526033+0000","last_became_active":"2023-07-05T23:32:57.356797+0000","last_became_peered":"2023-07-05T23:32:57.356797+0000","last_unstale":"2023-07-05T23:35:13.526033+0000","last_undegraded":"2023-07-05T23:35:13.526033+0000","last_fullsized":"2023-07-05T23:35:13.526033+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:04:21.723966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"30'3","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:05.629762+0000","last_change":"2023-07-05T23:32:52.906030+0000","last_active":"2023-07-05T23:35:05.629762+0000","last_peered":"2023-07-05T23:35:05.629762+0000","last_clean":"2023-07-05T23:35:05.629762+0000","last_became_active":"2023-07-05T23:32:52.905704+0000","last_became_peered":"2023-07-05T23:32:52.905704+0000","last_unstale":"2023-07-05T23:35:05.629762+0000","last_undegraded":"2023-07-05T23:35:05.629762+0000","last_fullsized":"2023-07-05T23:35:05.629762+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:48:50.472580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.229743+0000","last_change":"2023-07-05T23:32:47.769126+0000","last_active":"2023-07-05T23:33:35.229743+0000","last_peered":"2023-07-05T23:33:35.229743+0000","last_clean":"2023-07-05T23:33:35.229743+0000","last_became_active":"2023-07-05T23:32:47.768844+0000","last_became_peered":"2023-07-05T23:32:47.768844+0000","last_unstale":"2023-07-05T23:33:35.229743+0000","last_undegraded":"2023-07-05T23:33:35.229743+0000","last_fullsized":"2023-07-05T23:33:35.229743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_clean_scrub_stamp":"2023-07-05T23:32:46.741565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:09:50.580774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"30'18","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.504878+0000","last_change":"2023-07-05T23:33:35.012743+0000","last_active":"2023-07-05T23:35:14.504878+0000","last_peered":"2023-07-05T23:35:14.504878+0000","last_clean":"2023-07-05T23:35:14.504878+0000","last_became_active":"2023-07-05T23:33:35.012290+0000","last_became_peered":"2023-07-05T23:33:35.012290+0000","last_unstale":"2023-07-05T23:35:14.504878+0000","last_undegraded":"2023-07-05T23:35:14.504878+0000","last_fullsized":"2023-07-05T23:35:14.504878+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:22:31.213068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"30'447","reported_seq":465,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.467484+0000","last_change":"2023-07-05T23:32:57.362654+0000","last_active":"2023-07-05T23:35:14.467484+0000","last_peered":"2023-07-05T23:35:14.467484+0000","last_clean":"2023-07-05T23:35:14.467484+0000","last_became_active":"2023-07-05T23:32:57.362112+0000","last_became_peered":"2023-07-05T23:32:57.362112+0000","last_unstale":"2023-07-05T23:35:14.467484+0000","last_undegraded":"2023-07-05T23:35:14.467484+0000","last_fullsized":"2023-07-05T23:35:14.467484+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:00:45.855064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":46080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.228846+0000","last_change":"2023-07-05T23:32:47.769537+0000","last_active":"2023-07-05T23:33:35.228846+0000","last_peered":"2023-07-05T23:33:35.228846+0000","last_clean":"2023-07-05T23:33:35.228846+0000","last_became_active":"2023-07-05T23:32:47.769141+0000","last_became_peered":"2023-07-05T23:32:47.769141+0000","last_unstale":"2023-07-05T23:33:35.228846+0000","last_undegraded":"2023-07-05T23:33:35.228846+0000","last_fullsized":"2023-07-05T23:33:35.228846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_clean_scrub_stamp":"2023-07-05T23:32:46.741565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:24:40.558028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"30'11","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:07.903767+0000","last_change":"2023-07-05T23:32:52.905759+0000","last_active":"2023-07-05T23:35:07.903767+0000","last_peered":"2023-07-05T23:35:07.903767+0000","last_clean":"2023-07-05T23:35:07.903767+0000","last_became_active":"2023-07-05T23:32:52.905451+0000","last_became_peered":"2023-07-05T23:32:52.905451+0000","last_unstale":"2023-07-05T23:35:07.903767+0000","last_undegraded":"2023-07-05T23:35:07.903767+0000","last_fullsized":"2023-07-05T23:35:07.903767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:03:44.827174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"30'17","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.520533+0000","last_change":"2023-07-05T23:32:53.332443+0000","last_active":"2023-07-05T23:35:14.520533+0000","last_peered":"2023-07-05T23:35:14.520533+0000","last_clean":"2023-07-05T23:35:14.520533+0000","last_became_active":"2023-07-05T23:32:53.332159+0000","last_became_peered":"2023-07-05T23:32:53.332159+0000","last_unstale":"2023-07-05T23:35:14.520533+0000","last_undegraded":"2023-07-05T23:35:14.520533+0000","last_fullsized":"2023-07-05T23:35:14.520533+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:20:52.387593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"30'468","reported_seq":485,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:13.571013+0000","last_change":"2023-07-05T23:32:57.363998+0000","last_active":"2023-07-05T23:35:13.571013+0000","last_peered":"2023-07-05T23:35:13.571013+0000","last_clean":"2023-07-05T23:35:13.571013+0000","last_became_active":"2023-07-05T23:32:57.363620+0000","last_became_peered":"2023-07-05T23:32:57.363620+0000","last_unstale":"2023-07-05T23:35:13.571013+0000","last_undegraded":"2023-07-05T23:35:13.571013+0000","last_fullsized":"2023-07-05T23:35:13.571013+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:47:48.642379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.228911+0000","last_change":"2023-07-05T23:32:52.908550+0000","last_active":"2023-07-05T23:33:35.228911+0000","last_peered":"2023-07-05T23:33:35.228911+0000","last_clean":"2023-07-05T23:33:35.228911+0000","last_became_active":"2023-07-05T23:32:52.908111+0000","last_became_peered":"2023-07-05T23:32:52.908111+0000","last_unstale":"2023-07-05T23:33:35.228911+0000","last_undegraded":"2023-07-05T23:33:35.228911+0000","last_fullsized":"2023-07-05T23:33:35.228911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:47:44.198348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"30'24","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.508353+0000","last_change":"2023-07-05T23:32:53.340098+0000","last_active":"2023-07-05T23:35:14.508353+0000","last_peered":"2023-07-05T23:35:14.508353+0000","last_clean":"2023-07-05T23:35:14.508353+0000","last_became_active":"2023-07-05T23:32:53.339686+0000","last_became_peered":"2023-07-05T23:32:53.339686+0000","last_unstale":"2023-07-05T23:35:14.508353+0000","last_undegraded":"2023-07-05T23:35:14.508353+0000","last_fullsized":"2023-07-05T23:35:14.508353+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:37:45.661547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"30'478","reported_seq":495,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:13.535971+0000","last_change":"2023-07-05T23:32:57.356309+0000","last_active":"2023-07-05T23:35:13.535971+0000","last_peered":"2023-07-05T23:35:13.535971+0000","last_clean":"2023-07-05T23:35:13.535971+0000","last_became_active":"2023-07-05T23:32:57.355910+0000","last_became_peered":"2023-07-05T23:32:57.355910+0000","last_unstale":"2023-07-05T23:35:13.535971+0000","last_undegraded":"2023-07-05T23:35:13.535971+0000","last_fullsized":"2023-07-05T23:35:13.535971+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:47:48.642379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:34.897485+0000","last_change":"2023-07-05T23:32:52.899481+0000","last_active":"2023-07-05T23:33:34.897485+0000","last_peered":"2023-07-05T23:33:34.897485+0000","last_clean":"2023-07-05T23:33:34.897485+0000","last_became_active":"2023-07-05T23:32:52.899159+0000","last_became_peered":"2023-07-05T23:32:52.899159+0000","last_unstale":"2023-07-05T23:33:34.897485+0000","last_undegraded":"2023-07-05T23:33:34.897485+0000","last_fullsized":"2023-07-05T23:33:34.897485+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:55:01.034913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"30'19","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.520324+0000","last_change":"2023-07-05T23:32:53.343643+0000","last_active":"2023-07-05T23:35:14.520324+0000","last_peered":"2023-07-05T23:35:14.520324+0000","last_clean":"2023-07-05T23:35:14.520324+0000","last_became_active":"2023-07-05T23:32:53.343262+0000","last_became_peered":"2023-07-05T23:32:53.343262+0000","last_unstale":"2023-07-05T23:35:14.520324+0000","last_undegraded":"2023-07-05T23:35:14.520324+0000","last_fullsized":"2023-07-05T23:35:14.520324+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:24:39.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"30'465","reported_seq":482,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.465946+0000","last_change":"2023-07-05T23:32:57.365478+0000","last_active":"2023-07-05T23:35:14.465946+0000","last_peered":"2023-07-05T23:35:14.465946+0000","last_clean":"2023-07-05T23:35:14.465946+0000","last_became_active":"2023-07-05T23:32:57.365087+0000","last_became_peered":"2023-07-05T23:32:57.365087+0000","last_unstale":"2023-07-05T23:35:14.465946+0000","last_undegraded":"2023-07-05T23:35:14.465946+0000","last_fullsized":"2023-07-05T23:35:14.465946+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:47:27.711548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"30'3","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:34.897598+0000","last_change":"2023-07-05T23:32:52.902806+0000","last_active":"2023-07-05T23:33:34.897598+0000","last_peered":"2023-07-05T23:33:34.897598+0000","last_clean":"2023-07-05T23:33:34.897598+0000","last_became_active":"2023-07-05T23:32:52.901689+0000","last_became_peered":"2023-07-05T23:32:52.901689+0000","last_unstale":"2023-07-05T23:33:34.897598+0000","last_undegraded":"2023-07-05T23:33:34.897598+0000","last_fullsized":"2023-07-05T23:33:34.897598+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:34:31.075112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'15","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.521404+0000","last_change":"2023-07-05T23:32:53.346776+0000","last_active":"2023-07-05T23:35:14.521404+0000","last_peered":"2023-07-05T23:35:14.521404+0000","last_clean":"2023-07-05T23:35:14.521404+0000","last_became_active":"2023-07-05T23:32:53.346553+0000","last_became_peered":"2023-07-05T23:32:53.346553+0000","last_unstale":"2023-07-05T23:35:14.521404+0000","last_undegraded":"2023-07-05T23:35:14.521404+0000","last_fullsized":"2023-07-05T23:35:14.521404+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:23:00.312260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"30'486","reported_seq":503,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.466120+0000","last_change":"2023-07-05T23:32:57.353173+0000","last_active":"2023-07-05T23:35:14.466120+0000","last_peered":"2023-07-05T23:35:14.466120+0000","last_clean":"2023-07-05T23:35:14.466120+0000","last_became_active":"2023-07-05T23:32:57.352716+0000","last_became_peered":"2023-07-05T23:32:57.352716+0000","last_unstale":"2023-07-05T23:35:14.466120+0000","last_undegraded":"2023-07-05T23:35:14.466120+0000","last_fullsized":"2023-07-05T23:35:14.466120+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:41:41.820423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.231058+0000","last_change":"2023-07-05T23:32:52.906954+0000","last_active":"2023-07-05T23:33:35.231058+0000","last_peered":"2023-07-05T23:33:35.231058+0000","last_clean":"2023-07-05T23:33:35.231058+0000","last_became_active":"2023-07-05T23:32:52.906688+0000","last_became_peered":"2023-07-05T23:32:52.906688+0000","last_unstale":"2023-07-05T23:33:35.231058+0000","last_undegraded":"2023-07-05T23:33:35.231058+0000","last_fullsized":"2023-07-05T23:33:35.231058+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:32:02.036320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"30'28","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.508674+0000","last_change":"2023-07-05T23:32:53.348210+0000","last_active":"2023-07-05T23:35:14.508674+0000","last_peered":"2023-07-05T23:35:14.508674+0000","last_clean":"2023-07-05T23:35:14.508674+0000","last_became_active":"2023-07-05T23:32:53.346652+0000","last_became_peered":"2023-07-05T23:32:53.346652+0000","last_unstale":"2023-07-05T23:35:14.508674+0000","last_undegraded":"2023-07-05T23:35:14.508674+0000","last_fullsized":"2023-07-05T23:35:14.508674+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:55:02.039251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"30'493","reported_seq":510,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:13.562560+0000","last_change":"2023-07-05T23:32:57.357185+0000","last_active":"2023-07-05T23:35:13.562560+0000","last_peered":"2023-07-05T23:35:13.562560+0000","last_clean":"2023-07-05T23:35:13.562560+0000","last_became_active":"2023-07-05T23:32:57.356637+0000","last_became_peered":"2023-07-05T23:32:57.356637+0000","last_unstale":"2023-07-05T23:35:13.562560+0000","last_undegraded":"2023-07-05T23:35:13.562560+0000","last_fullsized":"2023-07-05T23:35:13.562560+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:03:49.271205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"30'5","reported_seq":31,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:00.628733+0000","last_change":"2023-07-05T23:32:52.904412+0000","last_active":"2023-07-05T23:35:00.628733+0000","last_peered":"2023-07-05T23:35:00.628733+0000","last_clean":"2023-07-05T23:35:00.628733+0000","last_became_active":"2023-07-05T23:32:52.903823+0000","last_became_peered":"2023-07-05T23:32:52.903823+0000","last_unstale":"2023-07-05T23:35:00.628733+0000","last_undegraded":"2023-07-05T23:35:00.628733+0000","last_fullsized":"2023-07-05T23:35:00.628733+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:55:01.034913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"30'30","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.521424+0000","last_change":"2023-07-05T23:32:53.342800+0000","last_active":"2023-07-05T23:35:14.521424+0000","last_peered":"2023-07-05T23:35:14.521424+0000","last_clean":"2023-07-05T23:35:14.521424+0000","last_became_active":"2023-07-05T23:32:53.339863+0000","last_became_peered":"2023-07-05T23:32:53.339863+0000","last_unstale":"2023-07-05T23:35:14.521424+0000","last_undegraded":"2023-07-05T23:35:14.521424+0000","last_fullsized":"2023-07-05T23:35:14.521424+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:18:02.496050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"30'37","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.505625+0000","last_change":"2023-07-05T23:32:53.337066+0000","last_active":"2023-07-05T23:35:14.505625+0000","last_peered":"2023-07-05T23:35:14.505625+0000","last_clean":"2023-07-05T23:35:14.505625+0000","last_became_active":"2023-07-05T23:32:53.336759+0000","last_became_peered":"2023-07-05T23:32:53.336759+0000","last_unstale":"2023-07-05T23:35:14.505625+0000","last_undegraded":"2023-07-05T23:35:14.505625+0000","last_fullsized":"2023-07-05T23:35:14.505625+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:10:47.650972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"30'33","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.509724+0000","last_change":"2023-07-05T23:32:53.346160+0000","last_active":"2023-07-05T23:35:14.509724+0000","last_peered":"2023-07-05T23:35:14.509724+0000","last_clean":"2023-07-05T23:35:14.509724+0000","last_became_active":"2023-07-05T23:32:53.345711+0000","last_became_peered":"2023-07-05T23:32:53.345711+0000","last_unstale":"2023-07-05T23:35:14.509724+0000","last_undegraded":"2023-07-05T23:35:14.509724+0000","last_fullsized":"2023-07-05T23:35:14.509724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:19:28.044822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"30'30","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.521711+0000","last_change":"2023-07-05T23:32:53.339729+0000","last_active":"2023-07-05T23:35:14.521711+0000","last_peered":"2023-07-05T23:35:14.521711+0000","last_clean":"2023-07-05T23:35:14.521711+0000","last_became_active":"2023-07-05T23:32:53.339431+0000","last_became_peered":"2023-07-05T23:32:53.339431+0000","last_unstale":"2023-07-05T23:35:14.521711+0000","last_undegraded":"2023-07-05T23:35:14.521711+0000","last_fullsized":"2023-07-05T23:35:14.521711+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:27:36.127458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"30'25","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.514712+0000","last_change":"2023-07-05T23:32:53.335512+0000","last_active":"2023-07-05T23:35:14.514712+0000","last_peered":"2023-07-05T23:35:14.514712+0000","last_clean":"2023-07-05T23:35:14.514712+0000","last_became_active":"2023-07-05T23:32:53.335181+0000","last_became_peered":"2023-07-05T23:32:53.335181+0000","last_unstale":"2023-07-05T23:35:14.514712+0000","last_undegraded":"2023-07-05T23:35:14.514712+0000","last_fullsized":"2023-07-05T23:35:14.514712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:47:24.271855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"30'20","reported_seq":44,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.513749+0000","last_change":"2023-07-05T23:32:53.338171+0000","last_active":"2023-07-05T23:35:14.513749+0000","last_peered":"2023-07-05T23:35:14.513749+0000","last_clean":"2023-07-05T23:35:14.513749+0000","last_became_active":"2023-07-05T23:32:53.337835+0000","last_became_peered":"2023-07-05T23:32:53.337835+0000","last_unstale":"2023-07-05T23:35:14.513749+0000","last_undegraded":"2023-07-05T23:35:14.513749+0000","last_fullsized":"2023-07-05T23:35:14.513749+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:00:42.415370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":155189248,"num_objects":37,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":577,"num_write_kb":1236992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":310378496,"data_stored":310378496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15026,"ondisk_log_size":15026,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1559,"ondisk_log_size":1559,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1443896,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":14,"num_read_kb":16,"num_write":438,"num_write_kb":1699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2949120,"data_stored":2887792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":438,"ondisk_log_size":438,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574883,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":100960,"kb_used_data":65816,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94270880,"statfs":{"total":96636764160,"available":96533381120,"internally_reserved":0,"allocated":67395584,"data_stored":67176597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 5 23:34:44 2023","interfaces":[{"interface":"back","average":{"1min":3.7120000000000002,"5min":1.2150000000000001,"15min":0.79900000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":12.042,"5min":12.042,"15min":12.042},"last":0.29799999999999999},{"interface":"front","average":{"1min":6.5010000000000003,"5min":2.4590000000000001,"15min":1.7849999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":26.367999999999999,"5min":26.367999999999999,"15min":26.367999999999999},"last":0.41299999999999998}]},{"osd":1,"last update":"Wed Jul 5 23:34:44 2023","interfaces":[{"interface":"back","average":{"1min":3.536,"5min":1.2789999999999999,"15min":0.90300000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":11.948,"5min":11.948,"15min":11.948},"last":0.36799999999999999},{"interface":"front","average":{"1min":4.0110000000000001,"5min":1.2789999999999999,"15min":0.82399999999999995},"min":{"1min":0.318,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":11.952,"5min":11.952,"15min":11.952},"last":0.39400000000000002}]},{"osd":2,"last update":"Wed Jul 5 23:34:44 2023","interfaces":[{"interface":"back","average":{"1min":4.0209999999999999,"5min":1.675,"15min":1.284},"min":{"1min":0.38500000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":11.997,"5min":11.997,"15min":11.997},"last":0.35499999999999998},{"interface":"front","average":{"1min":6.1189999999999998,"5min":1.7829999999999999,"15min":1.0600000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":26.419,"5min":26.419,"15min":26.419},"last":0.46000000000000002}]},{"osd":3,"last update":"Wed Jul 5 23:34:44 2023","interfaces":[{"interface":"back","average":{"1min":4.9889999999999999,"5min":1.51,"15min":0.93000000000000005},"min":{"1min":0.43099999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":24.094000000000001,"5min":24.094000000000001,"15min":24.094000000000001},"last":0.40500000000000003},{"interface":"front","average":{"1min":5.3719999999999999,"5min":1.5780000000000001,"15min":0.94599999999999995},"min":{"1min":0.44700000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":22.588000000000001,"5min":22.588000000000001,"15min":22.588000000000001},"last":0.32500000000000001}]},{"osd":4,"last update":"Wed Jul 5 23:34:44 2023","interfaces":[{"interface":"back","average":{"1min":3.4390000000000001,"5min":1.111,"15min":0.72299999999999998},"min":{"1min":0.32500000000000001,"5min":0.318,"15min":0.318},"max":{"1min":12.173999999999999,"5min":12.173999999999999,"15min":12.173999999999999},"last":0.28000000000000003},{"interface":"front","average":{"1min":3.4780000000000002,"5min":1.147,"15min":0.75900000000000001},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":12.151,"5min":12.151,"15min":12.151},"last":0.307}]},{"osd":5,"last update":"Wed Jul 5 23:34:44 2023","interfaces":[{"interface":"back","average":{"1min":3.8519999999999999,"5min":1.222,"15min":0.78400000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":19.954999999999998,"5min":19.954999999999998,"15min":19.954999999999998},"last":0.33400000000000002},{"interface":"front","average":{"1min":3.6509999999999998,"5min":1.2150000000000001,"15min":0.80900000000000005},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":21.870999999999999,"5min":21.870999999999999,"15min":21.870999999999999},"last":0.38500000000000001}]},{"osd":6,"last update":"Wed Jul 5 23:34:44 2023","interfaces":[{"interface":"back","average":{"1min":5.4880000000000004,"5min":1.6060000000000001,"15min":0.95899999999999996},"min":{"1min":0.436,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":20.212,"5min":20.212,"15min":20.212},"last":0.44},{"interface":"front","average":{"1min":2.4449999999999998,"5min":0.98399999999999999,"15min":0.73999999999999999},"min":{"1min":0.45700000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":12.010999999999999,"5min":12.010999999999999,"15min":12.010999999999999},"last":0.34599999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574883,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78472,"kb_used_data":47424,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94293368,"statfs":{"total":96636764160,"available":96556408832,"internally_reserved":0,"allocated":48562176,"data_stored":48373342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 5 23:34:42 2023","interfaces":[{"interface":"back","average":{"1min":7.4859999999999998,"5min":1.9059999999999999,"15min":0.97599999999999998},"min":{"1min":0.39800000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":24.012,"5min":24.012,"15min":24.012},"last":0.39700000000000002},{"interface":"front","average":{"1min":7.5389999999999997,"5min":1.909,"15min":0.97099999999999997},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":27.036000000000001,"5min":27.036000000000001,"15min":27.036000000000001},"last":0.38300000000000001}]},{"osd":1,"last update":"Wed Jul 5 23:34:42 2023","interfaces":[{"interface":"back","average":{"1min":7.0979999999999999,"5min":1.8220000000000001,"15min":0.94199999999999995},"min":{"1min":0.34499999999999997,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":20.021999999999998,"5min":20.021999999999998,"15min":20.021999999999998},"last":0.434},{"interface":"front","average":{"1min":7.7549999999999999,"5min":1.9970000000000001,"15min":1.0369999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":23.943000000000001,"5min":23.943000000000001,"15min":23.943000000000001},"last":0.503}]},{"osd":2,"last update":"Wed Jul 5 23:34:42 2023","interfaces":[{"interface":"back","average":{"1min":7.1660000000000004,"5min":1.871,"15min":0.98899999999999999},"min":{"1min":0.36699999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":25.658000000000001,"5min":25.658000000000001,"15min":25.658000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":5.9139999999999997,"5min":1.647,"15min":0.93600000000000005},"min":{"1min":0.40000000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":27.062000000000001,"5min":27.062000000000001,"15min":27.062000000000001},"last":0.57099999999999995}]},{"osd":3,"last update":"Wed Jul 5 23:34:42 2023","interfaces":[{"interface":"back","average":{"1min":6.657,"5min":1.7889999999999999,"15min":0.97699999999999998},"min":{"1min":0.443,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":27.108000000000001,"5min":27.108000000000001,"15min":27.108000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":7.6630000000000003,"5min":1.976,"15min":1.028},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":19.940000000000001,"5min":19.940000000000001,"15min":19.940000000000001},"last":0.55200000000000005}]},{"osd":4,"last update":"Wed Jul 5 23:34:42 2023","interfaces":[{"interface":"back","average":{"1min":8.0489999999999995,"5min":2.0430000000000001,"15min":1.042},"min":{"1min":0.34899999999999998,"5min":0.308,"15min":0.308},"max":{"1min":26,"5min":26,"15min":26},"last":0.58299999999999996},{"interface":"front","average":{"1min":5.0650000000000004,"5min":1.482,"15min":0.88500000000000001},"min":{"1min":0.376,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":27.085000000000001,"5min":27.085000000000001,"15min":27.085000000000001},"last":0.52400000000000002}]},{"osd":5,"last update":"Wed Jul 5 23:34:42 2023","interfaces":[{"interface":"back","average":{"1min":5.5750000000000002,"5min":1.5549999999999999,"15min":0.88500000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":19.975000000000001,"5min":19.975000000000001,"15min":19.975000000000001},"last":0.49299999999999999},{"interface":"front","average":{"1min":6.4349999999999996,"5min":1.7789999999999999,"15min":1.0029999999999999},"min":{"1min":0.41999999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":17.126999999999999,"5min":17.126999999999999,"15min":17.126999999999999},"last":0.60699999999999998}]},{"osd":7,"last update":"Wed Jul 5 23:34:42 2023","interfaces":[{"interface":"back","average":{"1min":5.7000000000000002,"5min":1.6240000000000001,"15min":0.94499999999999995},"min":{"1min":0.438,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":26.992000000000001,"5min":26.992000000000001,"15min":26.992000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":6.1929999999999996,"5min":1.7250000000000001,"15min":0.98099999999999998},"min":{"1min":0.44700000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":19.998999999999999,"5min":19.998999999999999,"15min":19.998999999999999},"last":0.59099999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574883,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72328,"kb_used_data":41280,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94299512,"statfs":{"total":96636764160,"available":96562700288,"internally_reserved":0,"allocated":42270720,"data_stored":42081886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 5 23:34:46 2023","interfaces":[{"interface":"back","average":{"1min":3.9239999999999999,"5min":1.0700000000000001,"15min":0.59399999999999997},"min":{"1min":0.29799999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":14.039999999999999,"5min":14.039999999999999,"15min":14.039999999999999},"last":0.27500000000000002},{"interface":"front","average":{"1min":3.871,"5min":1.0669999999999999,"15min":0.59899999999999998},"min":{"1min":0.27400000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":18.006,"5min":18.006,"15min":18.006},"last":0.28999999999999998}]},{"osd":2,"last update":"Wed Jul 5 23:34:46 2023","interfaces":[{"interface":"back","average":{"1min":4.3860000000000001,"5min":1.1839999999999999,"15min":0.65000000000000002},"min":{"1min":0.32200000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":14.092000000000001,"5min":14.092000000000001,"15min":14.092000000000001},"last":0.313},{"interface":"front","average":{"1min":4.3929999999999998,"5min":1.173,"15min":0.63600000000000001},"min":{"1min":0.33500000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":17.994,"5min":17.994,"15min":17.994},"last":0.26500000000000001}]},{"osd":3,"last update":"Wed Jul 5 23:34:46 2023","interfaces":[{"interface":"back","average":{"1min":4.9980000000000002,"5min":1.3180000000000001,"15min":0.70399999999999996},"min":{"1min":0.29999999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":17.949999999999999,"5min":17.949999999999999,"15min":17.949999999999999},"last":0.34399999999999997},{"interface":"front","average":{"1min":3.2240000000000002,"5min":0.96999999999999997,"15min":0.59399999999999997},"min":{"1min":0.38800000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":14.377000000000001,"5min":14.377000000000001,"15min":14.377000000000001},"last":0.33100000000000002}]},{"osd":4,"last update":"Wed Jul 5 23:34:46 2023","interfaces":[{"interface":"back","average":{"1min":5.0419999999999998,"5min":1.4790000000000001,"15min":0.88500000000000001},"min":{"1min":0.436,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":14.004,"5min":14.004,"15min":14.004},"last":0.55800000000000005},{"interface":"front","average":{"1min":5.75,"5min":1.6100000000000001,"15min":0.92000000000000004},"min":{"1min":0.49399999999999999,"5min":0.371,"15min":0.371},"max":{"1min":20.943999999999999,"5min":20.943999999999999,"15min":20.943999999999999},"last":0.63}]},{"osd":5,"last update":"Wed Jul 5 23:34:46 2023","interfaces":[{"interface":"back","average":{"1min":5.2549999999999999,"5min":1.5509999999999999,"15min":0.93400000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":24.949999999999999,"5min":24.949999999999999,"15min":24.949999999999999},"last":0.745},{"interface":"front","average":{"1min":5.9710000000000001,"5min":1.7190000000000001,"15min":1.0109999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":21.945,"5min":21.945,"15min":21.945},"last":0.64100000000000001}]},{"osd":6,"last update":"Wed Jul 5 23:34:46 2023","interfaces":[{"interface":"back","average":{"1min":4.2859999999999996,"5min":1.3420000000000001,"15min":0.85099999999999998},"min":{"1min":0.42799999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":17.981999999999999,"5min":17.981999999999999,"15min":17.981999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":6.0060000000000002,"5min":1.714,"15min":0.998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":24.943000000000001,"5min":24.943000000000001,"15min":24.943000000000001},"last":0.68000000000000005}]},{"osd":7,"last update":"Wed Jul 5 23:34:46 2023","interfaces":[{"interface":"back","average":{"1min":5.6079999999999997,"5min":1.621,"15min":0.95699999999999996},"min":{"1min":0.52700000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":18.045000000000002,"5min":18.045000000000002,"15min":18.045000000000002},"last":0.66800000000000004},{"interface":"front","average":{"1min":3.9289999999999998,"5min":1.2769999999999999,"15min":0.83499999999999996},"min":{"1min":0.46000000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":14.352,"5min":14.352,"15min":14.352},"last":0.69399999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574883,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":101592,"kb_used_data":70544,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94270248,"statfs":{"total":96636764160,"available":96532733952,"internally_reserved":0,"allocated":72237056,"data_stored":72040498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Jul 5 23:34:41 2023","interfaces":[{"interface":"back","average":{"1min":4.0949999999999998,"5min":1.081,"15min":0.57899999999999996},"min":{"1min":0.254,"5min":0.185,"15min":0.185},"max":{"1min":23.974,"5min":23.974,"15min":23.974},"last":0.313},{"interface":"front","average":{"1min":5.0419999999999998,"5min":1.282,"15min":0.65500000000000003},"min":{"1min":0.28999999999999998,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":32.256999999999998,"5min":32.256999999999998,"15min":32.256999999999998},"last":1.1040000000000001}]},{"osd":2,"last update":"Wed Jul 5 23:34:41 2023","interfaces":[{"interface":"back","average":{"1min":3.4060000000000001,"5min":0.97899999999999998,"15min":0.57499999999999996},"min":{"1min":0.31,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":16.157,"5min":16.157,"15min":16.157},"last":0.21199999999999999},{"interface":"front","average":{"1min":3.6739999999999999,"5min":1.0269999999999999,"15min":0.58599999999999997},"min":{"1min":0.28899999999999998,"5min":0.254,"15min":0.254},"max":{"1min":14.91,"5min":14.91,"15min":14.91},"last":1.0700000000000001}]},{"osd":3,"last update":"Wed Jul 5 23:34:41 2023","interfaces":[{"interface":"back","average":{"1min":6.1820000000000004,"5min":1.534,"15min":0.75900000000000001},"min":{"1min":0.35299999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":16.928999999999998,"5min":16.928999999999998,"15min":16.928999999999998},"last":2.0529999999999999},{"interface":"front","average":{"1min":2.4399999999999999,"5min":0.83199999999999996,"15min":0.56399999999999995},"min":{"1min":0.38500000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":11.923999999999999,"5min":11.923999999999999,"15min":11.923999999999999},"last":0.34799999999999998}]},{"osd":4,"last update":"Wed Jul 5 23:34:41 2023","interfaces":[{"interface":"back","average":{"1min":4.6520000000000001,"5min":1.3899999999999999,"15min":0.84599999999999997},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":16.838000000000001,"5min":16.838000000000001,"15min":16.838000000000001},"last":0.95599999999999996},{"interface":"front","average":{"1min":5.7990000000000004,"5min":1.633,"15min":0.93899999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":23.905999999999999,"5min":23.905999999999999,"15min":23.905999999999999},"last":1.1910000000000001}]},{"osd":5,"last update":"Wed Jul 5 23:34:41 2023","interfaces":[{"interface":"back","average":{"1min":4.7140000000000004,"5min":1.4299999999999999,"15min":0.88200000000000001},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":17.824000000000002,"5min":17.824000000000002,"15min":17.824000000000002},"last":1.5109999999999999},{"interface":"front","average":{"1min":5.0519999999999996,"5min":1.5,"15min":0.90800000000000003},"min":{"1min":0.498,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":16.905000000000001,"5min":16.905000000000001,"15min":16.905000000000001},"last":0.98799999999999999}]},{"osd":6,"last update":"Wed Jul 5 23:34:41 2023","interfaces":[{"interface":"back","average":{"1min":2.7469999999999999,"5min":1.0389999999999999,"15min":0.754},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":10.102,"5min":10.102,"15min":10.102},"last":0.59699999999999998},{"interface":"front","average":{"1min":5.2690000000000001,"5min":1.5529999999999999,"15min":0.93300000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":32.298999999999999,"5min":32.298999999999999,"15min":32.298999999999999},"last":1.129}]},{"osd":7,"last update":"Wed Jul 5 23:34:41 2023","interfaces":[{"interface":"back","average":{"1min":4.7759999999999998,"5min":1.464,"15min":0.91200000000000003},"min":{"1min":0.51000000000000001,"5min":0.503,"15min":0.503},"max":{"1min":14.946,"5min":14.946,"15min":14.946},"last":1.1579999999999999},{"interface":"front","average":{"1min":5.8360000000000003,"5min":1.657,"15min":0.96099999999999997},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":16.878,"5min":16.878,"15min":16.878},"last":1.0149999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574884,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":88712,"kb_used_data":57664,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94283128,"statfs":{"total":96636764160,"available":96545923072,"internally_reserved":0,"allocated":59047936,"data_stored":58859102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 5 23:34:45 2023","interfaces":[{"interface":"back","average":{"1min":6.4109999999999996,"5min":1.728,"15min":0.94799999999999995},"min":{"1min":0.27600000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":29.716000000000001,"5min":29.716000000000001,"15min":29.716000000000001},"last":0.24399999999999999},{"interface":"front","average":{"1min":6.1890000000000001,"5min":1.7290000000000001,"15min":0.98599999999999999},"min":{"1min":0.26800000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":21.699000000000002,"5min":21.699000000000002,"15min":21.699000000000002},"last":0.34699999999999998}]},{"osd":1,"last update":"Wed Jul 5 23:34:45 2023","interfaces":[{"interface":"back","average":{"1min":6.0640000000000001,"5min":1.718,"15min":0.99399999999999999},"min":{"1min":0.35999999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":23.053000000000001,"5min":23.053000000000001,"15min":23.053000000000001},"last":0.39700000000000002},{"interface":"front","average":{"1min":5.3579999999999997,"5min":1.5720000000000001,"15min":0.94099999999999995},"min":{"1min":0.32800000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":29.632999999999999,"5min":29.632999999999999,"15min":29.632999999999999},"last":0.311}]},{"osd":3,"last update":"Wed Jul 5 23:34:45 2023","interfaces":[{"interface":"back","average":{"1min":3.52,"5min":1.1559999999999999,"15min":0.76200000000000001},"min":{"1min":0.29799999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":22.018000000000001,"5min":22.018000000000001,"15min":22.018000000000001},"last":0.28599999999999998},{"interface":"front","average":{"1min":4.9390000000000001,"5min":1.5429999999999999,"15min":0.97699999999999998},"min":{"1min":0.41399999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":29.686,"5min":29.686,"15min":29.686},"last":0.36399999999999999}]},{"osd":4,"last update":"Wed Jul 5 23:34:45 2023","interfaces":[{"interface":"back","average":{"1min":6.9909999999999997,"5min":2.0550000000000002,"15min":1.2330000000000001},"min":{"1min":0.46200000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":29.768999999999998,"5min":29.768999999999998,"15min":29.768999999999998},"last":0.54900000000000004},{"interface":"front","average":{"1min":7.3170000000000002,"5min":2.141,"15min":1.278},"min":{"1min":0.44600000000000001,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":21.16,"5min":21.16,"15min":21.16},"last":0.45100000000000001}]},{"osd":5,"last update":"Wed Jul 5 23:34:45 2023","interfaces":[{"interface":"back","average":{"1min":8.359,"5min":2.331,"15min":1.3260000000000001},"min":{"1min":0.502,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":22.927,"5min":22.927,"15min":22.927},"last":0.51500000000000001},{"interface":"front","average":{"1min":5.6970000000000001,"5min":1.8140000000000001,"15min":1.167},"min":{"1min":0.52400000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":23.120000000000001,"5min":23.120000000000001,"15min":23.120000000000001},"last":0.497}]},{"osd":6,"last update":"Wed Jul 5 23:34:45 2023","interfaces":[{"interface":"back","average":{"1min":6.0430000000000001,"5min":1.889,"15min":1.1970000000000001},"min":{"1min":0.54200000000000004,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":23.173999999999999,"5min":23.173999999999999,"15min":23.173999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":8.3699999999999992,"5min":2.3570000000000002,"15min":1.355},"min":{"1min":0.59599999999999997,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":29.742999999999999,"5min":29.742999999999999,"15min":29.742999999999999},"last":0.45600000000000002}]},{"osd":7,"last update":"Wed Jul 5 23:34:45 2023","interfaces":[{"interface":"back","average":{"1min":8.6240000000000006,"5min":2.4140000000000001,"15min":1.379},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":32.924999999999997,"5min":32.924999999999997,"15min":32.924999999999997},"last":0.47399999999999998},{"interface":"front","average":{"1min":7.1630000000000003,"5min":2.1419999999999999,"15min":1.3049999999999999},"min":{"1min":0.53000000000000003,"5min":0.436,"15min":0.436},"max":{"1min":30.594999999999999,"5min":30.594999999999999,"15min":30.594999999999999},"last":0.55800000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574883,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70284,"kb_used_data":43332,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94301556,"statfs":{"total":96636764160,"available":96564793344,"internally_reserved":0,"allocated":44371968,"data_stored":44179128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 5 23:34:48 2023","interfaces":[{"interface":"back","average":{"1min":4.9059999999999997,"5min":1.333,"15min":0.73699999999999999},"min":{"1min":0.33100000000000002,"5min":0.25,"15min":0.25},"max":{"1min":22.948,"5min":22.948,"15min":22.948},"last":0.26000000000000001},{"interface":"front","average":{"1min":4.9850000000000003,"5min":1.3799999999999999,"15min":0.77900000000000003},"min":{"1min":0.34699999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":23.036000000000001,"5min":23.036000000000001,"15min":23.036000000000001},"last":0.315}]},{"osd":1,"last update":"Wed Jul 5 23:34:48 2023","interfaces":[{"interface":"back","average":{"1min":4.1429999999999998,"5min":1.405,"15min":0.94899999999999995},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":18.981999999999999,"5min":18.981999999999999,"15min":18.981999999999999},"last":0.29799999999999999},{"interface":"front","average":{"1min":4.5170000000000003,"5min":1.512,"15min":1.0109999999999999},"min":{"1min":0.38300000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":25.253,"5min":25.253,"15min":25.253},"last":0.33500000000000002}]},{"osd":2,"last update":"Wed Jul 5 23:34:48 2023","interfaces":[{"interface":"back","average":{"1min":4.101,"5min":1.234,"15min":0.75600000000000001},"min":{"1min":0.30499999999999999,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":25.32,"5min":25.32,"15min":25.32},"last":0.36499999999999999},{"interface":"front","average":{"1min":4.048,"5min":1.2010000000000001,"15min":0.72699999999999998},"min":{"1min":0.42499999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":12.010999999999999,"5min":12.010999999999999,"15min":12.010999999999999},"last":0.378}]},{"osd":4,"last update":"Wed Jul 5 23:34:48 2023","interfaces":[{"interface":"back","average":{"1min":4.343,"5min":1.379,"15min":0.88500000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":19.007999999999999,"5min":19.007999999999999,"15min":19.007999999999999},"last":0.502},{"interface":"front","average":{"1min":5.3330000000000002,"5min":1.6080000000000001,"15min":0.98699999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":22.882000000000001,"5min":22.882000000000001,"15min":22.882000000000001},"last":0.51300000000000001}]},{"osd":5,"last update":"Wed Jul 5 23:34:48 2023","interfaces":[{"interface":"back","average":{"1min":6.7869999999999999,"5min":1.919,"15min":1.1080000000000001},"min":{"1min":0.46600000000000003,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":23.004999999999999,"5min":23.004999999999999,"15min":23.004999999999999},"last":0.44800000000000001},{"interface":"front","average":{"1min":5.7699999999999996,"5min":1.7330000000000001,"15min":1.0600000000000001},"min":{"1min":0.61499999999999999,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":18.959,"5min":18.959,"15min":18.959},"last":0.55800000000000005}]},{"osd":6,"last update":"Wed Jul 5 23:34:48 2023","interfaces":[{"interface":"back","average":{"1min":4.2370000000000001,"5min":1.429,"15min":0.96099999999999997},"min":{"1min":0.60699999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":18.923999999999999,"5min":18.923999999999999,"15min":18.923999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":5.5460000000000003,"5min":1.6539999999999999,"15min":1.006},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":18.978000000000002,"5min":18.978000000000002,"15min":18.978000000000002},"last":0.46600000000000003}]},{"osd":7,"last update":"Wed Jul 5 23:34:48 2023","interfaces":[{"interface":"back","average":{"1min":5.2569999999999997,"5min":1.585,"15min":0.97299999999999998},"min":{"1min":0.47499999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":19.937999999999999,"5min":19.937999999999999,"15min":19.937999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":5.9630000000000001,"5min":1.7749999999999999,"15min":1.077},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":22.974,"5min":22.974,"15min":22.974},"last":0.48199999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574884,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":75804,"kb_used_data":40660,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94296036,"statfs":{"total":96636764160,"available":96559140864,"internally_reserved":0,"allocated":41635840,"data_stored":41427888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 5 23:34:44 2023","interfaces":[{"interface":"back","average":{"1min":5.1120000000000001,"5min":1.4319999999999999,"15min":0.81799999999999995},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":16.655999999999999,"5min":16.655999999999999,"15min":16.655999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":5.5030000000000001,"5min":1.5149999999999999,"15min":0.85099999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":18.661999999999999,"5min":18.661999999999999,"15min":18.661999999999999},"last":0.52700000000000002}]},{"osd":1,"last update":"Wed Jul 5 23:34:44 2023","interfaces":[{"interface":"back","average":{"1min":5.3860000000000001,"5min":1.47,"15min":0.81799999999999995},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":18.991,"5min":18.991,"15min":18.991},"last":0.503},{"interface":"front","average":{"1min":7.1799999999999997,"5min":1.8400000000000001,"15min":0.94999999999999996},"min":{"1min":0.371,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":23.879000000000001,"5min":23.879000000000001,"15min":23.879000000000001},"last":0.54900000000000004}]},{"osd":2,"last update":"Wed Jul 5 23:34:44 2023","interfaces":[{"interface":"back","average":{"1min":6.8799999999999999,"5min":1.8320000000000001,"15min":0.98999999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":23.805,"5min":23.805,"15min":23.805},"last":0.53600000000000003},{"interface":"front","average":{"1min":6.1379999999999999,"5min":1.6659999999999999,"15min":0.92100000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":18.707000000000001,"5min":18.707000000000001,"15min":18.707000000000001},"last":0.434}]},{"osd":3,"last update":"Wed Jul 5 23:34:44 2023","interfaces":[{"interface":"back","average":{"1min":6.0090000000000003,"5min":1.6220000000000001,"15min":0.89100000000000001},"min":{"1min":0.373,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":22.966999999999999,"5min":22.966999999999999,"15min":22.966999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":6.0899999999999999,"5min":1.6799999999999999,"15min":0.94499999999999995},"min":{"1min":0.33800000000000002,"5min":0.314,"15min":0.314},"max":{"1min":23.843,"5min":23.843,"15min":23.843},"last":0.42199999999999999}]},{"osd":5,"last update":"Wed Jul 5 23:34:44 2023","interfaces":[{"interface":"back","average":{"1min":4.7779999999999996,"5min":1.3280000000000001,"15min":0.753},"min":{"1min":0.39500000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":16.574999999999999,"5min":16.574999999999999,"15min":16.574999999999999},"last":0.36799999999999999},{"interface":"front","average":{"1min":3.8380000000000001,"5min":1.1870000000000001,"15min":0.745},"min":{"1min":0.40100000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":18.693999999999999,"5min":18.693999999999999,"15min":18.693999999999999},"last":0.44800000000000001}]},{"osd":6,"last update":"Wed Jul 5 23:34:44 2023","interfaces":[{"interface":"back","average":{"1min":5.016,"5min":1.425,"15min":0.82699999999999996},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":17.983000000000001,"5min":17.983000000000001,"15min":17.983000000000001},"last":0.38100000000000001},{"interface":"front","average":{"1min":4.4509999999999996,"5min":1.3300000000000001,"15min":0.81000000000000005},"min":{"1min":0.44500000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":16.622,"5min":16.622,"15min":16.622},"last":0.47599999999999998}]},{"osd":7,"last update":"Wed Jul 5 23:34:44 2023","interfaces":[{"interface":"back","average":{"1min":3.9460000000000002,"5min":1.226,"15min":0.77300000000000002},"min":{"1min":0.46500000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":22.931000000000001,"5min":22.931000000000001,"15min":22.931000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":4.2030000000000003,"5min":1.3069999999999999,"15min":0.82499999999999996},"min":{"1min":0.40400000000000003,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":18.966000000000001,"5min":18.966000000000001,"15min":18.966000000000001},"last":0.46700000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574883,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":98960,"kb_used_data":63816,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94272880,"statfs":{"total":96636764160,"available":96535429120,"internally_reserved":0,"allocated":65347584,"data_stored":65151210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,3,4],"upper_bound":128},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 5 23:34:40 2023","interfaces":[{"interface":"back","average":{"1min":5.9340000000000002,"5min":1.5860000000000001,"15min":0.86099999999999999},"min":{"1min":0.42999999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":18.867999999999999,"5min":18.867999999999999,"15min":18.867999999999999},"last":0.34999999999999998},{"interface":"front","average":{"1min":4.109,"5min":1.3380000000000001,"15min":0.876},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":18.099,"5min":18.099,"15min":18.099},"last":0.27400000000000002}]},{"osd":1,"last update":"Wed Jul 5 23:34:40 2023","interfaces":[{"interface":"back","average":{"1min":3.8809999999999998,"5min":1.244,"15min":0.80400000000000005},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":18.071999999999999,"5min":18.071999999999999,"15min":18.071999999999999},"last":0.376},{"interface":"front","average":{"1min":4.7530000000000001,"5min":1.444,"15min":0.89200000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":16.869,"5min":16.869,"15min":16.869},"last":0.247}]},{"osd":2,"last update":"Wed Jul 5 23:34:40 2023","interfaces":[{"interface":"back","average":{"1min":5.4950000000000001,"5min":1.556,"15min":0.90000000000000002},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":22.177,"5min":22.177,"15min":22.177},"last":0.316},{"interface":"front","average":{"1min":5.4589999999999996,"5min":1.5589999999999999,"15min":0.90900000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":18.902999999999999,"5min":18.902999999999999,"15min":18.902999999999999},"last":0.40999999999999998}]},{"osd":3,"last update":"Wed Jul 5 23:34:40 2023","interfaces":[{"interface":"back","average":{"1min":4.3230000000000004,"5min":1.333,"15min":0.83499999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":18.032,"5min":18.032,"15min":18.032},"last":0.41899999999999998},{"interface":"front","average":{"1min":4.2400000000000002,"5min":1.399,"15min":0.92500000000000004},"min":{"1min":0.46700000000000003,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":16.905000000000001,"5min":16.905000000000001,"15min":16.905000000000001},"last":0.36399999999999999}]},{"osd":4,"last update":"Wed Jul 5 23:34:40 2023","interfaces":[{"interface":"back","average":{"1min":5.4420000000000002,"5min":1.51,"15min":0.85499999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":18.957000000000001,"5min":18.957000000000001,"15min":18.957000000000001},"last":0.29799999999999999},{"interface":"front","average":{"1min":3.6560000000000001,"5min":1.2,"15min":0.79100000000000004},"min":{"1min":0.38400000000000001,"5min":0.377,"15min":0.377},"max":{"1min":18.123999999999999,"5min":18.123999999999999,"15min":18.123999999999999},"last":0.33300000000000002}]},{"osd":6,"last update":"Wed Jul 5 23:34:40 2023","interfaces":[{"interface":"back","average":{"1min":4.1299999999999999,"5min":1.29,"15min":0.81599999999999995},"min":{"1min":0.41999999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":16.952000000000002,"5min":16.952000000000002,"15min":16.952000000000002},"last":0.42799999999999999},{"interface":"front","average":{"1min":5.1159999999999997,"5min":1.488,"15min":0.88300000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":18.928000000000001,"5min":18.928000000000001,"15min":18.928000000000001},"last":0.39000000000000001}]},{"osd":7,"last update":"Wed Jul 5 23:34:40 2023","interfaces":[{"interface":"back","average":{"1min":2.4380000000000002,"5min":0.96299999999999997,"15min":0.71699999999999997},"min":{"1min":0.40899999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":10.324999999999999,"5min":10.324999999999999,"15min":10.324999999999999},"last":0.443},{"interface":"front","average":{"1min":2.8799999999999999,"5min":1.077,"15min":0.77700000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":13.013,"5min":13.013,"15min":13.013},"last":0.39800000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":8225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1462272,"data_stored":1443154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1462272,"data_stored":1435671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":39845888,"data_stored":39845888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":41943040,"data_stored":41943040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":35651584,"data_stored":35651584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":27262976,"data_stored":27262976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":39845888,"data_stored":39845888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":35651584,"data_stored":35651584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":48234496,"data_stored":48234496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":41943040,"data_stored":41943040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-05T23:35:18.451 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-05T23:35:18.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.601+0000 7f489af15700 1 Processor -- start 2023-07-05T23:35:18.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.601+0000 7f489af15700 1 -- start start 2023-07-05T23:35:18.605 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.602+0000 7f489af15700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4894069ef0 0x7f4894070ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:18.605 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.602+0000 7f489af15700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f48940c95e0 0x7f4894071020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:18.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.602+0000 7f489af15700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48940cb580 con 0x7f4894157a90 2023-07-05T23:35:18.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.602+0000 7f489af15700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f489406db80 con 0x7f48940c95e0 2023-07-05T23:35:18.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.602+0000 7f489af15700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48940cafb0 con 0x7f4894069ef0 2023-07-05T23:35:18.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.602+0000 7f48994b2700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f48940c95e0 0x7f4894071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:18.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.602+0000 7f48994b2700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f48940c95e0 0x7f4894071020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46432/0 (socket says 172.21.15.27:46432) 2023-07-05T23:35:18.607 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.602+0000 7f48994b2700 1 -- 172.21.15.27:0/2857680662 learned_addr learned my addr 172.21.15.27:0/2857680662 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:18.607 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.602+0000 7f4893fff700 1 --2- 172.21.15.27:0/2857680662 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4894069ef0 0x7f4894070ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:18.607 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.602+0000 7f48994b2700 1 -- 172.21.15.27:0/2857680662 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4894069ef0 msgr2=0x7f4894070ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:35:18.607 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.602+0000 7f48994b2700 1 --2- 172.21.15.27:0/2857680662 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4894069ef0 0x7f4894070ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:18.607 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.602+0000 7f48994b2700 1 -- 172.21.15.27:0/2857680662 >> v1:172.21.15.162:6789/0 conn(0x7f4894157a90 legacy=0x7f489415e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:18.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.602+0000 7f48994b2700 1 -- 172.21.15.27:0/2857680662 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48940cb250 con 0x7f48940c95e0 2023-07-05T23:35:18.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.603+0000 7f48994b2700 1 --2- 172.21.15.27:0/2857680662 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f48940c95e0 0x7f4894071020 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f488c009e50 tx=0x7f488c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5532c7329c9dca16 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:18.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.603+0000 7f48937fe700 1 -- 172.21.15.27:0/2857680662 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488c00e070 con 0x7f48940c95e0 2023-07-05T23:35:18.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.603+0000 7f48937fe700 1 -- 172.21.15.27:0/2857680662 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f488c00b910 con 0x7f48940c95e0 2023-07-05T23:35:18.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.603+0000 7f48937fe700 1 -- 172.21.15.27:0/2857680662 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488c00bcc0 con 0x7f48940c95e0 2023-07-05T23:35:18.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.603+0000 7f489af15700 1 -- 172.21.15.27:0/2857680662 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f48940c95e0 msgr2=0x7f4894071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:18.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.603+0000 7f489af15700 1 --2- 172.21.15.27:0/2857680662 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f48940c95e0 0x7f4894071020 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f488c009e50 tx=0x7f488c00b330 comp rx=0 tx=0).stop 2023-07-05T23:35:18.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.603+0000 7f489af15700 1 -- 172.21.15.27:0/2857680662 shutdown_connections 2023-07-05T23:35:18.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.603+0000 7f489af15700 1 --2- 172.21.15.27:0/2857680662 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f48940c95e0 0x7f4894071020 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:18.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.603+0000 7f489af15700 1 --2- 172.21.15.27:0/2857680662 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4894069ef0 0x7f4894070ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:18.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.603+0000 7f489af15700 1 -- 172.21.15.27:0/2857680662 >> 172.21.15.27:0/2857680662 conn(0x7f48940b1740 msgr2=0x7f489406cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:18.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.603+0000 7f489af15700 1 -- 172.21.15.27:0/2857680662 shutdown_connections 2023-07-05T23:35:18.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.603+0000 7f489af15700 1 -- 172.21.15.27:0/2857680662 wait complete. 2023-07-05T23:35:18.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.605+0000 7f489af15700 1 Processor -- start 2023-07-05T23:35:18.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.605+0000 7f489af15700 1 -- start start 2023-07-05T23:35:18.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.605+0000 7f489af15700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4894069ef0 0x7f48941e5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:18.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.605+0000 7f489af15700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f48940c95e0 0x7f48940c7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:18.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.605+0000 7f489af15700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4894157a90 0x7f48940c7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:18.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.605+0000 7f489af15700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f489415d4d0 con 0x7f48940c95e0 2023-07-05T23:35:18.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.605+0000 7f489af15700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f489414def0 con 0x7f4894157a90 2023-07-05T23:35:18.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.605+0000 7f489af15700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48941e5e50 con 0x7f4894069ef0 2023-07-05T23:35:18.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.606+0000 7f4893fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f48940c95e0 0x7f48940c7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:18.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.606+0000 7f4893fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f48940c95e0 0x7f48940c7650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46436/0 (socket says 172.21.15.27:46436) 2023-07-05T23:35:18.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.606+0000 7f4893fff700 1 -- 172.21.15.27:0/3881348878 learned_addr learned my addr 172.21.15.27:0/3881348878 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:18.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.606+0000 7f4898cb1700 1 --2- 172.21.15.27:0/3881348878 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4894069ef0 0x7f48941e5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:18.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.606+0000 7f48994b2700 1 --2- 172.21.15.27:0/3881348878 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4894157a90 0x7f48940c7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:18.616 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.606+0000 7f4893fff700 1 -- 172.21.15.27:0/3881348878 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4894069ef0 msgr2=0x7f48941e5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:18.616 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.606+0000 7f4893fff700 1 --2- 172.21.15.27:0/3881348878 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4894069ef0 0x7f48941e5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:18.616 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.606+0000 7f4893fff700 1 -- 172.21.15.27:0/3881348878 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4894157a90 msgr2=0x7f48940c7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:18.616 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.606+0000 7f4893fff700 1 --2- 172.21.15.27:0/3881348878 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4894157a90 0x7f48940c7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:18.616 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.606+0000 7f4893fff700 1 -- 172.21.15.27:0/3881348878 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f488c009b30 con 0x7f48940c95e0 2023-07-05T23:35:18.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.606+0000 7f4893fff700 1 --2- 172.21.15.27:0/3881348878 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f48940c95e0 0x7f48940c7650 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f488000e9b0 tx=0x7f488000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:18.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.606+0000 7f48917fa700 1 -- 172.21.15.27:0/3881348878 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4880009710 con 0x7f48940c95e0 2023-07-05T23:35:18.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.606+0000 7f48917fa700 1 -- 172.21.15.27:0/3881348878 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f488000ee50 con 0x7f48940c95e0 2023-07-05T23:35:18.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.606+0000 7f489af15700 1 -- 172.21.15.27:0/3881348878 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48940b2ef0 con 0x7f48940c95e0 2023-07-05T23:35:18.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.606+0000 7f48917fa700 1 -- 172.21.15.27:0/3881348878 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488000ca50 con 0x7f48940c95e0 2023-07-05T23:35:18.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.606+0000 7f489af15700 1 -- 172.21.15.27:0/3881348878 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f489415aac0 con 0x7f48940c95e0 2023-07-05T23:35:18.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.607+0000 7f489af15700 1 -- 172.21.15.27:0/3881348878 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4894073910 con 0x7f48940c95e0 2023-07-05T23:35:18.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.608+0000 7f48917fa700 1 -- 172.21.15.27:0/3881348878 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f488000cbb0 con 0x7f48940c95e0 2023-07-05T23:35:18.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.608+0000 7f48917fa700 1 --2- 172.21.15.27:0/3881348878 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f487806ace0 0x7f487806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:18.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.608+0000 7f48917fa700 1 -- 172.21.15.27:0/3881348878 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f48800897d0 con 0x7f48940c95e0 2023-07-05T23:35:18.619 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.609+0000 7f4898cb1700 1 --2- 172.21.15.27:0/3881348878 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f487806ace0 0x7f487806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:18.619 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.609+0000 7f4898cb1700 1 --2- 172.21.15.27:0/3881348878 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f487806ace0 0x7f487806d190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4888007fd0 tx=0x7f4888009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:18.619 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.613+0000 7f48917fa700 1 -- 172.21.15.27:0/3881348878 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4880057fe0 con 0x7f48940c95e0 2023-07-05T23:35:18.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.810+0000 7f489af15700 1 -- 172.21.15.27:0/3881348878 --> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f489406d8a0 con 0x7f487806ace0 2023-07-05T23:35:18.823 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.821+0000 7f48917fa700 1 -- 172.21.15.27:0/3881348878 <== mgr.4105 v2:172.21.15.162:6832/3790028097 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+391924 (secure 0 0 0) 0x7f4888001cc0 con 0x7f487806ace0 2023-07-05T23:35:18.827 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:35:18.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.825+0000 7f489af15700 1 -- 172.21.15.27:0/3881348878 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f487806ace0 msgr2=0x7f487806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:18.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.825+0000 7f489af15700 1 --2- 172.21.15.27:0/3881348878 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f487806ace0 0x7f487806d190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4888007fd0 tx=0x7f4888009040 comp rx=0 tx=0).stop 2023-07-05T23:35:18.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.825+0000 7f489af15700 1 -- 172.21.15.27:0/3881348878 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f48940c95e0 msgr2=0x7f48940c7650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:18.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.825+0000 7f489af15700 1 --2- 172.21.15.27:0/3881348878 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f48940c95e0 0x7f48940c7650 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f488000e9b0 tx=0x7f488000ecc0 comp rx=0 tx=0).stop 2023-07-05T23:35:18.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.825+0000 7f489af15700 1 -- 172.21.15.27:0/3881348878 shutdown_connections 2023-07-05T23:35:18.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.825+0000 7f489af15700 1 --2- 172.21.15.27:0/3881348878 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4894157a90 0x7f48940c7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:18.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.825+0000 7f489af15700 1 --2- 172.21.15.27:0/3881348878 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f487806ace0 0x7f487806d190 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:18.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.825+0000 7f489af15700 1 --2- 172.21.15.27:0/3881348878 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4894069ef0 0x7f48941e5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:18.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.825+0000 7f489af15700 1 --2- 172.21.15.27:0/3881348878 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f48940c95e0 0x7f48940c7650 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:18.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.825+0000 7f489af15700 1 -- 172.21.15.27:0/3881348878 >> 172.21.15.27:0/3881348878 conn(0x7f48940b1740 msgr2=0x7f4894158180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:18.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.825+0000 7f489af15700 1 -- 172.21.15.27:0/3881348878 shutdown_connections 2023-07-05T23:35:18.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:18.825+0000 7f489af15700 1 -- 172.21.15.27:0/3881348878 wait complete. 2023-07-05T23:35:18.833 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2023-07-05T23:35:18.839 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":102,"stamp":"2023-07-05T23:35:17.675366+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":157223512,"num_objects":62,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":130,"num_read_kb":116,"num_write":1174,"num_write_kb":1241107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17140,"ondisk_log_size":17140,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":687112,"kb_used_data":430536,"kb_used_omap":0,"kb_used_meta":256512,"kb_avail":754287608,"statfs":{"total":773094113280,"available":772390510592,"internally_reserved":0,"allocated":440868864,"data_stored":439289651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":262668288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1,0,0,0,3,4],"upper_bound":128},"perf_stat":{"commit_latency_ms":105,"apply_latency_ms":105,"commit_latency_ns":105000000,"apply_latency_ns":105000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-249284625,"num_objects":-61,"num_object_clones":0,"num_object_copies":-244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-61,"num_whiteouts":0,"num_read":10,"num_read_kb":12,"num_write":579,"num_write_kb":842061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003167"},"pg_stats":[{"pgid":"4.3f","version":"30'17","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.504698+0000","last_change":"2023-07-05T23:32:53.342316+0000","last_active":"2023-07-05T23:35:14.504698+0000","last_peered":"2023-07-05T23:35:14.504698+0000","last_clean":"2023-07-05T23:35:14.504698+0000","last_became_active":"2023-07-05T23:32:53.342061+0000","last_became_peered":"2023-07-05T23:32:53.342061+0000","last_unstale":"2023-07-05T23:35:14.504698+0000","last_undegraded":"2023-07-05T23:35:14.504698+0000","last_fullsized":"2023-07-05T23:35:14.504698+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:27:59.144444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"30'19","reported_seq":43,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.510265+0000","last_change":"2023-07-05T23:32:53.343107+0000","last_active":"2023-07-05T23:35:14.510265+0000","last_peered":"2023-07-05T23:35:14.510265+0000","last_clean":"2023-07-05T23:35:14.510265+0000","last_became_active":"2023-07-05T23:32:53.342843+0000","last_became_peered":"2023-07-05T23:32:53.342843+0000","last_unstale":"2023-07-05T23:35:14.510265+0000","last_undegraded":"2023-07-05T23:35:14.510265+0000","last_fullsized":"2023-07-05T23:35:14.510265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:34:18.782861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"30'35","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.520965+0000","last_change":"2023-07-05T23:32:53.339304+0000","last_active":"2023-07-05T23:35:14.520965+0000","last_peered":"2023-07-05T23:35:14.520965+0000","last_clean":"2023-07-05T23:35:14.520965+0000","last_became_active":"2023-07-05T23:32:53.338973+0000","last_became_peered":"2023-07-05T23:32:53.338973+0000","last_unstale":"2023-07-05T23:35:14.520965+0000","last_undegraded":"2023-07-05T23:35:14.520965+0000","last_fullsized":"2023-07-05T23:35:14.520965+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:28:30.568393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"30'17","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.504477+0000","last_change":"2023-07-05T23:32:53.334788+0000","last_active":"2023-07-05T23:35:14.504477+0000","last_peered":"2023-07-05T23:35:14.504477+0000","last_clean":"2023-07-05T23:35:14.504477+0000","last_became_active":"2023-07-05T23:32:53.334473+0000","last_became_peered":"2023-07-05T23:32:53.334473+0000","last_unstale":"2023-07-05T23:35:14.504477+0000","last_undegraded":"2023-07-05T23:35:14.504477+0000","last_fullsized":"2023-07-05T23:35:14.504477+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:32:19.839362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"30'25","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.517731+0000","last_change":"2023-07-05T23:32:53.346034+0000","last_active":"2023-07-05T23:35:14.517731+0000","last_peered":"2023-07-05T23:35:14.517731+0000","last_clean":"2023-07-05T23:35:14.517731+0000","last_became_active":"2023-07-05T23:32:53.345743+0000","last_became_peered":"2023-07-05T23:32:53.345743+0000","last_unstale":"2023-07-05T23:35:14.517731+0000","last_undegraded":"2023-07-05T23:35:14.517731+0000","last_fullsized":"2023-07-05T23:35:14.517731+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:09:06.821067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"30'27","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.514654+0000","last_change":"2023-07-05T23:32:53.335744+0000","last_active":"2023-07-05T23:35:14.514654+0000","last_peered":"2023-07-05T23:35:14.514654+0000","last_clean":"2023-07-05T23:35:14.514654+0000","last_became_active":"2023-07-05T23:32:53.335456+0000","last_became_peered":"2023-07-05T23:32:53.335456+0000","last_unstale":"2023-07-05T23:35:14.514654+0000","last_undegraded":"2023-07-05T23:35:14.514654+0000","last_fullsized":"2023-07-05T23:35:14.514654+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:29:41.800131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"30'21","reported_seq":44,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.510034+0000","last_change":"2023-07-05T23:32:53.341154+0000","last_active":"2023-07-05T23:35:14.510034+0000","last_peered":"2023-07-05T23:35:14.510034+0000","last_clean":"2023-07-05T23:35:14.510034+0000","last_became_active":"2023-07-05T23:32:53.340639+0000","last_became_peered":"2023-07-05T23:32:53.340639+0000","last_unstale":"2023-07-05T23:35:14.510034+0000","last_undegraded":"2023-07-05T23:35:14.510034+0000","last_fullsized":"2023-07-05T23:35:14.510034+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:06:29.575306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"30'24","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.514718+0000","last_change":"2023-07-05T23:32:53.336514+0000","last_active":"2023-07-05T23:35:14.514718+0000","last_peered":"2023-07-05T23:35:14.514718+0000","last_clean":"2023-07-05T23:35:14.514718+0000","last_became_active":"2023-07-05T23:32:53.336216+0000","last_became_peered":"2023-07-05T23:32:53.336216+0000","last_unstale":"2023-07-05T23:35:14.514718+0000","last_undegraded":"2023-07-05T23:35:14.514718+0000","last_fullsized":"2023-07-05T23:35:14.514718+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:09:56.721492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"30'31","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.516947+0000","last_change":"2023-07-05T23:32:53.348265+0000","last_active":"2023-07-05T23:35:14.516947+0000","last_peered":"2023-07-05T23:35:14.516947+0000","last_clean":"2023-07-05T23:35:14.516947+0000","last_became_active":"2023-07-05T23:32:53.347948+0000","last_became_peered":"2023-07-05T23:32:53.347948+0000","last_unstale":"2023-07-05T23:35:14.516947+0000","last_undegraded":"2023-07-05T23:35:14.516947+0000","last_fullsized":"2023-07-05T23:35:14.516947+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:30:02.990759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"30'36","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.518332+0000","last_change":"2023-07-05T23:32:53.330422+0000","last_active":"2023-07-05T23:35:14.518332+0000","last_peered":"2023-07-05T23:35:14.518332+0000","last_clean":"2023-07-05T23:35:14.518332+0000","last_became_active":"2023-07-05T23:32:53.330135+0000","last_became_peered":"2023-07-05T23:32:53.330135+0000","last_unstale":"2023-07-05T23:35:14.518332+0000","last_undegraded":"2023-07-05T23:35:14.518332+0000","last_fullsized":"2023-07-05T23:35:14.518332+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:32:03.040658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"30'21","reported_seq":44,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.521160+0000","last_change":"2023-07-05T23:32:53.341815+0000","last_active":"2023-07-05T23:35:14.521160+0000","last_peered":"2023-07-05T23:35:14.521160+0000","last_clean":"2023-07-05T23:35:14.521160+0000","last_became_active":"2023-07-05T23:32:53.341526+0000","last_became_peered":"2023-07-05T23:32:53.341526+0000","last_unstale":"2023-07-05T23:35:14.521160+0000","last_undegraded":"2023-07-05T23:35:14.521160+0000","last_fullsized":"2023-07-05T23:35:14.521160+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:28:47.019912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"30'21","reported_seq":44,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.522342+0000","last_change":"2023-07-05T23:32:53.337552+0000","last_active":"2023-07-05T23:35:14.522342+0000","last_peered":"2023-07-05T23:35:14.522342+0000","last_clean":"2023-07-05T23:35:14.522342+0000","last_became_active":"2023-07-05T23:32:53.337279+0000","last_became_peered":"2023-07-05T23:32:53.337279+0000","last_unstale":"2023-07-05T23:35:14.522342+0000","last_undegraded":"2023-07-05T23:35:14.522342+0000","last_fullsized":"2023-07-05T23:35:14.522342+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:24:31.034513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"30'26","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.505213+0000","last_change":"2023-07-05T23:32:53.336366+0000","last_active":"2023-07-05T23:35:14.505213+0000","last_peered":"2023-07-05T23:35:14.505213+0000","last_clean":"2023-07-05T23:35:14.505213+0000","last_became_active":"2023-07-05T23:32:53.336083+0000","last_became_peered":"2023-07-05T23:32:53.336083+0000","last_unstale":"2023-07-05T23:35:14.505213+0000","last_undegraded":"2023-07-05T23:35:14.505213+0000","last_fullsized":"2023-07-05T23:35:14.505213+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:32:24.944898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"30'23","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.509476+0000","last_change":"2023-07-05T23:32:53.328235+0000","last_active":"2023-07-05T23:35:14.509476+0000","last_peered":"2023-07-05T23:35:14.509476+0000","last_clean":"2023-07-05T23:35:14.509476+0000","last_became_active":"2023-07-05T23:32:53.327918+0000","last_became_peered":"2023-07-05T23:32:53.327918+0000","last_unstale":"2023-07-05T23:35:14.509476+0000","last_undegraded":"2023-07-05T23:35:14.509476+0000","last_fullsized":"2023-07-05T23:35:14.509476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:00:42.415370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"30'25","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.510439+0000","last_change":"2023-07-05T23:32:53.340929+0000","last_active":"2023-07-05T23:35:14.510439+0000","last_peered":"2023-07-05T23:35:14.510439+0000","last_clean":"2023-07-05T23:35:14.510439+0000","last_became_active":"2023-07-05T23:32:53.340246+0000","last_became_peered":"2023-07-05T23:32:53.340246+0000","last_unstale":"2023-07-05T23:35:14.510439+0000","last_undegraded":"2023-07-05T23:35:14.510439+0000","last_fullsized":"2023-07-05T23:35:14.510439+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:48:30.276766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"30'31","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.520820+0000","last_change":"2023-07-05T23:32:53.336278+0000","last_active":"2023-07-05T23:35:14.520820+0000","last_peered":"2023-07-05T23:35:14.520820+0000","last_clean":"2023-07-05T23:35:14.520820+0000","last_became_active":"2023-07-05T23:32:53.336006+0000","last_became_peered":"2023-07-05T23:32:53.336006+0000","last_unstale":"2023-07-05T23:35:14.520820+0000","last_undegraded":"2023-07-05T23:35:14.520820+0000","last_fullsized":"2023-07-05T23:35:14.520820+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:28:30.623573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"30'26","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.517502+0000","last_change":"2023-07-05T23:32:53.346115+0000","last_active":"2023-07-05T23:35:14.517502+0000","last_peered":"2023-07-05T23:35:14.517502+0000","last_clean":"2023-07-05T23:35:14.517502+0000","last_became_active":"2023-07-05T23:32:53.345848+0000","last_became_peered":"2023-07-05T23:32:53.345848+0000","last_unstale":"2023-07-05T23:35:14.517502+0000","last_undegraded":"2023-07-05T23:35:14.517502+0000","last_fullsized":"2023-07-05T23:35:14.517502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:27:22.570990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"30'23","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.520608+0000","last_change":"2023-07-05T23:32:53.339001+0000","last_active":"2023-07-05T23:35:14.520608+0000","last_peered":"2023-07-05T23:35:14.520608+0000","last_clean":"2023-07-05T23:35:14.520608+0000","last_became_active":"2023-07-05T23:32:53.335535+0000","last_became_peered":"2023-07-05T23:32:53.335535+0000","last_unstale":"2023-07-05T23:35:14.520608+0000","last_undegraded":"2023-07-05T23:35:14.520608+0000","last_fullsized":"2023-07-05T23:35:14.520608+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:40:11.653019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"30'22","reported_seq":46,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.504890+0000","last_change":"2023-07-05T23:32:53.338403+0000","last_active":"2023-07-05T23:35:14.504890+0000","last_peered":"2023-07-05T23:35:14.504890+0000","last_clean":"2023-07-05T23:35:14.504890+0000","last_became_active":"2023-07-05T23:32:53.338095+0000","last_became_peered":"2023-07-05T23:32:53.338095+0000","last_unstale":"2023-07-05T23:35:14.504890+0000","last_undegraded":"2023-07-05T23:35:14.504890+0000","last_fullsized":"2023-07-05T23:35:14.504890+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:52:25.342366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"30'25","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.521479+0000","last_change":"2023-07-05T23:32:53.341961+0000","last_active":"2023-07-05T23:35:14.521479+0000","last_peered":"2023-07-05T23:35:14.521479+0000","last_clean":"2023-07-05T23:35:14.521479+0000","last_became_active":"2023-07-05T23:32:53.341783+0000","last_became_peered":"2023-07-05T23:32:53.341783+0000","last_unstale":"2023-07-05T23:35:14.521479+0000","last_undegraded":"2023-07-05T23:35:14.521479+0000","last_fullsized":"2023-07-05T23:35:14.521479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:42:23.689201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"30'33","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.505439+0000","last_change":"2023-07-05T23:32:53.348405+0000","last_active":"2023-07-05T23:35:14.505439+0000","last_peered":"2023-07-05T23:35:14.505439+0000","last_clean":"2023-07-05T23:35:14.505439+0000","last_became_active":"2023-07-05T23:32:53.348108+0000","last_became_peered":"2023-07-05T23:32:53.348108+0000","last_unstale":"2023-07-05T23:35:14.505439+0000","last_undegraded":"2023-07-05T23:35:14.505439+0000","last_fullsized":"2023-07-05T23:35:14.505439+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:09:56.721492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"30'24","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.512155+0000","last_change":"2023-07-05T23:32:53.340963+0000","last_active":"2023-07-05T23:35:14.512155+0000","last_peered":"2023-07-05T23:35:14.512155+0000","last_clean":"2023-07-05T23:35:14.512155+0000","last_became_active":"2023-07-05T23:32:53.340698+0000","last_became_peered":"2023-07-05T23:32:53.340698+0000","last_unstale":"2023-07-05T23:35:14.512155+0000","last_undegraded":"2023-07-05T23:35:14.512155+0000","last_fullsized":"2023-07-05T23:35:14.512155+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:34:43.735212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"30'28","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.510476+0000","last_change":"2023-07-05T23:32:53.345981+0000","last_active":"2023-07-05T23:35:14.510476+0000","last_peered":"2023-07-05T23:35:14.510476+0000","last_clean":"2023-07-05T23:35:14.510476+0000","last_became_active":"2023-07-05T23:32:53.345403+0000","last_became_peered":"2023-07-05T23:32:53.345403+0000","last_unstale":"2023-07-05T23:35:14.510476+0000","last_undegraded":"2023-07-05T23:35:14.510476+0000","last_fullsized":"2023-07-05T23:35:14.510476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:09:56.721492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"30'20","reported_seq":44,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.509712+0000","last_change":"2023-07-05T23:32:53.348335+0000","last_active":"2023-07-05T23:35:14.509712+0000","last_peered":"2023-07-05T23:35:14.509712+0000","last_clean":"2023-07-05T23:35:14.509712+0000","last_became_active":"2023-07-05T23:32:53.348053+0000","last_became_peered":"2023-07-05T23:32:53.348053+0000","last_unstale":"2023-07-05T23:35:14.509712+0000","last_undegraded":"2023-07-05T23:35:14.509712+0000","last_fullsized":"2023-07-05T23:35:14.509712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:03:45.831512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"30'19","reported_seq":43,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.505480+0000","last_change":"2023-07-05T23:32:53.339227+0000","last_active":"2023-07-05T23:35:14.505480+0000","last_peered":"2023-07-05T23:35:14.505480+0000","last_clean":"2023-07-05T23:35:14.505480+0000","last_became_active":"2023-07-05T23:32:53.338935+0000","last_became_peered":"2023-07-05T23:32:53.338935+0000","last_unstale":"2023-07-05T23:35:14.505480+0000","last_undegraded":"2023-07-05T23:35:14.505480+0000","last_fullsized":"2023-07-05T23:35:14.505480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:38:49.816055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"30'32","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.506682+0000","last_change":"2023-07-05T23:33:34.898632+0000","last_active":"2023-07-05T23:35:14.506682+0000","last_peered":"2023-07-05T23:35:14.506682+0000","last_clean":"2023-07-05T23:35:14.506682+0000","last_became_active":"2023-07-05T23:33:34.898383+0000","last_became_peered":"2023-07-05T23:33:34.898383+0000","last_unstale":"2023-07-05T23:35:14.506682+0000","last_undegraded":"2023-07-05T23:35:14.506682+0000","last_fullsized":"2023-07-05T23:35:14.506682+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:19:45.125125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.25","version":"30'21","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.510795+0000","last_change":"2023-07-05T23:32:53.336623+0000","last_active":"2023-07-05T23:35:14.510795+0000","last_peered":"2023-07-05T23:35:14.510795+0000","last_clean":"2023-07-05T23:35:14.510795+0000","last_became_active":"2023-07-05T23:32:53.335857+0000","last_became_peered":"2023-07-05T23:32:53.335857+0000","last_unstale":"2023-07-05T23:35:14.510795+0000","last_undegraded":"2023-07-05T23:35:14.510795+0000","last_fullsized":"2023-07-05T23:35:14.510795+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:53:37.219658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"30'478","reported_seq":495,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:13.488796+0000","last_change":"2023-07-05T23:32:57.365825+0000","last_active":"2023-07-05T23:35:13.488796+0000","last_peered":"2023-07-05T23:35:13.488796+0000","last_clean":"2023-07-05T23:35:13.488796+0000","last_became_active":"2023-07-05T23:32:57.365409+0000","last_became_peered":"2023-07-05T23:32:57.365409+0000","last_unstale":"2023-07-05T23:35:13.488796+0000","last_undegraded":"2023-07-05T23:35:13.488796+0000","last_fullsized":"2023-07-05T23:35:13.488796+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:43:38.161766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.205650+0000","last_change":"2023-07-05T23:32:52.901348+0000","last_active":"2023-07-05T23:33:35.205650+0000","last_peered":"2023-07-05T23:33:35.205650+0000","last_clean":"2023-07-05T23:33:35.205650+0000","last_became_active":"2023-07-05T23:32:52.901080+0000","last_became_peered":"2023-07-05T23:32:52.901080+0000","last_unstale":"2023-07-05T23:33:35.205650+0000","last_undegraded":"2023-07-05T23:33:35.205650+0000","last_fullsized":"2023-07-05T23:33:35.205650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:43:25.294641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'32","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.507557+0000","last_change":"2023-07-05T23:32:53.339739+0000","last_active":"2023-07-05T23:35:14.507557+0000","last_peered":"2023-07-05T23:35:14.507557+0000","last_clean":"2023-07-05T23:35:14.507557+0000","last_became_active":"2023-07-05T23:32:53.339464+0000","last_became_peered":"2023-07-05T23:32:53.339464+0000","last_unstale":"2023-07-05T23:35:14.507557+0000","last_undegraded":"2023-07-05T23:35:14.507557+0000","last_fullsized":"2023-07-05T23:35:14.507557+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:53:37.219658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"30'446","reported_seq":464,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:13.540073+0000","last_change":"2023-07-05T23:32:57.354002+0000","last_active":"2023-07-05T23:35:13.540073+0000","last_peered":"2023-07-05T23:35:13.540073+0000","last_clean":"2023-07-05T23:35:13.540073+0000","last_became_active":"2023-07-05T23:32:57.353465+0000","last_became_peered":"2023-07-05T23:32:57.353465+0000","last_unstale":"2023-07-05T23:35:13.540073+0000","last_undegraded":"2023-07-05T23:35:13.540073+0000","last_fullsized":"2023-07-05T23:35:13.540073+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:14:15.951550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.228609+0000","last_change":"2023-07-05T23:32:52.909685+0000","last_active":"2023-07-05T23:33:35.228609+0000","last_peered":"2023-07-05T23:33:35.228609+0000","last_clean":"2023-07-05T23:33:35.228609+0000","last_became_active":"2023-07-05T23:32:52.909347+0000","last_became_peered":"2023-07-05T23:32:52.909347+0000","last_unstale":"2023-07-05T23:33:35.228609+0000","last_undegraded":"2023-07-05T23:33:35.228609+0000","last_fullsized":"2023-07-05T23:33:35.228609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:06:28.570968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"30'21","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.510356+0000","last_change":"2023-07-05T23:32:53.339219+0000","last_active":"2023-07-05T23:35:14.510356+0000","last_peered":"2023-07-05T23:35:14.510356+0000","last_clean":"2023-07-05T23:35:14.510356+0000","last_became_active":"2023-07-05T23:32:53.338825+0000","last_became_peered":"2023-07-05T23:32:53.338825+0000","last_unstale":"2023-07-05T23:35:14.510356+0000","last_undegraded":"2023-07-05T23:35:14.510356+0000","last_fullsized":"2023-07-05T23:35:14.510356+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:09:56.721492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"30'460","reported_seq":478,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:13.557186+0000","last_change":"2023-07-05T23:32:57.359406+0000","last_active":"2023-07-05T23:35:13.557186+0000","last_peered":"2023-07-05T23:35:13.557186+0000","last_clean":"2023-07-05T23:35:13.557186+0000","last_became_active":"2023-07-05T23:32:57.358965+0000","last_became_peered":"2023-07-05T23:32:57.358965+0000","last_unstale":"2023-07-05T23:35:13.557186+0000","last_undegraded":"2023-07-05T23:35:13.557186+0000","last_fullsized":"2023-07-05T23:35:13.557186+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:00:45.855064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"30'1","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.230210+0000","last_change":"2023-07-05T23:32:52.909226+0000","last_active":"2023-07-05T23:33:35.230210+0000","last_peered":"2023-07-05T23:33:35.230210+0000","last_clean":"2023-07-05T23:33:35.230210+0000","last_became_active":"2023-07-05T23:32:52.908756+0000","last_became_peered":"2023-07-05T23:32:52.908756+0000","last_unstale":"2023-07-05T23:33:35.230210+0000","last_undegraded":"2023-07-05T23:33:35.230210+0000","last_fullsized":"2023-07-05T23:33:35.230210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:11:59.892651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"30'20","reported_seq":44,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.500303+0000","last_change":"2023-07-05T23:32:53.337872+0000","last_active":"2023-07-05T23:35:14.500303+0000","last_peered":"2023-07-05T23:35:14.500303+0000","last_clean":"2023-07-05T23:35:14.500303+0000","last_became_active":"2023-07-05T23:32:53.337480+0000","last_became_peered":"2023-07-05T23:32:53.337480+0000","last_unstale":"2023-07-05T23:35:14.500303+0000","last_undegraded":"2023-07-05T23:35:14.500303+0000","last_fullsized":"2023-07-05T23:35:14.500303+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:19:33.519319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"30'473","reported_seq":490,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:13.537060+0000","last_change":"2023-07-05T23:32:57.356296+0000","last_active":"2023-07-05T23:35:13.537060+0000","last_peered":"2023-07-05T23:35:13.537060+0000","last_clean":"2023-07-05T23:35:13.537060+0000","last_became_active":"2023-07-05T23:32:57.355940+0000","last_became_peered":"2023-07-05T23:32:57.355940+0000","last_unstale":"2023-07-05T23:35:13.537060+0000","last_undegraded":"2023-07-05T23:35:13.537060+0000","last_fullsized":"2023-07-05T23:35:13.537060+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:37:49.101240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"30'1","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.229859+0000","last_change":"2023-07-05T23:32:52.904533+0000","last_active":"2023-07-05T23:33:35.229859+0000","last_peered":"2023-07-05T23:33:35.229859+0000","last_clean":"2023-07-05T23:33:35.229859+0000","last_became_active":"2023-07-05T23:32:52.904140+0000","last_became_peered":"2023-07-05T23:32:52.904140+0000","last_unstale":"2023-07-05T23:33:35.229859+0000","last_undegraded":"2023-07-05T23:33:35.229859+0000","last_fullsized":"2023-07-05T23:33:35.229859+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:47:23.267517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"30'19","reported_seq":43,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.508009+0000","last_change":"2023-07-05T23:32:53.338517+0000","last_active":"2023-07-05T23:35:14.508009+0000","last_peered":"2023-07-05T23:35:14.508009+0000","last_clean":"2023-07-05T23:35:14.508009+0000","last_became_active":"2023-07-05T23:32:53.338248+0000","last_became_peered":"2023-07-05T23:32:53.338248+0000","last_unstale":"2023-07-05T23:35:14.508009+0000","last_undegraded":"2023-07-05T23:35:14.508009+0000","last_fullsized":"2023-07-05T23:35:14.508009+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:27:22.570990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"30'451","reported_seq":468,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:15.486573+0000","last_change":"2023-07-05T23:32:57.357483+0000","last_active":"2023-07-05T23:35:15.486573+0000","last_peered":"2023-07-05T23:35:15.486573+0000","last_clean":"2023-07-05T23:35:15.486573+0000","last_became_active":"2023-07-05T23:32:57.357039+0000","last_became_peered":"2023-07-05T23:32:57.357039+0000","last_unstale":"2023-07-05T23:35:15.486573+0000","last_undegraded":"2023-07-05T23:35:15.486573+0000","last_fullsized":"2023-07-05T23:35:15.486573+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:34:47.174905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:34.897995+0000","last_change":"2023-07-05T23:32:52.900665+0000","last_active":"2023-07-05T23:33:34.897995+0000","last_peered":"2023-07-05T23:33:34.897995+0000","last_clean":"2023-07-05T23:33:34.897995+0000","last_became_active":"2023-07-05T23:32:52.900352+0000","last_became_peered":"2023-07-05T23:32:52.900352+0000","last_unstale":"2023-07-05T23:33:34.897995+0000","last_undegraded":"2023-07-05T23:33:34.897995+0000","last_fullsized":"2023-07-05T23:33:34.897995+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:30:46.205291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"30'26","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.515920+0000","last_change":"2023-07-05T23:32:53.346621+0000","last_active":"2023-07-05T23:35:14.515920+0000","last_peered":"2023-07-05T23:35:14.515920+0000","last_clean":"2023-07-05T23:35:14.515920+0000","last_became_active":"2023-07-05T23:32:53.346373+0000","last_became_peered":"2023-07-05T23:32:53.346373+0000","last_unstale":"2023-07-05T23:35:14.515920+0000","last_undegraded":"2023-07-05T23:35:14.515920+0000","last_fullsized":"2023-07-05T23:35:14.515920+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:19:45.125125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"30'482","reported_seq":499,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:13.529931+0000","last_change":"2023-07-05T23:32:57.365669+0000","last_active":"2023-07-05T23:35:13.529931+0000","last_peered":"2023-07-05T23:35:13.529931+0000","last_clean":"2023-07-05T23:35:13.529931+0000","last_became_active":"2023-07-05T23:32:57.365200+0000","last_became_peered":"2023-07-05T23:32:57.365200+0000","last_unstale":"2023-07-05T23:35:13.529931+0000","last_undegraded":"2023-07-05T23:35:13.529931+0000","last_fullsized":"2023-07-05T23:35:13.529931+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:29:56.164375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"30'12","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:13.572510+0000","last_change":"2023-07-05T23:32:52.913055+0000","last_active":"2023-07-05T23:35:13.572510+0000","last_peered":"2023-07-05T23:35:13.572510+0000","last_clean":"2023-07-05T23:35:13.572510+0000","last_became_active":"2023-07-05T23:32:52.912749+0000","last_became_peered":"2023-07-05T23:32:52.912749+0000","last_unstale":"2023-07-05T23:35:13.572510+0000","last_undegraded":"2023-07-05T23:35:13.572510+0000","last_fullsized":"2023-07-05T23:35:13.572510+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:30:01.986422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"30'33","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.506424+0000","last_change":"2023-07-05T23:32:53.339331+0000","last_active":"2023-07-05T23:35:14.506424+0000","last_peered":"2023-07-05T23:35:14.506424+0000","last_clean":"2023-07-05T23:35:14.506424+0000","last_became_active":"2023-07-05T23:32:53.339001+0000","last_became_peered":"2023-07-05T23:32:53.339001+0000","last_unstale":"2023-07-05T23:35:14.506424+0000","last_undegraded":"2023-07-05T23:35:14.506424+0000","last_fullsized":"2023-07-05T23:35:14.506424+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:55:46.508107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"30'473","reported_seq":490,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:13.539863+0000","last_change":"2023-07-05T23:32:57.354307+0000","last_active":"2023-07-05T23:35:13.539863+0000","last_peered":"2023-07-05T23:35:13.539863+0000","last_clean":"2023-07-05T23:35:13.539863+0000","last_became_active":"2023-07-05T23:32:57.353848+0000","last_became_peered":"2023-07-05T23:32:57.353848+0000","last_unstale":"2023-07-05T23:35:13.539863+0000","last_undegraded":"2023-07-05T23:35:13.539863+0000","last_fullsized":"2023-07-05T23:35:13.539863+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:13:40.247704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"30'357","reported_seq":383,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.523946+0000","last_change":"2023-07-05T23:32:52.904627+0000","last_active":"2023-07-05T23:35:14.523946+0000","last_peered":"2023-07-05T23:35:14.523946+0000","last_clean":"2023-07-05T23:35:14.523946+0000","last_became_active":"2023-07-05T23:32:52.904318+0000","last_became_peered":"2023-07-05T23:32:52.904318+0000","last_unstale":"2023-07-05T23:35:14.523946+0000","last_undegraded":"2023-07-05T23:35:14.523946+0000","last_fullsized":"2023-07-05T23:35:14.523946+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:14:59.460164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1435455,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":356,"num_write_kb":1651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"30'31","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.521545+0000","last_change":"2023-07-05T23:32:53.339884+0000","last_active":"2023-07-05T23:35:14.521545+0000","last_peered":"2023-07-05T23:35:14.521545+0000","last_clean":"2023-07-05T23:35:14.521545+0000","last_became_active":"2023-07-05T23:32:53.339583+0000","last_became_peered":"2023-07-05T23:32:53.339583+0000","last_unstale":"2023-07-05T23:35:14.521545+0000","last_undegraded":"2023-07-05T23:35:14.521545+0000","last_fullsized":"2023-07-05T23:35:14.521545+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:41:33.847577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"30'438","reported_seq":455,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:11.489691+0000","last_change":"2023-07-05T23:32:57.365703+0000","last_active":"2023-07-05T23:35:11.489691+0000","last_peered":"2023-07-05T23:35:11.489691+0000","last_clean":"2023-07-05T23:35:11.489691+0000","last_became_active":"2023-07-05T23:32:57.365204+0000","last_became_peered":"2023-07-05T23:32:57.365204+0000","last_unstale":"2023-07-05T23:35:11.489691+0000","last_undegraded":"2023-07-05T23:35:11.489691+0000","last_fullsized":"2023-07-05T23:35:11.489691+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:10:37.483135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"30'3","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:06.836727+0000","last_change":"2023-07-05T23:32:52.908276+0000","last_active":"2023-07-05T23:35:06.836727+0000","last_peered":"2023-07-05T23:35:06.836727+0000","last_clean":"2023-07-05T23:35:06.836727+0000","last_became_active":"2023-07-05T23:32:52.907970+0000","last_became_peered":"2023-07-05T23:32:52.907970+0000","last_unstale":"2023-07-05T23:35:06.836727+0000","last_undegraded":"2023-07-05T23:35:06.836727+0000","last_fullsized":"2023-07-05T23:35:06.836727+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:09:05.816729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"30'23","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.508678+0000","last_change":"2023-07-05T23:32:53.340093+0000","last_active":"2023-07-05T23:35:14.508678+0000","last_peered":"2023-07-05T23:35:14.508678+0000","last_clean":"2023-07-05T23:35:14.508678+0000","last_became_active":"2023-07-05T23:32:53.339827+0000","last_became_peered":"2023-07-05T23:32:53.339827+0000","last_unstale":"2023-07-05T23:35:14.508678+0000","last_undegraded":"2023-07-05T23:35:14.508678+0000","last_fullsized":"2023-07-05T23:35:14.508678+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:10:34.043441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"30'469","reported_seq":486,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:13.536188+0000","last_change":"2023-07-05T23:32:57.354664+0000","last_active":"2023-07-05T23:35:13.536188+0000","last_peered":"2023-07-05T23:35:13.536188+0000","last_clean":"2023-07-05T23:35:13.536188+0000","last_became_active":"2023-07-05T23:32:57.354235+0000","last_became_peered":"2023-07-05T23:32:57.354235+0000","last_unstale":"2023-07-05T23:35:13.536188+0000","last_undegraded":"2023-07-05T23:35:13.536188+0000","last_fullsized":"2023-07-05T23:35:13.536188+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:35:51.306550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.228314+0000","last_change":"2023-07-05T23:32:52.900677+0000","last_active":"2023-07-05T23:33:35.228314+0000","last_peered":"2023-07-05T23:33:35.228314+0000","last_clean":"2023-07-05T23:33:35.228314+0000","last_became_active":"2023-07-05T23:32:52.900387+0000","last_became_peered":"2023-07-05T23:32:52.900387+0000","last_unstale":"2023-07-05T23:33:35.228314+0000","last_undegraded":"2023-07-05T23:33:35.228314+0000","last_fullsized":"2023-07-05T23:33:35.228314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:02:05.581169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"30'25","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.510890+0000","last_change":"2023-07-05T23:32:53.335865+0000","last_active":"2023-07-05T23:35:14.510890+0000","last_peered":"2023-07-05T23:35:14.510890+0000","last_clean":"2023-07-05T23:35:14.510890+0000","last_became_active":"2023-07-05T23:32:53.335513+0000","last_became_peered":"2023-07-05T23:32:53.335513+0000","last_unstale":"2023-07-05T23:35:14.510890+0000","last_undegraded":"2023-07-05T23:35:14.510890+0000","last_fullsized":"2023-07-05T23:35:14.510890+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:29:52.724682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"30'450","reported_seq":467,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:13.488697+0000","last_change":"2023-07-05T23:32:57.362840+0000","last_active":"2023-07-05T23:35:13.488697+0000","last_peered":"2023-07-05T23:35:13.488697+0000","last_clean":"2023-07-05T23:35:13.488697+0000","last_became_active":"2023-07-05T23:32:57.362407+0000","last_became_peered":"2023-07-05T23:32:57.362407+0000","last_unstale":"2023-07-05T23:35:13.488697+0000","last_undegraded":"2023-07-05T23:35:13.488697+0000","last_fullsized":"2023-07-05T23:35:13.488697+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:30:50.649322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"30'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:06.833400+0000","last_change":"2023-07-05T23:32:52.905899+0000","last_active":"2023-07-05T23:35:06.833400+0000","last_peered":"2023-07-05T23:35:06.833400+0000","last_clean":"2023-07-05T23:35:06.833400+0000","last_became_active":"2023-07-05T23:32:52.905595+0000","last_became_peered":"2023-07-05T23:32:52.905595+0000","last_unstale":"2023-07-05T23:35:06.833400+0000","last_undegraded":"2023-07-05T23:35:06.833400+0000","last_fullsized":"2023-07-05T23:35:06.833400+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:55:45.503769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"30'26","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.516579+0000","last_change":"2023-07-05T23:32:53.342284+0000","last_active":"2023-07-05T23:35:14.516579+0000","last_peered":"2023-07-05T23:35:14.516579+0000","last_clean":"2023-07-05T23:35:14.516579+0000","last_became_active":"2023-07-05T23:32:53.342033+0000","last_became_peered":"2023-07-05T23:32:53.342033+0000","last_unstale":"2023-07-05T23:35:14.516579+0000","last_undegraded":"2023-07-05T23:35:14.516579+0000","last_fullsized":"2023-07-05T23:35:14.516579+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:19:45.125125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"30'490","reported_seq":507,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:13.525283+0000","last_change":"2023-07-05T23:32:57.360505+0000","last_active":"2023-07-05T23:35:13.525283+0000","last_peered":"2023-07-05T23:35:13.525283+0000","last_clean":"2023-07-05T23:35:13.525283+0000","last_became_active":"2023-07-05T23:32:57.359532+0000","last_became_peered":"2023-07-05T23:32:57.359532+0000","last_unstale":"2023-07-05T23:35:13.525283+0000","last_undegraded":"2023-07-05T23:35:13.525283+0000","last_fullsized":"2023-07-05T23:35:13.525283+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:48:54.916611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":41984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.228388+0000","last_change":"2023-07-05T23:32:52.903656+0000","last_active":"2023-07-05T23:33:35.228388+0000","last_peered":"2023-07-05T23:33:35.228388+0000","last_clean":"2023-07-05T23:33:35.228388+0000","last_became_active":"2023-07-05T23:32:52.903419+0000","last_became_peered":"2023-07-05T23:32:52.903419+0000","last_unstale":"2023-07-05T23:33:35.228388+0000","last_undegraded":"2023-07-05T23:33:35.228388+0000","last_fullsized":"2023-07-05T23:33:35.228388+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:32:23.940560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"30'26","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.513247+0000","last_change":"2023-07-05T23:32:53.341509+0000","last_active":"2023-07-05T23:35:14.513247+0000","last_peered":"2023-07-05T23:35:14.513247+0000","last_clean":"2023-07-05T23:35:14.513247+0000","last_became_active":"2023-07-05T23:32:53.341162+0000","last_became_peered":"2023-07-05T23:32:53.341162+0000","last_unstale":"2023-07-05T23:35:14.513247+0000","last_undegraded":"2023-07-05T23:35:14.513247+0000","last_fullsized":"2023-07-05T23:35:14.513247+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:34:18.782861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"30'444","reported_seq":462,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:15.488893+0000","last_change":"2023-07-05T23:32:57.358009+0000","last_active":"2023-07-05T23:35:15.488893+0000","last_peered":"2023-07-05T23:35:15.488893+0000","last_clean":"2023-07-05T23:35:15.488893+0000","last_became_active":"2023-07-05T23:32:57.357082+0000","last_became_peered":"2023-07-05T23:32:57.357082+0000","last_unstale":"2023-07-05T23:35:15.488893+0000","last_undegraded":"2023-07-05T23:35:15.488893+0000","last_fullsized":"2023-07-05T23:35:15.488893+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:37:40.938898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.011998+0000","last_change":"2023-07-05T23:32:52.907916+0000","last_active":"2023-07-05T23:33:35.011998+0000","last_peered":"2023-07-05T23:33:35.011998+0000","last_clean":"2023-07-05T23:33:35.011998+0000","last_became_active":"2023-07-05T23:32:52.907397+0000","last_became_peered":"2023-07-05T23:32:52.907397+0000","last_unstale":"2023-07-05T23:33:35.011998+0000","last_undegraded":"2023-07-05T23:33:35.011998+0000","last_fullsized":"2023-07-05T23:33:35.011998+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:34:31.075112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"30'22","reported_seq":46,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.505088+0000","last_change":"2023-07-05T23:32:53.334487+0000","last_active":"2023-07-05T23:35:14.505088+0000","last_peered":"2023-07-05T23:35:14.505088+0000","last_clean":"2023-07-05T23:35:14.505088+0000","last_became_active":"2023-07-05T23:32:53.333978+0000","last_became_peered":"2023-07-05T23:32:53.333978+0000","last_unstale":"2023-07-05T23:35:14.505088+0000","last_undegraded":"2023-07-05T23:35:14.505088+0000","last_fullsized":"2023-07-05T23:35:14.505088+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:09:06.821067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"30'423","reported_seq":441,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:15.493883+0000","last_change":"2023-07-05T23:32:57.362413+0000","last_active":"2023-07-05T23:35:15.493883+0000","last_peered":"2023-07-05T23:35:15.493883+0000","last_clean":"2023-07-05T23:35:15.493883+0000","last_became_active":"2023-07-05T23:32:57.361892+0000","last_became_peered":"2023-07-05T23:32:57.361892+0000","last_unstale":"2023-07-05T23:35:15.493883+0000","last_undegraded":"2023-07-05T23:35:15.493883+0000","last_fullsized":"2023-07-05T23:35:15.493883+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:23:07.824943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.011790+0000","last_change":"2023-07-05T23:32:52.908261+0000","last_active":"2023-07-05T23:33:35.011790+0000","last_peered":"2023-07-05T23:33:35.011790+0000","last_clean":"2023-07-05T23:33:35.011790+0000","last_became_active":"2023-07-05T23:32:52.907975+0000","last_became_peered":"2023-07-05T23:32:52.907975+0000","last_unstale":"2023-07-05T23:33:35.011790+0000","last_undegraded":"2023-07-05T23:33:35.011790+0000","last_fullsized":"2023-07-05T23:33:35.011790+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:27:21.566652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"30'20","reported_seq":44,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.520367+0000","last_change":"2023-07-05T23:32:53.339917+0000","last_active":"2023-07-05T23:35:14.520367+0000","last_peered":"2023-07-05T23:35:14.520367+0000","last_clean":"2023-07-05T23:35:14.520367+0000","last_became_active":"2023-07-05T23:32:53.339543+0000","last_became_peered":"2023-07-05T23:32:53.339543+0000","last_unstale":"2023-07-05T23:35:14.520367+0000","last_undegraded":"2023-07-05T23:35:14.520367+0000","last_fullsized":"2023-07-05T23:35:14.520367+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:49:46.894720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"30'469","reported_seq":487,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:15.500248+0000","last_change":"2023-07-05T23:32:57.361110+0000","last_active":"2023-07-05T23:35:15.500248+0000","last_peered":"2023-07-05T23:35:15.500248+0000","last_clean":"2023-07-05T23:35:15.500248+0000","last_became_active":"2023-07-05T23:32:57.360614+0000","last_became_peered":"2023-07-05T23:32:57.360614+0000","last_unstale":"2023-07-05T23:35:15.500248+0000","last_undegraded":"2023-07-05T23:35:15.500248+0000","last_fullsized":"2023-07-05T23:35:15.500248+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:11:32.788099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.011936+0000","last_change":"2023-07-05T23:32:52.907840+0000","last_active":"2023-07-05T23:33:35.011936+0000","last_peered":"2023-07-05T23:33:35.011936+0000","last_clean":"2023-07-05T23:33:35.011936+0000","last_became_active":"2023-07-05T23:32:52.907441+0000","last_became_peered":"2023-07-05T23:32:52.907441+0000","last_unstale":"2023-07-05T23:33:35.011936+0000","last_undegraded":"2023-07-05T23:33:35.011936+0000","last_fullsized":"2023-07-05T23:33:35.011936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:55:01.034913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"30'26","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.508688+0000","last_change":"2023-07-05T23:32:53.343984+0000","last_active":"2023-07-05T23:35:14.508688+0000","last_peered":"2023-07-05T23:35:14.508688+0000","last_clean":"2023-07-05T23:35:14.508688+0000","last_became_active":"2023-07-05T23:32:53.343566+0000","last_became_peered":"2023-07-05T23:32:53.343566+0000","last_unstale":"2023-07-05T23:35:14.508688+0000","last_undegraded":"2023-07-05T23:35:14.508688+0000","last_fullsized":"2023-07-05T23:35:14.508688+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:27:59.144444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"30'484","reported_seq":502,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:13.553221+0000","last_change":"2023-07-05T23:32:57.356615+0000","last_active":"2023-07-05T23:35:13.553221+0000","last_peered":"2023-07-05T23:35:13.553221+0000","last_clean":"2023-07-05T23:35:13.553221+0000","last_became_active":"2023-07-05T23:32:57.356091+0000","last_became_peered":"2023-07-05T23:32:57.356091+0000","last_unstale":"2023-07-05T23:35:13.553221+0000","last_undegraded":"2023-07-05T23:35:13.553221+0000","last_fullsized":"2023-07-05T23:35:13.553221+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:10:51.090665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"30'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:02.479617+0000","last_change":"2023-07-05T23:32:52.906210+0000","last_active":"2023-07-05T23:35:02.479617+0000","last_peered":"2023-07-05T23:35:02.479617+0000","last_clean":"2023-07-05T23:35:02.479617+0000","last_became_active":"2023-07-05T23:32:52.905988+0000","last_became_peered":"2023-07-05T23:32:52.905988+0000","last_unstale":"2023-07-05T23:35:02.479617+0000","last_undegraded":"2023-07-05T23:35:02.479617+0000","last_fullsized":"2023-07-05T23:35:02.479617+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:30:01.986422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"30'24","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.516810+0000","last_change":"2023-07-05T23:32:53.339662+0000","last_active":"2023-07-05T23:35:14.516810+0000","last_peered":"2023-07-05T23:35:14.516810+0000","last_clean":"2023-07-05T23:35:14.516810+0000","last_became_active":"2023-07-05T23:32:53.339382+0000","last_became_peered":"2023-07-05T23:32:53.339382+0000","last_unstale":"2023-07-05T23:35:14.516810+0000","last_undegraded":"2023-07-05T23:35:14.516810+0000","last_fullsized":"2023-07-05T23:35:14.516810+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:06:29.575306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"30'468","reported_seq":486,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:13.538250+0000","last_change":"2023-07-05T23:32:57.354958+0000","last_active":"2023-07-05T23:35:13.538250+0000","last_peered":"2023-07-05T23:35:13.538250+0000","last_clean":"2023-07-05T23:35:13.538250+0000","last_became_active":"2023-07-05T23:32:57.354576+0000","last_became_peered":"2023-07-05T23:32:57.354576+0000","last_unstale":"2023-07-05T23:35:13.538250+0000","last_undegraded":"2023-07-05T23:35:13.538250+0000","last_fullsized":"2023-07-05T23:35:13.538250+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:32:54.986804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":27648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"30'4","reported_seq":30,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:05.478083+0000","last_change":"2023-07-05T23:32:52.906470+0000","last_active":"2023-07-05T23:35:05.478083+0000","last_peered":"2023-07-05T23:35:05.478083+0000","last_clean":"2023-07-05T23:35:05.478083+0000","last_became_active":"2023-07-05T23:32:52.906187+0000","last_became_peered":"2023-07-05T23:32:52.906187+0000","last_unstale":"2023-07-05T23:35:05.478083+0000","last_undegraded":"2023-07-05T23:35:05.478083+0000","last_fullsized":"2023-07-05T23:35:05.478083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:34:31.075112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"30'21","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.520529+0000","last_change":"2023-07-05T23:32:53.344178+0000","last_active":"2023-07-05T23:35:14.520529+0000","last_peered":"2023-07-05T23:35:14.520529+0000","last_clean":"2023-07-05T23:35:14.520529+0000","last_became_active":"2023-07-05T23:32:53.343393+0000","last_became_peered":"2023-07-05T23:32:53.343393+0000","last_unstale":"2023-07-05T23:35:14.520529+0000","last_undegraded":"2023-07-05T23:35:14.520529+0000","last_fullsized":"2023-07-05T23:35:14.520529+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:26:46.815538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"30'457","reported_seq":475,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:13.558128+0000","last_change":"2023-07-05T23:32:57.362812+0000","last_active":"2023-07-05T23:35:13.558128+0000","last_peered":"2023-07-05T23:35:13.558128+0000","last_clean":"2023-07-05T23:35:13.558128+0000","last_became_active":"2023-07-05T23:32:57.362431+0000","last_became_peered":"2023-07-05T23:32:57.362431+0000","last_unstale":"2023-07-05T23:35:13.558128+0000","last_undegraded":"2023-07-05T23:35:13.558128+0000","last_fullsized":"2023-07-05T23:35:13.558128+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:37:40.938898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"30'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:05.621978+0000","last_change":"2023-07-05T23:32:52.908272+0000","last_active":"2023-07-05T23:35:05.621978+0000","last_peered":"2023-07-05T23:35:05.621978+0000","last_clean":"2023-07-05T23:35:05.621978+0000","last_became_active":"2023-07-05T23:32:52.907983+0000","last_became_peered":"2023-07-05T23:32:52.907983+0000","last_unstale":"2023-07-05T23:35:05.621978+0000","last_undegraded":"2023-07-05T23:35:05.621978+0000","last_fullsized":"2023-07-05T23:35:05.621978+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:01:15.727729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"30'23","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.521028+0000","last_change":"2023-07-05T23:32:53.339766+0000","last_active":"2023-07-05T23:35:14.521028+0000","last_peered":"2023-07-05T23:35:14.521028+0000","last_clean":"2023-07-05T23:35:14.521028+0000","last_became_active":"2023-07-05T23:32:53.338903+0000","last_became_peered":"2023-07-05T23:32:53.338903+0000","last_unstale":"2023-07-05T23:35:14.521028+0000","last_undegraded":"2023-07-05T23:35:14.521028+0000","last_fullsized":"2023-07-05T23:35:14.521028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:21:39.351826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'490","reported_seq":508,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:15.503713+0000","last_change":"2023-07-05T23:32:57.357001+0000","last_active":"2023-07-05T23:35:15.503713+0000","last_peered":"2023-07-05T23:35:15.503713+0000","last_clean":"2023-07-05T23:35:15.503713+0000","last_became_active":"2023-07-05T23:32:57.356611+0000","last_became_peered":"2023-07-05T23:32:57.356611+0000","last_unstale":"2023-07-05T23:35:15.503713+0000","last_undegraded":"2023-07-05T23:35:15.503713+0000","last_fullsized":"2023-07-05T23:35:15.503713+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:18:00.591410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.205209+0000","last_change":"2023-07-05T23:32:52.907064+0000","last_active":"2023-07-05T23:33:35.205209+0000","last_peered":"2023-07-05T23:33:35.205209+0000","last_clean":"2023-07-05T23:33:35.205209+0000","last_became_active":"2023-07-05T23:32:52.906779+0000","last_became_peered":"2023-07-05T23:32:52.906779+0000","last_unstale":"2023-07-05T23:33:35.205209+0000","last_undegraded":"2023-07-05T23:33:35.205209+0000","last_fullsized":"2023-07-05T23:33:35.205209+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:21:56.357294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"30'12","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.521818+0000","last_change":"2023-07-05T23:32:53.341824+0000","last_active":"2023-07-05T23:35:14.521818+0000","last_peered":"2023-07-05T23:35:14.521818+0000","last_clean":"2023-07-05T23:35:14.521818+0000","last_became_active":"2023-07-05T23:32:53.339869+0000","last_became_peered":"2023-07-05T23:32:53.339869+0000","last_unstale":"2023-07-05T23:35:14.521818+0000","last_undegraded":"2023-07-05T23:35:14.521818+0000","last_fullsized":"2023-07-05T23:35:14.521818+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:06:11.729572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"30'495","reported_seq":513,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:13.554741+0000","last_change":"2023-07-05T23:32:57.363813+0000","last_active":"2023-07-05T23:35:13.554741+0000","last_peered":"2023-07-05T23:35:13.554741+0000","last_clean":"2023-07-05T23:35:13.554741+0000","last_became_active":"2023-07-05T23:32:57.363409+0000","last_became_peered":"2023-07-05T23:32:57.363409+0000","last_unstale":"2023-07-05T23:35:13.554741+0000","last_undegraded":"2023-07-05T23:35:13.554741+0000","last_fullsized":"2023-07-05T23:35:13.554741+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:07:41.069844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.229959+0000","last_change":"2023-07-05T23:32:52.910057+0000","last_active":"2023-07-05T23:33:35.229959+0000","last_peered":"2023-07-05T23:33:35.229959+0000","last_clean":"2023-07-05T23:33:35.229959+0000","last_became_active":"2023-07-05T23:32:52.909169+0000","last_became_peered":"2023-07-05T23:32:52.909169+0000","last_unstale":"2023-07-05T23:33:35.229959+0000","last_undegraded":"2023-07-05T23:33:35.229959+0000","last_fullsized":"2023-07-05T23:33:35.229959+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:30:01.986422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"30'24","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.506964+0000","last_change":"2023-07-05T23:32:53.342851+0000","last_active":"2023-07-05T23:35:14.506964+0000","last_peered":"2023-07-05T23:35:14.506964+0000","last_clean":"2023-07-05T23:35:14.506964+0000","last_became_active":"2023-07-05T23:32:53.342420+0000","last_became_peered":"2023-07-05T23:32:53.342420+0000","last_unstale":"2023-07-05T23:35:14.506964+0000","last_undegraded":"2023-07-05T23:35:14.506964+0000","last_fullsized":"2023-07-05T23:35:14.506964+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:48:30.276766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"30'501","reported_seq":519,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.469204+0000","last_change":"2023-07-05T23:32:57.358997+0000","last_active":"2023-07-05T23:35:14.469204+0000","last_peered":"2023-07-05T23:35:14.469204+0000","last_clean":"2023-07-05T23:35:14.469204+0000","last_became_active":"2023-07-05T23:32:57.358647+0000","last_became_peered":"2023-07-05T23:32:57.358647+0000","last_unstale":"2023-07-05T23:35:14.469204+0000","last_undegraded":"2023-07-05T23:35:14.469204+0000","last_fullsized":"2023-07-05T23:35:14.469204+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:48:33.716459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.229445+0000","last_change":"2023-07-05T23:32:47.790871+0000","last_active":"2023-07-05T23:33:35.229445+0000","last_peered":"2023-07-05T23:33:35.229445+0000","last_clean":"2023-07-05T23:33:35.229445+0000","last_became_active":"2023-07-05T23:32:47.790546+0000","last_became_peered":"2023-07-05T23:32:47.790546+0000","last_unstale":"2023-07-05T23:33:35.229445+0000","last_undegraded":"2023-07-05T23:33:35.229445+0000","last_fullsized":"2023-07-05T23:33:35.229445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_clean_scrub_stamp":"2023-07-05T23:32:46.741565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:28:20.777630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"30'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:00.632835+0000","last_change":"2023-07-05T23:32:52.912985+0000","last_active":"2023-07-05T23:35:00.632835+0000","last_peered":"2023-07-05T23:35:00.632835+0000","last_clean":"2023-07-05T23:35:00.632835+0000","last_became_active":"2023-07-05T23:32:52.912682+0000","last_became_peered":"2023-07-05T23:32:52.912682+0000","last_unstale":"2023-07-05T23:35:00.632835+0000","last_undegraded":"2023-07-05T23:35:00.632835+0000","last_fullsized":"2023-07-05T23:35:00.632835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:19:27.040484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"30'22","reported_seq":46,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.511330+0000","last_change":"2023-07-05T23:32:53.335398+0000","last_active":"2023-07-05T23:35:14.511330+0000","last_peered":"2023-07-05T23:35:14.511330+0000","last_clean":"2023-07-05T23:35:14.511330+0000","last_became_active":"2023-07-05T23:32:53.335073+0000","last_became_peered":"2023-07-05T23:32:53.335073+0000","last_unstale":"2023-07-05T23:35:14.511330+0000","last_undegraded":"2023-07-05T23:35:14.511330+0000","last_fullsized":"2023-07-05T23:35:14.511330+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:02:06.585507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"30'448","reported_seq":466,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:15.486442+0000","last_change":"2023-07-05T23:32:57.368301+0000","last_active":"2023-07-05T23:35:15.486442+0000","last_peered":"2023-07-05T23:35:15.486442+0000","last_clean":"2023-07-05T23:35:15.486442+0000","last_became_active":"2023-07-05T23:32:57.368030+0000","last_became_peered":"2023-07-05T23:32:57.368030+0000","last_unstale":"2023-07-05T23:35:15.486442+0000","last_undegraded":"2023-07-05T23:35:15.486442+0000","last_fullsized":"2023-07-05T23:35:15.486442+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:55:49.947801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:34.897517+0000","last_change":"2023-07-05T23:32:47.762370+0000","last_active":"2023-07-05T23:33:34.897517+0000","last_peered":"2023-07-05T23:33:34.897517+0000","last_clean":"2023-07-05T23:33:34.897517+0000","last_became_active":"2023-07-05T23:32:47.761996+0000","last_became_peered":"2023-07-05T23:32:47.761996+0000","last_unstale":"2023-07-05T23:33:34.897517+0000","last_undegraded":"2023-07-05T23:33:34.897517+0000","last_fullsized":"2023-07-05T23:33:34.897517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_clean_scrub_stamp":"2023-07-05T23:32:46.741565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:27:16.430272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.206217+0000","last_change":"2023-07-05T23:32:52.904472+0000","last_active":"2023-07-05T23:33:35.206217+0000","last_peered":"2023-07-05T23:33:35.206217+0000","last_clean":"2023-07-05T23:33:35.206217+0000","last_became_active":"2023-07-05T23:32:52.904202+0000","last_became_peered":"2023-07-05T23:32:52.904202+0000","last_unstale":"2023-07-05T23:33:35.206217+0000","last_undegraded":"2023-07-05T23:33:35.206217+0000","last_fullsized":"2023-07-05T23:33:35.206217+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:21:26.927343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"30'24","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.506926+0000","last_change":"2023-07-05T23:32:53.341847+0000","last_active":"2023-07-05T23:35:14.506926+0000","last_peered":"2023-07-05T23:35:14.506926+0000","last_clean":"2023-07-05T23:35:14.506926+0000","last_became_active":"2023-07-05T23:32:53.338626+0000","last_became_peered":"2023-07-05T23:32:53.338626+0000","last_unstale":"2023-07-05T23:35:14.506926+0000","last_undegraded":"2023-07-05T23:35:14.506926+0000","last_fullsized":"2023-07-05T23:35:14.506926+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:09:06.821067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"30'487","reported_seq":505,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.469505+0000","last_change":"2023-07-05T23:32:57.356351+0000","last_active":"2023-07-05T23:35:14.469505+0000","last_peered":"2023-07-05T23:35:14.469505+0000","last_clean":"2023-07-05T23:35:14.469505+0000","last_became_active":"2023-07-05T23:32:57.355882+0000","last_became_peered":"2023-07-05T23:32:57.355882+0000","last_unstale":"2023-07-05T23:35:14.469505+0000","last_undegraded":"2023-07-05T23:35:14.469505+0000","last_fullsized":"2023-07-05T23:35:14.469505+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:53:02.594417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":55296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:34.894615+0000","last_change":"2023-07-05T23:32:47.979611+0000","last_active":"2023-07-05T23:33:34.894615+0000","last_peered":"2023-07-05T23:33:34.894615+0000","last_clean":"2023-07-05T23:33:34.894615+0000","last_became_active":"2023-07-05T23:32:47.979348+0000","last_became_peered":"2023-07-05T23:32:47.979348+0000","last_unstale":"2023-07-05T23:33:34.894615+0000","last_undegraded":"2023-07-05T23:33:34.894615+0000","last_fullsized":"2023-07-05T23:33:34.894615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_clean_scrub_stamp":"2023-07-05T23:32:46.741565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:49:32.444450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.228652+0000","last_change":"2023-07-05T23:32:52.907652+0000","last_active":"2023-07-05T23:33:35.228652+0000","last_peered":"2023-07-05T23:33:35.228652+0000","last_clean":"2023-07-05T23:33:35.228652+0000","last_became_active":"2023-07-05T23:32:52.907307+0000","last_became_peered":"2023-07-05T23:32:52.907307+0000","last_unstale":"2023-07-05T23:33:35.228652+0000","last_undegraded":"2023-07-05T23:33:35.228652+0000","last_fullsized":"2023-07-05T23:33:35.228652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:50:56.145233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"30'23","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.511242+0000","last_change":"2023-07-05T23:32:53.338185+0000","last_active":"2023-07-05T23:35:14.511242+0000","last_peered":"2023-07-05T23:35:14.511242+0000","last_clean":"2023-07-05T23:35:14.511242+0000","last_became_active":"2023-07-05T23:32:53.337896+0000","last_became_peered":"2023-07-05T23:32:53.337896+0000","last_unstale":"2023-07-05T23:35:14.511242+0000","last_undegraded":"2023-07-05T23:35:14.511242+0000","last_fullsized":"2023-07-05T23:35:14.511242+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:34:43.735212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"30'477","reported_seq":495,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.465963+0000","last_change":"2023-07-05T23:32:57.355885+0000","last_active":"2023-07-05T23:35:14.465963+0000","last_peered":"2023-07-05T23:35:14.465963+0000","last_clean":"2023-07-05T23:35:14.465963+0000","last_became_active":"2023-07-05T23:32:57.355475+0000","last_became_peered":"2023-07-05T23:32:57.355475+0000","last_unstale":"2023-07-05T23:35:14.465963+0000","last_undegraded":"2023-07-05T23:35:14.465963+0000","last_fullsized":"2023-07-05T23:35:14.465963+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:19:48.564819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:34.897784+0000","last_change":"2023-07-05T23:32:47.761727+0000","last_active":"2023-07-05T23:33:34.897784+0000","last_peered":"2023-07-05T23:33:34.897784+0000","last_clean":"2023-07-05T23:33:34.897784+0000","last_became_active":"2023-07-05T23:32:47.761392+0000","last_became_peered":"2023-07-05T23:32:47.761392+0000","last_unstale":"2023-07-05T23:33:34.897784+0000","last_undegraded":"2023-07-05T23:33:34.897784+0000","last_fullsized":"2023-07-05T23:33:34.897784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_clean_scrub_stamp":"2023-07-05T23:32:46.741565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:35:41.726138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":188,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.011378+0000","last_change":"2023-07-05T23:32:42.737690+0000","last_active":"2023-07-05T23:33:35.011378+0000","last_peered":"2023-07-05T23:33:35.011378+0000","last_clean":"2023-07-05T23:33:35.011378+0000","last_became_active":"2023-07-05T23:32:42.736736+0000","last_became_peered":"2023-07-05T23:32:42.736736+0000","last_unstale":"2023-07-05T23:33:35.011378+0000","last_undegraded":"2023-07-05T23:33:35.011378+0000","last_fullsized":"2023-07-05T23:33:35.011378+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:41.674741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:41.674741+0000","last_clean_scrub_stamp":"2023-07-05T23:32:41.674741+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:28:15.710806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.230450+0000","last_change":"2023-07-05T23:32:52.912999+0000","last_active":"2023-07-05T23:33:35.230450+0000","last_peered":"2023-07-05T23:33:35.230450+0000","last_clean":"2023-07-05T23:33:35.230450+0000","last_became_active":"2023-07-05T23:32:52.912684+0000","last_became_peered":"2023-07-05T23:32:52.912684+0000","last_unstale":"2023-07-05T23:33:35.230450+0000","last_undegraded":"2023-07-05T23:33:35.230450+0000","last_fullsized":"2023-07-05T23:33:35.230450+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:17:56.147379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"30'25","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.522426+0000","last_change":"2023-07-05T23:32:53.344142+0000","last_active":"2023-07-05T23:35:14.522426+0000","last_peered":"2023-07-05T23:35:14.522426+0000","last_clean":"2023-07-05T23:35:14.522426+0000","last_became_active":"2023-07-05T23:32:53.343848+0000","last_became_peered":"2023-07-05T23:32:53.343848+0000","last_unstale":"2023-07-05T23:35:14.522426+0000","last_undegraded":"2023-07-05T23:35:14.522426+0000","last_fullsized":"2023-07-05T23:35:14.522426+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:21:04.019035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"30'449","reported_seq":467,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.459786+0000","last_change":"2023-07-05T23:32:57.366415+0000","last_active":"2023-07-05T23:35:14.459786+0000","last_peered":"2023-07-05T23:35:14.459786+0000","last_clean":"2023-07-05T23:35:14.459786+0000","last_became_active":"2023-07-05T23:32:57.365013+0000","last_became_peered":"2023-07-05T23:32:57.365013+0000","last_unstale":"2023-07-05T23:35:14.459786+0000","last_undegraded":"2023-07-05T23:35:14.459786+0000","last_fullsized":"2023-07-05T23:35:14.459786+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:12:04.336682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.011554+0000","last_change":"2023-07-05T23:32:47.767600+0000","last_active":"2023-07-05T23:33:35.011554+0000","last_peered":"2023-07-05T23:33:35.011554+0000","last_clean":"2023-07-05T23:33:35.011554+0000","last_became_active":"2023-07-05T23:32:47.767297+0000","last_became_peered":"2023-07-05T23:32:47.767297+0000","last_unstale":"2023-07-05T23:33:35.011554+0000","last_undegraded":"2023-07-05T23:33:35.011554+0000","last_fullsized":"2023-07-05T23:33:35.011554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_clean_scrub_stamp":"2023-07-05T23:32:46.741565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:00:36.274653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"30'15","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:15.480517+0000","last_change":"2023-07-05T23:32:52.906517+0000","last_active":"2023-07-05T23:35:15.480517+0000","last_peered":"2023-07-05T23:35:15.480517+0000","last_clean":"2023-07-05T23:35:15.480517+0000","last_became_active":"2023-07-05T23:32:52.906204+0000","last_became_peered":"2023-07-05T23:32:52.906204+0000","last_unstale":"2023-07-05T23:35:15.480517+0000","last_undegraded":"2023-07-05T23:35:15.480517+0000","last_fullsized":"2023-07-05T23:35:15.480517+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:38:48.811718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7643,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":16,"num_write":14,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"30'21","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.507187+0000","last_change":"2023-07-05T23:32:53.340334+0000","last_active":"2023-07-05T23:35:14.507187+0000","last_peered":"2023-07-05T23:35:14.507187+0000","last_clean":"2023-07-05T23:35:14.507187+0000","last_became_active":"2023-07-05T23:32:53.340061+0000","last_became_peered":"2023-07-05T23:32:53.340061+0000","last_unstale":"2023-07-05T23:35:14.507187+0000","last_undegraded":"2023-07-05T23:35:14.507187+0000","last_fullsized":"2023-07-05T23:35:14.507187+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:37:37.499204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"30'501","reported_seq":519,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:13.554516+0000","last_change":"2023-07-05T23:32:57.362424+0000","last_active":"2023-07-05T23:35:13.554516+0000","last_peered":"2023-07-05T23:35:13.554516+0000","last_clean":"2023-07-05T23:35:13.554516+0000","last_became_active":"2023-07-05T23:32:57.361941+0000","last_became_peered":"2023-07-05T23:32:57.361941+0000","last_unstale":"2023-07-05T23:35:13.554516+0000","last_undegraded":"2023-07-05T23:35:13.554516+0000","last_fullsized":"2023-07-05T23:35:13.554516+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:11:35.842714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.011798+0000","last_change":"2023-07-05T23:32:47.790754+0000","last_active":"2023-07-05T23:33:35.011798+0000","last_peered":"2023-07-05T23:33:35.011798+0000","last_clean":"2023-07-05T23:33:35.011798+0000","last_became_active":"2023-07-05T23:32:47.790408+0000","last_became_peered":"2023-07-05T23:32:47.790408+0000","last_unstale":"2023-07-05T23:33:35.011798+0000","last_undegraded":"2023-07-05T23:33:35.011798+0000","last_fullsized":"2023-07-05T23:33:35.011798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_clean_scrub_stamp":"2023-07-05T23:32:46.741565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:47:18.131137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"30'2","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:04.468711+0000","last_change":"2023-07-05T23:32:52.908711+0000","last_active":"2023-07-05T23:35:04.468711+0000","last_peered":"2023-07-05T23:35:04.468711+0000","last_clean":"2023-07-05T23:35:04.468711+0000","last_became_active":"2023-07-05T23:32:52.908379+0000","last_became_peered":"2023-07-05T23:32:52.908379+0000","last_unstale":"2023-07-05T23:35:04.468711+0000","last_undegraded":"2023-07-05T23:35:04.468711+0000","last_fullsized":"2023-07-05T23:35:04.468711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:19:44.120787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"30'22","reported_seq":46,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.515358+0000","last_change":"2023-07-05T23:32:53.331042+0000","last_active":"2023-07-05T23:35:14.515358+0000","last_peered":"2023-07-05T23:35:14.515358+0000","last_clean":"2023-07-05T23:35:14.515358+0000","last_became_active":"2023-07-05T23:32:53.330771+0000","last_became_peered":"2023-07-05T23:32:53.330771+0000","last_unstale":"2023-07-05T23:35:14.515358+0000","last_undegraded":"2023-07-05T23:35:14.515358+0000","last_fullsized":"2023-07-05T23:35:14.515358+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:28:26.918347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"30'486","reported_seq":504,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:13.526033+0000","last_change":"2023-07-05T23:32:57.357223+0000","last_active":"2023-07-05T23:35:13.526033+0000","last_peered":"2023-07-05T23:35:13.526033+0000","last_clean":"2023-07-05T23:35:13.526033+0000","last_became_active":"2023-07-05T23:32:57.356797+0000","last_became_peered":"2023-07-05T23:32:57.356797+0000","last_unstale":"2023-07-05T23:35:13.526033+0000","last_undegraded":"2023-07-05T23:35:13.526033+0000","last_fullsized":"2023-07-05T23:35:13.526033+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:04:21.723966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"30'3","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:05.629762+0000","last_change":"2023-07-05T23:32:52.906030+0000","last_active":"2023-07-05T23:35:05.629762+0000","last_peered":"2023-07-05T23:35:05.629762+0000","last_clean":"2023-07-05T23:35:05.629762+0000","last_became_active":"2023-07-05T23:32:52.905704+0000","last_became_peered":"2023-07-05T23:32:52.905704+0000","last_unstale":"2023-07-05T23:35:05.629762+0000","last_undegraded":"2023-07-05T23:35:05.629762+0000","last_fullsized":"2023-07-05T23:35:05.629762+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:48:50.472580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.229743+0000","last_change":"2023-07-05T23:32:47.769126+0000","last_active":"2023-07-05T23:33:35.229743+0000","last_peered":"2023-07-05T23:33:35.229743+0000","last_clean":"2023-07-05T23:33:35.229743+0000","last_became_active":"2023-07-05T23:32:47.768844+0000","last_became_peered":"2023-07-05T23:32:47.768844+0000","last_unstale":"2023-07-05T23:33:35.229743+0000","last_undegraded":"2023-07-05T23:33:35.229743+0000","last_fullsized":"2023-07-05T23:33:35.229743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_clean_scrub_stamp":"2023-07-05T23:32:46.741565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:09:50.580774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"30'18","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.504878+0000","last_change":"2023-07-05T23:33:35.012743+0000","last_active":"2023-07-05T23:35:14.504878+0000","last_peered":"2023-07-05T23:35:14.504878+0000","last_clean":"2023-07-05T23:35:14.504878+0000","last_became_active":"2023-07-05T23:33:35.012290+0000","last_became_peered":"2023-07-05T23:33:35.012290+0000","last_unstale":"2023-07-05T23:35:14.504878+0000","last_undegraded":"2023-07-05T23:35:14.504878+0000","last_fullsized":"2023-07-05T23:35:14.504878+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:22:31.213068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"30'447","reported_seq":465,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.467484+0000","last_change":"2023-07-05T23:32:57.362654+0000","last_active":"2023-07-05T23:35:14.467484+0000","last_peered":"2023-07-05T23:35:14.467484+0000","last_clean":"2023-07-05T23:35:14.467484+0000","last_became_active":"2023-07-05T23:32:57.362112+0000","last_became_peered":"2023-07-05T23:32:57.362112+0000","last_unstale":"2023-07-05T23:35:14.467484+0000","last_undegraded":"2023-07-05T23:35:14.467484+0000","last_fullsized":"2023-07-05T23:35:14.467484+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:00:45.855064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":46080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.228846+0000","last_change":"2023-07-05T23:32:47.769537+0000","last_active":"2023-07-05T23:33:35.228846+0000","last_peered":"2023-07-05T23:33:35.228846+0000","last_clean":"2023-07-05T23:33:35.228846+0000","last_became_active":"2023-07-05T23:32:47.769141+0000","last_became_peered":"2023-07-05T23:32:47.769141+0000","last_unstale":"2023-07-05T23:33:35.228846+0000","last_undegraded":"2023-07-05T23:33:35.228846+0000","last_fullsized":"2023-07-05T23:33:35.228846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_clean_scrub_stamp":"2023-07-05T23:32:46.741565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:24:40.558028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"30'11","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:07.903767+0000","last_change":"2023-07-05T23:32:52.905759+0000","last_active":"2023-07-05T23:35:07.903767+0000","last_peered":"2023-07-05T23:35:07.903767+0000","last_clean":"2023-07-05T23:35:07.903767+0000","last_became_active":"2023-07-05T23:32:52.905451+0000","last_became_peered":"2023-07-05T23:32:52.905451+0000","last_unstale":"2023-07-05T23:35:07.903767+0000","last_undegraded":"2023-07-05T23:35:07.903767+0000","last_fullsized":"2023-07-05T23:35:07.903767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:03:44.827174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"30'17","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.520533+0000","last_change":"2023-07-05T23:32:53.332443+0000","last_active":"2023-07-05T23:35:14.520533+0000","last_peered":"2023-07-05T23:35:14.520533+0000","last_clean":"2023-07-05T23:35:14.520533+0000","last_became_active":"2023-07-05T23:32:53.332159+0000","last_became_peered":"2023-07-05T23:32:53.332159+0000","last_unstale":"2023-07-05T23:35:14.520533+0000","last_undegraded":"2023-07-05T23:35:14.520533+0000","last_fullsized":"2023-07-05T23:35:14.520533+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:20:52.387593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"30'468","reported_seq":485,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:13.571013+0000","last_change":"2023-07-05T23:32:57.363998+0000","last_active":"2023-07-05T23:35:13.571013+0000","last_peered":"2023-07-05T23:35:13.571013+0000","last_clean":"2023-07-05T23:35:13.571013+0000","last_became_active":"2023-07-05T23:32:57.363620+0000","last_became_peered":"2023-07-05T23:32:57.363620+0000","last_unstale":"2023-07-05T23:35:13.571013+0000","last_undegraded":"2023-07-05T23:35:13.571013+0000","last_fullsized":"2023-07-05T23:35:13.571013+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:47:48.642379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.228911+0000","last_change":"2023-07-05T23:32:52.908550+0000","last_active":"2023-07-05T23:33:35.228911+0000","last_peered":"2023-07-05T23:33:35.228911+0000","last_clean":"2023-07-05T23:33:35.228911+0000","last_became_active":"2023-07-05T23:32:52.908111+0000","last_became_peered":"2023-07-05T23:32:52.908111+0000","last_unstale":"2023-07-05T23:33:35.228911+0000","last_undegraded":"2023-07-05T23:33:35.228911+0000","last_fullsized":"2023-07-05T23:33:35.228911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:47:44.198348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"30'24","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.508353+0000","last_change":"2023-07-05T23:32:53.340098+0000","last_active":"2023-07-05T23:35:14.508353+0000","last_peered":"2023-07-05T23:35:14.508353+0000","last_clean":"2023-07-05T23:35:14.508353+0000","last_became_active":"2023-07-05T23:32:53.339686+0000","last_became_peered":"2023-07-05T23:32:53.339686+0000","last_unstale":"2023-07-05T23:35:14.508353+0000","last_undegraded":"2023-07-05T23:35:14.508353+0000","last_fullsized":"2023-07-05T23:35:14.508353+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:37:45.661547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"30'478","reported_seq":495,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:13.535971+0000","last_change":"2023-07-05T23:32:57.356309+0000","last_active":"2023-07-05T23:35:13.535971+0000","last_peered":"2023-07-05T23:35:13.535971+0000","last_clean":"2023-07-05T23:35:13.535971+0000","last_became_active":"2023-07-05T23:32:57.355910+0000","last_became_peered":"2023-07-05T23:32:57.355910+0000","last_unstale":"2023-07-05T23:35:13.535971+0000","last_undegraded":"2023-07-05T23:35:13.535971+0000","last_fullsized":"2023-07-05T23:35:13.535971+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:47:48.642379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:34.897485+0000","last_change":"2023-07-05T23:32:52.899481+0000","last_active":"2023-07-05T23:33:34.897485+0000","last_peered":"2023-07-05T23:33:34.897485+0000","last_clean":"2023-07-05T23:33:34.897485+0000","last_became_active":"2023-07-05T23:32:52.899159+0000","last_became_peered":"2023-07-05T23:32:52.899159+0000","last_unstale":"2023-07-05T23:33:34.897485+0000","last_undegraded":"2023-07-05T23:33:34.897485+0000","last_fullsized":"2023-07-05T23:33:34.897485+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:55:01.034913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"30'19","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.520324+0000","last_change":"2023-07-05T23:32:53.343643+0000","last_active":"2023-07-05T23:35:14.520324+0000","last_peered":"2023-07-05T23:35:14.520324+0000","last_clean":"2023-07-05T23:35:14.520324+0000","last_became_active":"2023-07-05T23:32:53.343262+0000","last_became_peered":"2023-07-05T23:32:53.343262+0000","last_unstale":"2023-07-05T23:35:14.520324+0000","last_undegraded":"2023-07-05T23:35:14.520324+0000","last_fullsized":"2023-07-05T23:35:14.520324+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:24:39.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"30'465","reported_seq":482,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.465946+0000","last_change":"2023-07-05T23:32:57.365478+0000","last_active":"2023-07-05T23:35:14.465946+0000","last_peered":"2023-07-05T23:35:14.465946+0000","last_clean":"2023-07-05T23:35:14.465946+0000","last_became_active":"2023-07-05T23:32:57.365087+0000","last_became_peered":"2023-07-05T23:32:57.365087+0000","last_unstale":"2023-07-05T23:35:14.465946+0000","last_undegraded":"2023-07-05T23:35:14.465946+0000","last_fullsized":"2023-07-05T23:35:14.465946+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:47:27.711548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"30'3","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:34.897598+0000","last_change":"2023-07-05T23:32:52.902806+0000","last_active":"2023-07-05T23:33:34.897598+0000","last_peered":"2023-07-05T23:33:34.897598+0000","last_clean":"2023-07-05T23:33:34.897598+0000","last_became_active":"2023-07-05T23:32:52.901689+0000","last_became_peered":"2023-07-05T23:32:52.901689+0000","last_unstale":"2023-07-05T23:33:34.897598+0000","last_undegraded":"2023-07-05T23:33:34.897598+0000","last_fullsized":"2023-07-05T23:33:34.897598+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:34:31.075112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'15","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.521404+0000","last_change":"2023-07-05T23:32:53.346776+0000","last_active":"2023-07-05T23:35:14.521404+0000","last_peered":"2023-07-05T23:35:14.521404+0000","last_clean":"2023-07-05T23:35:14.521404+0000","last_became_active":"2023-07-05T23:32:53.346553+0000","last_became_peered":"2023-07-05T23:32:53.346553+0000","last_unstale":"2023-07-05T23:35:14.521404+0000","last_undegraded":"2023-07-05T23:35:14.521404+0000","last_fullsized":"2023-07-05T23:35:14.521404+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:23:00.312260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"30'486","reported_seq":503,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.466120+0000","last_change":"2023-07-05T23:32:57.353173+0000","last_active":"2023-07-05T23:35:14.466120+0000","last_peered":"2023-07-05T23:35:14.466120+0000","last_clean":"2023-07-05T23:35:14.466120+0000","last_became_active":"2023-07-05T23:32:57.352716+0000","last_became_peered":"2023-07-05T23:32:57.352716+0000","last_unstale":"2023-07-05T23:35:14.466120+0000","last_undegraded":"2023-07-05T23:35:14.466120+0000","last_fullsized":"2023-07-05T23:35:14.466120+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:41:41.820423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.231058+0000","last_change":"2023-07-05T23:32:52.906954+0000","last_active":"2023-07-05T23:33:35.231058+0000","last_peered":"2023-07-05T23:33:35.231058+0000","last_clean":"2023-07-05T23:33:35.231058+0000","last_became_active":"2023-07-05T23:32:52.906688+0000","last_became_peered":"2023-07-05T23:32:52.906688+0000","last_unstale":"2023-07-05T23:33:35.231058+0000","last_undegraded":"2023-07-05T23:33:35.231058+0000","last_fullsized":"2023-07-05T23:33:35.231058+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:32:02.036320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"30'28","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.508674+0000","last_change":"2023-07-05T23:32:53.348210+0000","last_active":"2023-07-05T23:35:14.508674+0000","last_peered":"2023-07-05T23:35:14.508674+0000","last_clean":"2023-07-05T23:35:14.508674+0000","last_became_active":"2023-07-05T23:32:53.346652+0000","last_became_peered":"2023-07-05T23:32:53.346652+0000","last_unstale":"2023-07-05T23:35:14.508674+0000","last_undegraded":"2023-07-05T23:35:14.508674+0000","last_fullsized":"2023-07-05T23:35:14.508674+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:55:02.039251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"30'493","reported_seq":510,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:13.562560+0000","last_change":"2023-07-05T23:32:57.357185+0000","last_active":"2023-07-05T23:35:13.562560+0000","last_peered":"2023-07-05T23:35:13.562560+0000","last_clean":"2023-07-05T23:35:13.562560+0000","last_became_active":"2023-07-05T23:32:57.356637+0000","last_became_peered":"2023-07-05T23:32:57.356637+0000","last_unstale":"2023-07-05T23:35:13.562560+0000","last_undegraded":"2023-07-05T23:35:13.562560+0000","last_fullsized":"2023-07-05T23:35:13.562560+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:03:49.271205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"30'5","reported_seq":31,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:00.628733+0000","last_change":"2023-07-05T23:32:52.904412+0000","last_active":"2023-07-05T23:35:00.628733+0000","last_peered":"2023-07-05T23:35:00.628733+0000","last_clean":"2023-07-05T23:35:00.628733+0000","last_became_active":"2023-07-05T23:32:52.903823+0000","last_became_peered":"2023-07-05T23:32:52.903823+0000","last_unstale":"2023-07-05T23:35:00.628733+0000","last_undegraded":"2023-07-05T23:35:00.628733+0000","last_fullsized":"2023-07-05T23:35:00.628733+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:55:01.034913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"30'30","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.521424+0000","last_change":"2023-07-05T23:32:53.342800+0000","last_active":"2023-07-05T23:35:14.521424+0000","last_peered":"2023-07-05T23:35:14.521424+0000","last_clean":"2023-07-05T23:35:14.521424+0000","last_became_active":"2023-07-05T23:32:53.339863+0000","last_became_peered":"2023-07-05T23:32:53.339863+0000","last_unstale":"2023-07-05T23:35:14.521424+0000","last_undegraded":"2023-07-05T23:35:14.521424+0000","last_fullsized":"2023-07-05T23:35:14.521424+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:18:02.496050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"30'37","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.505625+0000","last_change":"2023-07-05T23:32:53.337066+0000","last_active":"2023-07-05T23:35:14.505625+0000","last_peered":"2023-07-05T23:35:14.505625+0000","last_clean":"2023-07-05T23:35:14.505625+0000","last_became_active":"2023-07-05T23:32:53.336759+0000","last_became_peered":"2023-07-05T23:32:53.336759+0000","last_unstale":"2023-07-05T23:35:14.505625+0000","last_undegraded":"2023-07-05T23:35:14.505625+0000","last_fullsized":"2023-07-05T23:35:14.505625+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:10:47.650972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"30'33","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.509724+0000","last_change":"2023-07-05T23:32:53.346160+0000","last_active":"2023-07-05T23:35:14.509724+0000","last_peered":"2023-07-05T23:35:14.509724+0000","last_clean":"2023-07-05T23:35:14.509724+0000","last_became_active":"2023-07-05T23:32:53.345711+0000","last_became_peered":"2023-07-05T23:32:53.345711+0000","last_unstale":"2023-07-05T23:35:14.509724+0000","last_undegraded":"2023-07-05T23:35:14.509724+0000","last_fullsized":"2023-07-05T23:35:14.509724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:19:28.044822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"30'30","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.521711+0000","last_change":"2023-07-05T23:32:53.339729+0000","last_active":"2023-07-05T23:35:14.521711+0000","last_peered":"2023-07-05T23:35:14.521711+0000","last_clean":"2023-07-05T23:35:14.521711+0000","last_became_active":"2023-07-05T23:32:53.339431+0000","last_became_peered":"2023-07-05T23:32:53.339431+0000","last_unstale":"2023-07-05T23:35:14.521711+0000","last_undegraded":"2023-07-05T23:35:14.521711+0000","last_fullsized":"2023-07-05T23:35:14.521711+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:27:36.127458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"30'25","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.514712+0000","last_change":"2023-07-05T23:32:53.335512+0000","last_active":"2023-07-05T23:35:14.514712+0000","last_peered":"2023-07-05T23:35:14.514712+0000","last_clean":"2023-07-05T23:35:14.514712+0000","last_became_active":"2023-07-05T23:32:53.335181+0000","last_became_peered":"2023-07-05T23:32:53.335181+0000","last_unstale":"2023-07-05T23:35:14.514712+0000","last_undegraded":"2023-07-05T23:35:14.514712+0000","last_fullsized":"2023-07-05T23:35:14.514712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:47:24.271855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"30'20","reported_seq":44,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.513749+0000","last_change":"2023-07-05T23:32:53.338171+0000","last_active":"2023-07-05T23:35:14.513749+0000","last_peered":"2023-07-05T23:35:14.513749+0000","last_clean":"2023-07-05T23:35:14.513749+0000","last_became_active":"2023-07-05T23:32:53.337835+0000","last_became_peered":"2023-07-05T23:32:53.337835+0000","last_unstale":"2023-07-05T23:35:14.513749+0000","last_undegraded":"2023-07-05T23:35:14.513749+0000","last_fullsized":"2023-07-05T23:35:14.513749+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:00:42.415370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":155189248,"num_objects":37,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":577,"num_write_kb":1236992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":310378496,"data_stored":310378496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15026,"ondisk_log_size":15026,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1559,"ondisk_log_size":1559,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1443896,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":14,"num_read_kb":16,"num_write":438,"num_write_kb":1699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2949120,"data_stored":2887792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":438,"ondisk_log_size":438,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574883,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":100960,"kb_used_data":65816,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94270880,"statfs":{"total":96636764160,"available":96533381120,"internally_reserved":0,"allocated":67395584,"data_stored":67176597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 5 23:34:44 2023","interfaces":[{"interface":"back","average":{"1min":3.7120000000000002,"5min":1.2150000000000001,"15min":0.79900000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":12.042,"5min":12.042,"15min":12.042},"last":0.29799999999999999},{"interface":"front","average":{"1min":6.5010000000000003,"5min":2.4590000000000001,"15min":1.7849999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":26.367999999999999,"5min":26.367999999999999,"15min":26.367999999999999},"last":0.41299999999999998}]},{"osd":1,"last update":"Wed Jul 5 23:34:44 2023","interfaces":[{"interface":"back","average":{"1min":3.536,"5min":1.2789999999999999,"15min":0.90300000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":11.948,"5min":11.948,"15min":11.948},"last":0.36799999999999999},{"interface":"front","average":{"1min":4.0110000000000001,"5min":1.2789999999999999,"15min":0.82399999999999995},"min":{"1min":0.318,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":11.952,"5min":11.952,"15min":11.952},"last":0.39400000000000002}]},{"osd":2,"last update":"Wed Jul 5 23:34:44 2023","interfaces":[{"interface":"back","average":{"1min":4.0209999999999999,"5min":1.675,"15min":1.284},"min":{"1min":0.38500000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":11.997,"5min":11.997,"15min":11.997},"last":0.35499999999999998},{"interface":"front","average":{"1min":6.1189999999999998,"5min":1.7829999999999999,"15min":1.0600000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":26.419,"5min":26.419,"15min":26.419},"last":0.46000000000000002}]},{"osd":3,"last update":"Wed Jul 5 23:34:44 2023","interfaces":[{"interface":"back","average":{"1min":4.9889999999999999,"5min":1.51,"15min":0.93000000000000005},"min":{"1min":0.43099999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":24.094000000000001,"5min":24.094000000000001,"15min":24.094000000000001},"last":0.40500000000000003},{"interface":"front","average":{"1min":5.3719999999999999,"5min":1.5780000000000001,"15min":0.94599999999999995},"min":{"1min":0.44700000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":22.588000000000001,"5min":22.588000000000001,"15min":22.588000000000001},"last":0.32500000000000001}]},{"osd":4,"last update":"Wed Jul 5 23:34:44 2023","interfaces":[{"interface":"back","average":{"1min":3.4390000000000001,"5min":1.111,"15min":0.72299999999999998},"min":{"1min":0.32500000000000001,"5min":0.318,"15min":0.318},"max":{"1min":12.173999999999999,"5min":12.173999999999999,"15min":12.173999999999999},"last":0.28000000000000003},{"interface":"front","average":{"1min":3.4780000000000002,"5min":1.147,"15min":0.75900000000000001},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":12.151,"5min":12.151,"15min":12.151},"last":0.307}]},{"osd":5,"last update":"Wed Jul 5 23:34:44 2023","interfaces":[{"interface":"back","average":{"1min":3.8519999999999999,"5min":1.222,"15min":0.78400000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":19.954999999999998,"5min":19.954999999999998,"15min":19.954999999999998},"last":0.33400000000000002},{"interface":"front","average":{"1min":3.6509999999999998,"5min":1.2150000000000001,"15min":0.80900000000000005},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":21.870999999999999,"5min":21.870999999999999,"15min":21.870999999999999},"last":0.38500000000000001}]},{"osd":6,"last update":"Wed Jul 5 23:34:44 2023","interfaces":[{"interface":"back","average":{"1min":5.4880000000000004,"5min":1.6060000000000001,"15min":0.95899999999999996},"min":{"1min":0.436,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":20.212,"5min":20.212,"15min":20.212},"last":0.44},{"interface":"front","average":{"1min":2.4449999999999998,"5min":0.98399999999999999,"15min":0.73999999999999999},"min":{"1min":0.45700000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":12.010999999999999,"5min":12.010999999999999,"15min":12.010999999999999},"last":0.34599999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574883,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78472,"kb_used_data":47424,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94293368,"statfs":{"total":96636764160,"available":96556408832,"internally_reserved":0,"allocated":48562176,"data_stored":48373342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 5 23:34:42 2023","interfaces":[{"interface":"back","average":{"1min":7.4859999999999998,"5min":1.9059999999999999,"15min":0.97599999999999998},"min":{"1min":0.39800000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":24.012,"5min":24.012,"15min":24.012},"last":0.39700000000000002},{"interface":"front","average":{"1min":7.5389999999999997,"5min":1.909,"15min":0.97099999999999997},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":27.036000000000001,"5min":27.036000000000001,"15min":27.036000000000001},"last":0.38300000000000001}]},{"osd":1,"last update":"Wed Jul 5 23:34:42 2023","interfaces":[{"interface":"back","average":{"1min":7.0979999999999999,"5min":1.8220000000000001,"15min":0.94199999999999995},"min":{"1min":0.34499999999999997,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":20.021999999999998,"5min":20.021999999999998,"15min":20.021999999999998},"last":0.434},{"interface":"front","average":{"1min":7.7549999999999999,"5min":1.9970000000000001,"15min":1.0369999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":23.943000000000001,"5min":23.943000000000001,"15min":23.943000000000001},"last":0.503}]},{"osd":2,"last update":"Wed Jul 5 23:34:42 2023","interfaces":[{"interface":"back","average":{"1min":7.1660000000000004,"5min":1.871,"15min":0.98899999999999999},"min":{"1min":0.36699999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":25.658000000000001,"5min":25.658000000000001,"15min":25.658000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":5.9139999999999997,"5min":1.647,"15min":0.93600000000000005},"min":{"1min":0.40000000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":27.062000000000001,"5min":27.062000000000001,"15min":27.062000000000001},"last":0.57099999999999995}]},{"osd":3,"last update":"Wed Jul 5 23:34:42 2023","interfaces":[{"interface":"back","average":{"1min":6.657,"5min":1.7889999999999999,"15min":0.97699999999999998},"min":{"1min":0.443,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":27.108000000000001,"5min":27.108000000000001,"15min":27.108000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":7.6630000000000003,"5min":1.976,"15min":1.028},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":19.940000000000001,"5min":19.940000000000001,"15min":19.940000000000001},"last":0.55200000000000005}]},{"osd":4,"last update":"Wed Jul 5 23:34:42 2023","interfaces":[{"interface":"back","average":{"1min":8.0489999999999995,"5min":2.0430000000000001,"15min":1.042},"min":{"1min":0.34899999999999998,"5min":0.308,"15min":0.308},"max":{"1min":26,"5min":26,"15min":26},"last":0.58299999999999996},{"interface":"front","average":{"1min":5.0650000000000004,"5min":1.482,"15min":0.88500000000000001},"min":{"1min":0.376,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":27.085000000000001,"5min":27.085000000000001,"15min":27.085000000000001},"last":0.52400000000000002}]},{"osd":5,"last update":"Wed Jul 5 23:34:42 2023","interfaces":[{"interface":"back","average":{"1min":5.5750000000000002,"5min":1.5549999999999999,"15min":0.88500000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":19.975000000000001,"5min":19.975000000000001,"15min":19.975000000000001},"last":0.49299999999999999},{"interface":"front","average":{"1min":6.4349999999999996,"5min":1.7789999999999999,"15min":1.0029999999999999},"min":{"1min":0.41999999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":17.126999999999999,"5min":17.126999999999999,"15min":17.126999999999999},"last":0.60699999999999998}]},{"osd":7,"last update":"Wed Jul 5 23:34:42 2023","interfaces":[{"interface":"back","average":{"1min":5.7000000000000002,"5min":1.6240000000000001,"15min":0.94499999999999995},"min":{"1min":0.438,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":26.992000000000001,"5min":26.992000000000001,"15min":26.992000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":6.1929999999999996,"5min":1.7250000000000001,"15min":0.98099999999999998},"min":{"1min":0.44700000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":19.998999999999999,"5min":19.998999999999999,"15min":19.998999999999999},"last":0.59099999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574883,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72328,"kb_used_data":41280,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94299512,"statfs":{"total":96636764160,"available":96562700288,"internally_reserved":0,"allocated":42270720,"data_stored":42081886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 5 23:34:46 2023","interfaces":[{"interface":"back","average":{"1min":3.9239999999999999,"5min":1.0700000000000001,"15min":0.59399999999999997},"min":{"1min":0.29799999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":14.039999999999999,"5min":14.039999999999999,"15min":14.039999999999999},"last":0.27500000000000002},{"interface":"front","average":{"1min":3.871,"5min":1.0669999999999999,"15min":0.59899999999999998},"min":{"1min":0.27400000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":18.006,"5min":18.006,"15min":18.006},"last":0.28999999999999998}]},{"osd":2,"last update":"Wed Jul 5 23:34:46 2023","interfaces":[{"interface":"back","average":{"1min":4.3860000000000001,"5min":1.1839999999999999,"15min":0.65000000000000002},"min":{"1min":0.32200000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":14.092000000000001,"5min":14.092000000000001,"15min":14.092000000000001},"last":0.313},{"interface":"front","average":{"1min":4.3929999999999998,"5min":1.173,"15min":0.63600000000000001},"min":{"1min":0.33500000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":17.994,"5min":17.994,"15min":17.994},"last":0.26500000000000001}]},{"osd":3,"last update":"Wed Jul 5 23:34:46 2023","interfaces":[{"interface":"back","average":{"1min":4.9980000000000002,"5min":1.3180000000000001,"15min":0.70399999999999996},"min":{"1min":0.29999999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":17.949999999999999,"5min":17.949999999999999,"15min":17.949999999999999},"last":0.34399999999999997},{"interface":"front","average":{"1min":3.2240000000000002,"5min":0.96999999999999997,"15min":0.59399999999999997},"min":{"1min":0.38800000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":14.377000000000001,"5min":14.377000000000001,"15min":14.377000000000001},"last":0.33100000000000002}]},{"osd":4,"last update":"Wed Jul 5 23:34:46 2023","interfaces":[{"interface":"back","average":{"1min":5.0419999999999998,"5min":1.4790000000000001,"15min":0.88500000000000001},"min":{"1min":0.436,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":14.004,"5min":14.004,"15min":14.004},"last":0.55800000000000005},{"interface":"front","average":{"1min":5.75,"5min":1.6100000000000001,"15min":0.92000000000000004},"min":{"1min":0.49399999999999999,"5min":0.371,"15min":0.371},"max":{"1min":20.943999999999999,"5min":20.943999999999999,"15min":20.943999999999999},"last":0.63}]},{"osd":5,"last update":"Wed Jul 5 23:34:46 2023","interfaces":[{"interface":"back","average":{"1min":5.2549999999999999,"5min":1.5509999999999999,"15min":0.93400000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":24.949999999999999,"5min":24.949999999999999,"15min":24.949999999999999},"last":0.745},{"interface":"front","average":{"1min":5.9710000000000001,"5min":1.7190000000000001,"15min":1.0109999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":21.945,"5min":21.945,"15min":21.945},"last":0.64100000000000001}]},{"osd":6,"last update":"Wed Jul 5 23:34:46 2023","interfaces":[{"interface":"back","average":{"1min":4.2859999999999996,"5min":1.3420000000000001,"15min":0.85099999999999998},"min":{"1min":0.42799999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":17.981999999999999,"5min":17.981999999999999,"15min":17.981999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":6.0060000000000002,"5min":1.714,"15min":0.998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":24.943000000000001,"5min":24.943000000000001,"15min":24.943000000000001},"last":0.68000000000000005}]},{"osd":7,"last update":"Wed Jul 5 23:34:46 2023","interfaces":[{"interface":"back","average":{"1min":5.6079999999999997,"5min":1.621,"15min":0.95699999999999996},"min":{"1min":0.52700000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":18.045000000000002,"5min":18.045000000000002,"15min":18.045000000000002},"last":0.66800000000000004},{"interface":"front","average":{"1min":3.9289999999999998,"5min":1.2769999999999999,"15min":0.83499999999999996},"min":{"1min":0.46000000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":14.352,"5min":14.352,"15min":14.352},"last":0.69399999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574883,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":101592,"kb_used_data":70544,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94270248,"statfs":{"total":96636764160,"available":96532733952,"internally_reserved":0,"allocated":72237056,"data_stored":72040498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Jul 5 23:34:41 2023","interfaces":[{"interface":"back","average":{"1min":4.0949999999999998,"5min":1.081,"15min":0.57899999999999996},"min":{"1min":0.254,"5min":0.185,"15min":0.185},"max":{"1min":23.974,"5min":23.974,"15min":23.974},"last":0.313},{"interface":"front","average":{"1min":5.0419999999999998,"5min":1.282,"15min":0.65500000000000003},"min":{"1min":0.28999999999999998,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":32.256999999999998,"5min":32.256999999999998,"15min":32.256999999999998},"last":1.1040000000000001}]},{"osd":2,"last update":"Wed Jul 5 23:34:41 2023","interfaces":[{"interface":"back","average":{"1min":3.4060000000000001,"5min":0.97899999999999998,"15min":0.57499999999999996},"min":{"1min":0.31,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":16.157,"5min":16.157,"15min":16.157},"last":0.21199999999999999},{"interface":"front","average":{"1min":3.6739999999999999,"5min":1.0269999999999999,"15min":0.58599999999999997},"min":{"1min":0.28899999999999998,"5min":0.254,"15min":0.254},"max":{"1min":14.91,"5min":14.91,"15min":14.91},"last":1.0700000000000001}]},{"osd":3,"last update":"Wed Jul 5 23:34:41 2023","interfaces":[{"interface":"back","average":{"1min":6.1820000000000004,"5min":1.534,"15min":0.75900000000000001},"min":{"1min":0.35299999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":16.928999999999998,"5min":16.928999999999998,"15min":16.928999999999998},"last":2.0529999999999999},{"interface":"front","average":{"1min":2.4399999999999999,"5min":0.83199999999999996,"15min":0.56399999999999995},"min":{"1min":0.38500000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":11.923999999999999,"5min":11.923999999999999,"15min":11.923999999999999},"last":0.34799999999999998}]},{"osd":4,"last update":"Wed Jul 5 23:34:41 2023","interfaces":[{"interface":"back","average":{"1min":4.6520000000000001,"5min":1.3899999999999999,"15min":0.84599999999999997},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":16.838000000000001,"5min":16.838000000000001,"15min":16.838000000000001},"last":0.95599999999999996},{"interface":"front","average":{"1min":5.7990000000000004,"5min":1.633,"15min":0.93899999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":23.905999999999999,"5min":23.905999999999999,"15min":23.905999999999999},"last":1.1910000000000001}]},{"osd":5,"last update":"Wed Jul 5 23:34:41 2023","interfaces":[{"interface":"back","average":{"1min":4.7140000000000004,"5min":1.4299999999999999,"15min":0.88200000000000001},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":17.824000000000002,"5min":17.824000000000002,"15min":17.824000000000002},"last":1.5109999999999999},{"interface":"front","average":{"1min":5.0519999999999996,"5min":1.5,"15min":0.90800000000000003},"min":{"1min":0.498,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":16.905000000000001,"5min":16.905000000000001,"15min":16.905000000000001},"last":0.98799999999999999}]},{"osd":6,"last update":"Wed Jul 5 23:34:41 2023","interfaces":[{"interface":"back","average":{"1min":2.7469999999999999,"5min":1.0389999999999999,"15min":0.754},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":10.102,"5min":10.102,"15min":10.102},"last":0.59699999999999998},{"interface":"front","average":{"1min":5.2690000000000001,"5min":1.5529999999999999,"15min":0.93300000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":32.298999999999999,"5min":32.298999999999999,"15min":32.298999999999999},"last":1.129}]},{"osd":7,"last update":"Wed Jul 5 23:34:41 2023","interfaces":[{"interface":"back","average":{"1min":4.7759999999999998,"5min":1.464,"15min":0.91200000000000003},"min":{"1min":0.51000000000000001,"5min":0.503,"15min":0.503},"max":{"1min":14.946,"5min":14.946,"15min":14.946},"last":1.1579999999999999},{"interface":"front","average":{"1min":5.8360000000000003,"5min":1.657,"15min":0.96099999999999997},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":16.878,"5min":16.878,"15min":16.878},"last":1.0149999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574884,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":88712,"kb_used_data":57664,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94283128,"statfs":{"total":96636764160,"available":96545923072,"internally_reserved":0,"allocated":59047936,"data_stored":58859102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 5 23:34:45 2023","interfaces":[{"interface":"back","average":{"1min":6.4109999999999996,"5min":1.728,"15min":0.94799999999999995},"min":{"1min":0.27600000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":29.716000000000001,"5min":29.716000000000001,"15min":29.716000000000001},"last":0.24399999999999999},{"interface":"front","average":{"1min":6.1890000000000001,"5min":1.7290000000000001,"15min":0.98599999999999999},"min":{"1min":0.26800000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":21.699000000000002,"5min":21.699000000000002,"15min":21.699000000000002},"last":0.34699999999999998}]},{"osd":1,"last update":"Wed Jul 5 23:34:45 2023","interfaces":[{"interface":"back","average":{"1min":6.0640000000000001,"5min":1.718,"15min":0.99399999999999999},"min":{"1min":0.35999999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":23.053000000000001,"5min":23.053000000000001,"15min":23.053000000000001},"last":0.39700000000000002},{"interface":"front","average":{"1min":5.3579999999999997,"5min":1.5720000000000001,"15min":0.94099999999999995},"min":{"1min":0.32800000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":29.632999999999999,"5min":29.632999999999999,"15min":29.632999999999999},"last":0.311}]},{"osd":3,"last update":"Wed Jul 5 23:34:45 2023","interfaces":[{"interface":"back","average":{"1min":3.52,"5min":1.1559999999999999,"15min":0.76200000000000001},"min":{"1min":0.29799999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":22.018000000000001,"5min":22.018000000000001,"15min":22.018000000000001},"last":0.28599999999999998},{"interface":"front","average":{"1min":4.9390000000000001,"5min":1.5429999999999999,"15min":0.97699999999999998},"min":{"1min":0.41399999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":29.686,"5min":29.686,"15min":29.686},"last":0.36399999999999999}]},{"osd":4,"last update":"Wed Jul 5 23:34:45 2023","interfaces":[{"interface":"back","average":{"1min":6.9909999999999997,"5min":2.0550000000000002,"15min":1.2330000000000001},"min":{"1min":0.46200000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":29.768999999999998,"5min":29.768999999999998,"15min":29.768999999999998},"last":0.54900000000000004},{"interface":"front","average":{"1min":7.3170000000000002,"5min":2.141,"15min":1.278},"min":{"1min":0.44600000000000001,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":21.16,"5min":21.16,"15min":21.16},"last":0.45100000000000001}]},{"osd":5,"last update":"Wed Jul 5 23:34:45 2023","interfaces":[{"interface":"back","average":{"1min":8.359,"5min":2.331,"15min":1.3260000000000001},"min":{"1min":0.502,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":22.927,"5min":22.927,"15min":22.927},"last":0.51500000000000001},{"interface":"front","average":{"1min":5.6970000000000001,"5min":1.8140000000000001,"15min":1.167},"min":{"1min":0.52400000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":23.120000000000001,"5min":23.120000000000001,"15min":23.120000000000001},"last":0.497}]},{"osd":6,"last update":"Wed Jul 5 23:34:45 2023","interfaces":[{"interface":"back","average":{"1min":6.0430000000000001,"5min":1.889,"15min":1.1970000000000001},"min":{"1min":0.54200000000000004,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":23.173999999999999,"5min":23.173999999999999,"15min":23.173999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":8.3699999999999992,"5min":2.3570000000000002,"15min":1.355},"min":{"1min":0.59599999999999997,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":29.742999999999999,"5min":29.742999999999999,"15min":29.742999999999999},"last":0.45600000000000002}]},{"osd":7,"last update":"Wed Jul 5 23:34:45 2023","interfaces":[{"interface":"back","average":{"1min":8.6240000000000006,"5min":2.4140000000000001,"15min":1.379},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":32.924999999999997,"5min":32.924999999999997,"15min":32.924999999999997},"last":0.47399999999999998},{"interface":"front","average":{"1min":7.1630000000000003,"5min":2.1419999999999999,"15min":1.3049999999999999},"min":{"1min":0.53000000000000003,"5min":0.436,"15min":0.436},"max":{"1min":30.594999999999999,"5min":30.594999999999999,"15min":30.594999999999999},"last":0.55800000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574883,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70284,"kb_used_data":43332,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94301556,"statfs":{"total":96636764160,"available":96564793344,"internally_reserved":0,"allocated":44371968,"data_stored":44179128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 5 23:34:48 2023","interfaces":[{"interface":"back","average":{"1min":4.9059999999999997,"5min":1.333,"15min":0.73699999999999999},"min":{"1min":0.33100000000000002,"5min":0.25,"15min":0.25},"max":{"1min":22.948,"5min":22.948,"15min":22.948},"last":0.26000000000000001},{"interface":"front","average":{"1min":4.9850000000000003,"5min":1.3799999999999999,"15min":0.77900000000000003},"min":{"1min":0.34699999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":23.036000000000001,"5min":23.036000000000001,"15min":23.036000000000001},"last":0.315}]},{"osd":1,"last update":"Wed Jul 5 23:34:48 2023","interfaces":[{"interface":"back","average":{"1min":4.1429999999999998,"5min":1.405,"15min":0.94899999999999995},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":18.981999999999999,"5min":18.981999999999999,"15min":18.981999999999999},"last":0.29799999999999999},{"interface":"front","average":{"1min":4.5170000000000003,"5min":1.512,"15min":1.0109999999999999},"min":{"1min":0.38300000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":25.253,"5min":25.253,"15min":25.253},"last":0.33500000000000002}]},{"osd":2,"last update":"Wed Jul 5 23:34:48 2023","interfaces":[{"interface":"back","average":{"1min":4.101,"5min":1.234,"15min":0.75600000000000001},"min":{"1min":0.30499999999999999,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":25.32,"5min":25.32,"15min":25.32},"last":0.36499999999999999},{"interface":"front","average":{"1min":4.048,"5min":1.2010000000000001,"15min":0.72699999999999998},"min":{"1min":0.42499999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":12.010999999999999,"5min":12.010999999999999,"15min":12.010999999999999},"last":0.378}]},{"osd":4,"last update":"Wed Jul 5 23:34:48 2023","interfaces":[{"interface":"back","average":{"1min":4.343,"5min":1.379,"15min":0.88500000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":19.007999999999999,"5min":19.007999999999999,"15min":19.007999999999999},"last":0.502},{"interface":"front","average":{"1min":5.3330000000000002,"5min":1.6080000000000001,"15min":0.98699999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":22.882000000000001,"5min":22.882000000000001,"15min":22.882000000000001},"last":0.51300000000000001}]},{"osd":5,"last update":"Wed Jul 5 23:34:48 2023","interfaces":[{"interface":"back","average":{"1min":6.7869999999999999,"5min":1.919,"15min":1.1080000000000001},"min":{"1min":0.46600000000000003,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":23.004999999999999,"5min":23.004999999999999,"15min":23.004999999999999},"last":0.44800000000000001},{"interface":"front","average":{"1min":5.7699999999999996,"5min":1.7330000000000001,"15min":1.0600000000000001},"min":{"1min":0.61499999999999999,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":18.959,"5min":18.959,"15min":18.959},"last":0.55800000000000005}]},{"osd":6,"last update":"Wed Jul 5 23:34:48 2023","interfaces":[{"interface":"back","average":{"1min":4.2370000000000001,"5min":1.429,"15min":0.96099999999999997},"min":{"1min":0.60699999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":18.923999999999999,"5min":18.923999999999999,"15min":18.923999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":5.5460000000000003,"5min":1.6539999999999999,"15min":1.006},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":18.978000000000002,"5min":18.978000000000002,"15min":18.978000000000002},"last":0.46600000000000003}]},{"osd":7,"last update":"Wed Jul 5 23:34:48 2023","interfaces":[{"interface":"back","average":{"1min":5.2569999999999997,"5min":1.585,"15min":0.97299999999999998},"min":{"1min":0.47499999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":19.937999999999999,"5min":19.937999999999999,"15min":19.937999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":5.9630000000000001,"5min":1.7749999999999999,"15min":1.077},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":22.974,"5min":22.974,"15min":22.974},"last":0.48199999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574884,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":75804,"kb_used_data":40660,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94296036,"statfs":{"total":96636764160,"available":96559140864,"internally_reserved":0,"allocated":41635840,"data_stored":41427888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 5 23:34:44 2023","interfaces":[{"interface":"back","average":{"1min":5.1120000000000001,"5min":1.4319999999999999,"15min":0.81799999999999995},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":16.655999999999999,"5min":16.655999999999999,"15min":16.655999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":5.5030000000000001,"5min":1.5149999999999999,"15min":0.85099999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":18.661999999999999,"5min":18.661999999999999,"15min":18.661999999999999},"last":0.52700000000000002}]},{"osd":1,"last update":"Wed Jul 5 23:34:44 2023","interfaces":[{"interface":"back","average":{"1min":5.3860000000000001,"5min":1.47,"15min":0.81799999999999995},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":18.991,"5min":18.991,"15min":18.991},"last":0.503},{"interface":"front","average":{"1min":7.1799999999999997,"5min":1.8400000000000001,"15min":0.94999999999999996},"min":{"1min":0.371,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":23.879000000000001,"5min":23.879000000000001,"15min":23.879000000000001},"last":0.54900000000000004}]},{"osd":2,"last update":"Wed Jul 5 23:34:44 2023","interfaces":[{"interface":"back","average":{"1min":6.8799999999999999,"5min":1.8320000000000001,"15min":0.98999999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":23.805,"5min":23.805,"15min":23.805},"last":0.53600000000000003},{"interface":"front","average":{"1min":6.1379999999999999,"5min":1.6659999999999999,"15min":0.92100000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":18.707000000000001,"5min":18.707000000000001,"15min":18.707000000000001},"last":0.434}]},{"osd":3,"last update":"Wed Jul 5 23:34:44 2023","interfaces":[{"interface":"back","average":{"1min":6.0090000000000003,"5min":1.6220000000000001,"15min":0.89100000000000001},"min":{"1min":0.373,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":22.966999999999999,"5min":22.966999999999999,"15min":22.966999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":6.0899999999999999,"5min":1.6799999999999999,"15min":0.94499999999999995},"min":{"1min":0.33800000000000002,"5min":0.314,"15min":0.314},"max":{"1min":23.843,"5min":23.843,"15min":23.843},"last":0.42199999999999999}]},{"osd":5,"last update":"Wed Jul 5 23:34:44 2023","interfaces":[{"interface":"back","average":{"1min":4.7779999999999996,"5min":1.3280000000000001,"15min":0.753},"min":{"1min":0.39500000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":16.574999999999999,"5min":16.574999999999999,"15min":16.574999999999999},"last":0.36799999999999999},{"interface":"front","average":{"1min":3.8380000000000001,"5min":1.1870000000000001,"15min":0.745},"min":{"1min":0.40100000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":18.693999999999999,"5min":18.693999999999999,"15min":18.693999999999999},"last":0.44800000000000001}]},{"osd":6,"last update":"Wed Jul 5 23:34:44 2023","interfaces":[{"interface":"back","average":{"1min":5.016,"5min":1.425,"15min":0.82699999999999996},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":17.983000000000001,"5min":17.983000000000001,"15min":17.983000000000001},"last":0.38100000000000001},{"interface":"front","average":{"1min":4.4509999999999996,"5min":1.3300000000000001,"15min":0.81000000000000005},"min":{"1min":0.44500000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":16.622,"5min":16.622,"15min":16.622},"last":0.47599999999999998}]},{"osd":7,"last update":"Wed Jul 5 23:34:44 2023","interfaces":[{"interface":"back","average":{"1min":3.9460000000000002,"5min":1.226,"15min":0.77300000000000002},"min":{"1min":0.46500000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":22.931000000000001,"5min":22.931000000000001,"15min":22.931000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":4.2030000000000003,"5min":1.3069999999999999,"15min":0.82499999999999996},"min":{"1min":0.40400000000000003,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":18.966000000000001,"5min":18.966000000000001,"15min":18.966000000000001},"last":0.46700000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574883,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":98960,"kb_used_data":63816,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94272880,"statfs":{"total":96636764160,"available":96535429120,"internally_reserved":0,"allocated":65347584,"data_stored":65151210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,3,4],"upper_bound":128},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 5 23:34:40 2023","interfaces":[{"interface":"back","average":{"1min":5.9340000000000002,"5min":1.5860000000000001,"15min":0.86099999999999999},"min":{"1min":0.42999999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":18.867999999999999,"5min":18.867999999999999,"15min":18.867999999999999},"last":0.34999999999999998},{"interface":"front","average":{"1min":4.109,"5min":1.3380000000000001,"15min":0.876},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":18.099,"5min":18.099,"15min":18.099},"last":0.27400000000000002}]},{"osd":1,"last update":"Wed Jul 5 23:34:40 2023","interfaces":[{"interface":"back","average":{"1min":3.8809999999999998,"5min":1.244,"15min":0.80400000000000005},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":18.071999999999999,"5min":18.071999999999999,"15min":18.071999999999999},"last":0.376},{"interface":"front","average":{"1min":4.7530000000000001,"5min":1.444,"15min":0.89200000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":16.869,"5min":16.869,"15min":16.869},"last":0.247}]},{"osd":2,"last update":"Wed Jul 5 23:34:40 2023","interfaces":[{"interface":"back","average":{"1min":5.4950000000000001,"5min":1.556,"15min":0.90000000000000002},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":22.177,"5min":22.177,"15min":22.177},"last":0.316},{"interface":"front","average":{"1min":5.4589999999999996,"5min":1.5589999999999999,"15min":0.90900000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":18.902999999999999,"5min":18.902999999999999,"15min":18.902999999999999},"last":0.40999999999999998}]},{"osd":3,"last update":"Wed Jul 5 23:34:40 2023","interfaces":[{"interface":"back","average":{"1min":4.3230000000000004,"5min":1.333,"15min":0.83499999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":18.032,"5min":18.032,"15min":18.032},"last":0.41899999999999998},{"interface":"front","average":{"1min":4.2400000000000002,"5min":1.399,"15min":0.92500000000000004},"min":{"1min":0.46700000000000003,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":16.905000000000001,"5min":16.905000000000001,"15min":16.905000000000001},"last":0.36399999999999999}]},{"osd":4,"last update":"Wed Jul 5 23:34:40 2023","interfaces":[{"interface":"back","average":{"1min":5.4420000000000002,"5min":1.51,"15min":0.85499999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":18.957000000000001,"5min":18.957000000000001,"15min":18.957000000000001},"last":0.29799999999999999},{"interface":"front","average":{"1min":3.6560000000000001,"5min":1.2,"15min":0.79100000000000004},"min":{"1min":0.38400000000000001,"5min":0.377,"15min":0.377},"max":{"1min":18.123999999999999,"5min":18.123999999999999,"15min":18.123999999999999},"last":0.33300000000000002}]},{"osd":6,"last update":"Wed Jul 5 23:34:40 2023","interfaces":[{"interface":"back","average":{"1min":4.1299999999999999,"5min":1.29,"15min":0.81599999999999995},"min":{"1min":0.41999999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":16.952000000000002,"5min":16.952000000000002,"15min":16.952000000000002},"last":0.42799999999999999},{"interface":"front","average":{"1min":5.1159999999999997,"5min":1.488,"15min":0.88300000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":18.928000000000001,"5min":18.928000000000001,"15min":18.928000000000001},"last":0.39000000000000001}]},{"osd":7,"last update":"Wed Jul 5 23:34:40 2023","interfaces":[{"interface":"back","average":{"1min":2.4380000000000002,"5min":0.96299999999999997,"15min":0.71699999999999997},"min":{"1min":0.40899999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":10.324999999999999,"5min":10.324999999999999,"15min":10.324999999999999},"last":0.443},{"interface":"front","average":{"1min":2.8799999999999999,"5min":1.077,"15min":0.77700000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":13.013,"5min":13.013,"15min":13.013},"last":0.39800000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":8225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1462272,"data_stored":1443154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1462272,"data_stored":1435671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":39845888,"data_stored":39845888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":41943040,"data_stored":41943040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":35651584,"data_stored":35651584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":27262976,"data_stored":27262976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":39845888,"data_stored":39845888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":35651584,"data_stored":35651584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":48234496,"data_stored":48234496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":41943040,"data_stored":41943040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-05T23:35:18.849 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-07-05T23:35:18.849 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-05T23:35:19.005 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.003+0000 7f1727a0c700 1 Processor -- start 2023-07-05T23:35:19.005 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.003+0000 7f1727a0c700 1 -- start start 2023-07-05T23:35:19.007 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.004+0000 7f1727a0c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f172015a820 0x7f17200caf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:19.007 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.004+0000 7f1727a0c700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f17200d0f80 0x7f17200ce480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:19.008 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.004+0000 7f1727a0c700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17200cfa60 con 0x7f17200d0b00 2023-07-05T23:35:19.008 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.004+0000 7f1727a0c700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1720154a80 con 0x7f172015a820 2023-07-05T23:35:19.008 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.004+0000 7f1727a0c700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17200cfd40 con 0x7f17200d0f80 2023-07-05T23:35:19.008 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.004+0000 7f17257a8700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f172015a820 0x7f17200caf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:19.009 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.004+0000 7f17257a8700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f172015a820 0x7f17200caf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46442/0 (socket says 172.21.15.27:46442) 2023-07-05T23:35:19.009 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.004+0000 7f17257a8700 1 -- 172.21.15.27:0/1895833722 learned_addr learned my addr 172.21.15.27:0/1895833722 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:19.009 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.004+0000 7f1725fa9700 1 --2- 172.21.15.27:0/1895833722 >> v2:172.21.15.162:3300/0 conn(0x7f17200d0f80 0x7f17200ce480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:19.010 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.004+0000 7f17257a8700 1 -- 172.21.15.27:0/1895833722 >> v2:172.21.15.162:3300/0 conn(0x7f17200d0f80 msgr2=0x7f17200ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:35:19.010 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.004+0000 7f17257a8700 1 --2- 172.21.15.27:0/1895833722 >> v2:172.21.15.162:3300/0 conn(0x7f17200d0f80 0x7f17200ce480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:19.010 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.004+0000 7f17257a8700 1 -- 172.21.15.27:0/1895833722 >> v1:172.21.15.162:6789/0 conn(0x7f17200d0b00 legacy=0x7f172015abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:35:19.010 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.004+0000 7f17257a8700 1 -- 172.21.15.27:0/1895833722 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17200d0020 con 0x7f172015a820 2023-07-05T23:35:19.010 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.004+0000 7f17257a8700 1 --2- 172.21.15.27:0/1895833722 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f172015a820 0x7f17200caf00 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f172006f5d0 tx=0x7f171c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2134d78ba3bc1c5 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:19.011 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.005+0000 7f1717fff700 1 -- 172.21.15.27:0/1895833722 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171c004230 con 0x7f172015a820 2023-07-05T23:35:19.011 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.005+0000 7f1717fff700 1 -- 172.21.15.27:0/1895833722 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f171c004390 con 0x7f172015a820 2023-07-05T23:35:19.011 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.005+0000 7f1717fff700 1 -- 172.21.15.27:0/1895833722 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171c0036a0 con 0x7f172015a820 2023-07-05T23:35:19.011 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.005+0000 7f1727a0c700 1 -- 172.21.15.27:0/1895833722 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f172015a820 msgr2=0x7f17200caf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:19.011 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.005+0000 7f1727a0c700 1 --2- 172.21.15.27:0/1895833722 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f172015a820 0x7f17200caf00 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f172006f5d0 tx=0x7f171c009bd0 comp rx=0 tx=0).stop 2023-07-05T23:35:19.012 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.005+0000 7f1727a0c700 1 -- 172.21.15.27:0/1895833722 shutdown_connections 2023-07-05T23:35:19.012 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.005+0000 7f1727a0c700 1 --2- 172.21.15.27:0/1895833722 >> v2:172.21.15.162:3300/0 conn(0x7f17200d0f80 0x7f17200ce480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:19.012 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.005+0000 7f1727a0c700 1 --2- 172.21.15.27:0/1895833722 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f172015a820 0x7f17200caf00 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:19.012 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.005+0000 7f1727a0c700 1 -- 172.21.15.27:0/1895833722 >> 172.21.15.27:0/1895833722 conn(0x7f172006e530 msgr2=0x7f172006e900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:19.013 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.005+0000 7f1727a0c700 1 -- 172.21.15.27:0/1895833722 shutdown_connections 2023-07-05T23:35:19.013 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.005+0000 7f1727a0c700 1 -- 172.21.15.27:0/1895833722 wait complete. 2023-07-05T23:35:19.016 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.006+0000 7f1727a0c700 1 Processor -- start 2023-07-05T23:35:19.017 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.007+0000 7f1727a0c700 1 -- start start 2023-07-05T23:35:19.017 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.007+0000 7f1727a0c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f17200d0b00 0x7f172006c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:19.017 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.007+0000 7f1727a0c700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f17200d0f80 0x7f1720152b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:19.018 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.007+0000 7f1727a0c700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f172015a820 0x7f1720158fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:19.018 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.007+0000 7f1727a0c700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f172006b000 con 0x7f17200d0b00 2023-07-05T23:35:19.018 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.007+0000 7f1727a0c700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f172006b2e0 con 0x7f17200d0f80 2023-07-05T23:35:19.018 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.007+0000 7f1727a0c700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f172006b5c0 con 0x7f172015a820 2023-07-05T23:35:19.018 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.007+0000 7f17257a8700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f17200d0b00 0x7f172006c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:19.019 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.007+0000 7f17257a8700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f17200d0b00 0x7f172006c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46448/0 (socket says 172.21.15.27:46448) 2023-07-05T23:35:19.019 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.007+0000 7f17257a8700 1 -- 172.21.15.27:0/2256536742 learned_addr learned my addr 172.21.15.27:0/2256536742 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:19.019 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.008+0000 7f1724fa7700 1 --2- 172.21.15.27:0/2256536742 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f17200d0f80 0x7f1720152b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:19.019 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.008+0000 7f1725fa9700 1 --2- 172.21.15.27:0/2256536742 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f172015a820 0x7f1720158fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:19.019 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.008+0000 7f17257a8700 1 -- 172.21.15.27:0/2256536742 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f172015a820 msgr2=0x7f1720158fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:19.020 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.008+0000 7f17257a8700 1 --2- 172.21.15.27:0/2256536742 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f172015a820 0x7f1720158fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:19.020 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.008+0000 7f17257a8700 1 -- 172.21.15.27:0/2256536742 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f17200d0f80 msgr2=0x7f1720152b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:19.020 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.008+0000 7f17257a8700 1 --2- 172.21.15.27:0/2256536742 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f17200d0f80 0x7f1720152b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:19.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.008+0000 7f17257a8700 1 -- 172.21.15.27:0/2256536742 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f171c009550 con 0x7f17200d0b00 2023-07-05T23:35:19.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.008+0000 7f17257a8700 1 --2- 172.21.15.27:0/2256536742 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f17200d0b00 0x7f172006c0a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f172006fa70 tx=0x7f171c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:19.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.008+0000 7f1715ffb700 1 -- 172.21.15.27:0/2256536742 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171c003de0 con 0x7f17200d0b00 2023-07-05T23:35:19.022 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.008+0000 7f1715ffb700 1 -- 172.21.15.27:0/2256536742 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f171c011630 con 0x7f17200d0b00 2023-07-05T23:35:19.022 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.008+0000 7f1715ffb700 1 -- 172.21.15.27:0/2256536742 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171c0119c0 con 0x7f17200d0b00 2023-07-05T23:35:19.022 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.008+0000 7f1727a0c700 1 -- 172.21.15.27:0/2256536742 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f172006b8a0 con 0x7f17200d0b00 2023-07-05T23:35:19.022 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.008+0000 7f1727a0c700 1 -- 172.21.15.27:0/2256536742 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f172006c5e0 con 0x7f17200d0b00 2023-07-05T23:35:19.022 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.009+0000 7f1727a0c700 1 -- 172.21.15.27:0/2256536742 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f172006c770 con 0x7f17200d0b00 2023-07-05T23:35:19.023 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.010+0000 7f1715ffb700 1 -- 172.21.15.27:0/2256536742 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f171c011b20 con 0x7f17200d0b00 2023-07-05T23:35:19.023 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.010+0000 7f1715ffb700 1 --2- 172.21.15.27:0/2256536742 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f170406ace0 0x7f170406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:19.023 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.010+0000 7f1715ffb700 1 -- 172.21.15.27:0/2256536742 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f171c08ad00 con 0x7f17200d0b00 2023-07-05T23:35:19.023 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.010+0000 7f1724fa7700 1 --2- 172.21.15.27:0/2256536742 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f170406ace0 0x7f170406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:19.024 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.011+0000 7f1724fa7700 1 --2- 172.21.15.27:0/2256536742 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f170406ace0 0x7f170406d190 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f17200cd860 tx=0x7f1710009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:19.024 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.015+0000 7f1715ffb700 1 -- 172.21.15.27:0/2256536742 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f171c055b10 con 0x7f17200d0b00 2023-07-05T23:35:19.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.208+0000 7f1727a0c700 1 -- 172.21.15.27:0/2256536742 --> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f17200d05e0 con 0x7f170406ace0 2023-07-05T23:35:19.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.219+0000 7f1715ffb700 1 -- 172.21.15.27:0/2256536742 <== mgr.4105 v2:172.21.15.162:6832/3790028097 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+391924 (secure 0 0 0) 0x7f1710015430 con 0x7f170406ace0 2023-07-05T23:35:19.225 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:35:19.227 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.223+0000 7f1727a0c700 1 -- 172.21.15.27:0/2256536742 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f170406ace0 msgr2=0x7f170406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:19.228 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.223+0000 7f1727a0c700 1 --2- 172.21.15.27:0/2256536742 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f170406ace0 0x7f170406d190 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f17200cd860 tx=0x7f1710009040 comp rx=0 tx=0).stop 2023-07-05T23:35:19.228 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.223+0000 7f1727a0c700 1 -- 172.21.15.27:0/2256536742 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f17200d0b00 msgr2=0x7f172006c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:19.228 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.223+0000 7f1727a0c700 1 --2- 172.21.15.27:0/2256536742 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f17200d0b00 0x7f172006c0a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f172006fa70 tx=0x7f171c004750 comp rx=0 tx=0).stop 2023-07-05T23:35:19.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.223+0000 7f1727a0c700 1 -- 172.21.15.27:0/2256536742 shutdown_connections 2023-07-05T23:35:19.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.223+0000 7f1727a0c700 1 --2- 172.21.15.27:0/2256536742 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f170406ace0 0x7f170406d190 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:19.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.223+0000 7f1727a0c700 1 --2- 172.21.15.27:0/2256536742 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f172015a820 0x7f1720158fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:19.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.223+0000 7f1727a0c700 1 --2- 172.21.15.27:0/2256536742 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f17200d0b00 0x7f172006c0a0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:19.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.223+0000 7f1727a0c700 1 --2- 172.21.15.27:0/2256536742 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f17200d0f80 0x7f1720152b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:19.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.223+0000 7f1727a0c700 1 -- 172.21.15.27:0/2256536742 >> 172.21.15.27:0/2256536742 conn(0x7f172006e530 msgr2=0x7f17200cc7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:19.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.223+0000 7f1727a0c700 1 -- 172.21.15.27:0/2256536742 shutdown_connections 2023-07-05T23:35:19.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.223+0000 7f1727a0c700 1 -- 172.21.15.27:0/2256536742 wait complete. 2023-07-05T23:35:19.231 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2023-07-05T23:35:19.237 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":102,"stamp":"2023-07-05T23:35:17.675366+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":157223512,"num_objects":62,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":130,"num_read_kb":116,"num_write":1174,"num_write_kb":1241107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17140,"ondisk_log_size":17140,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":687112,"kb_used_data":430536,"kb_used_omap":0,"kb_used_meta":256512,"kb_avail":754287608,"statfs":{"total":773094113280,"available":772390510592,"internally_reserved":0,"allocated":440868864,"data_stored":439289651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":262668288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1,0,0,0,3,4],"upper_bound":128},"perf_stat":{"commit_latency_ms":105,"apply_latency_ms":105,"commit_latency_ns":105000000,"apply_latency_ns":105000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-249284625,"num_objects":-61,"num_object_clones":0,"num_object_copies":-244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-61,"num_whiteouts":0,"num_read":10,"num_read_kb":12,"num_write":579,"num_write_kb":842061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003167"},"pg_stats":[{"pgid":"4.3f","version":"30'17","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.504698+0000","last_change":"2023-07-05T23:32:53.342316+0000","last_active":"2023-07-05T23:35:14.504698+0000","last_peered":"2023-07-05T23:35:14.504698+0000","last_clean":"2023-07-05T23:35:14.504698+0000","last_became_active":"2023-07-05T23:32:53.342061+0000","last_became_peered":"2023-07-05T23:32:53.342061+0000","last_unstale":"2023-07-05T23:35:14.504698+0000","last_undegraded":"2023-07-05T23:35:14.504698+0000","last_fullsized":"2023-07-05T23:35:14.504698+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:27:59.144444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"30'19","reported_seq":43,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.510265+0000","last_change":"2023-07-05T23:32:53.343107+0000","last_active":"2023-07-05T23:35:14.510265+0000","last_peered":"2023-07-05T23:35:14.510265+0000","last_clean":"2023-07-05T23:35:14.510265+0000","last_became_active":"2023-07-05T23:32:53.342843+0000","last_became_peered":"2023-07-05T23:32:53.342843+0000","last_unstale":"2023-07-05T23:35:14.510265+0000","last_undegraded":"2023-07-05T23:35:14.510265+0000","last_fullsized":"2023-07-05T23:35:14.510265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:34:18.782861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"30'35","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.520965+0000","last_change":"2023-07-05T23:32:53.339304+0000","last_active":"2023-07-05T23:35:14.520965+0000","last_peered":"2023-07-05T23:35:14.520965+0000","last_clean":"2023-07-05T23:35:14.520965+0000","last_became_active":"2023-07-05T23:32:53.338973+0000","last_became_peered":"2023-07-05T23:32:53.338973+0000","last_unstale":"2023-07-05T23:35:14.520965+0000","last_undegraded":"2023-07-05T23:35:14.520965+0000","last_fullsized":"2023-07-05T23:35:14.520965+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:28:30.568393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"30'17","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.504477+0000","last_change":"2023-07-05T23:32:53.334788+0000","last_active":"2023-07-05T23:35:14.504477+0000","last_peered":"2023-07-05T23:35:14.504477+0000","last_clean":"2023-07-05T23:35:14.504477+0000","last_became_active":"2023-07-05T23:32:53.334473+0000","last_became_peered":"2023-07-05T23:32:53.334473+0000","last_unstale":"2023-07-05T23:35:14.504477+0000","last_undegraded":"2023-07-05T23:35:14.504477+0000","last_fullsized":"2023-07-05T23:35:14.504477+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:32:19.839362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"30'25","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.517731+0000","last_change":"2023-07-05T23:32:53.346034+0000","last_active":"2023-07-05T23:35:14.517731+0000","last_peered":"2023-07-05T23:35:14.517731+0000","last_clean":"2023-07-05T23:35:14.517731+0000","last_became_active":"2023-07-05T23:32:53.345743+0000","last_became_peered":"2023-07-05T23:32:53.345743+0000","last_unstale":"2023-07-05T23:35:14.517731+0000","last_undegraded":"2023-07-05T23:35:14.517731+0000","last_fullsized":"2023-07-05T23:35:14.517731+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:09:06.821067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"30'27","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.514654+0000","last_change":"2023-07-05T23:32:53.335744+0000","last_active":"2023-07-05T23:35:14.514654+0000","last_peered":"2023-07-05T23:35:14.514654+0000","last_clean":"2023-07-05T23:35:14.514654+0000","last_became_active":"2023-07-05T23:32:53.335456+0000","last_became_peered":"2023-07-05T23:32:53.335456+0000","last_unstale":"2023-07-05T23:35:14.514654+0000","last_undegraded":"2023-07-05T23:35:14.514654+0000","last_fullsized":"2023-07-05T23:35:14.514654+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:29:41.800131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"30'21","reported_seq":44,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.510034+0000","last_change":"2023-07-05T23:32:53.341154+0000","last_active":"2023-07-05T23:35:14.510034+0000","last_peered":"2023-07-05T23:35:14.510034+0000","last_clean":"2023-07-05T23:35:14.510034+0000","last_became_active":"2023-07-05T23:32:53.340639+0000","last_became_peered":"2023-07-05T23:32:53.340639+0000","last_unstale":"2023-07-05T23:35:14.510034+0000","last_undegraded":"2023-07-05T23:35:14.510034+0000","last_fullsized":"2023-07-05T23:35:14.510034+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:06:29.575306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"30'24","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.514718+0000","last_change":"2023-07-05T23:32:53.336514+0000","last_active":"2023-07-05T23:35:14.514718+0000","last_peered":"2023-07-05T23:35:14.514718+0000","last_clean":"2023-07-05T23:35:14.514718+0000","last_became_active":"2023-07-05T23:32:53.336216+0000","last_became_peered":"2023-07-05T23:32:53.336216+0000","last_unstale":"2023-07-05T23:35:14.514718+0000","last_undegraded":"2023-07-05T23:35:14.514718+0000","last_fullsized":"2023-07-05T23:35:14.514718+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:09:56.721492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"30'31","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.516947+0000","last_change":"2023-07-05T23:32:53.348265+0000","last_active":"2023-07-05T23:35:14.516947+0000","last_peered":"2023-07-05T23:35:14.516947+0000","last_clean":"2023-07-05T23:35:14.516947+0000","last_became_active":"2023-07-05T23:32:53.347948+0000","last_became_peered":"2023-07-05T23:32:53.347948+0000","last_unstale":"2023-07-05T23:35:14.516947+0000","last_undegraded":"2023-07-05T23:35:14.516947+0000","last_fullsized":"2023-07-05T23:35:14.516947+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:30:02.990759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"30'36","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.518332+0000","last_change":"2023-07-05T23:32:53.330422+0000","last_active":"2023-07-05T23:35:14.518332+0000","last_peered":"2023-07-05T23:35:14.518332+0000","last_clean":"2023-07-05T23:35:14.518332+0000","last_became_active":"2023-07-05T23:32:53.330135+0000","last_became_peered":"2023-07-05T23:32:53.330135+0000","last_unstale":"2023-07-05T23:35:14.518332+0000","last_undegraded":"2023-07-05T23:35:14.518332+0000","last_fullsized":"2023-07-05T23:35:14.518332+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:32:03.040658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"30'21","reported_seq":44,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.521160+0000","last_change":"2023-07-05T23:32:53.341815+0000","last_active":"2023-07-05T23:35:14.521160+0000","last_peered":"2023-07-05T23:35:14.521160+0000","last_clean":"2023-07-05T23:35:14.521160+0000","last_became_active":"2023-07-05T23:32:53.341526+0000","last_became_peered":"2023-07-05T23:32:53.341526+0000","last_unstale":"2023-07-05T23:35:14.521160+0000","last_undegraded":"2023-07-05T23:35:14.521160+0000","last_fullsized":"2023-07-05T23:35:14.521160+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:28:47.019912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"30'21","reported_seq":44,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.522342+0000","last_change":"2023-07-05T23:32:53.337552+0000","last_active":"2023-07-05T23:35:14.522342+0000","last_peered":"2023-07-05T23:35:14.522342+0000","last_clean":"2023-07-05T23:35:14.522342+0000","last_became_active":"2023-07-05T23:32:53.337279+0000","last_became_peered":"2023-07-05T23:32:53.337279+0000","last_unstale":"2023-07-05T23:35:14.522342+0000","last_undegraded":"2023-07-05T23:35:14.522342+0000","last_fullsized":"2023-07-05T23:35:14.522342+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:24:31.034513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"30'26","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.505213+0000","last_change":"2023-07-05T23:32:53.336366+0000","last_active":"2023-07-05T23:35:14.505213+0000","last_peered":"2023-07-05T23:35:14.505213+0000","last_clean":"2023-07-05T23:35:14.505213+0000","last_became_active":"2023-07-05T23:32:53.336083+0000","last_became_peered":"2023-07-05T23:32:53.336083+0000","last_unstale":"2023-07-05T23:35:14.505213+0000","last_undegraded":"2023-07-05T23:35:14.505213+0000","last_fullsized":"2023-07-05T23:35:14.505213+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:32:24.944898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"30'23","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.509476+0000","last_change":"2023-07-05T23:32:53.328235+0000","last_active":"2023-07-05T23:35:14.509476+0000","last_peered":"2023-07-05T23:35:14.509476+0000","last_clean":"2023-07-05T23:35:14.509476+0000","last_became_active":"2023-07-05T23:32:53.327918+0000","last_became_peered":"2023-07-05T23:32:53.327918+0000","last_unstale":"2023-07-05T23:35:14.509476+0000","last_undegraded":"2023-07-05T23:35:14.509476+0000","last_fullsized":"2023-07-05T23:35:14.509476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:00:42.415370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"30'25","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.510439+0000","last_change":"2023-07-05T23:32:53.340929+0000","last_active":"2023-07-05T23:35:14.510439+0000","last_peered":"2023-07-05T23:35:14.510439+0000","last_clean":"2023-07-05T23:35:14.510439+0000","last_became_active":"2023-07-05T23:32:53.340246+0000","last_became_peered":"2023-07-05T23:32:53.340246+0000","last_unstale":"2023-07-05T23:35:14.510439+0000","last_undegraded":"2023-07-05T23:35:14.510439+0000","last_fullsized":"2023-07-05T23:35:14.510439+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:48:30.276766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"30'31","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.520820+0000","last_change":"2023-07-05T23:32:53.336278+0000","last_active":"2023-07-05T23:35:14.520820+0000","last_peered":"2023-07-05T23:35:14.520820+0000","last_clean":"2023-07-05T23:35:14.520820+0000","last_became_active":"2023-07-05T23:32:53.336006+0000","last_became_peered":"2023-07-05T23:32:53.336006+0000","last_unstale":"2023-07-05T23:35:14.520820+0000","last_undegraded":"2023-07-05T23:35:14.520820+0000","last_fullsized":"2023-07-05T23:35:14.520820+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:28:30.623573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"30'26","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.517502+0000","last_change":"2023-07-05T23:32:53.346115+0000","last_active":"2023-07-05T23:35:14.517502+0000","last_peered":"2023-07-05T23:35:14.517502+0000","last_clean":"2023-07-05T23:35:14.517502+0000","last_became_active":"2023-07-05T23:32:53.345848+0000","last_became_peered":"2023-07-05T23:32:53.345848+0000","last_unstale":"2023-07-05T23:35:14.517502+0000","last_undegraded":"2023-07-05T23:35:14.517502+0000","last_fullsized":"2023-07-05T23:35:14.517502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:27:22.570990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"30'23","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.520608+0000","last_change":"2023-07-05T23:32:53.339001+0000","last_active":"2023-07-05T23:35:14.520608+0000","last_peered":"2023-07-05T23:35:14.520608+0000","last_clean":"2023-07-05T23:35:14.520608+0000","last_became_active":"2023-07-05T23:32:53.335535+0000","last_became_peered":"2023-07-05T23:32:53.335535+0000","last_unstale":"2023-07-05T23:35:14.520608+0000","last_undegraded":"2023-07-05T23:35:14.520608+0000","last_fullsized":"2023-07-05T23:35:14.520608+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:40:11.653019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"30'22","reported_seq":46,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.504890+0000","last_change":"2023-07-05T23:32:53.338403+0000","last_active":"2023-07-05T23:35:14.504890+0000","last_peered":"2023-07-05T23:35:14.504890+0000","last_clean":"2023-07-05T23:35:14.504890+0000","last_became_active":"2023-07-05T23:32:53.338095+0000","last_became_peered":"2023-07-05T23:32:53.338095+0000","last_unstale":"2023-07-05T23:35:14.504890+0000","last_undegraded":"2023-07-05T23:35:14.504890+0000","last_fullsized":"2023-07-05T23:35:14.504890+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:52:25.342366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"30'25","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.521479+0000","last_change":"2023-07-05T23:32:53.341961+0000","last_active":"2023-07-05T23:35:14.521479+0000","last_peered":"2023-07-05T23:35:14.521479+0000","last_clean":"2023-07-05T23:35:14.521479+0000","last_became_active":"2023-07-05T23:32:53.341783+0000","last_became_peered":"2023-07-05T23:32:53.341783+0000","last_unstale":"2023-07-05T23:35:14.521479+0000","last_undegraded":"2023-07-05T23:35:14.521479+0000","last_fullsized":"2023-07-05T23:35:14.521479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:42:23.689201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"30'33","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.505439+0000","last_change":"2023-07-05T23:32:53.348405+0000","last_active":"2023-07-05T23:35:14.505439+0000","last_peered":"2023-07-05T23:35:14.505439+0000","last_clean":"2023-07-05T23:35:14.505439+0000","last_became_active":"2023-07-05T23:32:53.348108+0000","last_became_peered":"2023-07-05T23:32:53.348108+0000","last_unstale":"2023-07-05T23:35:14.505439+0000","last_undegraded":"2023-07-05T23:35:14.505439+0000","last_fullsized":"2023-07-05T23:35:14.505439+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:09:56.721492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"30'24","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.512155+0000","last_change":"2023-07-05T23:32:53.340963+0000","last_active":"2023-07-05T23:35:14.512155+0000","last_peered":"2023-07-05T23:35:14.512155+0000","last_clean":"2023-07-05T23:35:14.512155+0000","last_became_active":"2023-07-05T23:32:53.340698+0000","last_became_peered":"2023-07-05T23:32:53.340698+0000","last_unstale":"2023-07-05T23:35:14.512155+0000","last_undegraded":"2023-07-05T23:35:14.512155+0000","last_fullsized":"2023-07-05T23:35:14.512155+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:34:43.735212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"30'28","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.510476+0000","last_change":"2023-07-05T23:32:53.345981+0000","last_active":"2023-07-05T23:35:14.510476+0000","last_peered":"2023-07-05T23:35:14.510476+0000","last_clean":"2023-07-05T23:35:14.510476+0000","last_became_active":"2023-07-05T23:32:53.345403+0000","last_became_peered":"2023-07-05T23:32:53.345403+0000","last_unstale":"2023-07-05T23:35:14.510476+0000","last_undegraded":"2023-07-05T23:35:14.510476+0000","last_fullsized":"2023-07-05T23:35:14.510476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:09:56.721492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"30'20","reported_seq":44,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.509712+0000","last_change":"2023-07-05T23:32:53.348335+0000","last_active":"2023-07-05T23:35:14.509712+0000","last_peered":"2023-07-05T23:35:14.509712+0000","last_clean":"2023-07-05T23:35:14.509712+0000","last_became_active":"2023-07-05T23:32:53.348053+0000","last_became_peered":"2023-07-05T23:32:53.348053+0000","last_unstale":"2023-07-05T23:35:14.509712+0000","last_undegraded":"2023-07-05T23:35:14.509712+0000","last_fullsized":"2023-07-05T23:35:14.509712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:03:45.831512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"30'19","reported_seq":43,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.505480+0000","last_change":"2023-07-05T23:32:53.339227+0000","last_active":"2023-07-05T23:35:14.505480+0000","last_peered":"2023-07-05T23:35:14.505480+0000","last_clean":"2023-07-05T23:35:14.505480+0000","last_became_active":"2023-07-05T23:32:53.338935+0000","last_became_peered":"2023-07-05T23:32:53.338935+0000","last_unstale":"2023-07-05T23:35:14.505480+0000","last_undegraded":"2023-07-05T23:35:14.505480+0000","last_fullsized":"2023-07-05T23:35:14.505480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:38:49.816055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"30'32","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.506682+0000","last_change":"2023-07-05T23:33:34.898632+0000","last_active":"2023-07-05T23:35:14.506682+0000","last_peered":"2023-07-05T23:35:14.506682+0000","last_clean":"2023-07-05T23:35:14.506682+0000","last_became_active":"2023-07-05T23:33:34.898383+0000","last_became_peered":"2023-07-05T23:33:34.898383+0000","last_unstale":"2023-07-05T23:35:14.506682+0000","last_undegraded":"2023-07-05T23:35:14.506682+0000","last_fullsized":"2023-07-05T23:35:14.506682+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:19:45.125125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.25","version":"30'21","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.510795+0000","last_change":"2023-07-05T23:32:53.336623+0000","last_active":"2023-07-05T23:35:14.510795+0000","last_peered":"2023-07-05T23:35:14.510795+0000","last_clean":"2023-07-05T23:35:14.510795+0000","last_became_active":"2023-07-05T23:32:53.335857+0000","last_became_peered":"2023-07-05T23:32:53.335857+0000","last_unstale":"2023-07-05T23:35:14.510795+0000","last_undegraded":"2023-07-05T23:35:14.510795+0000","last_fullsized":"2023-07-05T23:35:14.510795+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:53:37.219658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"30'478","reported_seq":495,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:13.488796+0000","last_change":"2023-07-05T23:32:57.365825+0000","last_active":"2023-07-05T23:35:13.488796+0000","last_peered":"2023-07-05T23:35:13.488796+0000","last_clean":"2023-07-05T23:35:13.488796+0000","last_became_active":"2023-07-05T23:32:57.365409+0000","last_became_peered":"2023-07-05T23:32:57.365409+0000","last_unstale":"2023-07-05T23:35:13.488796+0000","last_undegraded":"2023-07-05T23:35:13.488796+0000","last_fullsized":"2023-07-05T23:35:13.488796+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:43:38.161766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.205650+0000","last_change":"2023-07-05T23:32:52.901348+0000","last_active":"2023-07-05T23:33:35.205650+0000","last_peered":"2023-07-05T23:33:35.205650+0000","last_clean":"2023-07-05T23:33:35.205650+0000","last_became_active":"2023-07-05T23:32:52.901080+0000","last_became_peered":"2023-07-05T23:32:52.901080+0000","last_unstale":"2023-07-05T23:33:35.205650+0000","last_undegraded":"2023-07-05T23:33:35.205650+0000","last_fullsized":"2023-07-05T23:33:35.205650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:43:25.294641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'32","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.507557+0000","last_change":"2023-07-05T23:32:53.339739+0000","last_active":"2023-07-05T23:35:14.507557+0000","last_peered":"2023-07-05T23:35:14.507557+0000","last_clean":"2023-07-05T23:35:14.507557+0000","last_became_active":"2023-07-05T23:32:53.339464+0000","last_became_peered":"2023-07-05T23:32:53.339464+0000","last_unstale":"2023-07-05T23:35:14.507557+0000","last_undegraded":"2023-07-05T23:35:14.507557+0000","last_fullsized":"2023-07-05T23:35:14.507557+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:53:37.219658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"30'446","reported_seq":464,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:13.540073+0000","last_change":"2023-07-05T23:32:57.354002+0000","last_active":"2023-07-05T23:35:13.540073+0000","last_peered":"2023-07-05T23:35:13.540073+0000","last_clean":"2023-07-05T23:35:13.540073+0000","last_became_active":"2023-07-05T23:32:57.353465+0000","last_became_peered":"2023-07-05T23:32:57.353465+0000","last_unstale":"2023-07-05T23:35:13.540073+0000","last_undegraded":"2023-07-05T23:35:13.540073+0000","last_fullsized":"2023-07-05T23:35:13.540073+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:14:15.951550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.228609+0000","last_change":"2023-07-05T23:32:52.909685+0000","last_active":"2023-07-05T23:33:35.228609+0000","last_peered":"2023-07-05T23:33:35.228609+0000","last_clean":"2023-07-05T23:33:35.228609+0000","last_became_active":"2023-07-05T23:32:52.909347+0000","last_became_peered":"2023-07-05T23:32:52.909347+0000","last_unstale":"2023-07-05T23:33:35.228609+0000","last_undegraded":"2023-07-05T23:33:35.228609+0000","last_fullsized":"2023-07-05T23:33:35.228609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:06:28.570968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"30'21","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.510356+0000","last_change":"2023-07-05T23:32:53.339219+0000","last_active":"2023-07-05T23:35:14.510356+0000","last_peered":"2023-07-05T23:35:14.510356+0000","last_clean":"2023-07-05T23:35:14.510356+0000","last_became_active":"2023-07-05T23:32:53.338825+0000","last_became_peered":"2023-07-05T23:32:53.338825+0000","last_unstale":"2023-07-05T23:35:14.510356+0000","last_undegraded":"2023-07-05T23:35:14.510356+0000","last_fullsized":"2023-07-05T23:35:14.510356+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:09:56.721492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"30'460","reported_seq":478,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:13.557186+0000","last_change":"2023-07-05T23:32:57.359406+0000","last_active":"2023-07-05T23:35:13.557186+0000","last_peered":"2023-07-05T23:35:13.557186+0000","last_clean":"2023-07-05T23:35:13.557186+0000","last_became_active":"2023-07-05T23:32:57.358965+0000","last_became_peered":"2023-07-05T23:32:57.358965+0000","last_unstale":"2023-07-05T23:35:13.557186+0000","last_undegraded":"2023-07-05T23:35:13.557186+0000","last_fullsized":"2023-07-05T23:35:13.557186+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:00:45.855064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"30'1","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.230210+0000","last_change":"2023-07-05T23:32:52.909226+0000","last_active":"2023-07-05T23:33:35.230210+0000","last_peered":"2023-07-05T23:33:35.230210+0000","last_clean":"2023-07-05T23:33:35.230210+0000","last_became_active":"2023-07-05T23:32:52.908756+0000","last_became_peered":"2023-07-05T23:32:52.908756+0000","last_unstale":"2023-07-05T23:33:35.230210+0000","last_undegraded":"2023-07-05T23:33:35.230210+0000","last_fullsized":"2023-07-05T23:33:35.230210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:11:59.892651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"30'20","reported_seq":44,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.500303+0000","last_change":"2023-07-05T23:32:53.337872+0000","last_active":"2023-07-05T23:35:14.500303+0000","last_peered":"2023-07-05T23:35:14.500303+0000","last_clean":"2023-07-05T23:35:14.500303+0000","last_became_active":"2023-07-05T23:32:53.337480+0000","last_became_peered":"2023-07-05T23:32:53.337480+0000","last_unstale":"2023-07-05T23:35:14.500303+0000","last_undegraded":"2023-07-05T23:35:14.500303+0000","last_fullsized":"2023-07-05T23:35:14.500303+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:19:33.519319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"30'473","reported_seq":490,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:13.537060+0000","last_change":"2023-07-05T23:32:57.356296+0000","last_active":"2023-07-05T23:35:13.537060+0000","last_peered":"2023-07-05T23:35:13.537060+0000","last_clean":"2023-07-05T23:35:13.537060+0000","last_became_active":"2023-07-05T23:32:57.355940+0000","last_became_peered":"2023-07-05T23:32:57.355940+0000","last_unstale":"2023-07-05T23:35:13.537060+0000","last_undegraded":"2023-07-05T23:35:13.537060+0000","last_fullsized":"2023-07-05T23:35:13.537060+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:37:49.101240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"30'1","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.229859+0000","last_change":"2023-07-05T23:32:52.904533+0000","last_active":"2023-07-05T23:33:35.229859+0000","last_peered":"2023-07-05T23:33:35.229859+0000","last_clean":"2023-07-05T23:33:35.229859+0000","last_became_active":"2023-07-05T23:32:52.904140+0000","last_became_peered":"2023-07-05T23:32:52.904140+0000","last_unstale":"2023-07-05T23:33:35.229859+0000","last_undegraded":"2023-07-05T23:33:35.229859+0000","last_fullsized":"2023-07-05T23:33:35.229859+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:47:23.267517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"30'19","reported_seq":43,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.508009+0000","last_change":"2023-07-05T23:32:53.338517+0000","last_active":"2023-07-05T23:35:14.508009+0000","last_peered":"2023-07-05T23:35:14.508009+0000","last_clean":"2023-07-05T23:35:14.508009+0000","last_became_active":"2023-07-05T23:32:53.338248+0000","last_became_peered":"2023-07-05T23:32:53.338248+0000","last_unstale":"2023-07-05T23:35:14.508009+0000","last_undegraded":"2023-07-05T23:35:14.508009+0000","last_fullsized":"2023-07-05T23:35:14.508009+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:27:22.570990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"30'451","reported_seq":468,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:15.486573+0000","last_change":"2023-07-05T23:32:57.357483+0000","last_active":"2023-07-05T23:35:15.486573+0000","last_peered":"2023-07-05T23:35:15.486573+0000","last_clean":"2023-07-05T23:35:15.486573+0000","last_became_active":"2023-07-05T23:32:57.357039+0000","last_became_peered":"2023-07-05T23:32:57.357039+0000","last_unstale":"2023-07-05T23:35:15.486573+0000","last_undegraded":"2023-07-05T23:35:15.486573+0000","last_fullsized":"2023-07-05T23:35:15.486573+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:34:47.174905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:34.897995+0000","last_change":"2023-07-05T23:32:52.900665+0000","last_active":"2023-07-05T23:33:34.897995+0000","last_peered":"2023-07-05T23:33:34.897995+0000","last_clean":"2023-07-05T23:33:34.897995+0000","last_became_active":"2023-07-05T23:32:52.900352+0000","last_became_peered":"2023-07-05T23:32:52.900352+0000","last_unstale":"2023-07-05T23:33:34.897995+0000","last_undegraded":"2023-07-05T23:33:34.897995+0000","last_fullsized":"2023-07-05T23:33:34.897995+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:30:46.205291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"30'26","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.515920+0000","last_change":"2023-07-05T23:32:53.346621+0000","last_active":"2023-07-05T23:35:14.515920+0000","last_peered":"2023-07-05T23:35:14.515920+0000","last_clean":"2023-07-05T23:35:14.515920+0000","last_became_active":"2023-07-05T23:32:53.346373+0000","last_became_peered":"2023-07-05T23:32:53.346373+0000","last_unstale":"2023-07-05T23:35:14.515920+0000","last_undegraded":"2023-07-05T23:35:14.515920+0000","last_fullsized":"2023-07-05T23:35:14.515920+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:19:45.125125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"30'482","reported_seq":499,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:13.529931+0000","last_change":"2023-07-05T23:32:57.365669+0000","last_active":"2023-07-05T23:35:13.529931+0000","last_peered":"2023-07-05T23:35:13.529931+0000","last_clean":"2023-07-05T23:35:13.529931+0000","last_became_active":"2023-07-05T23:32:57.365200+0000","last_became_peered":"2023-07-05T23:32:57.365200+0000","last_unstale":"2023-07-05T23:35:13.529931+0000","last_undegraded":"2023-07-05T23:35:13.529931+0000","last_fullsized":"2023-07-05T23:35:13.529931+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:29:56.164375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"30'12","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:13.572510+0000","last_change":"2023-07-05T23:32:52.913055+0000","last_active":"2023-07-05T23:35:13.572510+0000","last_peered":"2023-07-05T23:35:13.572510+0000","last_clean":"2023-07-05T23:35:13.572510+0000","last_became_active":"2023-07-05T23:32:52.912749+0000","last_became_peered":"2023-07-05T23:32:52.912749+0000","last_unstale":"2023-07-05T23:35:13.572510+0000","last_undegraded":"2023-07-05T23:35:13.572510+0000","last_fullsized":"2023-07-05T23:35:13.572510+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:30:01.986422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"30'33","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.506424+0000","last_change":"2023-07-05T23:32:53.339331+0000","last_active":"2023-07-05T23:35:14.506424+0000","last_peered":"2023-07-05T23:35:14.506424+0000","last_clean":"2023-07-05T23:35:14.506424+0000","last_became_active":"2023-07-05T23:32:53.339001+0000","last_became_peered":"2023-07-05T23:32:53.339001+0000","last_unstale":"2023-07-05T23:35:14.506424+0000","last_undegraded":"2023-07-05T23:35:14.506424+0000","last_fullsized":"2023-07-05T23:35:14.506424+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:55:46.508107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"30'473","reported_seq":490,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:13.539863+0000","last_change":"2023-07-05T23:32:57.354307+0000","last_active":"2023-07-05T23:35:13.539863+0000","last_peered":"2023-07-05T23:35:13.539863+0000","last_clean":"2023-07-05T23:35:13.539863+0000","last_became_active":"2023-07-05T23:32:57.353848+0000","last_became_peered":"2023-07-05T23:32:57.353848+0000","last_unstale":"2023-07-05T23:35:13.539863+0000","last_undegraded":"2023-07-05T23:35:13.539863+0000","last_fullsized":"2023-07-05T23:35:13.539863+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:13:40.247704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"30'357","reported_seq":383,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.523946+0000","last_change":"2023-07-05T23:32:52.904627+0000","last_active":"2023-07-05T23:35:14.523946+0000","last_peered":"2023-07-05T23:35:14.523946+0000","last_clean":"2023-07-05T23:35:14.523946+0000","last_became_active":"2023-07-05T23:32:52.904318+0000","last_became_peered":"2023-07-05T23:32:52.904318+0000","last_unstale":"2023-07-05T23:35:14.523946+0000","last_undegraded":"2023-07-05T23:35:14.523946+0000","last_fullsized":"2023-07-05T23:35:14.523946+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:14:59.460164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1435455,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":356,"num_write_kb":1651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"30'31","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.521545+0000","last_change":"2023-07-05T23:32:53.339884+0000","last_active":"2023-07-05T23:35:14.521545+0000","last_peered":"2023-07-05T23:35:14.521545+0000","last_clean":"2023-07-05T23:35:14.521545+0000","last_became_active":"2023-07-05T23:32:53.339583+0000","last_became_peered":"2023-07-05T23:32:53.339583+0000","last_unstale":"2023-07-05T23:35:14.521545+0000","last_undegraded":"2023-07-05T23:35:14.521545+0000","last_fullsized":"2023-07-05T23:35:14.521545+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:41:33.847577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"30'438","reported_seq":455,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:11.489691+0000","last_change":"2023-07-05T23:32:57.365703+0000","last_active":"2023-07-05T23:35:11.489691+0000","last_peered":"2023-07-05T23:35:11.489691+0000","last_clean":"2023-07-05T23:35:11.489691+0000","last_became_active":"2023-07-05T23:32:57.365204+0000","last_became_peered":"2023-07-05T23:32:57.365204+0000","last_unstale":"2023-07-05T23:35:11.489691+0000","last_undegraded":"2023-07-05T23:35:11.489691+0000","last_fullsized":"2023-07-05T23:35:11.489691+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:10:37.483135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"30'3","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:06.836727+0000","last_change":"2023-07-05T23:32:52.908276+0000","last_active":"2023-07-05T23:35:06.836727+0000","last_peered":"2023-07-05T23:35:06.836727+0000","last_clean":"2023-07-05T23:35:06.836727+0000","last_became_active":"2023-07-05T23:32:52.907970+0000","last_became_peered":"2023-07-05T23:32:52.907970+0000","last_unstale":"2023-07-05T23:35:06.836727+0000","last_undegraded":"2023-07-05T23:35:06.836727+0000","last_fullsized":"2023-07-05T23:35:06.836727+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:09:05.816729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"30'23","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.508678+0000","last_change":"2023-07-05T23:32:53.340093+0000","last_active":"2023-07-05T23:35:14.508678+0000","last_peered":"2023-07-05T23:35:14.508678+0000","last_clean":"2023-07-05T23:35:14.508678+0000","last_became_active":"2023-07-05T23:32:53.339827+0000","last_became_peered":"2023-07-05T23:32:53.339827+0000","last_unstale":"2023-07-05T23:35:14.508678+0000","last_undegraded":"2023-07-05T23:35:14.508678+0000","last_fullsized":"2023-07-05T23:35:14.508678+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:10:34.043441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"30'469","reported_seq":486,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:13.536188+0000","last_change":"2023-07-05T23:32:57.354664+0000","last_active":"2023-07-05T23:35:13.536188+0000","last_peered":"2023-07-05T23:35:13.536188+0000","last_clean":"2023-07-05T23:35:13.536188+0000","last_became_active":"2023-07-05T23:32:57.354235+0000","last_became_peered":"2023-07-05T23:32:57.354235+0000","last_unstale":"2023-07-05T23:35:13.536188+0000","last_undegraded":"2023-07-05T23:35:13.536188+0000","last_fullsized":"2023-07-05T23:35:13.536188+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:35:51.306550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.228314+0000","last_change":"2023-07-05T23:32:52.900677+0000","last_active":"2023-07-05T23:33:35.228314+0000","last_peered":"2023-07-05T23:33:35.228314+0000","last_clean":"2023-07-05T23:33:35.228314+0000","last_became_active":"2023-07-05T23:32:52.900387+0000","last_became_peered":"2023-07-05T23:32:52.900387+0000","last_unstale":"2023-07-05T23:33:35.228314+0000","last_undegraded":"2023-07-05T23:33:35.228314+0000","last_fullsized":"2023-07-05T23:33:35.228314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:02:05.581169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"30'25","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.510890+0000","last_change":"2023-07-05T23:32:53.335865+0000","last_active":"2023-07-05T23:35:14.510890+0000","last_peered":"2023-07-05T23:35:14.510890+0000","last_clean":"2023-07-05T23:35:14.510890+0000","last_became_active":"2023-07-05T23:32:53.335513+0000","last_became_peered":"2023-07-05T23:32:53.335513+0000","last_unstale":"2023-07-05T23:35:14.510890+0000","last_undegraded":"2023-07-05T23:35:14.510890+0000","last_fullsized":"2023-07-05T23:35:14.510890+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:29:52.724682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"30'450","reported_seq":467,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:13.488697+0000","last_change":"2023-07-05T23:32:57.362840+0000","last_active":"2023-07-05T23:35:13.488697+0000","last_peered":"2023-07-05T23:35:13.488697+0000","last_clean":"2023-07-05T23:35:13.488697+0000","last_became_active":"2023-07-05T23:32:57.362407+0000","last_became_peered":"2023-07-05T23:32:57.362407+0000","last_unstale":"2023-07-05T23:35:13.488697+0000","last_undegraded":"2023-07-05T23:35:13.488697+0000","last_fullsized":"2023-07-05T23:35:13.488697+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:30:50.649322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"30'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:06.833400+0000","last_change":"2023-07-05T23:32:52.905899+0000","last_active":"2023-07-05T23:35:06.833400+0000","last_peered":"2023-07-05T23:35:06.833400+0000","last_clean":"2023-07-05T23:35:06.833400+0000","last_became_active":"2023-07-05T23:32:52.905595+0000","last_became_peered":"2023-07-05T23:32:52.905595+0000","last_unstale":"2023-07-05T23:35:06.833400+0000","last_undegraded":"2023-07-05T23:35:06.833400+0000","last_fullsized":"2023-07-05T23:35:06.833400+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:55:45.503769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"30'26","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.516579+0000","last_change":"2023-07-05T23:32:53.342284+0000","last_active":"2023-07-05T23:35:14.516579+0000","last_peered":"2023-07-05T23:35:14.516579+0000","last_clean":"2023-07-05T23:35:14.516579+0000","last_became_active":"2023-07-05T23:32:53.342033+0000","last_became_peered":"2023-07-05T23:32:53.342033+0000","last_unstale":"2023-07-05T23:35:14.516579+0000","last_undegraded":"2023-07-05T23:35:14.516579+0000","last_fullsized":"2023-07-05T23:35:14.516579+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:19:45.125125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"30'490","reported_seq":507,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:13.525283+0000","last_change":"2023-07-05T23:32:57.360505+0000","last_active":"2023-07-05T23:35:13.525283+0000","last_peered":"2023-07-05T23:35:13.525283+0000","last_clean":"2023-07-05T23:35:13.525283+0000","last_became_active":"2023-07-05T23:32:57.359532+0000","last_became_peered":"2023-07-05T23:32:57.359532+0000","last_unstale":"2023-07-05T23:35:13.525283+0000","last_undegraded":"2023-07-05T23:35:13.525283+0000","last_fullsized":"2023-07-05T23:35:13.525283+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:48:54.916611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":41984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.228388+0000","last_change":"2023-07-05T23:32:52.903656+0000","last_active":"2023-07-05T23:33:35.228388+0000","last_peered":"2023-07-05T23:33:35.228388+0000","last_clean":"2023-07-05T23:33:35.228388+0000","last_became_active":"2023-07-05T23:32:52.903419+0000","last_became_peered":"2023-07-05T23:32:52.903419+0000","last_unstale":"2023-07-05T23:33:35.228388+0000","last_undegraded":"2023-07-05T23:33:35.228388+0000","last_fullsized":"2023-07-05T23:33:35.228388+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:32:23.940560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"30'26","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.513247+0000","last_change":"2023-07-05T23:32:53.341509+0000","last_active":"2023-07-05T23:35:14.513247+0000","last_peered":"2023-07-05T23:35:14.513247+0000","last_clean":"2023-07-05T23:35:14.513247+0000","last_became_active":"2023-07-05T23:32:53.341162+0000","last_became_peered":"2023-07-05T23:32:53.341162+0000","last_unstale":"2023-07-05T23:35:14.513247+0000","last_undegraded":"2023-07-05T23:35:14.513247+0000","last_fullsized":"2023-07-05T23:35:14.513247+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:34:18.782861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"30'444","reported_seq":462,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:15.488893+0000","last_change":"2023-07-05T23:32:57.358009+0000","last_active":"2023-07-05T23:35:15.488893+0000","last_peered":"2023-07-05T23:35:15.488893+0000","last_clean":"2023-07-05T23:35:15.488893+0000","last_became_active":"2023-07-05T23:32:57.357082+0000","last_became_peered":"2023-07-05T23:32:57.357082+0000","last_unstale":"2023-07-05T23:35:15.488893+0000","last_undegraded":"2023-07-05T23:35:15.488893+0000","last_fullsized":"2023-07-05T23:35:15.488893+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:37:40.938898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.011998+0000","last_change":"2023-07-05T23:32:52.907916+0000","last_active":"2023-07-05T23:33:35.011998+0000","last_peered":"2023-07-05T23:33:35.011998+0000","last_clean":"2023-07-05T23:33:35.011998+0000","last_became_active":"2023-07-05T23:32:52.907397+0000","last_became_peered":"2023-07-05T23:32:52.907397+0000","last_unstale":"2023-07-05T23:33:35.011998+0000","last_undegraded":"2023-07-05T23:33:35.011998+0000","last_fullsized":"2023-07-05T23:33:35.011998+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:34:31.075112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"30'22","reported_seq":46,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.505088+0000","last_change":"2023-07-05T23:32:53.334487+0000","last_active":"2023-07-05T23:35:14.505088+0000","last_peered":"2023-07-05T23:35:14.505088+0000","last_clean":"2023-07-05T23:35:14.505088+0000","last_became_active":"2023-07-05T23:32:53.333978+0000","last_became_peered":"2023-07-05T23:32:53.333978+0000","last_unstale":"2023-07-05T23:35:14.505088+0000","last_undegraded":"2023-07-05T23:35:14.505088+0000","last_fullsized":"2023-07-05T23:35:14.505088+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:09:06.821067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"30'423","reported_seq":441,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:15.493883+0000","last_change":"2023-07-05T23:32:57.362413+0000","last_active":"2023-07-05T23:35:15.493883+0000","last_peered":"2023-07-05T23:35:15.493883+0000","last_clean":"2023-07-05T23:35:15.493883+0000","last_became_active":"2023-07-05T23:32:57.361892+0000","last_became_peered":"2023-07-05T23:32:57.361892+0000","last_unstale":"2023-07-05T23:35:15.493883+0000","last_undegraded":"2023-07-05T23:35:15.493883+0000","last_fullsized":"2023-07-05T23:35:15.493883+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:23:07.824943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.011790+0000","last_change":"2023-07-05T23:32:52.908261+0000","last_active":"2023-07-05T23:33:35.011790+0000","last_peered":"2023-07-05T23:33:35.011790+0000","last_clean":"2023-07-05T23:33:35.011790+0000","last_became_active":"2023-07-05T23:32:52.907975+0000","last_became_peered":"2023-07-05T23:32:52.907975+0000","last_unstale":"2023-07-05T23:33:35.011790+0000","last_undegraded":"2023-07-05T23:33:35.011790+0000","last_fullsized":"2023-07-05T23:33:35.011790+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:27:21.566652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"30'20","reported_seq":44,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.520367+0000","last_change":"2023-07-05T23:32:53.339917+0000","last_active":"2023-07-05T23:35:14.520367+0000","last_peered":"2023-07-05T23:35:14.520367+0000","last_clean":"2023-07-05T23:35:14.520367+0000","last_became_active":"2023-07-05T23:32:53.339543+0000","last_became_peered":"2023-07-05T23:32:53.339543+0000","last_unstale":"2023-07-05T23:35:14.520367+0000","last_undegraded":"2023-07-05T23:35:14.520367+0000","last_fullsized":"2023-07-05T23:35:14.520367+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:49:46.894720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"30'469","reported_seq":487,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:15.500248+0000","last_change":"2023-07-05T23:32:57.361110+0000","last_active":"2023-07-05T23:35:15.500248+0000","last_peered":"2023-07-05T23:35:15.500248+0000","last_clean":"2023-07-05T23:35:15.500248+0000","last_became_active":"2023-07-05T23:32:57.360614+0000","last_became_peered":"2023-07-05T23:32:57.360614+0000","last_unstale":"2023-07-05T23:35:15.500248+0000","last_undegraded":"2023-07-05T23:35:15.500248+0000","last_fullsized":"2023-07-05T23:35:15.500248+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:11:32.788099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.011936+0000","last_change":"2023-07-05T23:32:52.907840+0000","last_active":"2023-07-05T23:33:35.011936+0000","last_peered":"2023-07-05T23:33:35.011936+0000","last_clean":"2023-07-05T23:33:35.011936+0000","last_became_active":"2023-07-05T23:32:52.907441+0000","last_became_peered":"2023-07-05T23:32:52.907441+0000","last_unstale":"2023-07-05T23:33:35.011936+0000","last_undegraded":"2023-07-05T23:33:35.011936+0000","last_fullsized":"2023-07-05T23:33:35.011936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:55:01.034913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"30'26","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.508688+0000","last_change":"2023-07-05T23:32:53.343984+0000","last_active":"2023-07-05T23:35:14.508688+0000","last_peered":"2023-07-05T23:35:14.508688+0000","last_clean":"2023-07-05T23:35:14.508688+0000","last_became_active":"2023-07-05T23:32:53.343566+0000","last_became_peered":"2023-07-05T23:32:53.343566+0000","last_unstale":"2023-07-05T23:35:14.508688+0000","last_undegraded":"2023-07-05T23:35:14.508688+0000","last_fullsized":"2023-07-05T23:35:14.508688+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:27:59.144444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"30'484","reported_seq":502,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:13.553221+0000","last_change":"2023-07-05T23:32:57.356615+0000","last_active":"2023-07-05T23:35:13.553221+0000","last_peered":"2023-07-05T23:35:13.553221+0000","last_clean":"2023-07-05T23:35:13.553221+0000","last_became_active":"2023-07-05T23:32:57.356091+0000","last_became_peered":"2023-07-05T23:32:57.356091+0000","last_unstale":"2023-07-05T23:35:13.553221+0000","last_undegraded":"2023-07-05T23:35:13.553221+0000","last_fullsized":"2023-07-05T23:35:13.553221+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:10:51.090665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"30'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:02.479617+0000","last_change":"2023-07-05T23:32:52.906210+0000","last_active":"2023-07-05T23:35:02.479617+0000","last_peered":"2023-07-05T23:35:02.479617+0000","last_clean":"2023-07-05T23:35:02.479617+0000","last_became_active":"2023-07-05T23:32:52.905988+0000","last_became_peered":"2023-07-05T23:32:52.905988+0000","last_unstale":"2023-07-05T23:35:02.479617+0000","last_undegraded":"2023-07-05T23:35:02.479617+0000","last_fullsized":"2023-07-05T23:35:02.479617+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:30:01.986422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"30'24","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.516810+0000","last_change":"2023-07-05T23:32:53.339662+0000","last_active":"2023-07-05T23:35:14.516810+0000","last_peered":"2023-07-05T23:35:14.516810+0000","last_clean":"2023-07-05T23:35:14.516810+0000","last_became_active":"2023-07-05T23:32:53.339382+0000","last_became_peered":"2023-07-05T23:32:53.339382+0000","last_unstale":"2023-07-05T23:35:14.516810+0000","last_undegraded":"2023-07-05T23:35:14.516810+0000","last_fullsized":"2023-07-05T23:35:14.516810+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:06:29.575306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"30'468","reported_seq":486,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:13.538250+0000","last_change":"2023-07-05T23:32:57.354958+0000","last_active":"2023-07-05T23:35:13.538250+0000","last_peered":"2023-07-05T23:35:13.538250+0000","last_clean":"2023-07-05T23:35:13.538250+0000","last_became_active":"2023-07-05T23:32:57.354576+0000","last_became_peered":"2023-07-05T23:32:57.354576+0000","last_unstale":"2023-07-05T23:35:13.538250+0000","last_undegraded":"2023-07-05T23:35:13.538250+0000","last_fullsized":"2023-07-05T23:35:13.538250+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:32:54.986804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":27648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"30'4","reported_seq":30,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:05.478083+0000","last_change":"2023-07-05T23:32:52.906470+0000","last_active":"2023-07-05T23:35:05.478083+0000","last_peered":"2023-07-05T23:35:05.478083+0000","last_clean":"2023-07-05T23:35:05.478083+0000","last_became_active":"2023-07-05T23:32:52.906187+0000","last_became_peered":"2023-07-05T23:32:52.906187+0000","last_unstale":"2023-07-05T23:35:05.478083+0000","last_undegraded":"2023-07-05T23:35:05.478083+0000","last_fullsized":"2023-07-05T23:35:05.478083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:34:31.075112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"30'21","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.520529+0000","last_change":"2023-07-05T23:32:53.344178+0000","last_active":"2023-07-05T23:35:14.520529+0000","last_peered":"2023-07-05T23:35:14.520529+0000","last_clean":"2023-07-05T23:35:14.520529+0000","last_became_active":"2023-07-05T23:32:53.343393+0000","last_became_peered":"2023-07-05T23:32:53.343393+0000","last_unstale":"2023-07-05T23:35:14.520529+0000","last_undegraded":"2023-07-05T23:35:14.520529+0000","last_fullsized":"2023-07-05T23:35:14.520529+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:26:46.815538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"30'457","reported_seq":475,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:13.558128+0000","last_change":"2023-07-05T23:32:57.362812+0000","last_active":"2023-07-05T23:35:13.558128+0000","last_peered":"2023-07-05T23:35:13.558128+0000","last_clean":"2023-07-05T23:35:13.558128+0000","last_became_active":"2023-07-05T23:32:57.362431+0000","last_became_peered":"2023-07-05T23:32:57.362431+0000","last_unstale":"2023-07-05T23:35:13.558128+0000","last_undegraded":"2023-07-05T23:35:13.558128+0000","last_fullsized":"2023-07-05T23:35:13.558128+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:37:40.938898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"30'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:05.621978+0000","last_change":"2023-07-05T23:32:52.908272+0000","last_active":"2023-07-05T23:35:05.621978+0000","last_peered":"2023-07-05T23:35:05.621978+0000","last_clean":"2023-07-05T23:35:05.621978+0000","last_became_active":"2023-07-05T23:32:52.907983+0000","last_became_peered":"2023-07-05T23:32:52.907983+0000","last_unstale":"2023-07-05T23:35:05.621978+0000","last_undegraded":"2023-07-05T23:35:05.621978+0000","last_fullsized":"2023-07-05T23:35:05.621978+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:01:15.727729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"30'23","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.521028+0000","last_change":"2023-07-05T23:32:53.339766+0000","last_active":"2023-07-05T23:35:14.521028+0000","last_peered":"2023-07-05T23:35:14.521028+0000","last_clean":"2023-07-05T23:35:14.521028+0000","last_became_active":"2023-07-05T23:32:53.338903+0000","last_became_peered":"2023-07-05T23:32:53.338903+0000","last_unstale":"2023-07-05T23:35:14.521028+0000","last_undegraded":"2023-07-05T23:35:14.521028+0000","last_fullsized":"2023-07-05T23:35:14.521028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:21:39.351826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'490","reported_seq":508,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:15.503713+0000","last_change":"2023-07-05T23:32:57.357001+0000","last_active":"2023-07-05T23:35:15.503713+0000","last_peered":"2023-07-05T23:35:15.503713+0000","last_clean":"2023-07-05T23:35:15.503713+0000","last_became_active":"2023-07-05T23:32:57.356611+0000","last_became_peered":"2023-07-05T23:32:57.356611+0000","last_unstale":"2023-07-05T23:35:15.503713+0000","last_undegraded":"2023-07-05T23:35:15.503713+0000","last_fullsized":"2023-07-05T23:35:15.503713+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:18:00.591410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.205209+0000","last_change":"2023-07-05T23:32:52.907064+0000","last_active":"2023-07-05T23:33:35.205209+0000","last_peered":"2023-07-05T23:33:35.205209+0000","last_clean":"2023-07-05T23:33:35.205209+0000","last_became_active":"2023-07-05T23:32:52.906779+0000","last_became_peered":"2023-07-05T23:32:52.906779+0000","last_unstale":"2023-07-05T23:33:35.205209+0000","last_undegraded":"2023-07-05T23:33:35.205209+0000","last_fullsized":"2023-07-05T23:33:35.205209+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:21:56.357294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"30'12","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.521818+0000","last_change":"2023-07-05T23:32:53.341824+0000","last_active":"2023-07-05T23:35:14.521818+0000","last_peered":"2023-07-05T23:35:14.521818+0000","last_clean":"2023-07-05T23:35:14.521818+0000","last_became_active":"2023-07-05T23:32:53.339869+0000","last_became_peered":"2023-07-05T23:32:53.339869+0000","last_unstale":"2023-07-05T23:35:14.521818+0000","last_undegraded":"2023-07-05T23:35:14.521818+0000","last_fullsized":"2023-07-05T23:35:14.521818+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:06:11.729572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"30'495","reported_seq":513,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:13.554741+0000","last_change":"2023-07-05T23:32:57.363813+0000","last_active":"2023-07-05T23:35:13.554741+0000","last_peered":"2023-07-05T23:35:13.554741+0000","last_clean":"2023-07-05T23:35:13.554741+0000","last_became_active":"2023-07-05T23:32:57.363409+0000","last_became_peered":"2023-07-05T23:32:57.363409+0000","last_unstale":"2023-07-05T23:35:13.554741+0000","last_undegraded":"2023-07-05T23:35:13.554741+0000","last_fullsized":"2023-07-05T23:35:13.554741+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:07:41.069844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.229959+0000","last_change":"2023-07-05T23:32:52.910057+0000","last_active":"2023-07-05T23:33:35.229959+0000","last_peered":"2023-07-05T23:33:35.229959+0000","last_clean":"2023-07-05T23:33:35.229959+0000","last_became_active":"2023-07-05T23:32:52.909169+0000","last_became_peered":"2023-07-05T23:32:52.909169+0000","last_unstale":"2023-07-05T23:33:35.229959+0000","last_undegraded":"2023-07-05T23:33:35.229959+0000","last_fullsized":"2023-07-05T23:33:35.229959+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:30:01.986422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"30'24","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.506964+0000","last_change":"2023-07-05T23:32:53.342851+0000","last_active":"2023-07-05T23:35:14.506964+0000","last_peered":"2023-07-05T23:35:14.506964+0000","last_clean":"2023-07-05T23:35:14.506964+0000","last_became_active":"2023-07-05T23:32:53.342420+0000","last_became_peered":"2023-07-05T23:32:53.342420+0000","last_unstale":"2023-07-05T23:35:14.506964+0000","last_undegraded":"2023-07-05T23:35:14.506964+0000","last_fullsized":"2023-07-05T23:35:14.506964+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:48:30.276766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"30'501","reported_seq":519,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.469204+0000","last_change":"2023-07-05T23:32:57.358997+0000","last_active":"2023-07-05T23:35:14.469204+0000","last_peered":"2023-07-05T23:35:14.469204+0000","last_clean":"2023-07-05T23:35:14.469204+0000","last_became_active":"2023-07-05T23:32:57.358647+0000","last_became_peered":"2023-07-05T23:32:57.358647+0000","last_unstale":"2023-07-05T23:35:14.469204+0000","last_undegraded":"2023-07-05T23:35:14.469204+0000","last_fullsized":"2023-07-05T23:35:14.469204+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:48:33.716459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.229445+0000","last_change":"2023-07-05T23:32:47.790871+0000","last_active":"2023-07-05T23:33:35.229445+0000","last_peered":"2023-07-05T23:33:35.229445+0000","last_clean":"2023-07-05T23:33:35.229445+0000","last_became_active":"2023-07-05T23:32:47.790546+0000","last_became_peered":"2023-07-05T23:32:47.790546+0000","last_unstale":"2023-07-05T23:33:35.229445+0000","last_undegraded":"2023-07-05T23:33:35.229445+0000","last_fullsized":"2023-07-05T23:33:35.229445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_clean_scrub_stamp":"2023-07-05T23:32:46.741565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:28:20.777630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"30'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:00.632835+0000","last_change":"2023-07-05T23:32:52.912985+0000","last_active":"2023-07-05T23:35:00.632835+0000","last_peered":"2023-07-05T23:35:00.632835+0000","last_clean":"2023-07-05T23:35:00.632835+0000","last_became_active":"2023-07-05T23:32:52.912682+0000","last_became_peered":"2023-07-05T23:32:52.912682+0000","last_unstale":"2023-07-05T23:35:00.632835+0000","last_undegraded":"2023-07-05T23:35:00.632835+0000","last_fullsized":"2023-07-05T23:35:00.632835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:19:27.040484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"30'22","reported_seq":46,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.511330+0000","last_change":"2023-07-05T23:32:53.335398+0000","last_active":"2023-07-05T23:35:14.511330+0000","last_peered":"2023-07-05T23:35:14.511330+0000","last_clean":"2023-07-05T23:35:14.511330+0000","last_became_active":"2023-07-05T23:32:53.335073+0000","last_became_peered":"2023-07-05T23:32:53.335073+0000","last_unstale":"2023-07-05T23:35:14.511330+0000","last_undegraded":"2023-07-05T23:35:14.511330+0000","last_fullsized":"2023-07-05T23:35:14.511330+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:02:06.585507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"30'448","reported_seq":466,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:15.486442+0000","last_change":"2023-07-05T23:32:57.368301+0000","last_active":"2023-07-05T23:35:15.486442+0000","last_peered":"2023-07-05T23:35:15.486442+0000","last_clean":"2023-07-05T23:35:15.486442+0000","last_became_active":"2023-07-05T23:32:57.368030+0000","last_became_peered":"2023-07-05T23:32:57.368030+0000","last_unstale":"2023-07-05T23:35:15.486442+0000","last_undegraded":"2023-07-05T23:35:15.486442+0000","last_fullsized":"2023-07-05T23:35:15.486442+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:55:49.947801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:34.897517+0000","last_change":"2023-07-05T23:32:47.762370+0000","last_active":"2023-07-05T23:33:34.897517+0000","last_peered":"2023-07-05T23:33:34.897517+0000","last_clean":"2023-07-05T23:33:34.897517+0000","last_became_active":"2023-07-05T23:32:47.761996+0000","last_became_peered":"2023-07-05T23:32:47.761996+0000","last_unstale":"2023-07-05T23:33:34.897517+0000","last_undegraded":"2023-07-05T23:33:34.897517+0000","last_fullsized":"2023-07-05T23:33:34.897517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_clean_scrub_stamp":"2023-07-05T23:32:46.741565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:27:16.430272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.206217+0000","last_change":"2023-07-05T23:32:52.904472+0000","last_active":"2023-07-05T23:33:35.206217+0000","last_peered":"2023-07-05T23:33:35.206217+0000","last_clean":"2023-07-05T23:33:35.206217+0000","last_became_active":"2023-07-05T23:32:52.904202+0000","last_became_peered":"2023-07-05T23:32:52.904202+0000","last_unstale":"2023-07-05T23:33:35.206217+0000","last_undegraded":"2023-07-05T23:33:35.206217+0000","last_fullsized":"2023-07-05T23:33:35.206217+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:21:26.927343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"30'24","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.506926+0000","last_change":"2023-07-05T23:32:53.341847+0000","last_active":"2023-07-05T23:35:14.506926+0000","last_peered":"2023-07-05T23:35:14.506926+0000","last_clean":"2023-07-05T23:35:14.506926+0000","last_became_active":"2023-07-05T23:32:53.338626+0000","last_became_peered":"2023-07-05T23:32:53.338626+0000","last_unstale":"2023-07-05T23:35:14.506926+0000","last_undegraded":"2023-07-05T23:35:14.506926+0000","last_fullsized":"2023-07-05T23:35:14.506926+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:09:06.821067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"30'487","reported_seq":505,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.469505+0000","last_change":"2023-07-05T23:32:57.356351+0000","last_active":"2023-07-05T23:35:14.469505+0000","last_peered":"2023-07-05T23:35:14.469505+0000","last_clean":"2023-07-05T23:35:14.469505+0000","last_became_active":"2023-07-05T23:32:57.355882+0000","last_became_peered":"2023-07-05T23:32:57.355882+0000","last_unstale":"2023-07-05T23:35:14.469505+0000","last_undegraded":"2023-07-05T23:35:14.469505+0000","last_fullsized":"2023-07-05T23:35:14.469505+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:53:02.594417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":55296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:34.894615+0000","last_change":"2023-07-05T23:32:47.979611+0000","last_active":"2023-07-05T23:33:34.894615+0000","last_peered":"2023-07-05T23:33:34.894615+0000","last_clean":"2023-07-05T23:33:34.894615+0000","last_became_active":"2023-07-05T23:32:47.979348+0000","last_became_peered":"2023-07-05T23:32:47.979348+0000","last_unstale":"2023-07-05T23:33:34.894615+0000","last_undegraded":"2023-07-05T23:33:34.894615+0000","last_fullsized":"2023-07-05T23:33:34.894615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_clean_scrub_stamp":"2023-07-05T23:32:46.741565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:49:32.444450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.228652+0000","last_change":"2023-07-05T23:32:52.907652+0000","last_active":"2023-07-05T23:33:35.228652+0000","last_peered":"2023-07-05T23:33:35.228652+0000","last_clean":"2023-07-05T23:33:35.228652+0000","last_became_active":"2023-07-05T23:32:52.907307+0000","last_became_peered":"2023-07-05T23:32:52.907307+0000","last_unstale":"2023-07-05T23:33:35.228652+0000","last_undegraded":"2023-07-05T23:33:35.228652+0000","last_fullsized":"2023-07-05T23:33:35.228652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:50:56.145233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"30'23","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.511242+0000","last_change":"2023-07-05T23:32:53.338185+0000","last_active":"2023-07-05T23:35:14.511242+0000","last_peered":"2023-07-05T23:35:14.511242+0000","last_clean":"2023-07-05T23:35:14.511242+0000","last_became_active":"2023-07-05T23:32:53.337896+0000","last_became_peered":"2023-07-05T23:32:53.337896+0000","last_unstale":"2023-07-05T23:35:14.511242+0000","last_undegraded":"2023-07-05T23:35:14.511242+0000","last_fullsized":"2023-07-05T23:35:14.511242+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:34:43.735212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"30'477","reported_seq":495,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.465963+0000","last_change":"2023-07-05T23:32:57.355885+0000","last_active":"2023-07-05T23:35:14.465963+0000","last_peered":"2023-07-05T23:35:14.465963+0000","last_clean":"2023-07-05T23:35:14.465963+0000","last_became_active":"2023-07-05T23:32:57.355475+0000","last_became_peered":"2023-07-05T23:32:57.355475+0000","last_unstale":"2023-07-05T23:35:14.465963+0000","last_undegraded":"2023-07-05T23:35:14.465963+0000","last_fullsized":"2023-07-05T23:35:14.465963+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:19:48.564819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:34.897784+0000","last_change":"2023-07-05T23:32:47.761727+0000","last_active":"2023-07-05T23:33:34.897784+0000","last_peered":"2023-07-05T23:33:34.897784+0000","last_clean":"2023-07-05T23:33:34.897784+0000","last_became_active":"2023-07-05T23:32:47.761392+0000","last_became_peered":"2023-07-05T23:32:47.761392+0000","last_unstale":"2023-07-05T23:33:34.897784+0000","last_undegraded":"2023-07-05T23:33:34.897784+0000","last_fullsized":"2023-07-05T23:33:34.897784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_clean_scrub_stamp":"2023-07-05T23:32:46.741565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:35:41.726138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":188,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.011378+0000","last_change":"2023-07-05T23:32:42.737690+0000","last_active":"2023-07-05T23:33:35.011378+0000","last_peered":"2023-07-05T23:33:35.011378+0000","last_clean":"2023-07-05T23:33:35.011378+0000","last_became_active":"2023-07-05T23:32:42.736736+0000","last_became_peered":"2023-07-05T23:32:42.736736+0000","last_unstale":"2023-07-05T23:33:35.011378+0000","last_undegraded":"2023-07-05T23:33:35.011378+0000","last_fullsized":"2023-07-05T23:33:35.011378+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:41.674741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:41.674741+0000","last_clean_scrub_stamp":"2023-07-05T23:32:41.674741+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:28:15.710806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.230450+0000","last_change":"2023-07-05T23:32:52.912999+0000","last_active":"2023-07-05T23:33:35.230450+0000","last_peered":"2023-07-05T23:33:35.230450+0000","last_clean":"2023-07-05T23:33:35.230450+0000","last_became_active":"2023-07-05T23:32:52.912684+0000","last_became_peered":"2023-07-05T23:32:52.912684+0000","last_unstale":"2023-07-05T23:33:35.230450+0000","last_undegraded":"2023-07-05T23:33:35.230450+0000","last_fullsized":"2023-07-05T23:33:35.230450+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:17:56.147379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"30'25","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.522426+0000","last_change":"2023-07-05T23:32:53.344142+0000","last_active":"2023-07-05T23:35:14.522426+0000","last_peered":"2023-07-05T23:35:14.522426+0000","last_clean":"2023-07-05T23:35:14.522426+0000","last_became_active":"2023-07-05T23:32:53.343848+0000","last_became_peered":"2023-07-05T23:32:53.343848+0000","last_unstale":"2023-07-05T23:35:14.522426+0000","last_undegraded":"2023-07-05T23:35:14.522426+0000","last_fullsized":"2023-07-05T23:35:14.522426+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:21:04.019035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"30'449","reported_seq":467,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.459786+0000","last_change":"2023-07-05T23:32:57.366415+0000","last_active":"2023-07-05T23:35:14.459786+0000","last_peered":"2023-07-05T23:35:14.459786+0000","last_clean":"2023-07-05T23:35:14.459786+0000","last_became_active":"2023-07-05T23:32:57.365013+0000","last_became_peered":"2023-07-05T23:32:57.365013+0000","last_unstale":"2023-07-05T23:35:14.459786+0000","last_undegraded":"2023-07-05T23:35:14.459786+0000","last_fullsized":"2023-07-05T23:35:14.459786+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:12:04.336682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.011554+0000","last_change":"2023-07-05T23:32:47.767600+0000","last_active":"2023-07-05T23:33:35.011554+0000","last_peered":"2023-07-05T23:33:35.011554+0000","last_clean":"2023-07-05T23:33:35.011554+0000","last_became_active":"2023-07-05T23:32:47.767297+0000","last_became_peered":"2023-07-05T23:32:47.767297+0000","last_unstale":"2023-07-05T23:33:35.011554+0000","last_undegraded":"2023-07-05T23:33:35.011554+0000","last_fullsized":"2023-07-05T23:33:35.011554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_clean_scrub_stamp":"2023-07-05T23:32:46.741565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:00:36.274653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"30'15","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:15.480517+0000","last_change":"2023-07-05T23:32:52.906517+0000","last_active":"2023-07-05T23:35:15.480517+0000","last_peered":"2023-07-05T23:35:15.480517+0000","last_clean":"2023-07-05T23:35:15.480517+0000","last_became_active":"2023-07-05T23:32:52.906204+0000","last_became_peered":"2023-07-05T23:32:52.906204+0000","last_unstale":"2023-07-05T23:35:15.480517+0000","last_undegraded":"2023-07-05T23:35:15.480517+0000","last_fullsized":"2023-07-05T23:35:15.480517+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:38:48.811718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7643,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":16,"num_write":14,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"30'21","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.507187+0000","last_change":"2023-07-05T23:32:53.340334+0000","last_active":"2023-07-05T23:35:14.507187+0000","last_peered":"2023-07-05T23:35:14.507187+0000","last_clean":"2023-07-05T23:35:14.507187+0000","last_became_active":"2023-07-05T23:32:53.340061+0000","last_became_peered":"2023-07-05T23:32:53.340061+0000","last_unstale":"2023-07-05T23:35:14.507187+0000","last_undegraded":"2023-07-05T23:35:14.507187+0000","last_fullsized":"2023-07-05T23:35:14.507187+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:37:37.499204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"30'501","reported_seq":519,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:13.554516+0000","last_change":"2023-07-05T23:32:57.362424+0000","last_active":"2023-07-05T23:35:13.554516+0000","last_peered":"2023-07-05T23:35:13.554516+0000","last_clean":"2023-07-05T23:35:13.554516+0000","last_became_active":"2023-07-05T23:32:57.361941+0000","last_became_peered":"2023-07-05T23:32:57.361941+0000","last_unstale":"2023-07-05T23:35:13.554516+0000","last_undegraded":"2023-07-05T23:35:13.554516+0000","last_fullsized":"2023-07-05T23:35:13.554516+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:11:35.842714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.011798+0000","last_change":"2023-07-05T23:32:47.790754+0000","last_active":"2023-07-05T23:33:35.011798+0000","last_peered":"2023-07-05T23:33:35.011798+0000","last_clean":"2023-07-05T23:33:35.011798+0000","last_became_active":"2023-07-05T23:32:47.790408+0000","last_became_peered":"2023-07-05T23:32:47.790408+0000","last_unstale":"2023-07-05T23:33:35.011798+0000","last_undegraded":"2023-07-05T23:33:35.011798+0000","last_fullsized":"2023-07-05T23:33:35.011798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_clean_scrub_stamp":"2023-07-05T23:32:46.741565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:47:18.131137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"30'2","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:04.468711+0000","last_change":"2023-07-05T23:32:52.908711+0000","last_active":"2023-07-05T23:35:04.468711+0000","last_peered":"2023-07-05T23:35:04.468711+0000","last_clean":"2023-07-05T23:35:04.468711+0000","last_became_active":"2023-07-05T23:32:52.908379+0000","last_became_peered":"2023-07-05T23:32:52.908379+0000","last_unstale":"2023-07-05T23:35:04.468711+0000","last_undegraded":"2023-07-05T23:35:04.468711+0000","last_fullsized":"2023-07-05T23:35:04.468711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:19:44.120787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"30'22","reported_seq":46,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.515358+0000","last_change":"2023-07-05T23:32:53.331042+0000","last_active":"2023-07-05T23:35:14.515358+0000","last_peered":"2023-07-05T23:35:14.515358+0000","last_clean":"2023-07-05T23:35:14.515358+0000","last_became_active":"2023-07-05T23:32:53.330771+0000","last_became_peered":"2023-07-05T23:32:53.330771+0000","last_unstale":"2023-07-05T23:35:14.515358+0000","last_undegraded":"2023-07-05T23:35:14.515358+0000","last_fullsized":"2023-07-05T23:35:14.515358+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:28:26.918347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"30'486","reported_seq":504,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:13.526033+0000","last_change":"2023-07-05T23:32:57.357223+0000","last_active":"2023-07-05T23:35:13.526033+0000","last_peered":"2023-07-05T23:35:13.526033+0000","last_clean":"2023-07-05T23:35:13.526033+0000","last_became_active":"2023-07-05T23:32:57.356797+0000","last_became_peered":"2023-07-05T23:32:57.356797+0000","last_unstale":"2023-07-05T23:35:13.526033+0000","last_undegraded":"2023-07-05T23:35:13.526033+0000","last_fullsized":"2023-07-05T23:35:13.526033+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:04:21.723966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"30'3","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:05.629762+0000","last_change":"2023-07-05T23:32:52.906030+0000","last_active":"2023-07-05T23:35:05.629762+0000","last_peered":"2023-07-05T23:35:05.629762+0000","last_clean":"2023-07-05T23:35:05.629762+0000","last_became_active":"2023-07-05T23:32:52.905704+0000","last_became_peered":"2023-07-05T23:32:52.905704+0000","last_unstale":"2023-07-05T23:35:05.629762+0000","last_undegraded":"2023-07-05T23:35:05.629762+0000","last_fullsized":"2023-07-05T23:35:05.629762+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:48:50.472580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.229743+0000","last_change":"2023-07-05T23:32:47.769126+0000","last_active":"2023-07-05T23:33:35.229743+0000","last_peered":"2023-07-05T23:33:35.229743+0000","last_clean":"2023-07-05T23:33:35.229743+0000","last_became_active":"2023-07-05T23:32:47.768844+0000","last_became_peered":"2023-07-05T23:32:47.768844+0000","last_unstale":"2023-07-05T23:33:35.229743+0000","last_undegraded":"2023-07-05T23:33:35.229743+0000","last_fullsized":"2023-07-05T23:33:35.229743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_clean_scrub_stamp":"2023-07-05T23:32:46.741565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:09:50.580774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"30'18","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.504878+0000","last_change":"2023-07-05T23:33:35.012743+0000","last_active":"2023-07-05T23:35:14.504878+0000","last_peered":"2023-07-05T23:35:14.504878+0000","last_clean":"2023-07-05T23:35:14.504878+0000","last_became_active":"2023-07-05T23:33:35.012290+0000","last_became_peered":"2023-07-05T23:33:35.012290+0000","last_unstale":"2023-07-05T23:35:14.504878+0000","last_undegraded":"2023-07-05T23:35:14.504878+0000","last_fullsized":"2023-07-05T23:35:14.504878+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:22:31.213068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"30'447","reported_seq":465,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.467484+0000","last_change":"2023-07-05T23:32:57.362654+0000","last_active":"2023-07-05T23:35:14.467484+0000","last_peered":"2023-07-05T23:35:14.467484+0000","last_clean":"2023-07-05T23:35:14.467484+0000","last_became_active":"2023-07-05T23:32:57.362112+0000","last_became_peered":"2023-07-05T23:32:57.362112+0000","last_unstale":"2023-07-05T23:35:14.467484+0000","last_undegraded":"2023-07-05T23:35:14.467484+0000","last_fullsized":"2023-07-05T23:35:14.467484+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:00:45.855064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":46080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.228846+0000","last_change":"2023-07-05T23:32:47.769537+0000","last_active":"2023-07-05T23:33:35.228846+0000","last_peered":"2023-07-05T23:33:35.228846+0000","last_clean":"2023-07-05T23:33:35.228846+0000","last_became_active":"2023-07-05T23:32:47.769141+0000","last_became_peered":"2023-07-05T23:32:47.769141+0000","last_unstale":"2023-07-05T23:33:35.228846+0000","last_undegraded":"2023-07-05T23:33:35.228846+0000","last_fullsized":"2023-07-05T23:33:35.228846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_clean_scrub_stamp":"2023-07-05T23:32:46.741565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:24:40.558028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"30'11","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:07.903767+0000","last_change":"2023-07-05T23:32:52.905759+0000","last_active":"2023-07-05T23:35:07.903767+0000","last_peered":"2023-07-05T23:35:07.903767+0000","last_clean":"2023-07-05T23:35:07.903767+0000","last_became_active":"2023-07-05T23:32:52.905451+0000","last_became_peered":"2023-07-05T23:32:52.905451+0000","last_unstale":"2023-07-05T23:35:07.903767+0000","last_undegraded":"2023-07-05T23:35:07.903767+0000","last_fullsized":"2023-07-05T23:35:07.903767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:03:44.827174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"30'17","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.520533+0000","last_change":"2023-07-05T23:32:53.332443+0000","last_active":"2023-07-05T23:35:14.520533+0000","last_peered":"2023-07-05T23:35:14.520533+0000","last_clean":"2023-07-05T23:35:14.520533+0000","last_became_active":"2023-07-05T23:32:53.332159+0000","last_became_peered":"2023-07-05T23:32:53.332159+0000","last_unstale":"2023-07-05T23:35:14.520533+0000","last_undegraded":"2023-07-05T23:35:14.520533+0000","last_fullsized":"2023-07-05T23:35:14.520533+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:20:52.387593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"30'468","reported_seq":485,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:13.571013+0000","last_change":"2023-07-05T23:32:57.363998+0000","last_active":"2023-07-05T23:35:13.571013+0000","last_peered":"2023-07-05T23:35:13.571013+0000","last_clean":"2023-07-05T23:35:13.571013+0000","last_became_active":"2023-07-05T23:32:57.363620+0000","last_became_peered":"2023-07-05T23:32:57.363620+0000","last_unstale":"2023-07-05T23:35:13.571013+0000","last_undegraded":"2023-07-05T23:35:13.571013+0000","last_fullsized":"2023-07-05T23:35:13.571013+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:47:48.642379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.228911+0000","last_change":"2023-07-05T23:32:52.908550+0000","last_active":"2023-07-05T23:33:35.228911+0000","last_peered":"2023-07-05T23:33:35.228911+0000","last_clean":"2023-07-05T23:33:35.228911+0000","last_became_active":"2023-07-05T23:32:52.908111+0000","last_became_peered":"2023-07-05T23:32:52.908111+0000","last_unstale":"2023-07-05T23:33:35.228911+0000","last_undegraded":"2023-07-05T23:33:35.228911+0000","last_fullsized":"2023-07-05T23:33:35.228911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:47:44.198348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"30'24","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.508353+0000","last_change":"2023-07-05T23:32:53.340098+0000","last_active":"2023-07-05T23:35:14.508353+0000","last_peered":"2023-07-05T23:35:14.508353+0000","last_clean":"2023-07-05T23:35:14.508353+0000","last_became_active":"2023-07-05T23:32:53.339686+0000","last_became_peered":"2023-07-05T23:32:53.339686+0000","last_unstale":"2023-07-05T23:35:14.508353+0000","last_undegraded":"2023-07-05T23:35:14.508353+0000","last_fullsized":"2023-07-05T23:35:14.508353+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:37:45.661547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"30'478","reported_seq":495,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:13.535971+0000","last_change":"2023-07-05T23:32:57.356309+0000","last_active":"2023-07-05T23:35:13.535971+0000","last_peered":"2023-07-05T23:35:13.535971+0000","last_clean":"2023-07-05T23:35:13.535971+0000","last_became_active":"2023-07-05T23:32:57.355910+0000","last_became_peered":"2023-07-05T23:32:57.355910+0000","last_unstale":"2023-07-05T23:35:13.535971+0000","last_undegraded":"2023-07-05T23:35:13.535971+0000","last_fullsized":"2023-07-05T23:35:13.535971+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:47:48.642379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:34.897485+0000","last_change":"2023-07-05T23:32:52.899481+0000","last_active":"2023-07-05T23:33:34.897485+0000","last_peered":"2023-07-05T23:33:34.897485+0000","last_clean":"2023-07-05T23:33:34.897485+0000","last_became_active":"2023-07-05T23:32:52.899159+0000","last_became_peered":"2023-07-05T23:32:52.899159+0000","last_unstale":"2023-07-05T23:33:34.897485+0000","last_undegraded":"2023-07-05T23:33:34.897485+0000","last_fullsized":"2023-07-05T23:33:34.897485+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:55:01.034913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"30'19","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.520324+0000","last_change":"2023-07-05T23:32:53.343643+0000","last_active":"2023-07-05T23:35:14.520324+0000","last_peered":"2023-07-05T23:35:14.520324+0000","last_clean":"2023-07-05T23:35:14.520324+0000","last_became_active":"2023-07-05T23:32:53.343262+0000","last_became_peered":"2023-07-05T23:32:53.343262+0000","last_unstale":"2023-07-05T23:35:14.520324+0000","last_undegraded":"2023-07-05T23:35:14.520324+0000","last_fullsized":"2023-07-05T23:35:14.520324+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:24:39.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"30'465","reported_seq":482,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.465946+0000","last_change":"2023-07-05T23:32:57.365478+0000","last_active":"2023-07-05T23:35:14.465946+0000","last_peered":"2023-07-05T23:35:14.465946+0000","last_clean":"2023-07-05T23:35:14.465946+0000","last_became_active":"2023-07-05T23:32:57.365087+0000","last_became_peered":"2023-07-05T23:32:57.365087+0000","last_unstale":"2023-07-05T23:35:14.465946+0000","last_undegraded":"2023-07-05T23:35:14.465946+0000","last_fullsized":"2023-07-05T23:35:14.465946+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:47:27.711548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"30'3","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:34.897598+0000","last_change":"2023-07-05T23:32:52.902806+0000","last_active":"2023-07-05T23:33:34.897598+0000","last_peered":"2023-07-05T23:33:34.897598+0000","last_clean":"2023-07-05T23:33:34.897598+0000","last_became_active":"2023-07-05T23:32:52.901689+0000","last_became_peered":"2023-07-05T23:32:52.901689+0000","last_unstale":"2023-07-05T23:33:34.897598+0000","last_undegraded":"2023-07-05T23:33:34.897598+0000","last_fullsized":"2023-07-05T23:33:34.897598+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:34:31.075112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'15","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.521404+0000","last_change":"2023-07-05T23:32:53.346776+0000","last_active":"2023-07-05T23:35:14.521404+0000","last_peered":"2023-07-05T23:35:14.521404+0000","last_clean":"2023-07-05T23:35:14.521404+0000","last_became_active":"2023-07-05T23:32:53.346553+0000","last_became_peered":"2023-07-05T23:32:53.346553+0000","last_unstale":"2023-07-05T23:35:14.521404+0000","last_undegraded":"2023-07-05T23:35:14.521404+0000","last_fullsized":"2023-07-05T23:35:14.521404+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:23:00.312260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"30'486","reported_seq":503,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.466120+0000","last_change":"2023-07-05T23:32:57.353173+0000","last_active":"2023-07-05T23:35:14.466120+0000","last_peered":"2023-07-05T23:35:14.466120+0000","last_clean":"2023-07-05T23:35:14.466120+0000","last_became_active":"2023-07-05T23:32:57.352716+0000","last_became_peered":"2023-07-05T23:32:57.352716+0000","last_unstale":"2023-07-05T23:35:14.466120+0000","last_undegraded":"2023-07-05T23:35:14.466120+0000","last_fullsized":"2023-07-05T23:35:14.466120+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:41:41.820423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.231058+0000","last_change":"2023-07-05T23:32:52.906954+0000","last_active":"2023-07-05T23:33:35.231058+0000","last_peered":"2023-07-05T23:33:35.231058+0000","last_clean":"2023-07-05T23:33:35.231058+0000","last_became_active":"2023-07-05T23:32:52.906688+0000","last_became_peered":"2023-07-05T23:32:52.906688+0000","last_unstale":"2023-07-05T23:33:35.231058+0000","last_undegraded":"2023-07-05T23:33:35.231058+0000","last_fullsized":"2023-07-05T23:33:35.231058+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:32:02.036320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"30'28","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.508674+0000","last_change":"2023-07-05T23:32:53.348210+0000","last_active":"2023-07-05T23:35:14.508674+0000","last_peered":"2023-07-05T23:35:14.508674+0000","last_clean":"2023-07-05T23:35:14.508674+0000","last_became_active":"2023-07-05T23:32:53.346652+0000","last_became_peered":"2023-07-05T23:32:53.346652+0000","last_unstale":"2023-07-05T23:35:14.508674+0000","last_undegraded":"2023-07-05T23:35:14.508674+0000","last_fullsized":"2023-07-05T23:35:14.508674+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:55:02.039251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"30'493","reported_seq":510,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:13.562560+0000","last_change":"2023-07-05T23:32:57.357185+0000","last_active":"2023-07-05T23:35:13.562560+0000","last_peered":"2023-07-05T23:35:13.562560+0000","last_clean":"2023-07-05T23:35:13.562560+0000","last_became_active":"2023-07-05T23:32:57.356637+0000","last_became_peered":"2023-07-05T23:32:57.356637+0000","last_unstale":"2023-07-05T23:35:13.562560+0000","last_undegraded":"2023-07-05T23:35:13.562560+0000","last_fullsized":"2023-07-05T23:35:13.562560+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:03:49.271205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"30'5","reported_seq":31,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:00.628733+0000","last_change":"2023-07-05T23:32:52.904412+0000","last_active":"2023-07-05T23:35:00.628733+0000","last_peered":"2023-07-05T23:35:00.628733+0000","last_clean":"2023-07-05T23:35:00.628733+0000","last_became_active":"2023-07-05T23:32:52.903823+0000","last_became_peered":"2023-07-05T23:32:52.903823+0000","last_unstale":"2023-07-05T23:35:00.628733+0000","last_undegraded":"2023-07-05T23:35:00.628733+0000","last_fullsized":"2023-07-05T23:35:00.628733+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:55:01.034913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"30'30","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.521424+0000","last_change":"2023-07-05T23:32:53.342800+0000","last_active":"2023-07-05T23:35:14.521424+0000","last_peered":"2023-07-05T23:35:14.521424+0000","last_clean":"2023-07-05T23:35:14.521424+0000","last_became_active":"2023-07-05T23:32:53.339863+0000","last_became_peered":"2023-07-05T23:32:53.339863+0000","last_unstale":"2023-07-05T23:35:14.521424+0000","last_undegraded":"2023-07-05T23:35:14.521424+0000","last_fullsized":"2023-07-05T23:35:14.521424+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:18:02.496050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"30'37","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.505625+0000","last_change":"2023-07-05T23:32:53.337066+0000","last_active":"2023-07-05T23:35:14.505625+0000","last_peered":"2023-07-05T23:35:14.505625+0000","last_clean":"2023-07-05T23:35:14.505625+0000","last_became_active":"2023-07-05T23:32:53.336759+0000","last_became_peered":"2023-07-05T23:32:53.336759+0000","last_unstale":"2023-07-05T23:35:14.505625+0000","last_undegraded":"2023-07-05T23:35:14.505625+0000","last_fullsized":"2023-07-05T23:35:14.505625+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:10:47.650972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"30'33","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.509724+0000","last_change":"2023-07-05T23:32:53.346160+0000","last_active":"2023-07-05T23:35:14.509724+0000","last_peered":"2023-07-05T23:35:14.509724+0000","last_clean":"2023-07-05T23:35:14.509724+0000","last_became_active":"2023-07-05T23:32:53.345711+0000","last_became_peered":"2023-07-05T23:32:53.345711+0000","last_unstale":"2023-07-05T23:35:14.509724+0000","last_undegraded":"2023-07-05T23:35:14.509724+0000","last_fullsized":"2023-07-05T23:35:14.509724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:19:28.044822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"30'30","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.521711+0000","last_change":"2023-07-05T23:32:53.339729+0000","last_active":"2023-07-05T23:35:14.521711+0000","last_peered":"2023-07-05T23:35:14.521711+0000","last_clean":"2023-07-05T23:35:14.521711+0000","last_became_active":"2023-07-05T23:32:53.339431+0000","last_became_peered":"2023-07-05T23:32:53.339431+0000","last_unstale":"2023-07-05T23:35:14.521711+0000","last_undegraded":"2023-07-05T23:35:14.521711+0000","last_fullsized":"2023-07-05T23:35:14.521711+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:27:36.127458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"30'25","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.514712+0000","last_change":"2023-07-05T23:32:53.335512+0000","last_active":"2023-07-05T23:35:14.514712+0000","last_peered":"2023-07-05T23:35:14.514712+0000","last_clean":"2023-07-05T23:35:14.514712+0000","last_became_active":"2023-07-05T23:32:53.335181+0000","last_became_peered":"2023-07-05T23:32:53.335181+0000","last_unstale":"2023-07-05T23:35:14.514712+0000","last_undegraded":"2023-07-05T23:35:14.514712+0000","last_fullsized":"2023-07-05T23:35:14.514712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:47:24.271855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"30'20","reported_seq":44,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.513749+0000","last_change":"2023-07-05T23:32:53.338171+0000","last_active":"2023-07-05T23:35:14.513749+0000","last_peered":"2023-07-05T23:35:14.513749+0000","last_clean":"2023-07-05T23:35:14.513749+0000","last_became_active":"2023-07-05T23:32:53.337835+0000","last_became_peered":"2023-07-05T23:32:53.337835+0000","last_unstale":"2023-07-05T23:35:14.513749+0000","last_undegraded":"2023-07-05T23:35:14.513749+0000","last_fullsized":"2023-07-05T23:35:14.513749+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:00:42.415370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":155189248,"num_objects":37,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":577,"num_write_kb":1236992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":310378496,"data_stored":310378496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15026,"ondisk_log_size":15026,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1559,"ondisk_log_size":1559,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1443896,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":14,"num_read_kb":16,"num_write":438,"num_write_kb":1699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2949120,"data_stored":2887792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":438,"ondisk_log_size":438,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574883,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":100960,"kb_used_data":65816,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94270880,"statfs":{"total":96636764160,"available":96533381120,"internally_reserved":0,"allocated":67395584,"data_stored":67176597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 5 23:34:44 2023","interfaces":[{"interface":"back","average":{"1min":3.7120000000000002,"5min":1.2150000000000001,"15min":0.79900000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":12.042,"5min":12.042,"15min":12.042},"last":0.29799999999999999},{"interface":"front","average":{"1min":6.5010000000000003,"5min":2.4590000000000001,"15min":1.7849999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":26.367999999999999,"5min":26.367999999999999,"15min":26.367999999999999},"last":0.41299999999999998}]},{"osd":1,"last update":"Wed Jul 5 23:34:44 2023","interfaces":[{"interface":"back","average":{"1min":3.536,"5min":1.2789999999999999,"15min":0.90300000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":11.948,"5min":11.948,"15min":11.948},"last":0.36799999999999999},{"interface":"front","average":{"1min":4.0110000000000001,"5min":1.2789999999999999,"15min":0.82399999999999995},"min":{"1min":0.318,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":11.952,"5min":11.952,"15min":11.952},"last":0.39400000000000002}]},{"osd":2,"last update":"Wed Jul 5 23:34:44 2023","interfaces":[{"interface":"back","average":{"1min":4.0209999999999999,"5min":1.675,"15min":1.284},"min":{"1min":0.38500000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":11.997,"5min":11.997,"15min":11.997},"last":0.35499999999999998},{"interface":"front","average":{"1min":6.1189999999999998,"5min":1.7829999999999999,"15min":1.0600000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":26.419,"5min":26.419,"15min":26.419},"last":0.46000000000000002}]},{"osd":3,"last update":"Wed Jul 5 23:34:44 2023","interfaces":[{"interface":"back","average":{"1min":4.9889999999999999,"5min":1.51,"15min":0.93000000000000005},"min":{"1min":0.43099999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":24.094000000000001,"5min":24.094000000000001,"15min":24.094000000000001},"last":0.40500000000000003},{"interface":"front","average":{"1min":5.3719999999999999,"5min":1.5780000000000001,"15min":0.94599999999999995},"min":{"1min":0.44700000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":22.588000000000001,"5min":22.588000000000001,"15min":22.588000000000001},"last":0.32500000000000001}]},{"osd":4,"last update":"Wed Jul 5 23:34:44 2023","interfaces":[{"interface":"back","average":{"1min":3.4390000000000001,"5min":1.111,"15min":0.72299999999999998},"min":{"1min":0.32500000000000001,"5min":0.318,"15min":0.318},"max":{"1min":12.173999999999999,"5min":12.173999999999999,"15min":12.173999999999999},"last":0.28000000000000003},{"interface":"front","average":{"1min":3.4780000000000002,"5min":1.147,"15min":0.75900000000000001},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":12.151,"5min":12.151,"15min":12.151},"last":0.307}]},{"osd":5,"last update":"Wed Jul 5 23:34:44 2023","interfaces":[{"interface":"back","average":{"1min":3.8519999999999999,"5min":1.222,"15min":0.78400000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":19.954999999999998,"5min":19.954999999999998,"15min":19.954999999999998},"last":0.33400000000000002},{"interface":"front","average":{"1min":3.6509999999999998,"5min":1.2150000000000001,"15min":0.80900000000000005},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":21.870999999999999,"5min":21.870999999999999,"15min":21.870999999999999},"last":0.38500000000000001}]},{"osd":6,"last update":"Wed Jul 5 23:34:44 2023","interfaces":[{"interface":"back","average":{"1min":5.4880000000000004,"5min":1.6060000000000001,"15min":0.95899999999999996},"min":{"1min":0.436,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":20.212,"5min":20.212,"15min":20.212},"last":0.44},{"interface":"front","average":{"1min":2.4449999999999998,"5min":0.98399999999999999,"15min":0.73999999999999999},"min":{"1min":0.45700000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":12.010999999999999,"5min":12.010999999999999,"15min":12.010999999999999},"last":0.34599999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574883,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78472,"kb_used_data":47424,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94293368,"statfs":{"total":96636764160,"available":96556408832,"internally_reserved":0,"allocated":48562176,"data_stored":48373342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 5 23:34:42 2023","interfaces":[{"interface":"back","average":{"1min":7.4859999999999998,"5min":1.9059999999999999,"15min":0.97599999999999998},"min":{"1min":0.39800000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":24.012,"5min":24.012,"15min":24.012},"last":0.39700000000000002},{"interface":"front","average":{"1min":7.5389999999999997,"5min":1.909,"15min":0.97099999999999997},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":27.036000000000001,"5min":27.036000000000001,"15min":27.036000000000001},"last":0.38300000000000001}]},{"osd":1,"last update":"Wed Jul 5 23:34:42 2023","interfaces":[{"interface":"back","average":{"1min":7.0979999999999999,"5min":1.8220000000000001,"15min":0.94199999999999995},"min":{"1min":0.34499999999999997,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":20.021999999999998,"5min":20.021999999999998,"15min":20.021999999999998},"last":0.434},{"interface":"front","average":{"1min":7.7549999999999999,"5min":1.9970000000000001,"15min":1.0369999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":23.943000000000001,"5min":23.943000000000001,"15min":23.943000000000001},"last":0.503}]},{"osd":2,"last update":"Wed Jul 5 23:34:42 2023","interfaces":[{"interface":"back","average":{"1min":7.1660000000000004,"5min":1.871,"15min":0.98899999999999999},"min":{"1min":0.36699999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":25.658000000000001,"5min":25.658000000000001,"15min":25.658000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":5.9139999999999997,"5min":1.647,"15min":0.93600000000000005},"min":{"1min":0.40000000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":27.062000000000001,"5min":27.062000000000001,"15min":27.062000000000001},"last":0.57099999999999995}]},{"osd":3,"last update":"Wed Jul 5 23:34:42 2023","interfaces":[{"interface":"back","average":{"1min":6.657,"5min":1.7889999999999999,"15min":0.97699999999999998},"min":{"1min":0.443,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":27.108000000000001,"5min":27.108000000000001,"15min":27.108000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":7.6630000000000003,"5min":1.976,"15min":1.028},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":19.940000000000001,"5min":19.940000000000001,"15min":19.940000000000001},"last":0.55200000000000005}]},{"osd":4,"last update":"Wed Jul 5 23:34:42 2023","interfaces":[{"interface":"back","average":{"1min":8.0489999999999995,"5min":2.0430000000000001,"15min":1.042},"min":{"1min":0.34899999999999998,"5min":0.308,"15min":0.308},"max":{"1min":26,"5min":26,"15min":26},"last":0.58299999999999996},{"interface":"front","average":{"1min":5.0650000000000004,"5min":1.482,"15min":0.88500000000000001},"min":{"1min":0.376,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":27.085000000000001,"5min":27.085000000000001,"15min":27.085000000000001},"last":0.52400000000000002}]},{"osd":5,"last update":"Wed Jul 5 23:34:42 2023","interfaces":[{"interface":"back","average":{"1min":5.5750000000000002,"5min":1.5549999999999999,"15min":0.88500000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":19.975000000000001,"5min":19.975000000000001,"15min":19.975000000000001},"last":0.49299999999999999},{"interface":"front","average":{"1min":6.4349999999999996,"5min":1.7789999999999999,"15min":1.0029999999999999},"min":{"1min":0.41999999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":17.126999999999999,"5min":17.126999999999999,"15min":17.126999999999999},"last":0.60699999999999998}]},{"osd":7,"last update":"Wed Jul 5 23:34:42 2023","interfaces":[{"interface":"back","average":{"1min":5.7000000000000002,"5min":1.6240000000000001,"15min":0.94499999999999995},"min":{"1min":0.438,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":26.992000000000001,"5min":26.992000000000001,"15min":26.992000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":6.1929999999999996,"5min":1.7250000000000001,"15min":0.98099999999999998},"min":{"1min":0.44700000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":19.998999999999999,"5min":19.998999999999999,"15min":19.998999999999999},"last":0.59099999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574883,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72328,"kb_used_data":41280,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94299512,"statfs":{"total":96636764160,"available":96562700288,"internally_reserved":0,"allocated":42270720,"data_stored":42081886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 5 23:34:46 2023","interfaces":[{"interface":"back","average":{"1min":3.9239999999999999,"5min":1.0700000000000001,"15min":0.59399999999999997},"min":{"1min":0.29799999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":14.039999999999999,"5min":14.039999999999999,"15min":14.039999999999999},"last":0.27500000000000002},{"interface":"front","average":{"1min":3.871,"5min":1.0669999999999999,"15min":0.59899999999999998},"min":{"1min":0.27400000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":18.006,"5min":18.006,"15min":18.006},"last":0.28999999999999998}]},{"osd":2,"last update":"Wed Jul 5 23:34:46 2023","interfaces":[{"interface":"back","average":{"1min":4.3860000000000001,"5min":1.1839999999999999,"15min":0.65000000000000002},"min":{"1min":0.32200000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":14.092000000000001,"5min":14.092000000000001,"15min":14.092000000000001},"last":0.313},{"interface":"front","average":{"1min":4.3929999999999998,"5min":1.173,"15min":0.63600000000000001},"min":{"1min":0.33500000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":17.994,"5min":17.994,"15min":17.994},"last":0.26500000000000001}]},{"osd":3,"last update":"Wed Jul 5 23:34:46 2023","interfaces":[{"interface":"back","average":{"1min":4.9980000000000002,"5min":1.3180000000000001,"15min":0.70399999999999996},"min":{"1min":0.29999999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":17.949999999999999,"5min":17.949999999999999,"15min":17.949999999999999},"last":0.34399999999999997},{"interface":"front","average":{"1min":3.2240000000000002,"5min":0.96999999999999997,"15min":0.59399999999999997},"min":{"1min":0.38800000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":14.377000000000001,"5min":14.377000000000001,"15min":14.377000000000001},"last":0.33100000000000002}]},{"osd":4,"last update":"Wed Jul 5 23:34:46 2023","interfaces":[{"interface":"back","average":{"1min":5.0419999999999998,"5min":1.4790000000000001,"15min":0.88500000000000001},"min":{"1min":0.436,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":14.004,"5min":14.004,"15min":14.004},"last":0.55800000000000005},{"interface":"front","average":{"1min":5.75,"5min":1.6100000000000001,"15min":0.92000000000000004},"min":{"1min":0.49399999999999999,"5min":0.371,"15min":0.371},"max":{"1min":20.943999999999999,"5min":20.943999999999999,"15min":20.943999999999999},"last":0.63}]},{"osd":5,"last update":"Wed Jul 5 23:34:46 2023","interfaces":[{"interface":"back","average":{"1min":5.2549999999999999,"5min":1.5509999999999999,"15min":0.93400000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":24.949999999999999,"5min":24.949999999999999,"15min":24.949999999999999},"last":0.745},{"interface":"front","average":{"1min":5.9710000000000001,"5min":1.7190000000000001,"15min":1.0109999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":21.945,"5min":21.945,"15min":21.945},"last":0.64100000000000001}]},{"osd":6,"last update":"Wed Jul 5 23:34:46 2023","interfaces":[{"interface":"back","average":{"1min":4.2859999999999996,"5min":1.3420000000000001,"15min":0.85099999999999998},"min":{"1min":0.42799999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":17.981999999999999,"5min":17.981999999999999,"15min":17.981999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":6.0060000000000002,"5min":1.714,"15min":0.998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":24.943000000000001,"5min":24.943000000000001,"15min":24.943000000000001},"last":0.68000000000000005}]},{"osd":7,"last update":"Wed Jul 5 23:34:46 2023","interfaces":[{"interface":"back","average":{"1min":5.6079999999999997,"5min":1.621,"15min":0.95699999999999996},"min":{"1min":0.52700000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":18.045000000000002,"5min":18.045000000000002,"15min":18.045000000000002},"last":0.66800000000000004},{"interface":"front","average":{"1min":3.9289999999999998,"5min":1.2769999999999999,"15min":0.83499999999999996},"min":{"1min":0.46000000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":14.352,"5min":14.352,"15min":14.352},"last":0.69399999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574883,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":101592,"kb_used_data":70544,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94270248,"statfs":{"total":96636764160,"available":96532733952,"internally_reserved":0,"allocated":72237056,"data_stored":72040498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Jul 5 23:34:41 2023","interfaces":[{"interface":"back","average":{"1min":4.0949999999999998,"5min":1.081,"15min":0.57899999999999996},"min":{"1min":0.254,"5min":0.185,"15min":0.185},"max":{"1min":23.974,"5min":23.974,"15min":23.974},"last":0.313},{"interface":"front","average":{"1min":5.0419999999999998,"5min":1.282,"15min":0.65500000000000003},"min":{"1min":0.28999999999999998,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":32.256999999999998,"5min":32.256999999999998,"15min":32.256999999999998},"last":1.1040000000000001}]},{"osd":2,"last update":"Wed Jul 5 23:34:41 2023","interfaces":[{"interface":"back","average":{"1min":3.4060000000000001,"5min":0.97899999999999998,"15min":0.57499999999999996},"min":{"1min":0.31,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":16.157,"5min":16.157,"15min":16.157},"last":0.21199999999999999},{"interface":"front","average":{"1min":3.6739999999999999,"5min":1.0269999999999999,"15min":0.58599999999999997},"min":{"1min":0.28899999999999998,"5min":0.254,"15min":0.254},"max":{"1min":14.91,"5min":14.91,"15min":14.91},"last":1.0700000000000001}]},{"osd":3,"last update":"Wed Jul 5 23:34:41 2023","interfaces":[{"interface":"back","average":{"1min":6.1820000000000004,"5min":1.534,"15min":0.75900000000000001},"min":{"1min":0.35299999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":16.928999999999998,"5min":16.928999999999998,"15min":16.928999999999998},"last":2.0529999999999999},{"interface":"front","average":{"1min":2.4399999999999999,"5min":0.83199999999999996,"15min":0.56399999999999995},"min":{"1min":0.38500000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":11.923999999999999,"5min":11.923999999999999,"15min":11.923999999999999},"last":0.34799999999999998}]},{"osd":4,"last update":"Wed Jul 5 23:34:41 2023","interfaces":[{"interface":"back","average":{"1min":4.6520000000000001,"5min":1.3899999999999999,"15min":0.84599999999999997},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":16.838000000000001,"5min":16.838000000000001,"15min":16.838000000000001},"last":0.95599999999999996},{"interface":"front","average":{"1min":5.7990000000000004,"5min":1.633,"15min":0.93899999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":23.905999999999999,"5min":23.905999999999999,"15min":23.905999999999999},"last":1.1910000000000001}]},{"osd":5,"last update":"Wed Jul 5 23:34:41 2023","interfaces":[{"interface":"back","average":{"1min":4.7140000000000004,"5min":1.4299999999999999,"15min":0.88200000000000001},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":17.824000000000002,"5min":17.824000000000002,"15min":17.824000000000002},"last":1.5109999999999999},{"interface":"front","average":{"1min":5.0519999999999996,"5min":1.5,"15min":0.90800000000000003},"min":{"1min":0.498,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":16.905000000000001,"5min":16.905000000000001,"15min":16.905000000000001},"last":0.98799999999999999}]},{"osd":6,"last update":"Wed Jul 5 23:34:41 2023","interfaces":[{"interface":"back","average":{"1min":2.7469999999999999,"5min":1.0389999999999999,"15min":0.754},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":10.102,"5min":10.102,"15min":10.102},"last":0.59699999999999998},{"interface":"front","average":{"1min":5.2690000000000001,"5min":1.5529999999999999,"15min":0.93300000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":32.298999999999999,"5min":32.298999999999999,"15min":32.298999999999999},"last":1.129}]},{"osd":7,"last update":"Wed Jul 5 23:34:41 2023","interfaces":[{"interface":"back","average":{"1min":4.7759999999999998,"5min":1.464,"15min":0.91200000000000003},"min":{"1min":0.51000000000000001,"5min":0.503,"15min":0.503},"max":{"1min":14.946,"5min":14.946,"15min":14.946},"last":1.1579999999999999},{"interface":"front","average":{"1min":5.8360000000000003,"5min":1.657,"15min":0.96099999999999997},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":16.878,"5min":16.878,"15min":16.878},"last":1.0149999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574884,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":88712,"kb_used_data":57664,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94283128,"statfs":{"total":96636764160,"available":96545923072,"internally_reserved":0,"allocated":59047936,"data_stored":58859102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 5 23:34:45 2023","interfaces":[{"interface":"back","average":{"1min":6.4109999999999996,"5min":1.728,"15min":0.94799999999999995},"min":{"1min":0.27600000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":29.716000000000001,"5min":29.716000000000001,"15min":29.716000000000001},"last":0.24399999999999999},{"interface":"front","average":{"1min":6.1890000000000001,"5min":1.7290000000000001,"15min":0.98599999999999999},"min":{"1min":0.26800000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":21.699000000000002,"5min":21.699000000000002,"15min":21.699000000000002},"last":0.34699999999999998}]},{"osd":1,"last update":"Wed Jul 5 23:34:45 2023","interfaces":[{"interface":"back","average":{"1min":6.0640000000000001,"5min":1.718,"15min":0.99399999999999999},"min":{"1min":0.35999999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":23.053000000000001,"5min":23.053000000000001,"15min":23.053000000000001},"last":0.39700000000000002},{"interface":"front","average":{"1min":5.3579999999999997,"5min":1.5720000000000001,"15min":0.94099999999999995},"min":{"1min":0.32800000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":29.632999999999999,"5min":29.632999999999999,"15min":29.632999999999999},"last":0.311}]},{"osd":3,"last update":"Wed Jul 5 23:34:45 2023","interfaces":[{"interface":"back","average":{"1min":3.52,"5min":1.1559999999999999,"15min":0.76200000000000001},"min":{"1min":0.29799999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":22.018000000000001,"5min":22.018000000000001,"15min":22.018000000000001},"last":0.28599999999999998},{"interface":"front","average":{"1min":4.9390000000000001,"5min":1.5429999999999999,"15min":0.97699999999999998},"min":{"1min":0.41399999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":29.686,"5min":29.686,"15min":29.686},"last":0.36399999999999999}]},{"osd":4,"last update":"Wed Jul 5 23:34:45 2023","interfaces":[{"interface":"back","average":{"1min":6.9909999999999997,"5min":2.0550000000000002,"15min":1.2330000000000001},"min":{"1min":0.46200000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":29.768999999999998,"5min":29.768999999999998,"15min":29.768999999999998},"last":0.54900000000000004},{"interface":"front","average":{"1min":7.3170000000000002,"5min":2.141,"15min":1.278},"min":{"1min":0.44600000000000001,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":21.16,"5min":21.16,"15min":21.16},"last":0.45100000000000001}]},{"osd":5,"last update":"Wed Jul 5 23:34:45 2023","interfaces":[{"interface":"back","average":{"1min":8.359,"5min":2.331,"15min":1.3260000000000001},"min":{"1min":0.502,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":22.927,"5min":22.927,"15min":22.927},"last":0.51500000000000001},{"interface":"front","average":{"1min":5.6970000000000001,"5min":1.8140000000000001,"15min":1.167},"min":{"1min":0.52400000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":23.120000000000001,"5min":23.120000000000001,"15min":23.120000000000001},"last":0.497}]},{"osd":6,"last update":"Wed Jul 5 23:34:45 2023","interfaces":[{"interface":"back","average":{"1min":6.0430000000000001,"5min":1.889,"15min":1.1970000000000001},"min":{"1min":0.54200000000000004,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":23.173999999999999,"5min":23.173999999999999,"15min":23.173999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":8.3699999999999992,"5min":2.3570000000000002,"15min":1.355},"min":{"1min":0.59599999999999997,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":29.742999999999999,"5min":29.742999999999999,"15min":29.742999999999999},"last":0.45600000000000002}]},{"osd":7,"last update":"Wed Jul 5 23:34:45 2023","interfaces":[{"interface":"back","average":{"1min":8.6240000000000006,"5min":2.4140000000000001,"15min":1.379},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":32.924999999999997,"5min":32.924999999999997,"15min":32.924999999999997},"last":0.47399999999999998},{"interface":"front","average":{"1min":7.1630000000000003,"5min":2.1419999999999999,"15min":1.3049999999999999},"min":{"1min":0.53000000000000003,"5min":0.436,"15min":0.436},"max":{"1min":30.594999999999999,"5min":30.594999999999999,"15min":30.594999999999999},"last":0.55800000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574883,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70284,"kb_used_data":43332,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94301556,"statfs":{"total":96636764160,"available":96564793344,"internally_reserved":0,"allocated":44371968,"data_stored":44179128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 5 23:34:48 2023","interfaces":[{"interface":"back","average":{"1min":4.9059999999999997,"5min":1.333,"15min":0.73699999999999999},"min":{"1min":0.33100000000000002,"5min":0.25,"15min":0.25},"max":{"1min":22.948,"5min":22.948,"15min":22.948},"last":0.26000000000000001},{"interface":"front","average":{"1min":4.9850000000000003,"5min":1.3799999999999999,"15min":0.77900000000000003},"min":{"1min":0.34699999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":23.036000000000001,"5min":23.036000000000001,"15min":23.036000000000001},"last":0.315}]},{"osd":1,"last update":"Wed Jul 5 23:34:48 2023","interfaces":[{"interface":"back","average":{"1min":4.1429999999999998,"5min":1.405,"15min":0.94899999999999995},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":18.981999999999999,"5min":18.981999999999999,"15min":18.981999999999999},"last":0.29799999999999999},{"interface":"front","average":{"1min":4.5170000000000003,"5min":1.512,"15min":1.0109999999999999},"min":{"1min":0.38300000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":25.253,"5min":25.253,"15min":25.253},"last":0.33500000000000002}]},{"osd":2,"last update":"Wed Jul 5 23:34:48 2023","interfaces":[{"interface":"back","average":{"1min":4.101,"5min":1.234,"15min":0.75600000000000001},"min":{"1min":0.30499999999999999,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":25.32,"5min":25.32,"15min":25.32},"last":0.36499999999999999},{"interface":"front","average":{"1min":4.048,"5min":1.2010000000000001,"15min":0.72699999999999998},"min":{"1min":0.42499999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":12.010999999999999,"5min":12.010999999999999,"15min":12.010999999999999},"last":0.378}]},{"osd":4,"last update":"Wed Jul 5 23:34:48 2023","interfaces":[{"interface":"back","average":{"1min":4.343,"5min":1.379,"15min":0.88500000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":19.007999999999999,"5min":19.007999999999999,"15min":19.007999999999999},"last":0.502},{"interface":"front","average":{"1min":5.3330000000000002,"5min":1.6080000000000001,"15min":0.98699999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":22.882000000000001,"5min":22.882000000000001,"15min":22.882000000000001},"last":0.51300000000000001}]},{"osd":5,"last update":"Wed Jul 5 23:34:48 2023","interfaces":[{"interface":"back","average":{"1min":6.7869999999999999,"5min":1.919,"15min":1.1080000000000001},"min":{"1min":0.46600000000000003,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":23.004999999999999,"5min":23.004999999999999,"15min":23.004999999999999},"last":0.44800000000000001},{"interface":"front","average":{"1min":5.7699999999999996,"5min":1.7330000000000001,"15min":1.0600000000000001},"min":{"1min":0.61499999999999999,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":18.959,"5min":18.959,"15min":18.959},"last":0.55800000000000005}]},{"osd":6,"last update":"Wed Jul 5 23:34:48 2023","interfaces":[{"interface":"back","average":{"1min":4.2370000000000001,"5min":1.429,"15min":0.96099999999999997},"min":{"1min":0.60699999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":18.923999999999999,"5min":18.923999999999999,"15min":18.923999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":5.5460000000000003,"5min":1.6539999999999999,"15min":1.006},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":18.978000000000002,"5min":18.978000000000002,"15min":18.978000000000002},"last":0.46600000000000003}]},{"osd":7,"last update":"Wed Jul 5 23:34:48 2023","interfaces":[{"interface":"back","average":{"1min":5.2569999999999997,"5min":1.585,"15min":0.97299999999999998},"min":{"1min":0.47499999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":19.937999999999999,"5min":19.937999999999999,"15min":19.937999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":5.9630000000000001,"5min":1.7749999999999999,"15min":1.077},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":22.974,"5min":22.974,"15min":22.974},"last":0.48199999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574884,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":75804,"kb_used_data":40660,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94296036,"statfs":{"total":96636764160,"available":96559140864,"internally_reserved":0,"allocated":41635840,"data_stored":41427888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 5 23:34:44 2023","interfaces":[{"interface":"back","average":{"1min":5.1120000000000001,"5min":1.4319999999999999,"15min":0.81799999999999995},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":16.655999999999999,"5min":16.655999999999999,"15min":16.655999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":5.5030000000000001,"5min":1.5149999999999999,"15min":0.85099999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":18.661999999999999,"5min":18.661999999999999,"15min":18.661999999999999},"last":0.52700000000000002}]},{"osd":1,"last update":"Wed Jul 5 23:34:44 2023","interfaces":[{"interface":"back","average":{"1min":5.3860000000000001,"5min":1.47,"15min":0.81799999999999995},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":18.991,"5min":18.991,"15min":18.991},"last":0.503},{"interface":"front","average":{"1min":7.1799999999999997,"5min":1.8400000000000001,"15min":0.94999999999999996},"min":{"1min":0.371,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":23.879000000000001,"5min":23.879000000000001,"15min":23.879000000000001},"last":0.54900000000000004}]},{"osd":2,"last update":"Wed Jul 5 23:34:44 2023","interfaces":[{"interface":"back","average":{"1min":6.8799999999999999,"5min":1.8320000000000001,"15min":0.98999999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":23.805,"5min":23.805,"15min":23.805},"last":0.53600000000000003},{"interface":"front","average":{"1min":6.1379999999999999,"5min":1.6659999999999999,"15min":0.92100000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":18.707000000000001,"5min":18.707000000000001,"15min":18.707000000000001},"last":0.434}]},{"osd":3,"last update":"Wed Jul 5 23:34:44 2023","interfaces":[{"interface":"back","average":{"1min":6.0090000000000003,"5min":1.6220000000000001,"15min":0.89100000000000001},"min":{"1min":0.373,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":22.966999999999999,"5min":22.966999999999999,"15min":22.966999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":6.0899999999999999,"5min":1.6799999999999999,"15min":0.94499999999999995},"min":{"1min":0.33800000000000002,"5min":0.314,"15min":0.314},"max":{"1min":23.843,"5min":23.843,"15min":23.843},"last":0.42199999999999999}]},{"osd":5,"last update":"Wed Jul 5 23:34:44 2023","interfaces":[{"interface":"back","average":{"1min":4.7779999999999996,"5min":1.3280000000000001,"15min":0.753},"min":{"1min":0.39500000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":16.574999999999999,"5min":16.574999999999999,"15min":16.574999999999999},"last":0.36799999999999999},{"interface":"front","average":{"1min":3.8380000000000001,"5min":1.1870000000000001,"15min":0.745},"min":{"1min":0.40100000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":18.693999999999999,"5min":18.693999999999999,"15min":18.693999999999999},"last":0.44800000000000001}]},{"osd":6,"last update":"Wed Jul 5 23:34:44 2023","interfaces":[{"interface":"back","average":{"1min":5.016,"5min":1.425,"15min":0.82699999999999996},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":17.983000000000001,"5min":17.983000000000001,"15min":17.983000000000001},"last":0.38100000000000001},{"interface":"front","average":{"1min":4.4509999999999996,"5min":1.3300000000000001,"15min":0.81000000000000005},"min":{"1min":0.44500000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":16.622,"5min":16.622,"15min":16.622},"last":0.47599999999999998}]},{"osd":7,"last update":"Wed Jul 5 23:34:44 2023","interfaces":[{"interface":"back","average":{"1min":3.9460000000000002,"5min":1.226,"15min":0.77300000000000002},"min":{"1min":0.46500000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":22.931000000000001,"5min":22.931000000000001,"15min":22.931000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":4.2030000000000003,"5min":1.3069999999999999,"15min":0.82499999999999996},"min":{"1min":0.40400000000000003,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":18.966000000000001,"5min":18.966000000000001,"15min":18.966000000000001},"last":0.46700000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574883,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":98960,"kb_used_data":63816,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94272880,"statfs":{"total":96636764160,"available":96535429120,"internally_reserved":0,"allocated":65347584,"data_stored":65151210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,3,4],"upper_bound":128},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 5 23:34:40 2023","interfaces":[{"interface":"back","average":{"1min":5.9340000000000002,"5min":1.5860000000000001,"15min":0.86099999999999999},"min":{"1min":0.42999999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":18.867999999999999,"5min":18.867999999999999,"15min":18.867999999999999},"last":0.34999999999999998},{"interface":"front","average":{"1min":4.109,"5min":1.3380000000000001,"15min":0.876},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":18.099,"5min":18.099,"15min":18.099},"last":0.27400000000000002}]},{"osd":1,"last update":"Wed Jul 5 23:34:40 2023","interfaces":[{"interface":"back","average":{"1min":3.8809999999999998,"5min":1.244,"15min":0.80400000000000005},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":18.071999999999999,"5min":18.071999999999999,"15min":18.071999999999999},"last":0.376},{"interface":"front","average":{"1min":4.7530000000000001,"5min":1.444,"15min":0.89200000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":16.869,"5min":16.869,"15min":16.869},"last":0.247}]},{"osd":2,"last update":"Wed Jul 5 23:34:40 2023","interfaces":[{"interface":"back","average":{"1min":5.4950000000000001,"5min":1.556,"15min":0.90000000000000002},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":22.177,"5min":22.177,"15min":22.177},"last":0.316},{"interface":"front","average":{"1min":5.4589999999999996,"5min":1.5589999999999999,"15min":0.90900000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":18.902999999999999,"5min":18.902999999999999,"15min":18.902999999999999},"last":0.40999999999999998}]},{"osd":3,"last update":"Wed Jul 5 23:34:40 2023","interfaces":[{"interface":"back","average":{"1min":4.3230000000000004,"5min":1.333,"15min":0.83499999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":18.032,"5min":18.032,"15min":18.032},"last":0.41899999999999998},{"interface":"front","average":{"1min":4.2400000000000002,"5min":1.399,"15min":0.92500000000000004},"min":{"1min":0.46700000000000003,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":16.905000000000001,"5min":16.905000000000001,"15min":16.905000000000001},"last":0.36399999999999999}]},{"osd":4,"last update":"Wed Jul 5 23:34:40 2023","interfaces":[{"interface":"back","average":{"1min":5.4420000000000002,"5min":1.51,"15min":0.85499999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":18.957000000000001,"5min":18.957000000000001,"15min":18.957000000000001},"last":0.29799999999999999},{"interface":"front","average":{"1min":3.6560000000000001,"5min":1.2,"15min":0.79100000000000004},"min":{"1min":0.38400000000000001,"5min":0.377,"15min":0.377},"max":{"1min":18.123999999999999,"5min":18.123999999999999,"15min":18.123999999999999},"last":0.33300000000000002}]},{"osd":6,"last update":"Wed Jul 5 23:34:40 2023","interfaces":[{"interface":"back","average":{"1min":4.1299999999999999,"5min":1.29,"15min":0.81599999999999995},"min":{"1min":0.41999999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":16.952000000000002,"5min":16.952000000000002,"15min":16.952000000000002},"last":0.42799999999999999},{"interface":"front","average":{"1min":5.1159999999999997,"5min":1.488,"15min":0.88300000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":18.928000000000001,"5min":18.928000000000001,"15min":18.928000000000001},"last":0.39000000000000001}]},{"osd":7,"last update":"Wed Jul 5 23:34:40 2023","interfaces":[{"interface":"back","average":{"1min":2.4380000000000002,"5min":0.96299999999999997,"15min":0.71699999999999997},"min":{"1min":0.40899999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":10.324999999999999,"5min":10.324999999999999,"15min":10.324999999999999},"last":0.443},{"interface":"front","average":{"1min":2.8799999999999999,"5min":1.077,"15min":0.77700000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":13.013,"5min":13.013,"15min":13.013},"last":0.39800000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":8225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1462272,"data_stored":1443154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1462272,"data_stored":1435671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":39845888,"data_stored":39845888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":41943040,"data_stored":41943040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":35651584,"data_stored":35651584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":27262976,"data_stored":27262976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":39845888,"data_stored":39845888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":35651584,"data_stored":35651584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":48234496,"data_stored":48234496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":41943040,"data_stored":41943040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-05T23:35:19.246 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-05T23:35:19.402 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.400+0000 7f64ef4e5700 1 Processor -- start 2023-07-05T23:35:19.403 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.400+0000 7f64ef4e5700 1 -- start start 2023-07-05T23:35:19.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.401+0000 7f64ef4e5700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f64e815a820 0x7f64e80caf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:19.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.401+0000 7f64ef4e5700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f64e80d0b00 0x7f64e815abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:19.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.401+0000 7f64ef4e5700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64e80cfa60 con 0x7f64e80d0f80 2023-07-05T23:35:19.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.401+0000 7f64ef4e5700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64e8154a80 con 0x7f64e80d0b00 2023-07-05T23:35:19.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.401+0000 7f64ef4e5700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64e80cfd40 con 0x7f64e815a820 2023-07-05T23:35:19.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.401+0000 7f64eca80700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f64e80d0b00 0x7f64e815abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:19.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.401+0000 7f64eca80700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f64e80d0b00 0x7f64e815abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46456/0 (socket says 172.21.15.27:46456) 2023-07-05T23:35:19.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.401+0000 7f64eca80700 1 -- 172.21.15.27:0/1783563273 learned_addr learned my addr 172.21.15.27:0/1783563273 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:19.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.401+0000 7f64ed281700 1 --2- 172.21.15.27:0/1783563273 >> v2:172.21.15.162:3300/0 conn(0x7f64e815a820 0x7f64e80caf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:19.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.401+0000 7f64eca80700 1 -- 172.21.15.27:0/1783563273 >> v2:172.21.15.162:3300/0 conn(0x7f64e815a820 msgr2=0x7f64e80caf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:35:19.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.402+0000 7f64eca80700 1 --2- 172.21.15.27:0/1783563273 >> v2:172.21.15.162:3300/0 conn(0x7f64e815a820 0x7f64e80caf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:19.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.402+0000 7f64eca80700 1 -- 172.21.15.27:0/1783563273 >> v1:172.21.15.162:6789/0 conn(0x7f64e80d0f80 legacy=0x7f64e80ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:35:19.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.402+0000 7f64eca80700 1 -- 172.21.15.27:0/1783563273 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64e80d0020 con 0x7f64e80d0b00 2023-07-05T23:35:19.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.402+0000 7f64eca80700 1 --2- 172.21.15.27:0/1783563273 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f64e80d0b00 0x7f64e815abf0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f64e806f5a0 tx=0x7f64d8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=109ddd4c15e02eaa server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:19.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.402+0000 7f64dffff700 1 -- 172.21.15.27:0/1783563273 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d8004230 con 0x7f64e80d0b00 2023-07-05T23:35:19.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.402+0000 7f64dffff700 1 -- 172.21.15.27:0/1783563273 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64d8004390 con 0x7f64e80d0b00 2023-07-05T23:35:19.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.402+0000 7f64dffff700 1 -- 172.21.15.27:0/1783563273 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d80036a0 con 0x7f64e80d0b00 2023-07-05T23:35:19.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.402+0000 7f64ef4e5700 1 -- 172.21.15.27:0/1783563273 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f64e80d0b00 msgr2=0x7f64e815abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:19.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.402+0000 7f64ef4e5700 1 --2- 172.21.15.27:0/1783563273 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f64e80d0b00 0x7f64e815abf0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f64e806f5a0 tx=0x7f64d8009bd0 comp rx=0 tx=0).stop 2023-07-05T23:35:19.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.402+0000 7f64ef4e5700 1 -- 172.21.15.27:0/1783563273 shutdown_connections 2023-07-05T23:35:19.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.402+0000 7f64ef4e5700 1 --2- 172.21.15.27:0/1783563273 >> v2:172.21.15.162:3300/0 conn(0x7f64e815a820 0x7f64e80caf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:19.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.402+0000 7f64ef4e5700 1 --2- 172.21.15.27:0/1783563273 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f64e80d0b00 0x7f64e815abf0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:19.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.402+0000 7f64ef4e5700 1 -- 172.21.15.27:0/1783563273 >> 172.21.15.27:0/1783563273 conn(0x7f64e806e530 msgr2=0x7f64e806e900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:19.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.403+0000 7f64ef4e5700 1 -- 172.21.15.27:0/1783563273 shutdown_connections 2023-07-05T23:35:19.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.403+0000 7f64ef4e5700 1 -- 172.21.15.27:0/1783563273 wait complete. 2023-07-05T23:35:19.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.404+0000 7f64ef4e5700 1 Processor -- start 2023-07-05T23:35:19.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.404+0000 7f64ef4e5700 1 -- start start 2023-07-05T23:35:19.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.405+0000 7f64ef4e5700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f64e80d0b00 0x7f64e80ca0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:19.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.405+0000 7f64ef4e5700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f64e80d0f80 0x7f64e80c8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:19.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.405+0000 7f64ef4e5700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f64e815a820 0x7f64e814deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:19.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.405+0000 7f64ef4e5700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e80c9410 con 0x7f64e80d0b00 2023-07-05T23:35:19.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.405+0000 7f64ef4e5700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e80c88d0 con 0x7f64e815a820 2023-07-05T23:35:19.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.405+0000 7f64ef4e5700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64e80c8b70 con 0x7f64e80d0f80 2023-07-05T23:35:19.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.405+0000 7f64ed281700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f64e80d0b00 0x7f64e80ca0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:19.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.405+0000 7f64ed281700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f64e80d0b00 0x7f64e80ca0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46462/0 (socket says 172.21.15.27:46462) 2023-07-05T23:35:19.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.405+0000 7f64ed281700 1 -- 172.21.15.27:0/560827720 learned_addr learned my addr 172.21.15.27:0/560827720 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:19.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.405+0000 7f64eca80700 1 --2- 172.21.15.27:0/560827720 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f64e80d0f80 0x7f64e80c8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:19.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.405+0000 7f64eda82700 1 --2- 172.21.15.27:0/560827720 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f64e815a820 0x7f64e814deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:19.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.405+0000 7f64ed281700 1 -- 172.21.15.27:0/560827720 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f64e80d0f80 msgr2=0x7f64e80c8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:19.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.405+0000 7f64ed281700 1 --2- 172.21.15.27:0/560827720 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f64e80d0f80 0x7f64e80c8390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:19.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.405+0000 7f64ed281700 1 -- 172.21.15.27:0/560827720 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f64e815a820 msgr2=0x7f64e814deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:19.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.405+0000 7f64ed281700 1 --2- 172.21.15.27:0/560827720 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f64e815a820 0x7f64e814deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:19.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.405+0000 7f64ed281700 1 -- 172.21.15.27:0/560827720 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d8009550 con 0x7f64e80d0b00 2023-07-05T23:35:19.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.405+0000 7f64ed281700 1 --2- 172.21.15.27:0/560827720 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f64e80d0b00 0x7f64e80ca0c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f64e400d800 tx=0x7f64e400dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:19.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.405+0000 7f64ddffb700 1 -- 172.21.15.27:0/560827720 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e40125f0 con 0x7f64e80d0b00 2023-07-05T23:35:19.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.405+0000 7f64ddffb700 1 -- 172.21.15.27:0/560827720 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64e4012750 con 0x7f64e80d0b00 2023-07-05T23:35:19.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.405+0000 7f64ef4e5700 1 -- 172.21.15.27:0/560827720 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64e80c8e50 con 0x7f64e80d0b00 2023-07-05T23:35:19.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.405+0000 7f64ddffb700 1 -- 172.21.15.27:0/560827720 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e4012b00 con 0x7f64e80d0b00 2023-07-05T23:35:19.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.406+0000 7f64ef4e5700 1 -- 172.21.15.27:0/560827720 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64e815bb80 con 0x7f64e80d0b00 2023-07-05T23:35:19.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.407+0000 7f64ef4e5700 1 -- 172.21.15.27:0/560827720 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64e8073910 con 0x7f64e80d0b00 2023-07-05T23:35:19.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.407+0000 7f64ddffb700 1 -- 172.21.15.27:0/560827720 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f64e4012c60 con 0x7f64e80d0b00 2023-07-05T23:35:19.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.407+0000 7f64ddffb700 1 --2- 172.21.15.27:0/560827720 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f64cc06ace0 0x7f64cc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:19.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.407+0000 7f64ddffb700 1 -- 172.21.15.27:0/560827720 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f64e4089b20 con 0x7f64e80d0b00 2023-07-05T23:35:19.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.408+0000 7f64eca80700 1 --2- 172.21.15.27:0/560827720 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f64cc06ace0 0x7f64cc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:19.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.408+0000 7f64eca80700 1 --2- 172.21.15.27:0/560827720 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f64cc06ace0 0x7f64cc06d190 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f64d8009130 tx=0x7f64d8008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:19.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.412+0000 7f64ddffb700 1 -- 172.21.15.27:0/560827720 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f64e4054930 con 0x7f64e80d0b00 2023-07-05T23:35:19.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.611+0000 7f64ef4e5700 1 -- 172.21.15.27:0/560827720 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f64e80b1270 con 0x7f64e80d0b00 2023-07-05T23:35:19.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.612+0000 7f64ddffb700 1 -- 172.21.15.27:0/560827720 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20215 (secure 0 0 0) 0x7f64e4057f50 con 0x7f64e80d0b00 2023-07-05T23:35:19.615 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:35:19.615 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":30,"fsid":"23eebe48-65f5-4d3c-8c2d-4aa171c055d5","created":"2023-07-05T23:32:27.989612+0000","modified":"2023-07-05T23:33:34.883498+0000","last_up_change":"2023-07-05T23:32:39.601570+0000","last_in_change":"2023-07-05T23:32:30.488261+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-05T23:32:41.624598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-05T23:32:46.481587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-05T23:32:51.025210+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-05T23:32:52.286964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-05T23:32:55.354212+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ac2071e4-394b-4385-b9ba-fad5265efc65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6814","nonce":3766536605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6818","nonce":3766536605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6823","nonce":3766536605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6821","nonce":3766536605}]},"public_addr":"172.21.15.27:6814/3766536605","cluster_addr":"172.21.15.27:6818/3766536605","heartbeat_back_addr":"172.21.15.27:6823/3766536605","heartbeat_front_addr":"172.21.15.27:6821/3766536605","state":["exists","up"]},{"osd":1,"uuid":"8c9b61a0-39d5-46bf-afd6-5add78453ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6801","nonce":1579117455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6803","nonce":1579117455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6807","nonce":1579117455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6805","nonce":1579117455}]},"public_addr":"172.21.15.27:6801/1579117455","cluster_addr":"172.21.15.27:6803/1579117455","heartbeat_back_addr":"172.21.15.27:6807/1579117455","heartbeat_front_addr":"172.21.15.27:6805/1579117455","state":["exists","up"]},{"osd":2,"uuid":"dcd032a2-06b1-4055-b798-b86c71a7107d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6825","nonce":807520271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6827","nonce":807520271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6831","nonce":807520271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6829","nonce":807520271}]},"public_addr":"172.21.15.27:6825/807520271","cluster_addr":"172.21.15.27:6827/807520271","heartbeat_back_addr":"172.21.15.27:6831/807520271","heartbeat_front_addr":"172.21.15.27:6829/807520271","state":["exists","up"]},{"osd":3,"uuid":"b0ffe0fc-47ba-4636-b5ea-6bab637642c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6809","nonce":2125656143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6811","nonce":2125656143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6817","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6819","nonce":2125656143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6813","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6815","nonce":2125656143}]},"public_addr":"172.21.15.27:6809/2125656143","cluster_addr":"172.21.15.27:6811/2125656143","heartbeat_back_addr":"172.21.15.27:6819/2125656143","heartbeat_front_addr":"172.21.15.27:6815/2125656143","state":["exists","up"]},{"osd":4,"uuid":"7fab4e5a-1246-4efe-9562-10c4a6c789ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6801","nonce":2111223016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6803","nonce":2111223016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6807","nonce":2111223016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6805","nonce":2111223016}]},"public_addr":"172.21.15.162:6801/2111223016","cluster_addr":"172.21.15.162:6803/2111223016","heartbeat_back_addr":"172.21.15.162:6807/2111223016","heartbeat_front_addr":"172.21.15.162:6805/2111223016","state":["exists","up"]},{"osd":5,"uuid":"110c4d9f-cef6-48ab-a818-5a81e72372af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6825","nonce":3102609008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6827","nonce":3102609008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6831","nonce":3102609008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6829","nonce":3102609008}]},"public_addr":"172.21.15.162:6825/3102609008","cluster_addr":"172.21.15.162:6827/3102609008","heartbeat_back_addr":"172.21.15.162:6831/3102609008","heartbeat_front_addr":"172.21.15.162:6829/3102609008","state":["exists","up"]},{"osd":6,"uuid":"16803bcc-2c92-4aed-954e-487938c9f24a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6809","nonce":2657688865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6811","nonce":2657688865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6815","nonce":2657688865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6813","nonce":2657688865}]},"public_addr":"172.21.15.162:6809/2657688865","cluster_addr":"172.21.15.162:6811/2657688865","heartbeat_back_addr":"172.21.15.162:6815/2657688865","heartbeat_front_addr":"172.21.15.162:6813/2657688865","state":["exists","up"]},{"osd":7,"uuid":"b7c35377-3cf2-4569-b6b9-72376eb463bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6817","nonce":2096609978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6819","nonce":2096609978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6823","nonce":2096609978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6821","nonce":2096609978}]},"public_addr":"172.21.15.162:6817/2096609978","cluster_addr":"172.21.15.162:6819/2096609978","heartbeat_back_addr":"172.21.15.162:6823/2096609978","heartbeat_front_addr":"172.21.15.162:6821/2096609978","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.735448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.645561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.759120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.682507+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.736228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.694664+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.716002+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.680485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":3,"to":2}]},{"pgid":"4.26","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-05T23:35:19.616 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.614+0000 7f64ef4e5700 1 -- 172.21.15.27:0/560827720 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f64cc06ace0 msgr2=0x7f64cc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:19.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.614+0000 7f64ef4e5700 1 --2- 172.21.15.27:0/560827720 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f64cc06ace0 0x7f64cc06d190 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f64d8009130 tx=0x7f64d8008030 comp rx=0 tx=0).stop 2023-07-05T23:35:19.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.614+0000 7f64ef4e5700 1 -- 172.21.15.27:0/560827720 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f64e80d0b00 msgr2=0x7f64e80ca0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:19.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.614+0000 7f64ef4e5700 1 --2- 172.21.15.27:0/560827720 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f64e80d0b00 0x7f64e80ca0c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f64e400d800 tx=0x7f64e400dbc0 comp rx=0 tx=0).stop 2023-07-05T23:35:19.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.614+0000 7f64ef4e5700 1 -- 172.21.15.27:0/560827720 shutdown_connections 2023-07-05T23:35:19.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.614+0000 7f64ef4e5700 1 --2- 172.21.15.27:0/560827720 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f64e815a820 0x7f64e814deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:19.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.614+0000 7f64ef4e5700 1 --2- 172.21.15.27:0/560827720 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f64cc06ace0 0x7f64cc06d190 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:19.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.614+0000 7f64ef4e5700 1 --2- 172.21.15.27:0/560827720 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f64e80d0b00 0x7f64e80ca0c0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:19.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.614+0000 7f64ef4e5700 1 --2- 172.21.15.27:0/560827720 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f64e80d0f80 0x7f64e80c8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:19.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.614+0000 7f64ef4e5700 1 -- 172.21.15.27:0/560827720 >> 172.21.15.27:0/560827720 conn(0x7f64e806e530 msgr2=0x7f64e815e170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:19.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.614+0000 7f64ef4e5700 1 -- 172.21.15.27:0/560827720 shutdown_connections 2023-07-05T23:35:19.619 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:19.614+0000 7f64ef4e5700 1 -- 172.21.15.27:0/560827720 wait complete. 2023-07-05T23:35:20.630 INFO:tasks.ceph:Scrubbing osd.0 2023-07-05T23:35:20.630 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-07-05T23:35:20.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.771+0000 7f006d21a700 1 Processor -- start 2023-07-05T23:35:20.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.771+0000 7f006d21a700 1 -- start start 2023-07-05T23:35:20.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.772+0000 7f006d21a700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f00680cd5e0 0x7f00680cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:20.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.772+0000 7f006d21a700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f006806e030 0x7f006806e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:20.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.772+0000 7f006d21a700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f006815cf70 0x7f006815d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:20.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.772+0000 7f006d21a700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00680ce2c0 con 0x7f00680cd5e0 2023-07-05T23:35:20.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.772+0000 7f006d21a700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f006806f0e0 con 0x7f006806e030 2023-07-05T23:35:20.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.772+0000 7f006d21a700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00680cdef0 con 0x7f006815cf70 2023-07-05T23:35:20.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.772+0000 7f0066d9d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f00680cd5e0 0x7f00680cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:20.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.772+0000 7f0066d9d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f00680cd5e0 0x7f00680cd9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46470/0 (socket says 172.21.15.27:46470) 2023-07-05T23:35:20.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.772+0000 7f0066d9d700 1 -- 172.21.15.27:0/1130392498 learned_addr learned my addr 172.21.15.27:0/1130392498 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:20.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.772+0000 7f006759e700 1 --2- 172.21.15.27:0/1130392498 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f006815cf70 0x7f006815d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:20.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.772+0000 7f006659c700 1 --2- 172.21.15.27:0/1130392498 >> v2:172.21.15.162:3300/0 conn(0x7f006806e030 0x7f006806e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:20.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.772+0000 7f0066d9d700 1 -- 172.21.15.27:0/1130392498 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f006815cf70 msgr2=0x7f006815d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:35:20.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.772+0000 7f0066d9d700 1 --2- 172.21.15.27:0/1130392498 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f006815cf70 0x7f006815d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:20.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.772+0000 7f0066d9d700 1 -- 172.21.15.27:0/1130392498 >> v2:172.21.15.162:3300/0 conn(0x7f006806e030 msgr2=0x7f006806e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:35:20.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.772+0000 7f0066d9d700 1 --2- 172.21.15.27:0/1130392498 >> v2:172.21.15.162:3300/0 conn(0x7f006806e030 0x7f006806e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:20.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.772+0000 7f0066d9d700 1 -- 172.21.15.27:0/1130392498 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f006806eb20 con 0x7f00680cd5e0 2023-07-05T23:35:20.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.772+0000 7f006759e700 1 --2- 172.21.15.27:0/1130392498 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f006815cf70 0x7f006815d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T23:35:20.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.773+0000 7f0066d9d700 1 --2- 172.21.15.27:0/1130392498 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00680cd5e0 0x7f00680cd9b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f006815ced0 tx=0x7f0058009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3cf4c7e0e1462a5 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:20.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.773+0000 7f0065d9b700 1 -- 172.21.15.27:0/1130392498 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0058005e30 con 0x7f00680cd5e0 2023-07-05T23:35:20.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.773+0000 7f0065d9b700 1 -- 172.21.15.27:0/1130392498 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0058004030 con 0x7f00680cd5e0 2023-07-05T23:35:20.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.773+0000 7f0065d9b700 1 -- 172.21.15.27:0/1130392498 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00580043e0 con 0x7f00680cd5e0 2023-07-05T23:35:20.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.773+0000 7f006d21a700 1 -- 172.21.15.27:0/1130392498 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00680cd5e0 msgr2=0x7f00680cd9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:20.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.773+0000 7f006d21a700 1 --2- 172.21.15.27:0/1130392498 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00680cd5e0 0x7f00680cd9b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f006815ced0 tx=0x7f0058009bd0 comp rx=0 tx=0).stop 2023-07-05T23:35:20.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.773+0000 7f006d21a700 1 -- 172.21.15.27:0/1130392498 shutdown_connections 2023-07-05T23:35:20.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.773+0000 7f006d21a700 1 --2- 172.21.15.27:0/1130392498 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f006815cf70 0x7f006815d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:20.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.773+0000 7f006d21a700 1 --2- 172.21.15.27:0/1130392498 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00680cd5e0 0x7f00680cd9b0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:20.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.773+0000 7f006d21a700 1 --2- 172.21.15.27:0/1130392498 >> v2:172.21.15.162:3300/0 conn(0x7f006806e030 0x7f006806e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:20.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.773+0000 7f006d21a700 1 -- 172.21.15.27:0/1130392498 >> 172.21.15.27:0/1130392498 conn(0x7f006806b920 msgr2=0x7f00680cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:20.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.773+0000 7f006d21a700 1 -- 172.21.15.27:0/1130392498 shutdown_connections 2023-07-05T23:35:20.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.773+0000 7f006d21a700 1 -- 172.21.15.27:0/1130392498 wait complete. 2023-07-05T23:35:20.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.775+0000 7f006d21a700 1 Processor -- start 2023-07-05T23:35:20.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.775+0000 7f006d21a700 1 -- start start 2023-07-05T23:35:20.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.776+0000 7f006d21a700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f006806e030 0x7f006809cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:20.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.776+0000 7f006d21a700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00680cd5e0 0x7f00681f3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:20.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.776+0000 7f006d21a700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f006815cf70 0x7f006815a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:20.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.776+0000 7f006d21a700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00680c4280 con 0x7f00680cd5e0 2023-07-05T23:35:20.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.776+0000 7f006d21a700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00680c3670 con 0x7f006815cf70 2023-07-05T23:35:20.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.776+0000 7f006d21a700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00680c3950 con 0x7f006806e030 2023-07-05T23:35:20.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.776+0000 7f006659c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00680cd5e0 0x7f00681f3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:20.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.776+0000 7f006659c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00680cd5e0 0x7f00681f3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46478/0 (socket says 172.21.15.27:46478) 2023-07-05T23:35:20.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.776+0000 7f006659c700 1 -- 172.21.15.27:0/2366710014 learned_addr learned my addr 172.21.15.27:0/2366710014 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:20.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.776+0000 7f006759e700 1 --2- 172.21.15.27:0/2366710014 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f006815cf70 0x7f006815a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:20.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.776+0000 7f0066d9d700 1 --2- 172.21.15.27:0/2366710014 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f006806e030 0x7f006809cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:20.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.776+0000 7f006659c700 1 -- 172.21.15.27:0/2366710014 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f006806e030 msgr2=0x7f006809cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:20.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.776+0000 7f006659c700 1 --2- 172.21.15.27:0/2366710014 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f006806e030 0x7f006809cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:20.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.776+0000 7f006659c700 1 -- 172.21.15.27:0/2366710014 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f006815cf70 msgr2=0x7f006815a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:20.791 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.776+0000 7f006659c700 1 --2- 172.21.15.27:0/2366710014 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f006815cf70 0x7f006815a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:20.791 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.776+0000 7f006659c700 1 -- 172.21.15.27:0/2366710014 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0058009500 con 0x7f00680cd5e0 2023-07-05T23:35:20.791 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.776+0000 7f006659c700 1 --2- 172.21.15.27:0/2366710014 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00680cd5e0 0x7f00681f3ba0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f005c00e810 tx=0x7f005c00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:20.791 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.777+0000 7f004f7fe700 1 -- 172.21.15.27:0/2366710014 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005c013610 con 0x7f00680cd5e0 2023-07-05T23:35:20.792 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.777+0000 7f004f7fe700 1 -- 172.21.15.27:0/2366710014 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f005c013790 con 0x7f00680cd5e0 2023-07-05T23:35:20.792 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.777+0000 7f006d21a700 1 -- 172.21.15.27:0/2366710014 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00680c3c30 con 0x7f00680cd5e0 2023-07-05T23:35:20.792 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.777+0000 7f004f7fe700 1 -- 172.21.15.27:0/2366710014 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005c013b40 con 0x7f00680cd5e0 2023-07-05T23:35:20.792 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.777+0000 7f006d21a700 1 -- 172.21.15.27:0/2366710014 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00680c3290 con 0x7f00680cd5e0 2023-07-05T23:35:20.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.777+0000 7f006d21a700 1 -- 172.21.15.27:0/2366710014 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f00680ac730 con 0x7f00680cd5e0 2023-07-05T23:35:20.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.778+0000 7f004f7fe700 1 -- 172.21.15.27:0/2366710014 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f005c013ca0 con 0x7f00680cd5e0 2023-07-05T23:35:20.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.779+0000 7f004f7fe700 1 --2- 172.21.15.27:0/2366710014 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f005406ace0 0x7f005406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:20.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.779+0000 7f004f7fe700 1 -- 172.21.15.27:0/2366710014 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f005c089980 con 0x7f00680cd5e0 2023-07-05T23:35:20.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.779+0000 7f004f7fe700 1 --2- 172.21.15.27:0/2366710014 >> [v2:172.21.15.27:6812/3766536605,v1:172.21.15.27:6814/3766536605] conn(0x7f00540749f0 0x7f0054076e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:20.794 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.779+0000 7f004f7fe700 1 -- 172.21.15.27:0/2366710014 --> [v2:172.21.15.27:6812/3766536605,v1:172.21.15.27:6814/3766536605] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0054077530 con 0x7f00540749f0 2023-07-05T23:35:20.794 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.779+0000 7f004f7fe700 1 -- 172.21.15.27:0/2366710014 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f005c089dd0 con 0x7f00680cd5e0 2023-07-05T23:35:20.794 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.779+0000 7f0066d9d700 1 --2- 172.21.15.27:0/2366710014 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f005406ace0 0x7f005406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:20.794 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.779+0000 7f006759e700 1 --2- 172.21.15.27:0/2366710014 >> [v2:172.21.15.27:6812/3766536605,v1:172.21.15.27:6814/3766536605] conn(0x7f00540749f0 0x7f0054076e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:20.794 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.779+0000 7f006759e700 1 --2- 172.21.15.27:0/2366710014 >> [v2:172.21.15.27:6812/3766536605,v1:172.21.15.27:6814/3766536605] conn(0x7f00540749f0 0x7f0054076e60 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:20.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.779+0000 7f0066d9d700 1 --2- 172.21.15.27:0/2366710014 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f005406ace0 0x7f005406d190 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f006815ced0 tx=0x7f0058008070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:20.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.780+0000 7f004f7fe700 1 -- 172.21.15.27:0/2366710014 <== osd.0 v2:172.21.15.27:6812/3766536605 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f0054077530 con 0x7f00540749f0 2023-07-05T23:35:20.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.794+0000 7f006d21a700 1 -- 172.21.15.27:0/2366710014 --> [v2:172.21.15.27:6812/3766536605,v1:172.21.15.27:6814/3766536605] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f006806ee00 con 0x7f00540749f0 2023-07-05T23:35:20.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.795+0000 7f004f7fe700 1 -- 172.21.15.27:0/2366710014 <== osd.0 v2:172.21.15.27:6812/3766536605 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f006000f450 con 0x7f00540749f0 2023-07-05T23:35:20.797 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2023-07-05T23:35:20.797 INFO:teuthology.orchestra.run.smithi027.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-05T23:35:20.798 INFO:teuthology.orchestra.run.smithi027.stdout:} 2023-07-05T23:35:20.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.795+0000 7f006d21a700 1 -- 172.21.15.27:0/2366710014 >> [v2:172.21.15.27:6812/3766536605,v1:172.21.15.27:6814/3766536605] conn(0x7f00540749f0 msgr2=0x7f0054076e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:20.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.795+0000 7f006d21a700 1 --2- 172.21.15.27:0/2366710014 >> [v2:172.21.15.27:6812/3766536605,v1:172.21.15.27:6814/3766536605] conn(0x7f00540749f0 0x7f0054076e60 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:20.800 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.795+0000 7f006d21a700 1 -- 172.21.15.27:0/2366710014 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f005406ace0 msgr2=0x7f005406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:20.800 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.795+0000 7f006d21a700 1 --2- 172.21.15.27:0/2366710014 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f005406ace0 0x7f005406d190 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f006815ced0 tx=0x7f0058008070 comp rx=0 tx=0).stop 2023-07-05T23:35:20.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.795+0000 7f006d21a700 1 -- 172.21.15.27:0/2366710014 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00680cd5e0 msgr2=0x7f00681f3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:20.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.795+0000 7f006d21a700 1 --2- 172.21.15.27:0/2366710014 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00680cd5e0 0x7f00681f3ba0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f005c00e810 tx=0x7f005c00eb20 comp rx=0 tx=0).stop 2023-07-05T23:35:20.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.795+0000 7f006759e700 1 -- 172.21.15.27:0/2366710014 reap_dead start 2023-07-05T23:35:20.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.795+0000 7f006d21a700 1 -- 172.21.15.27:0/2366710014 shutdown_connections 2023-07-05T23:35:20.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.795+0000 7f006d21a700 1 -- 172.21.15.27:0/2366710014 >> 172.21.15.27:0/2366710014 conn(0x7f006806b920 msgr2=0x7f00680ae5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:20.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.795+0000 7f006d21a700 1 -- 172.21.15.27:0/2366710014 shutdown_connections 2023-07-05T23:35:20.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.795+0000 7f006d21a700 1 -- 172.21.15.27:0/2366710014 wait complete. 2023-07-05T23:35:20.809 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-07-05T23:35:20.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.933+0000 7fd2b7469700 1 Processor -- start 2023-07-05T23:35:20.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.934+0000 7fd2b7469700 1 -- start start 2023-07-05T23:35:20.938 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.934+0000 7fd2b7469700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2b0156880 0x7fd2b0069ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:20.938 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.934+0000 7fd2b7469700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd2b00cc1d0 0x7fd2b00cc650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:20.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.934+0000 7fd2b7469700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2b00cee80 con 0x7fd2b00aed30 2023-07-05T23:35:20.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.934+0000 7fd2b7469700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2b00ccb90 con 0x7fd2b00cc1d0 2023-07-05T23:35:20.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.934+0000 7fd2b7469700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b00cf100 con 0x7fd2b0156880 2023-07-05T23:35:20.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.935+0000 7fd2b5a06700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd2b00cc1d0 0x7fd2b00cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:20.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.935+0000 7fd2b5a06700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd2b00cc1d0 0x7fd2b00cc650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46490/0 (socket says 172.21.15.27:46490) 2023-07-05T23:35:20.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.935+0000 7fd2b5a06700 1 -- 172.21.15.27:0/832946401 learned_addr learned my addr 172.21.15.27:0/832946401 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:20.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.935+0000 7fd2b5205700 1 --2- 172.21.15.27:0/832946401 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2b0156880 0x7fd2b0069ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:20.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.935+0000 7fd2b5a06700 1 -- 172.21.15.27:0/832946401 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2b0156880 msgr2=0x7fd2b0069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:35:20.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.935+0000 7fd2b5a06700 1 --2- 172.21.15.27:0/832946401 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2b0156880 0x7fd2b0069ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:20.941 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.935+0000 7fd2b5a06700 1 -- 172.21.15.27:0/832946401 >> v1:172.21.15.27:6789/0 conn(0x7fd2b00aed30 legacy=0x7fd2b0160580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:35:20.941 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.935+0000 7fd2b5a06700 1 -- 172.21.15.27:0/832946401 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2b00cf3e0 con 0x7fd2b00cc1d0 2023-07-05T23:35:20.941 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.935+0000 7fd2b5a06700 1 --2- 172.21.15.27:0/832946401 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd2b00cc1d0 0x7fd2b00cc650 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8009e50 tx=0x7fd2a800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb72b51461d4a2e4 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:20.941 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.935+0000 7fd2a7fff700 1 -- 172.21.15.27:0/832946401 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a800e070 con 0x7fd2b00cc1d0 2023-07-05T23:35:20.942 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.935+0000 7fd2a7fff700 1 -- 172.21.15.27:0/832946401 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2a8003a20 con 0x7fd2b00cc1d0 2023-07-05T23:35:20.942 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.935+0000 7fd2a7fff700 1 -- 172.21.15.27:0/832946401 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a8003dd0 con 0x7fd2b00cc1d0 2023-07-05T23:35:20.942 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.936+0000 7fd2b7469700 1 -- 172.21.15.27:0/832946401 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd2b00cc1d0 msgr2=0x7fd2b00cc650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:20.942 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.936+0000 7fd2b7469700 1 --2- 172.21.15.27:0/832946401 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd2b00cc1d0 0x7fd2b00cc650 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8009e50 tx=0x7fd2a800b330 comp rx=0 tx=0).stop 2023-07-05T23:35:20.942 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.936+0000 7fd2b7469700 1 -- 172.21.15.27:0/832946401 shutdown_connections 2023-07-05T23:35:20.943 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.936+0000 7fd2b7469700 1 --2- 172.21.15.27:0/832946401 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd2b00cc1d0 0x7fd2b00cc650 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:20.943 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.936+0000 7fd2b7469700 1 --2- 172.21.15.27:0/832946401 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2b0156880 0x7fd2b0069ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:20.943 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.936+0000 7fd2b7469700 1 -- 172.21.15.27:0/832946401 >> 172.21.15.27:0/832946401 conn(0x7fd2b006d4a0 msgr2=0x7fd2b006d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:20.943 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.936+0000 7fd2b7469700 1 -- 172.21.15.27:0/832946401 shutdown_connections 2023-07-05T23:35:20.943 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.936+0000 7fd2b7469700 1 -- 172.21.15.27:0/832946401 wait complete. 2023-07-05T23:35:20.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.937+0000 7fd2b7469700 1 Processor -- start 2023-07-05T23:35:20.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.937+0000 7fd2b7469700 1 -- start start 2023-07-05T23:35:20.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.938+0000 7fd2b7469700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd2b00aed30 0x7fd2b0155c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:20.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.938+0000 7fd2b7469700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2b00cc1d0 0x7fd2b00ab8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:20.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.938+0000 7fd2b7469700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd2b0156880 0x7fd2b00abe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:20.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.938+0000 7fd2b7469700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b0156170 con 0x7fd2b0156880 2023-07-05T23:35:20.948 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.938+0000 7fd2b7469700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b00b3660 con 0x7fd2b00aed30 2023-07-05T23:35:20.948 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.938+0000 7fd2b7469700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b00c5590 con 0x7fd2b00cc1d0 2023-07-05T23:35:20.948 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.938+0000 7fd2b5a06700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd2b0156880 0x7fd2b00abe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:20.948 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.938+0000 7fd2b5a06700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd2b0156880 0x7fd2b00abe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46496/0 (socket says 172.21.15.27:46496) 2023-07-05T23:35:20.948 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.938+0000 7fd2b5a06700 1 -- 172.21.15.27:0/3027009408 learned_addr learned my addr 172.21.15.27:0/3027009408 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:20.949 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.938+0000 7fd2b5205700 1 --2- 172.21.15.27:0/3027009408 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd2b00aed30 0x7fd2b0155c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:20.949 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.938+0000 7fd2b4a04700 1 --2- 172.21.15.27:0/3027009408 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2b00cc1d0 0x7fd2b00ab8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:20.949 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.938+0000 7fd2b5a06700 1 -- 172.21.15.27:0/3027009408 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2b00cc1d0 msgr2=0x7fd2b00ab8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:20.949 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.938+0000 7fd2b5a06700 1 --2- 172.21.15.27:0/3027009408 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2b00cc1d0 0x7fd2b00ab8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:20.950 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.938+0000 7fd2b5a06700 1 -- 172.21.15.27:0/3027009408 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd2b00aed30 msgr2=0x7fd2b0155c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:20.950 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.938+0000 7fd2b5a06700 1 --2- 172.21.15.27:0/3027009408 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd2b00aed30 0x7fd2b0155c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:20.950 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.938+0000 7fd2b5a06700 1 -- 172.21.15.27:0/3027009408 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a8009b30 con 0x7fd2b0156880 2023-07-05T23:35:20.950 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.938+0000 7fd2b5a06700 1 --2- 172.21.15.27:0/3027009408 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd2b0156880 0x7fd2b00abe10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fd2b00ccf50 tx=0x7fd2a8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:20.951 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.939+0000 7fd2a5ffb700 1 -- 172.21.15.27:0/3027009408 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a8004440 con 0x7fd2b0156880 2023-07-05T23:35:20.951 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.939+0000 7fd2a5ffb700 1 -- 172.21.15.27:0/3027009408 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2a80045c0 con 0x7fd2b0156880 2023-07-05T23:35:20.951 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.939+0000 7fd2b7469700 1 -- 172.21.15.27:0/3027009408 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2b00c5870 con 0x7fd2b0156880 2023-07-05T23:35:20.951 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.939+0000 7fd2a5ffb700 1 -- 172.21.15.27:0/3027009408 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a8004970 con 0x7fd2b0156880 2023-07-05T23:35:20.951 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.939+0000 7fd2b7469700 1 -- 172.21.15.27:0/3027009408 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2b00c5e30 con 0x7fd2b0156880 2023-07-05T23:35:20.952 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.940+0000 7fd2b7469700 1 -- 172.21.15.27:0/3027009408 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2b00c5fc0 con 0x7fd2b0156880 2023-07-05T23:35:20.952 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.940+0000 7fd2a5ffb700 1 -- 172.21.15.27:0/3027009408 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd2a8025450 con 0x7fd2b0156880 2023-07-05T23:35:20.952 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.941+0000 7fd2a5ffb700 1 --2- 172.21.15.27:0/3027009408 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fd29406ace0 0x7fd29406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:20.952 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.941+0000 7fd2a5ffb700 1 -- 172.21.15.27:0/3027009408 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd2a808ad60 con 0x7fd2b0156880 2023-07-05T23:35:20.953 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.941+0000 7fd2b5205700 1 --2- 172.21.15.27:0/3027009408 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fd29406ace0 0x7fd29406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:20.953 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.941+0000 7fd2b5205700 1 --2- 172.21.15.27:0/3027009408 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fd29406ace0 0x7fd29406d190 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd2a0006b20 tx=0x7fd2a0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:20.953 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:20.945+0000 7fd2a5ffb700 1 -- 172.21.15.27:0/3027009408 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd2a8059600 con 0x7fd2b0156880 2023-07-05T23:35:21.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.144+0000 7fd2b7469700 1 -- 172.21.15.27:0/3027009408 --> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fd2b00cd670 con 0x7fd29406ace0 2023-07-05T23:35:21.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.145+0000 7fd2a5ffb700 1 -- 172.21.15.27:0/3027009408 <== mgr.4105 v2:172.21.15.162:6832/3790028097 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd2a0009e40 con 0x7fd29406ace0 2023-07-05T23:35:21.149 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.147+0000 7fd2b7469700 1 -- 172.21.15.27:0/3027009408 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fd29406ace0 msgr2=0x7fd29406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:21.149 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.147+0000 7fd2b7469700 1 --2- 172.21.15.27:0/3027009408 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fd29406ace0 0x7fd29406d190 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd2a0006b20 tx=0x7fd2a0008040 comp rx=0 tx=0).stop 2023-07-05T23:35:21.149 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.147+0000 7fd2b7469700 1 -- 172.21.15.27:0/3027009408 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd2b0156880 msgr2=0x7fd2b00abe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:21.149 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.147+0000 7fd2b7469700 1 --2- 172.21.15.27:0/3027009408 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd2b0156880 0x7fd2b00abe10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fd2b00ccf50 tx=0x7fd2a8004ad0 comp rx=0 tx=0).stop 2023-07-05T23:35:21.150 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.147+0000 7fd2b7469700 1 -- 172.21.15.27:0/3027009408 shutdown_connections 2023-07-05T23:35:21.150 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.147+0000 7fd2b7469700 1 --2- 172.21.15.27:0/3027009408 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd2b00aed30 0x7fd2b0155c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:21.150 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.147+0000 7fd2b7469700 1 --2- 172.21.15.27:0/3027009408 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fd29406ace0 0x7fd29406d190 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:21.150 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.147+0000 7fd2b7469700 1 --2- 172.21.15.27:0/3027009408 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd2b0156880 0x7fd2b00abe10 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:21.150 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.147+0000 7fd2b7469700 1 --2- 172.21.15.27:0/3027009408 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2b00cc1d0 0x7fd2b00ab8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:21.151 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.147+0000 7fd2b7469700 1 -- 172.21.15.27:0/3027009408 >> 172.21.15.27:0/3027009408 conn(0x7fd2b006d4a0 msgr2=0x7fd2b006a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:21.151 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.147+0000 7fd2b7469700 1 -- 172.21.15.27:0/3027009408 shutdown_connections 2023-07-05T23:35:21.151 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.147+0000 7fd2b7469700 1 -- 172.21.15.27:0/3027009408 wait complete. 2023-07-05T23:35:21.151 INFO:teuthology.orchestra.run.smithi027.stderr:instructed osd(s) 0 to deep-scrub 2023-07-05T23:35:21.161 INFO:tasks.ceph:Scrubbing osd.1 2023-07-05T23:35:21.161 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-07-05T23:35:21.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.288+0000 7fd906900700 1 Processor -- start 2023-07-05T23:35:21.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.288+0000 7fd906900700 1 -- start start 2023-07-05T23:35:21.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.289+0000 7fd906900700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd9000cd330 0x7fd900070980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:21.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.289+0000 7fd906900700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd90015a330 0x7fd9000cd700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:21.293 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.289+0000 7fd906900700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9000caf70 con 0x7fd9000afc40 2023-07-05T23:35:21.293 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.289+0000 7fd906900700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd90015e360 con 0x7fd90015a330 2023-07-05T23:35:21.293 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.289+0000 7fd906900700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9000cdc40 con 0x7fd9000cd330 2023-07-05T23:35:21.293 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.289+0000 7fd8ff7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd90015a330 0x7fd9000cd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:21.293 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.289+0000 7fd8ff7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd90015a330 0x7fd9000cd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46500/0 (socket says 172.21.15.27:46500) 2023-07-05T23:35:21.294 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.289+0000 7fd8ff7fe700 1 -- 172.21.15.27:0/2201318770 learned_addr learned my addr 172.21.15.27:0/2201318770 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:21.294 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.289+0000 7fd8fffff700 1 --2- 172.21.15.27:0/2201318770 >> v2:172.21.15.162:3300/0 conn(0x7fd9000cd330 0x7fd900070980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:21.294 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.289+0000 7fd8ff7fe700 1 -- 172.21.15.27:0/2201318770 >> v2:172.21.15.162:3300/0 conn(0x7fd9000cd330 msgr2=0x7fd900070980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:35:21.294 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.289+0000 7fd8ff7fe700 1 --2- 172.21.15.27:0/2201318770 >> v2:172.21.15.162:3300/0 conn(0x7fd9000cd330 0x7fd900070980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:21.294 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.289+0000 7fd8ff7fe700 1 -- 172.21.15.27:0/2201318770 >> v1:172.21.15.27:6789/0 conn(0x7fd9000afc40 legacy=0x7fd90015dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:21.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.289+0000 7fd8ff7fe700 1 -- 172.21.15.27:0/2201318770 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9000cb210 con 0x7fd90015a330 2023-07-05T23:35:21.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.290+0000 7fd8ff7fe700 1 --2- 172.21.15.27:0/2201318770 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd90015a330 0x7fd9000cd700 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fd9000d0880 tx=0x7fd8f0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b7e41300ddcd2ea server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:21.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.290+0000 7fd8feffd700 1 -- 172.21.15.27:0/2201318770 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f000b870 con 0x7fd90015a330 2023-07-05T23:35:21.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.290+0000 7fd8feffd700 1 -- 172.21.15.27:0/2201318770 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8f000b9d0 con 0x7fd90015a330 2023-07-05T23:35:21.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.290+0000 7fd8feffd700 1 -- 172.21.15.27:0/2201318770 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f000bd60 con 0x7fd90015a330 2023-07-05T23:35:21.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.290+0000 7fd906900700 1 -- 172.21.15.27:0/2201318770 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd90015a330 msgr2=0x7fd9000cd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:21.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.290+0000 7fd906900700 1 --2- 172.21.15.27:0/2201318770 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd90015a330 0x7fd9000cd700 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fd9000d0880 tx=0x7fd8f0009bd0 comp rx=0 tx=0).stop 2023-07-05T23:35:21.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.290+0000 7fd906900700 1 -- 172.21.15.27:0/2201318770 shutdown_connections 2023-07-05T23:35:21.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.290+0000 7fd906900700 1 --2- 172.21.15.27:0/2201318770 >> v2:172.21.15.162:3300/0 conn(0x7fd9000cd330 0x7fd900070980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:21.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.290+0000 7fd906900700 1 --2- 172.21.15.27:0/2201318770 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd90015a330 0x7fd9000cd700 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:21.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.290+0000 7fd906900700 1 -- 172.21.15.27:0/2201318770 >> 172.21.15.27:0/2201318770 conn(0x7fd90006e5c0 msgr2=0x7fd90006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:21.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.290+0000 7fd906900700 1 -- 172.21.15.27:0/2201318770 shutdown_connections 2023-07-05T23:35:21.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.290+0000 7fd906900700 1 -- 172.21.15.27:0/2201318770 wait complete. 2023-07-05T23:35:21.300 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.291+0000 7fd906900700 1 Processor -- start 2023-07-05T23:35:21.300 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.292+0000 7fd906900700 1 -- start start 2023-07-05T23:35:21.300 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.292+0000 7fd906900700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd9000afc40 0x7fd9000c6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:21.300 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.292+0000 7fd906900700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9000cd330 0x7fd90006ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:21.301 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.292+0000 7fd906900700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd90015a330 0x7fd90015a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:21.301 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.292+0000 7fd906900700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd90006cc90 con 0x7fd9000cd330 2023-07-05T23:35:21.301 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.292+0000 7fd906900700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd90006c3f0 con 0x7fd90015a330 2023-07-05T23:35:21.301 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.292+0000 7fd906900700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd90006c6d0 con 0x7fd9000afc40 2023-07-05T23:35:21.301 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.293+0000 7fd8ff7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9000cd330 0x7fd90006ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:21.302 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.293+0000 7fd8ff7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9000cd330 0x7fd90006ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46508/0 (socket says 172.21.15.27:46508) 2023-07-05T23:35:21.302 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.293+0000 7fd8ff7fe700 1 -- 172.21.15.27:0/1940833501 learned_addr learned my addr 172.21.15.27:0/1940833501 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:21.302 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.293+0000 7fd8ff7fe700 1 -- 172.21.15.27:0/1940833501 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd9000afc40 msgr2=0x7fd9000c6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:21.302 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.293+0000 7fd8ff7fe700 1 --2- 172.21.15.27:0/1940833501 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd9000afc40 0x7fd9000c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:21.302 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.293+0000 7fd8ff7fe700 1 -- 172.21.15.27:0/1940833501 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd90015a330 msgr2=0x7fd90015a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:21.303 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.293+0000 7fd904e9d700 1 --2- 172.21.15.27:0/1940833501 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd90015a330 0x7fd90015a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:21.303 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.293+0000 7fd8ff7fe700 1 --2- 172.21.15.27:0/1940833501 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd90015a330 0x7fd90015a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:21.303 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.293+0000 7fd8ff7fe700 1 -- 172.21.15.27:0/1940833501 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f0009550 con 0x7fd9000cd330 2023-07-05T23:35:21.303 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.293+0000 7fd904e9d700 1 --2- 172.21.15.27:0/1940833501 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd90015a330 0x7fd90015a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T23:35:21.303 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.293+0000 7fd8ff7fe700 1 --2- 172.21.15.27:0/1940833501 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9000cd330 0x7fd90006ba10 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0000c00 tx=0x7fd8f0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:21.304 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.293+0000 7fd8fcff9700 1 -- 172.21.15.27:0/1940833501 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f0004520 con 0x7fd9000cd330 2023-07-05T23:35:21.304 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.293+0000 7fd8fcff9700 1 -- 172.21.15.27:0/1940833501 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8f001e070 con 0x7fd9000cd330 2023-07-05T23:35:21.304 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.293+0000 7fd8fcff9700 1 -- 172.21.15.27:0/1940833501 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f00038a0 con 0x7fd9000cd330 2023-07-05T23:35:21.304 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.293+0000 7fd906900700 1 -- 172.21.15.27:0/1940833501 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd90006c9b0 con 0x7fd9000cd330 2023-07-05T23:35:21.305 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.293+0000 7fd906900700 1 -- 172.21.15.27:0/1940833501 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9000c6670 con 0x7fd9000cd330 2023-07-05T23:35:21.305 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.294+0000 7fd906900700 1 -- 172.21.15.27:0/1940833501 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd9000ccf00 con 0x7fd9000cd330 2023-07-05T23:35:21.305 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.295+0000 7fd8fcff9700 1 -- 172.21.15.27:0/1940833501 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd8f0003a00 con 0x7fd9000cd330 2023-07-05T23:35:21.305 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.295+0000 7fd8fcff9700 1 --2- 172.21.15.27:0/1940833501 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fd8ec06ace0 0x7fd8ec06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:21.305 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.295+0000 7fd8fcff9700 1 -- 172.21.15.27:0/1940833501 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd8f0020070 con 0x7fd9000cd330 2023-07-05T23:35:21.306 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.295+0000 7fd8fcff9700 1 --2- 172.21.15.27:0/1940833501 >> [v2:172.21.15.27:6800/1579117455,v1:172.21.15.27:6801/1579117455] conn(0x7fd8ec0749f0 0x7fd8ec076e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:21.306 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.295+0000 7fd8fcff9700 1 -- 172.21.15.27:0/1940833501 --> [v2:172.21.15.27:6800/1579117455,v1:172.21.15.27:6801/1579117455] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd8ec077530 con 0x7fd8ec0749f0 2023-07-05T23:35:21.306 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.295+0000 7fd8fcff9700 1 -- 172.21.15.27:0/1940833501 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd8f008f2c0 con 0x7fd9000cd330 2023-07-05T23:35:21.306 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.295+0000 7fd8fffff700 1 --2- 172.21.15.27:0/1940833501 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fd8ec06ace0 0x7fd8ec06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:21.306 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.295+0000 7fd904e9d700 1 --2- 172.21.15.27:0/1940833501 >> [v2:172.21.15.27:6800/1579117455,v1:172.21.15.27:6801/1579117455] conn(0x7fd8ec0749f0 0x7fd8ec076e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:21.307 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.296+0000 7fd904e9d700 1 --2- 172.21.15.27:0/1940833501 >> [v2:172.21.15.27:6800/1579117455,v1:172.21.15.27:6801/1579117455] conn(0x7fd8ec0749f0 0x7fd8ec076e60 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:21.307 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.296+0000 7fd8fffff700 1 --2- 172.21.15.27:0/1940833501 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fd8ec06ace0 0x7fd8ec06d190 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd9001f5640 tx=0x7fd8f4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:21.307 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.296+0000 7fd8fcff9700 1 -- 172.21.15.27:0/1940833501 <== osd.1 v2:172.21.15.27:6800/1579117455 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fd8ec077530 con 0x7fd8ec0749f0 2023-07-05T23:35:21.312 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.311+0000 7fd906900700 1 -- 172.21.15.27:0/1940833501 --> [v2:172.21.15.27:6800/1579117455,v1:172.21.15.27:6801/1579117455] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd9000ccc20 con 0x7fd8ec0749f0 2023-07-05T23:35:21.313 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.311+0000 7fd8fcff9700 1 -- 172.21.15.27:0/1940833501 <== osd.1 v2:172.21.15.27:6800/1579117455 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fd8f8012380 con 0x7fd8ec0749f0 2023-07-05T23:35:21.313 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2023-07-05T23:35:21.313 INFO:teuthology.orchestra.run.smithi027.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-05T23:35:21.314 INFO:teuthology.orchestra.run.smithi027.stdout:} 2023-07-05T23:35:21.314 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.311+0000 7fd906900700 1 -- 172.21.15.27:0/1940833501 >> [v2:172.21.15.27:6800/1579117455,v1:172.21.15.27:6801/1579117455] conn(0x7fd8ec0749f0 msgr2=0x7fd8ec076e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:21.315 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.311+0000 7fd906900700 1 --2- 172.21.15.27:0/1940833501 >> [v2:172.21.15.27:6800/1579117455,v1:172.21.15.27:6801/1579117455] conn(0x7fd8ec0749f0 0x7fd8ec076e60 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:21.315 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.311+0000 7fd906900700 1 -- 172.21.15.27:0/1940833501 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fd8ec06ace0 msgr2=0x7fd8ec06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:21.315 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.311+0000 7fd906900700 1 --2- 172.21.15.27:0/1940833501 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fd8ec06ace0 0x7fd8ec06d190 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd9001f5640 tx=0x7fd8f4008040 comp rx=0 tx=0).stop 2023-07-05T23:35:21.315 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.311+0000 7fd906900700 1 -- 172.21.15.27:0/1940833501 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9000cd330 msgr2=0x7fd90006ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:21.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.311+0000 7fd906900700 1 --2- 172.21.15.27:0/1940833501 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9000cd330 0x7fd90006ba10 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0000c00 tx=0x7fd8f0004750 comp rx=0 tx=0).stop 2023-07-05T23:35:21.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.311+0000 7fd904e9d700 1 -- 172.21.15.27:0/1940833501 reap_dead start 2023-07-05T23:35:21.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.311+0000 7fd906900700 1 -- 172.21.15.27:0/1940833501 shutdown_connections 2023-07-05T23:35:21.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.311+0000 7fd906900700 1 -- 172.21.15.27:0/1940833501 >> 172.21.15.27:0/1940833501 conn(0x7fd90006e5c0 msgr2=0x7fd9000b1950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:21.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.311+0000 7fd906900700 1 -- 172.21.15.27:0/1940833501 shutdown_connections 2023-07-05T23:35:21.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.311+0000 7fd906900700 1 -- 172.21.15.27:0/1940833501 wait complete. 2023-07-05T23:35:21.325 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-07-05T23:35:21.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.451+0000 7f3337cf9700 1 Processor -- start 2023-07-05T23:35:21.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.451+0000 7f3337cf9700 1 -- start start 2023-07-05T23:35:21.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.452+0000 7f3337cf9700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f3330069ef0 0x7f333006a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:21.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.452+0000 7f3337cf9700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f333006bab0 0x7f333006a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:21.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.452+0000 7f3337cf9700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33300cc9e0 con 0x7f333006eef0 2023-07-05T23:35:21.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.452+0000 7f3337cf9700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f333006ad40 con 0x7f3330069ef0 2023-07-05T23:35:21.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.452+0000 7f3337cf9700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33300b5780 con 0x7f333006bab0 2023-07-05T23:35:21.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.452+0000 7f3335a95700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f3330069ef0 0x7f333006a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:21.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.452+0000 7f3335a95700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f3330069ef0 0x7f333006a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46516/0 (socket says 172.21.15.27:46516) 2023-07-05T23:35:21.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.452+0000 7f3335a95700 1 -- 172.21.15.27:0/3148604279 learned_addr learned my addr 172.21.15.27:0/3148604279 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:21.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.452+0000 7f3335294700 1 --2- 172.21.15.27:0/3148604279 >> v2:172.21.15.162:3300/0 conn(0x7f333006bab0 0x7f333006a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:21.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.452+0000 7f3335a95700 1 -- 172.21.15.27:0/3148604279 >> v2:172.21.15.162:3300/0 conn(0x7f333006bab0 msgr2=0x7f333006a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:35:21.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.452+0000 7f3335a95700 1 --2- 172.21.15.27:0/3148604279 >> v2:172.21.15.162:3300/0 conn(0x7f333006bab0 0x7f333006a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:21.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.453+0000 7f3335a95700 1 -- 172.21.15.27:0/3148604279 >> v1:172.21.15.162:6789/0 conn(0x7f333006eef0 legacy=0x7f333006f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:21.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.453+0000 7f3335a95700 1 -- 172.21.15.27:0/3148604279 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33300c9f40 con 0x7f3330069ef0 2023-07-05T23:35:21.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.453+0000 7f3335a95700 1 --2- 172.21.15.27:0/3148604279 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3330069ef0 0x7f333006a2c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f333015db40 tx=0x7f3320009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da8d1b7961dc8e4a server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:21.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.453+0000 7f3334a93700 1 -- 172.21.15.27:0/3148604279 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332000b870 con 0x7f3330069ef0 2023-07-05T23:35:21.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.453+0000 7f3334a93700 1 -- 172.21.15.27:0/3148604279 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f332000b9d0 con 0x7f3330069ef0 2023-07-05T23:35:21.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.453+0000 7f3334a93700 1 -- 172.21.15.27:0/3148604279 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332000bd60 con 0x7f3330069ef0 2023-07-05T23:35:21.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.453+0000 7f3337cf9700 1 -- 172.21.15.27:0/3148604279 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3330069ef0 msgr2=0x7f333006a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:21.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.453+0000 7f3337cf9700 1 --2- 172.21.15.27:0/3148604279 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3330069ef0 0x7f333006a2c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f333015db40 tx=0x7f3320009bd0 comp rx=0 tx=0).stop 2023-07-05T23:35:21.460 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.453+0000 7f3337cf9700 1 -- 172.21.15.27:0/3148604279 shutdown_connections 2023-07-05T23:35:21.460 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.453+0000 7f3337cf9700 1 --2- 172.21.15.27:0/3148604279 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3330069ef0 0x7f333006a2c0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:21.460 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.453+0000 7f3337cf9700 1 --2- 172.21.15.27:0/3148604279 >> v2:172.21.15.162:3300/0 conn(0x7f333006bab0 0x7f333006a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:21.460 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.453+0000 7f3337cf9700 1 -- 172.21.15.27:0/3148604279 >> 172.21.15.27:0/3148604279 conn(0x7f333006d4a0 msgr2=0x7f333006d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:21.460 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.454+0000 7f3337cf9700 1 -- 172.21.15.27:0/3148604279 shutdown_connections 2023-07-05T23:35:21.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.454+0000 7f3337cf9700 1 -- 172.21.15.27:0/3148604279 wait complete. 2023-07-05T23:35:21.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.455+0000 7f3337cf9700 1 Processor -- start 2023-07-05T23:35:21.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.455+0000 7f3337cf9700 1 -- start start 2023-07-05T23:35:21.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.456+0000 7f3337cf9700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3330069ef0 0x7f33300ce280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:21.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.456+0000 7f3337cf9700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f333006bab0 0x7f3330150140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:21.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.456+0000 7f3337cf9700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f333006eef0 0x7f33300acfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:21.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.456+0000 7f3337cf9700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33300ce7c0 con 0x7f3330069ef0 2023-07-05T23:35:21.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.456+0000 7f3337cf9700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3330150680 con 0x7f333006eef0 2023-07-05T23:35:21.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.456+0000 7f3337cf9700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33300afd30 con 0x7f333006bab0 2023-07-05T23:35:21.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.456+0000 7f3335a95700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3330069ef0 0x7f33300ce280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:21.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.456+0000 7f3335a95700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3330069ef0 0x7f33300ce280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46522/0 (socket says 172.21.15.27:46522) 2023-07-05T23:35:21.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.456+0000 7f3335a95700 1 -- 172.21.15.27:0/3599255616 learned_addr learned my addr 172.21.15.27:0/3599255616 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:21.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.456+0000 7f3335294700 1 --2- 172.21.15.27:0/3599255616 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f333006bab0 0x7f3330150140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:21.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.456+0000 7f3336296700 1 --2- 172.21.15.27:0/3599255616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f333006eef0 0x7f33300acfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:21.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.456+0000 7f3335a95700 1 -- 172.21.15.27:0/3599255616 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f333006bab0 msgr2=0x7f3330150140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:21.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.456+0000 7f3335a95700 1 --2- 172.21.15.27:0/3599255616 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f333006bab0 0x7f3330150140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:21.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.456+0000 7f3335a95700 1 -- 172.21.15.27:0/3599255616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f333006eef0 msgr2=0x7f33300acfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:21.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.456+0000 7f3335a95700 1 --2- 172.21.15.27:0/3599255616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f333006eef0 0x7f33300acfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:21.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.456+0000 7f3335a95700 1 -- 172.21.15.27:0/3599255616 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3320009550 con 0x7f3330069ef0 2023-07-05T23:35:21.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.456+0000 7f3335a95700 1 --2- 172.21.15.27:0/3599255616 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3330069ef0 0x7f33300ce280 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3320000c00 tx=0x7f3320004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:21.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.456+0000 7f33267fc700 1 -- 172.21.15.27:0/3599255616 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3320004520 con 0x7f3330069ef0 2023-07-05T23:35:21.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.456+0000 7f33267fc700 1 -- 172.21.15.27:0/3599255616 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f332001e070 con 0x7f3330069ef0 2023-07-05T23:35:21.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.456+0000 7f3337cf9700 1 -- 172.21.15.27:0/3599255616 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33300affd0 con 0x7f3330069ef0 2023-07-05T23:35:21.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.456+0000 7f33267fc700 1 -- 172.21.15.27:0/3599255616 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33200038a0 con 0x7f3330069ef0 2023-07-05T23:35:21.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.456+0000 7f3337cf9700 1 -- 172.21.15.27:0/3599255616 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33300b0590 con 0x7f3330069ef0 2023-07-05T23:35:21.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.457+0000 7f3337cf9700 1 -- 172.21.15.27:0/3599255616 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3330073910 con 0x7f3330069ef0 2023-07-05T23:35:21.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.458+0000 7f33267fc700 1 -- 172.21.15.27:0/3599255616 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3320003a00 con 0x7f3330069ef0 2023-07-05T23:35:21.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.458+0000 7f33267fc700 1 --2- 172.21.15.27:0/3599255616 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f331406ace0 0x7f331406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:21.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.459+0000 7f33267fc700 1 -- 172.21.15.27:0/3599255616 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3320020070 con 0x7f3330069ef0 2023-07-05T23:35:21.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.459+0000 7f3335294700 1 --2- 172.21.15.27:0/3599255616 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f331406ace0 0x7f331406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:21.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.459+0000 7f3335294700 1 --2- 172.21.15.27:0/3599255616 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f331406ace0 0x7f331406d190 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f333006a3c0 tx=0x7f332c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:21.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.463+0000 7f33267fc700 1 -- 172.21.15.27:0/3599255616 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3320055bb0 con 0x7f3330069ef0 2023-07-05T23:35:21.662 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.660+0000 7f3337cf9700 1 -- 172.21.15.27:0/3599255616 --> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f33300cc670 con 0x7f331406ace0 2023-07-05T23:35:21.663 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.660+0000 7f33267fc700 1 -- 172.21.15.27:0/3599255616 <== mgr.4105 v2:172.21.15.162:6832/3790028097 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f332c00be50 con 0x7f331406ace0 2023-07-05T23:35:21.665 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.662+0000 7f3337cf9700 1 -- 172.21.15.27:0/3599255616 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f331406ace0 msgr2=0x7f331406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:21.666 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.662+0000 7f3337cf9700 1 --2- 172.21.15.27:0/3599255616 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f331406ace0 0x7f331406d190 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f333006a3c0 tx=0x7f332c008040 comp rx=0 tx=0).stop 2023-07-05T23:35:21.667 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.662+0000 7f3337cf9700 1 -- 172.21.15.27:0/3599255616 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3330069ef0 msgr2=0x7f33300ce280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:21.667 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.662+0000 7f3337cf9700 1 --2- 172.21.15.27:0/3599255616 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3330069ef0 0x7f33300ce280 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3320000c00 tx=0x7f3320004750 comp rx=0 tx=0).stop 2023-07-05T23:35:21.667 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.663+0000 7f3337cf9700 1 -- 172.21.15.27:0/3599255616 shutdown_connections 2023-07-05T23:35:21.668 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.663+0000 7f3337cf9700 1 --2- 172.21.15.27:0/3599255616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f333006eef0 0x7f33300acfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:21.669 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.663+0000 7f3337cf9700 1 --2- 172.21.15.27:0/3599255616 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f331406ace0 0x7f331406d190 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:21.669 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.663+0000 7f3337cf9700 1 --2- 172.21.15.27:0/3599255616 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3330069ef0 0x7f33300ce280 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:21.670 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.663+0000 7f3337cf9700 1 --2- 172.21.15.27:0/3599255616 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f333006bab0 0x7f3330150140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:21.670 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.663+0000 7f3337cf9700 1 -- 172.21.15.27:0/3599255616 >> 172.21.15.27:0/3599255616 conn(0x7f333006d4a0 msgr2=0x7f3330159db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:21.670 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.663+0000 7f3337cf9700 1 -- 172.21.15.27:0/3599255616 shutdown_connections 2023-07-05T23:35:21.670 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.663+0000 7f3337cf9700 1 -- 172.21.15.27:0/3599255616 wait complete. 2023-07-05T23:35:21.670 INFO:teuthology.orchestra.run.smithi027.stderr:instructed osd(s) 1 to deep-scrub 2023-07-05T23:35:21.678 INFO:tasks.ceph:Scrubbing osd.2 2023-07-05T23:35:21.679 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-07-05T23:35:21.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.806+0000 7fd84eee3700 1 Processor -- start 2023-07-05T23:35:21.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.806+0000 7fd84eee3700 1 -- start start 2023-07-05T23:35:21.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.807+0000 7fd84eee3700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd84806e4d0 0x7fd8480ad640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:21.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.807+0000 7fd84eee3700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd84806e8f0 con 0x7fd8480cd5e0 2023-07-05T23:35:21.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.807+0000 7fd84eee3700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd84806f0e0 con 0x7fd84806e030 2023-07-05T23:35:21.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.807+0000 7fd84eee3700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8480ce2c0 con 0x7fd84806e4d0 2023-07-05T23:35:21.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.807+0000 7fd84cc7f700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fd8480cd5e0 0x7fd8480cd9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:53696/0 (socket says 172.21.15.27:53696) 2023-07-05T23:35:21.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.807+0000 7fd84cc7f700 1 -- 172.21.15.27:0/1941232857 learned_addr learned my addr 172.21.15.27:0/1941232857 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-07-05T23:35:21.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.807+0000 7fd84d480700 1 --2- 172.21.15.27:0/1941232857 >> v2:172.21.15.162:3300/0 conn(0x7fd84806e4d0 0x7fd8480ad640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:21.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.807+0000 7fd8477fe700 1 -- 172.21.15.27:0/1941232857 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2556261240 0 0) 0x7fd84806e8f0 con 0x7fd8480cd5e0 2023-07-05T23:35:21.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.807+0000 7fd8477fe700 1 -- 172.21.15.27:0/1941232857 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8380035b0 con 0x7fd8480cd5e0 2023-07-05T23:35:21.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.807+0000 7fd8477fe700 1 -- 172.21.15.27:0/1941232857 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 990259952 0 0) 0x7fd8380035b0 con 0x7fd8480cd5e0 2023-07-05T23:35:21.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.807+0000 7fd8477fe700 1 -- 172.21.15.27:0/1941232857 >> v2:172.21.15.162:3300/0 conn(0x7fd84806e4d0 msgr2=0x7fd8480ad640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:35:21.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.807+0000 7fd8477fe700 1 --2- 172.21.15.27:0/1941232857 >> v2:172.21.15.162:3300/0 conn(0x7fd84806e4d0 0x7fd8480ad640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:21.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.807+0000 7fd8477fe700 1 -- 172.21.15.27:0/1941232857 >> v1:172.21.15.162:6789/0 conn(0x7fd84806e030 legacy=0x7fd8480acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:21.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.807+0000 7fd8477fe700 1 -- 172.21.15.27:0/1941232857 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd84806eb20 con 0x7fd8480cd5e0 2023-07-05T23:35:21.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.807+0000 7fd8477fe700 1 -- 172.21.15.27:0/1941232857 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1246168953 0 0) 0x7fd83c0017f0 con 0x7fd8480cd5e0 2023-07-05T23:35:21.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.808+0000 7fd8477fe700 1 -- 172.21.15.27:0/1941232857 >> v1:172.21.15.27:6789/0 conn(0x7fd8480cd5e0 legacy=0x7fd8480cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:21.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.808+0000 7fd8477fe700 1 --2- 172.21.15.27:0/1941232857 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd838003a00 0x7fd838003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:21.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.808+0000 7fd8477fe700 1 --2- 172.21.15.27:0/1941232857 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd838004850 0x7fd838004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:21.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.808+0000 7fd8477fe700 1 --2- 172.21.15.27:0/1941232857 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd838005200 0x7fd83800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:21.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.808+0000 7fd8477fe700 1 -- 172.21.15.27:0/1941232857 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8480ce2c0 con 0x7fd838003a00 2023-07-05T23:35:21.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.808+0000 7fd8477fe700 1 -- 172.21.15.27:0/1941232857 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd83800c110 con 0x7fd838005200 2023-07-05T23:35:21.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.808+0000 7fd8477fe700 1 -- 172.21.15.27:0/1941232857 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd83800e4e0 con 0x7fd838004850 2023-07-05T23:35:21.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.808+0000 7fd84cc7f700 1 --2- 172.21.15.27:0/1941232857 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd838003a00 0x7fd838003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:21.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.808+0000 7fd847fff700 1 --2- 172.21.15.27:0/1941232857 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd838004850 0x7fd838004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:21.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.808+0000 7fd84d480700 1 --2- 172.21.15.27:0/1941232857 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd838005200 0x7fd83800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:21.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.808+0000 7fd84cc7f700 1 -- 172.21.15.27:0/1941232857 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd838004850 msgr2=0x7fd838004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:35:21.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.808+0000 7fd84cc7f700 1 --2- 172.21.15.27:0/1941232857 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd838004850 0x7fd838004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:21.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.808+0000 7fd84cc7f700 1 -- 172.21.15.27:0/1941232857 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd838005200 msgr2=0x7fd83800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:35:21.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.808+0000 7fd84cc7f700 1 --2- 172.21.15.27:0/1941232857 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd838005200 0x7fd83800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:21.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.808+0000 7fd84cc7f700 1 -- 172.21.15.27:0/1941232857 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8380035b0 con 0x7fd838003a00 2023-07-05T23:35:21.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.808+0000 7fd84d480700 1 --2- 172.21.15.27:0/1941232857 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd838005200 0x7fd83800ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T23:35:21.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.808+0000 7fd84d480700 1 -- 172.21.15.27:0/1941232857 reap_dead start 2023-07-05T23:35:21.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.808+0000 7fd84cc7f700 1 --2- 172.21.15.27:0/1941232857 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd838003a00 0x7fd838003e10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fd83c00c240 tx=0x7fd838005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=906ac008df227d48 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:21.820 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.808+0000 7fd8477fe700 1 -- 172.21.15.27:0/1941232857 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83c00cde0 con 0x7fd838003a00 2023-07-05T23:35:21.820 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.808+0000 7fd8477fe700 1 -- 172.21.15.27:0/1941232857 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd83c007b80 con 0x7fd838003a00 2023-07-05T23:35:21.820 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.808+0000 7fd8477fe700 1 -- 172.21.15.27:0/1941232857 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83c0072d0 con 0x7fd838003a00 2023-07-05T23:35:21.820 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.809+0000 7fd84eee3700 1 -- 172.21.15.27:0/1941232857 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd838003a00 msgr2=0x7fd838003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:21.821 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.809+0000 7fd84eee3700 1 --2- 172.21.15.27:0/1941232857 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd838003a00 0x7fd838003e10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fd83c00c240 tx=0x7fd838005880 comp rx=0 tx=0).stop 2023-07-05T23:35:21.821 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.809+0000 7fd84eee3700 1 -- 172.21.15.27:0/1941232857 shutdown_connections 2023-07-05T23:35:21.821 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.809+0000 7fd84eee3700 1 --2- 172.21.15.27:0/1941232857 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd838003a00 0x7fd838003e10 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:21.821 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.809+0000 7fd84eee3700 1 -- 172.21.15.27:0/1941232857 >> 172.21.15.27:0/1941232857 conn(0x7fd84806b920 msgr2=0x7fd8480cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:21.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.809+0000 7fd84eee3700 1 -- 172.21.15.27:0/1941232857 shutdown_connections 2023-07-05T23:35:21.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.809+0000 7fd84eee3700 1 -- 172.21.15.27:0/1941232857 wait complete. 2023-07-05T23:35:21.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.810+0000 7fd84eee3700 1 Processor -- start 2023-07-05T23:35:21.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.810+0000 7fd84eee3700 1 -- start start 2023-07-05T23:35:21.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.811+0000 7fd84eee3700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd838003a00 0x7fd848153000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:21.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.811+0000 7fd84eee3700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd848158440 0x7fd84809a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:21.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.811+0000 7fd84eee3700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd84809a6d0 0x7fd8480af470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:21.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.811+0000 7fd84eee3700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8480c4210 con 0x7fd84809a6d0 2023-07-05T23:35:21.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.811+0000 7fd84eee3700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8480c3600 con 0x7fd848158440 2023-07-05T23:35:21.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.811+0000 7fd84eee3700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8480c38e0 con 0x7fd838003a00 2023-07-05T23:35:21.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.811+0000 7fd84d480700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd84809a6d0 0x7fd8480af470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:21.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.811+0000 7fd84d480700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd84809a6d0 0x7fd8480af470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46544/0 (socket says 172.21.15.27:46544) 2023-07-05T23:35:21.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.811+0000 7fd84d480700 1 -- 172.21.15.27:0/1221106381 learned_addr learned my addr 172.21.15.27:0/1221106381 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:21.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.811+0000 7fd84cc7f700 1 --2- 172.21.15.27:0/1221106381 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd838003a00 0x7fd848153000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:21.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.811+0000 7fd847fff700 1 --2- 172.21.15.27:0/1221106381 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd848158440 0x7fd84809a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:21.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.811+0000 7fd84d480700 1 -- 172.21.15.27:0/1221106381 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd838003a00 msgr2=0x7fd848153000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:21.828 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.811+0000 7fd84d480700 1 --2- 172.21.15.27:0/1221106381 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd838003a00 0x7fd848153000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:21.828 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.811+0000 7fd84d480700 1 -- 172.21.15.27:0/1221106381 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd848158440 msgr2=0x7fd84809a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:21.828 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.812+0000 7fd84d480700 1 --2- 172.21.15.27:0/1221106381 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd848158440 0x7fd84809a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:21.828 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.812+0000 7fd84d480700 1 -- 172.21.15.27:0/1221106381 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8480c3bc0 con 0x7fd84809a6d0 2023-07-05T23:35:21.829 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.812+0000 7fd84cc7f700 1 --2- 172.21.15.27:0/1221106381 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd838003a00 0x7fd848153000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T23:35:21.829 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.812+0000 7fd847fff700 1 --2- 172.21.15.27:0/1221106381 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd848158440 0x7fd84809a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T23:35:21.829 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.812+0000 7fd84d480700 1 --2- 172.21.15.27:0/1221106381 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd84809a6d0 0x7fd8480af470 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fd8480cf110 tx=0x7fd8400104a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:21.829 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.812+0000 7fd8457fa700 1 -- 172.21.15.27:0/1221106381 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd84001b070 con 0x7fd84809a6d0 2023-07-05T23:35:21.829 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.812+0000 7fd8457fa700 1 -- 172.21.15.27:0/1221106381 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd84000f040 con 0x7fd84809a6d0 2023-07-05T23:35:21.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.812+0000 7fd84eee3700 1 -- 172.21.15.27:0/1221106381 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8480c3ea0 con 0x7fd84809a6d0 2023-07-05T23:35:21.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.812+0000 7fd8457fa700 1 -- 172.21.15.27:0/1221106381 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd84000e050 con 0x7fd84809a6d0 2023-07-05T23:35:21.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.812+0000 7fd84eee3700 1 -- 172.21.15.27:0/1221106381 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8480c3290 con 0x7fd84809a6d0 2023-07-05T23:35:21.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.813+0000 7fd84eee3700 1 -- 172.21.15.27:0/1221106381 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd8480ac730 con 0x7fd84809a6d0 2023-07-05T23:35:21.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.813+0000 7fd8457fa700 1 -- 172.21.15.27:0/1221106381 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd840015440 con 0x7fd84809a6d0 2023-07-05T23:35:21.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.814+0000 7fd8457fa700 1 --2- 172.21.15.27:0/1221106381 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fd82c06ace0 0x7fd82c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:21.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.814+0000 7fd8457fa700 1 -- 172.21.15.27:0/1221106381 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd84008a510 con 0x7fd84809a6d0 2023-07-05T23:35:21.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.814+0000 7fd8457fa700 1 --2- 172.21.15.27:0/1221106381 >> [v2:172.21.15.27:6824/807520271,v1:172.21.15.27:6825/807520271] conn(0x7fd82c0749f0 0x7fd82c076e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:21.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.814+0000 7fd8457fa700 1 -- 172.21.15.27:0/1221106381 --> [v2:172.21.15.27:6824/807520271,v1:172.21.15.27:6825/807520271] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd82c077530 con 0x7fd82c0749f0 2023-07-05T23:35:21.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.814+0000 7fd8457fa700 1 -- 172.21.15.27:0/1221106381 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd84008a960 con 0x7fd84809a6d0 2023-07-05T23:35:21.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.814+0000 7fd84cc7f700 1 --2- 172.21.15.27:0/1221106381 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fd82c06ace0 0x7fd82c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:21.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.814+0000 7fd847fff700 1 --2- 172.21.15.27:0/1221106381 >> [v2:172.21.15.27:6824/807520271,v1:172.21.15.27:6825/807520271] conn(0x7fd82c0749f0 0x7fd82c076e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:21.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.814+0000 7fd847fff700 1 --2- 172.21.15.27:0/1221106381 >> [v2:172.21.15.27:6824/807520271,v1:172.21.15.27:6825/807520271] conn(0x7fd82c0749f0 0x7fd82c076e60 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:21.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.814+0000 7fd84cc7f700 1 --2- 172.21.15.27:0/1221106381 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fd82c06ace0 0x7fd82c06d190 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd83c000ef0 tx=0x7fd83c007000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:21.834 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.815+0000 7fd8457fa700 1 -- 172.21.15.27:0/1221106381 <== osd.2 v2:172.21.15.27:6824/807520271 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fd82c077530 con 0x7fd82c0749f0 2023-07-05T23:35:21.834 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.829+0000 7fd84eee3700 1 -- 172.21.15.27:0/1221106381 --> [v2:172.21.15.27:6824/807520271,v1:172.21.15.27:6825/807520271] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd84806ee00 con 0x7fd82c0749f0 2023-07-05T23:35:21.834 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.829+0000 7fd8457fa700 1 -- 172.21.15.27:0/1221106381 <== osd.2 v2:172.21.15.27:6824/807520271 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fd834003760 con 0x7fd82c0749f0 2023-07-05T23:35:21.835 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2023-07-05T23:35:21.835 INFO:teuthology.orchestra.run.smithi027.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-05T23:35:21.835 INFO:teuthology.orchestra.run.smithi027.stdout:} 2023-07-05T23:35:21.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.830+0000 7fd84eee3700 1 -- 172.21.15.27:0/1221106381 >> [v2:172.21.15.27:6824/807520271,v1:172.21.15.27:6825/807520271] conn(0x7fd82c0749f0 msgr2=0x7fd82c076e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:21.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.830+0000 7fd84eee3700 1 --2- 172.21.15.27:0/1221106381 >> [v2:172.21.15.27:6824/807520271,v1:172.21.15.27:6825/807520271] conn(0x7fd82c0749f0 0x7fd82c076e60 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:21.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.830+0000 7fd84eee3700 1 -- 172.21.15.27:0/1221106381 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fd82c06ace0 msgr2=0x7fd82c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:21.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.830+0000 7fd84eee3700 1 --2- 172.21.15.27:0/1221106381 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fd82c06ace0 0x7fd82c06d190 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd83c000ef0 tx=0x7fd83c007000 comp rx=0 tx=0).stop 2023-07-05T23:35:21.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.830+0000 7fd84eee3700 1 -- 172.21.15.27:0/1221106381 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd84809a6d0 msgr2=0x7fd8480af470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:21.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.830+0000 7fd84eee3700 1 --2- 172.21.15.27:0/1221106381 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd84809a6d0 0x7fd8480af470 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fd8480cf110 tx=0x7fd8400104a0 comp rx=0 tx=0).stop 2023-07-05T23:35:21.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.830+0000 7fd84d480700 1 -- 172.21.15.27:0/1221106381 reap_dead start 2023-07-05T23:35:21.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.830+0000 7fd84eee3700 1 -- 172.21.15.27:0/1221106381 shutdown_connections 2023-07-05T23:35:21.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.830+0000 7fd84eee3700 1 -- 172.21.15.27:0/1221106381 >> 172.21.15.27:0/1221106381 conn(0x7fd84806b920 msgr2=0x7fd8480ccd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:21.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.830+0000 7fd84eee3700 1 -- 172.21.15.27:0/1221106381 shutdown_connections 2023-07-05T23:35:21.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.830+0000 7fd84eee3700 1 -- 172.21.15.27:0/1221106381 wait complete. 2023-07-05T23:35:21.844 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-07-05T23:35:21.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.968+0000 7fa6ebf7b700 1 Processor -- start 2023-07-05T23:35:21.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.969+0000 7fa6ebf7b700 1 -- start start 2023-07-05T23:35:21.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.969+0000 7fa6ebf7b700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6e40d05d0 0x7fa6e406fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:21.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.969+0000 7fa6ebf7b700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6e40ae580 con 0x7fa6e415a640 2023-07-05T23:35:21.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.969+0000 7fa6ebf7b700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6e406f610 con 0x7fa6e40cec80 2023-07-05T23:35:21.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.969+0000 7fa6ebf7b700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e40adf70 con 0x7fa6e40d05d0 2023-07-05T23:35:21.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.969+0000 7fa6e9d17700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fa6e415a640 0x7fa6e40ce570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:53716/0 (socket says 172.21.15.27:53716) 2023-07-05T23:35:21.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.970+0000 7fa6e9d17700 1 -- 172.21.15.27:0/1979455478 learned_addr learned my addr 172.21.15.27:0/1979455478 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-07-05T23:35:21.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.970+0000 7fa6e9516700 1 --2- 172.21.15.27:0/1979455478 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6e40d05d0 0x7fa6e406fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:21.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.970+0000 7fa6e8d15700 1 -- 172.21.15.27:0/1979455478 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1970939260 0 0) 0x7fa6e40ae580 con 0x7fa6e415a640 2023-07-05T23:35:21.977 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.970+0000 7fa6e8d15700 1 -- 172.21.15.27:0/1979455478 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6d00035b0 con 0x7fa6e415a640 2023-07-05T23:35:21.977 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.970+0000 7fa6e8d15700 1 -- 172.21.15.27:0/1979455478 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3375113908 0 0) 0x7fa6d00035b0 con 0x7fa6e415a640 2023-07-05T23:35:21.977 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.970+0000 7fa6e8d15700 1 -- 172.21.15.27:0/1979455478 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6e40d05d0 msgr2=0x7fa6e406fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:35:21.977 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.970+0000 7fa6e8d15700 1 --2- 172.21.15.27:0/1979455478 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6e40d05d0 0x7fa6e406fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:21.978 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.970+0000 7fa6e8d15700 1 -- 172.21.15.27:0/1979455478 >> v1:172.21.15.162:6789/0 conn(0x7fa6e40cec80 legacy=0x7fa6e40aea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:21.978 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.970+0000 7fa6e8d15700 1 -- 172.21.15.27:0/1979455478 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6e406f860 con 0x7fa6e415a640 2023-07-05T23:35:21.978 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.970+0000 7fa6e8d15700 1 -- 172.21.15.27:0/1979455478 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1246168953 0 0) 0x7fa6d4001670 con 0x7fa6e415a640 2023-07-05T23:35:21.978 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.970+0000 7fa6e8d15700 1 -- 172.21.15.27:0/1979455478 >> v1:172.21.15.27:6789/0 conn(0x7fa6e415a640 legacy=0x7fa6e40ce570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:21.979 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.970+0000 7fa6e8d15700 1 --2- 172.21.15.27:0/1979455478 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6e40d05d0 0x7fa6d0003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:21.979 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.970+0000 7fa6e8d15700 1 --2- 172.21.15.27:0/1979455478 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa6d0003f70 0x7fa6d0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:21.979 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.970+0000 7fa6e8d15700 1 --2- 172.21.15.27:0/1979455478 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6d0004d90 0x7fa6d0005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:21.979 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.970+0000 7fa6e8d15700 1 -- 172.21.15.27:0/1979455478 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e40adf70 con 0x7fa6d0003f70 2023-07-05T23:35:21.980 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.970+0000 7fa6e8d15700 1 -- 172.21.15.27:0/1979455478 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d000ba40 con 0x7fa6d0004d90 2023-07-05T23:35:21.980 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.970+0000 7fa6e8d15700 1 -- 172.21.15.27:0/1979455478 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d000bc00 con 0x7fa6e40d05d0 2023-07-05T23:35:21.980 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.970+0000 7fa6e9516700 1 --2- 172.21.15.27:0/1979455478 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa6d0003f70 0x7fa6d0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:21.981 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.970+0000 7fa6e9d17700 1 --2- 172.21.15.27:0/1979455478 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6e40d05d0 0x7fa6d0003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:21.981 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.970+0000 7fa6ea518700 1 --2- 172.21.15.27:0/1979455478 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6d0004d90 0x7fa6d0005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:21.981 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.971+0000 7fa6e9516700 1 -- 172.21.15.27:0/1979455478 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6e40d05d0 msgr2=0x7fa6d0003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:35:21.981 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.971+0000 7fa6e9516700 1 --2- 172.21.15.27:0/1979455478 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6e40d05d0 0x7fa6d0003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:21.981 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.971+0000 7fa6e9516700 1 -- 172.21.15.27:0/1979455478 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6d0004d90 msgr2=0x7fa6d0005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:35:21.982 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.971+0000 7fa6e9516700 1 --2- 172.21.15.27:0/1979455478 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6d0004d90 0x7fa6d0005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:21.982 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.971+0000 7fa6e9516700 1 -- 172.21.15.27:0/1979455478 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6d00035b0 con 0x7fa6d0003f70 2023-07-05T23:35:21.982 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.971+0000 7fa6e9516700 1 --2- 172.21.15.27:0/1979455478 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa6d0003f70 0x7fa6d0004850 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa6e0009b60 tx=0x7fa6d0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd68ba1dd785f626 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:21.982 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.971+0000 7fa6e8d15700 1 -- 172.21.15.27:0/1979455478 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e000e6c0 con 0x7fa6d0003f70 2023-07-05T23:35:21.982 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.971+0000 7fa6e8d15700 1 -- 172.21.15.27:0/1979455478 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6e000e820 con 0x7fa6d0003f70 2023-07-05T23:35:21.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.971+0000 7fa6e8d15700 1 -- 172.21.15.27:0/1979455478 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e000eb90 con 0x7fa6d0003f70 2023-07-05T23:35:21.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.971+0000 7fa6ebf7b700 1 -- 172.21.15.27:0/1979455478 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa6d0003f70 msgr2=0x7fa6d0004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:21.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.971+0000 7fa6ebf7b700 1 --2- 172.21.15.27:0/1979455478 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa6d0003f70 0x7fa6d0004850 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa6e0009b60 tx=0x7fa6d0005880 comp rx=0 tx=0).stop 2023-07-05T23:35:21.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.971+0000 7fa6ea518700 1 -- 172.21.15.27:0/1979455478 reap_dead start 2023-07-05T23:35:21.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.971+0000 7fa6ebf7b700 1 -- 172.21.15.27:0/1979455478 shutdown_connections 2023-07-05T23:35:21.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.971+0000 7fa6ebf7b700 1 -- 172.21.15.27:0/1979455478 >> 172.21.15.27:0/1979455478 conn(0x7fa6e4089fe0 msgr2=0x7fa6e40d09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:21.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.972+0000 7fa6ebf7b700 1 -- 172.21.15.27:0/1979455478 shutdown_connections 2023-07-05T23:35:21.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.972+0000 7fa6ebf7b700 1 -- 172.21.15.27:0/1979455478 wait complete. 2023-07-05T23:35:21.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.973+0000 7fa6ebf7b700 1 Processor -- start 2023-07-05T23:35:21.985 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.973+0000 7fa6ebf7b700 1 -- start start 2023-07-05T23:35:21.987 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.973+0000 7fa6ebf7b700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6d0003f70 0x7fa6e41efea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:21.987 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.973+0000 7fa6ebf7b700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6e41f03e0 0x7fa6e4151e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:21.987 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.974+0000 7fa6ebf7b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa6e41f3570 0x7fa6e41f3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:21.988 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.974+0000 7fa6ebf7b700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e41f0e40 con 0x7fa6e41f3570 2023-07-05T23:35:21.988 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.974+0000 7fa6ebf7b700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e41f0880 con 0x7fa6d0003f70 2023-07-05T23:35:21.988 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.974+0000 7fa6ebf7b700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e41f0b60 con 0x7fa6e41f03e0 2023-07-05T23:35:21.988 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.974+0000 7fa6ea518700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa6e41f3570 0x7fa6e41f3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:21.988 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.974+0000 7fa6ea518700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa6e41f3570 0x7fa6e41f3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46566/0 (socket says 172.21.15.27:46566) 2023-07-05T23:35:21.989 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.974+0000 7fa6ea518700 1 -- 172.21.15.27:0/1913050760 learned_addr learned my addr 172.21.15.27:0/1913050760 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:21.989 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.974+0000 7fa6e9d17700 1 --2- 172.21.15.27:0/1913050760 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6d0003f70 0x7fa6e41efea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:21.989 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.974+0000 7fa6e9516700 1 --2- 172.21.15.27:0/1913050760 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6e41f03e0 0x7fa6e4151e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:21.989 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.974+0000 7fa6ea518700 1 -- 172.21.15.27:0/1913050760 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6e41f03e0 msgr2=0x7fa6e4151e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:21.990 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.974+0000 7fa6ea518700 1 --2- 172.21.15.27:0/1913050760 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6e41f03e0 0x7fa6e4151e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:21.990 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.974+0000 7fa6ea518700 1 -- 172.21.15.27:0/1913050760 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6d0003f70 msgr2=0x7fa6e41efea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:21.990 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.974+0000 7fa6ea518700 1 --2- 172.21.15.27:0/1913050760 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6d0003f70 0x7fa6e41efea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:21.990 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.974+0000 7fa6ea518700 1 -- 172.21.15.27:0/1913050760 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6e4151670 con 0x7fa6e41f3570 2023-07-05T23:35:21.990 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.974+0000 7fa6ea518700 1 --2- 172.21.15.27:0/1913050760 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa6e41f3570 0x7fa6e41f3ba0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa6e4070530 tx=0x7fa6dc00d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:21.991 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.974+0000 7fa6da7fc700 1 -- 172.21.15.27:0/1913050760 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6dc003c10 con 0x7fa6e41f3570 2023-07-05T23:35:21.991 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.974+0000 7fa6da7fc700 1 -- 172.21.15.27:0/1913050760 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6dc003d90 con 0x7fa6e41f3570 2023-07-05T23:35:21.991 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.974+0000 7fa6ebf7b700 1 -- 172.21.15.27:0/1913050760 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6e4151950 con 0x7fa6e41f3570 2023-07-05T23:35:21.991 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.974+0000 7fa6da7fc700 1 -- 172.21.15.27:0/1913050760 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6dc00db20 con 0x7fa6e41f3570 2023-07-05T23:35:21.991 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.974+0000 7fa6ebf7b700 1 -- 172.21.15.27:0/1913050760 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6e4152570 con 0x7fa6e41f3570 2023-07-05T23:35:21.992 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.975+0000 7fa6ebf7b700 1 -- 172.21.15.27:0/1913050760 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6e4151cc0 con 0x7fa6e41f3570 2023-07-05T23:35:21.992 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.976+0000 7fa6da7fc700 1 -- 172.21.15.27:0/1913050760 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa6dc00dc80 con 0x7fa6e41f3570 2023-07-05T23:35:21.992 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.976+0000 7fa6da7fc700 1 --2- 172.21.15.27:0/1913050760 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fa6c806ace0 0x7fa6c806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:21.992 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.976+0000 7fa6da7fc700 1 -- 172.21.15.27:0/1913050760 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa6dc089980 con 0x7fa6e41f3570 2023-07-05T23:35:21.992 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.977+0000 7fa6e9d17700 1 --2- 172.21.15.27:0/1913050760 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fa6c806ace0 0x7fa6c806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:21.993 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.977+0000 7fa6e9d17700 1 --2- 172.21.15.27:0/1913050760 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fa6c806ace0 0x7fa6c806d190 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa6d4001050 tx=0x7fa6d4000f80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:21.993 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:21.981+0000 7fa6da7fc700 1 -- 172.21.15.27:0/1913050760 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa6dc054790 con 0x7fa6e41f3570 2023-07-05T23:35:22.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.178+0000 7fa6ebf7b700 1 -- 172.21.15.27:0/1913050760 --> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fa6e40ae210 con 0x7fa6c806ace0 2023-07-05T23:35:22.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.179+0000 7fa6da7fc700 1 -- 172.21.15.27:0/1913050760 <== mgr.4105 v2:172.21.15.162:6832/3790028097 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa6d40070c0 con 0x7fa6c806ace0 2023-07-05T23:35:22.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.182+0000 7fa6ebf7b700 1 -- 172.21.15.27:0/1913050760 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fa6c806ace0 msgr2=0x7fa6c806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:22.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.182+0000 7fa6ebf7b700 1 --2- 172.21.15.27:0/1913050760 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fa6c806ace0 0x7fa6c806d190 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa6d4001050 tx=0x7fa6d4000f80 comp rx=0 tx=0).stop 2023-07-05T23:35:22.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.182+0000 7fa6ebf7b700 1 -- 172.21.15.27:0/1913050760 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa6e41f3570 msgr2=0x7fa6e41f3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:22.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.182+0000 7fa6ebf7b700 1 --2- 172.21.15.27:0/1913050760 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa6e41f3570 0x7fa6e41f3ba0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa6e4070530 tx=0x7fa6dc00d430 comp rx=0 tx=0).stop 2023-07-05T23:35:22.185 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.182+0000 7fa6ebf7b700 1 -- 172.21.15.27:0/1913050760 shutdown_connections 2023-07-05T23:35:22.185 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.182+0000 7fa6ebf7b700 1 --2- 172.21.15.27:0/1913050760 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6d0003f70 0x7fa6e41efea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:22.185 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.182+0000 7fa6ebf7b700 1 --2- 172.21.15.27:0/1913050760 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fa6c806ace0 0x7fa6c806d190 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:22.185 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.182+0000 7fa6ebf7b700 1 --2- 172.21.15.27:0/1913050760 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa6e41f3570 0x7fa6e41f3ba0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:22.185 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.182+0000 7fa6ebf7b700 1 --2- 172.21.15.27:0/1913050760 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6e41f03e0 0x7fa6e4151e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:22.186 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.182+0000 7fa6ebf7b700 1 -- 172.21.15.27:0/1913050760 >> 172.21.15.27:0/1913050760 conn(0x7fa6e4089fe0 msgr2=0x7fa6e40c61b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:22.186 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.182+0000 7fa6ebf7b700 1 -- 172.21.15.27:0/1913050760 shutdown_connections 2023-07-05T23:35:22.186 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.182+0000 7fa6ebf7b700 1 -- 172.21.15.27:0/1913050760 wait complete. 2023-07-05T23:35:22.186 INFO:teuthology.orchestra.run.smithi027.stderr:instructed osd(s) 2 to deep-scrub 2023-07-05T23:35:22.196 INFO:tasks.ceph:Scrubbing osd.3 2023-07-05T23:35:22.197 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-07-05T23:35:22.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.324+0000 7fe3c49d6700 1 Processor -- start 2023-07-05T23:35:22.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.324+0000 7fe3c49d6700 1 -- start start 2023-07-05T23:35:22.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.325+0000 7fe3c49d6700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fe3c0069ef0 0x7fe3c006a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:22.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.325+0000 7fe3c49d6700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe3c00ce3d0 0x7fe3c00ce830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:22.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.325+0000 7fe3c49d6700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3c00cce30 con 0x7fe3c006d7b0 2023-07-05T23:35:22.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.325+0000 7fe3c49d6700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3c00cd360 con 0x7fe3c0069ef0 2023-07-05T23:35:22.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.325+0000 7fe3c49d6700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3c0160370 con 0x7fe3c00ce3d0 2023-07-05T23:35:22.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.325+0000 7fe3be59c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fe3c0069ef0 0x7fe3c006a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:22.330 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.325+0000 7fe3be59c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fe3c0069ef0 0x7fe3c006a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46570/0 (socket says 172.21.15.27:46570) 2023-07-05T23:35:22.330 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.325+0000 7fe3be59c700 1 -- 172.21.15.27:0/617935096 learned_addr learned my addr 172.21.15.27:0/617935096 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:22.330 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.325+0000 7fe3bed9d700 1 --2- 172.21.15.27:0/617935096 >> v2:172.21.15.162:3300/0 conn(0x7fe3c00ce3d0 0x7fe3c00ce830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:22.330 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.325+0000 7fe3be59c700 1 -- 172.21.15.27:0/617935096 >> v2:172.21.15.162:3300/0 conn(0x7fe3c00ce3d0 msgr2=0x7fe3c00ce830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:35:22.331 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.325+0000 7fe3be59c700 1 --2- 172.21.15.27:0/617935096 >> v2:172.21.15.162:3300/0 conn(0x7fe3c00ce3d0 0x7fe3c00ce830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:22.331 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.325+0000 7fe3be59c700 1 -- 172.21.15.27:0/617935096 >> v1:172.21.15.162:6789/0 conn(0x7fe3c006d7b0 legacy=0x7fe3c0160800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:35:22.331 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.325+0000 7fe3be59c700 1 -- 172.21.15.27:0/617935096 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c015ca50 con 0x7fe3c0069ef0 2023-07-05T23:35:22.331 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.326+0000 7fe3be59c700 1 --2- 172.21.15.27:0/617935096 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe3c0069ef0 0x7fe3c006a2c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe3c00c3400 tx=0x7fe3b4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f2346504d2e48d5 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:22.332 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.326+0000 7fe3bd59a700 1 -- 172.21.15.27:0/617935096 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b4005e30 con 0x7fe3c0069ef0 2023-07-05T23:35:22.332 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.326+0000 7fe3bd59a700 1 -- 172.21.15.27:0/617935096 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3b4006030 con 0x7fe3c0069ef0 2023-07-05T23:35:22.332 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.326+0000 7fe3bd59a700 1 -- 172.21.15.27:0/617935096 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b40063e0 con 0x7fe3c0069ef0 2023-07-05T23:35:22.333 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.326+0000 7fe3c49d6700 1 -- 172.21.15.27:0/617935096 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe3c0069ef0 msgr2=0x7fe3c006a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:22.333 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.326+0000 7fe3c49d6700 1 --2- 172.21.15.27:0/617935096 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe3c0069ef0 0x7fe3c006a2c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe3c00c3400 tx=0x7fe3b4009bd0 comp rx=0 tx=0).stop 2023-07-05T23:35:22.333 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.326+0000 7fe3c49d6700 1 -- 172.21.15.27:0/617935096 shutdown_connections 2023-07-05T23:35:22.333 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.326+0000 7fe3c49d6700 1 --2- 172.21.15.27:0/617935096 >> v2:172.21.15.162:3300/0 conn(0x7fe3c00ce3d0 0x7fe3c00ce830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:22.333 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.326+0000 7fe3c49d6700 1 --2- 172.21.15.27:0/617935096 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe3c0069ef0 0x7fe3c006a2c0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:22.334 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.326+0000 7fe3c49d6700 1 -- 172.21.15.27:0/617935096 >> 172.21.15.27:0/617935096 conn(0x7fe3c006b920 msgr2=0x7fe3c00cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:22.334 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.326+0000 7fe3c49d6700 1 -- 172.21.15.27:0/617935096 shutdown_connections 2023-07-05T23:35:22.334 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.326+0000 7fe3c49d6700 1 -- 172.21.15.27:0/617935096 wait complete. 2023-07-05T23:35:22.336 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.328+0000 7fe3c49d6700 1 Processor -- start 2023-07-05T23:35:22.337 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.328+0000 7fe3c49d6700 1 -- start start 2023-07-05T23:35:22.337 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.329+0000 7fe3c49d6700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe3c0069ef0 0x7fe3c00af430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:22.337 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.329+0000 7fe3c49d6700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe3c006d7b0 0x7fe3c00ad650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:22.337 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.329+0000 7fe3c49d6700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe3c00ce3d0 0x7fe3c00adb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:22.338 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.329+0000 7fe3c49d6700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c0151a30 con 0x7fe3c00ce3d0 2023-07-05T23:35:22.338 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.329+0000 7fe3c49d6700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c00b3170 con 0x7fe3c0069ef0 2023-07-05T23:35:22.338 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.329+0000 7fe3c49d6700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c015f9d0 con 0x7fe3c006d7b0 2023-07-05T23:35:22.338 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.329+0000 7fe3bed9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe3c00ce3d0 0x7fe3c00adb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:22.338 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.329+0000 7fe3bed9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe3c00ce3d0 0x7fe3c00adb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46578/0 (socket says 172.21.15.27:46578) 2023-07-05T23:35:22.339 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.329+0000 7fe3bed9d700 1 -- 172.21.15.27:0/1043311131 learned_addr learned my addr 172.21.15.27:0/1043311131 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:22.339 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.329+0000 7fe3be59c700 1 --2- 172.21.15.27:0/1043311131 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe3c0069ef0 0x7fe3c00af430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:22.339 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.329+0000 7fe3bdd9b700 1 --2- 172.21.15.27:0/1043311131 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe3c006d7b0 0x7fe3c00ad650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:22.339 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.330+0000 7fe3bed9d700 1 -- 172.21.15.27:0/1043311131 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe3c006d7b0 msgr2=0x7fe3c00ad650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:22.339 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.330+0000 7fe3bed9d700 1 --2- 172.21.15.27:0/1043311131 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe3c006d7b0 0x7fe3c00ad650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:22.339 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.330+0000 7fe3bed9d700 1 -- 172.21.15.27:0/1043311131 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe3c0069ef0 msgr2=0x7fe3c00af430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:22.340 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.330+0000 7fe3bed9d700 1 --2- 172.21.15.27:0/1043311131 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe3c0069ef0 0x7fe3c00af430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:22.340 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.330+0000 7fe3bed9d700 1 -- 172.21.15.27:0/1043311131 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3b4009500 con 0x7fe3c00ce3d0 2023-07-05T23:35:22.340 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.330+0000 7fe3be59c700 1 --2- 172.21.15.27:0/1043311131 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe3c0069ef0 0x7fe3c00af430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T23:35:22.341 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.330+0000 7fe3bed9d700 1 --2- 172.21.15.27:0/1043311131 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe3c00ce3d0 0x7fe3c00adb90 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe3b800cc30 tx=0x7fe3b800a1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:22.341 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.330+0000 7fe3aeffd700 1 -- 172.21.15.27:0/1043311131 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b800ab70 con 0x7fe3c00ce3d0 2023-07-05T23:35:22.341 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.330+0000 7fe3aeffd700 1 -- 172.21.15.27:0/1043311131 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3b800acd0 con 0x7fe3c00ce3d0 2023-07-05T23:35:22.341 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.330+0000 7fe3c49d6700 1 -- 172.21.15.27:0/1043311131 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3c00b2840 con 0x7fe3c00ce3d0 2023-07-05T23:35:22.342 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.330+0000 7fe3aeffd700 1 -- 172.21.15.27:0/1043311131 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b8003c40 con 0x7fe3c00ce3d0 2023-07-05T23:35:22.342 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.330+0000 7fe3c49d6700 1 -- 172.21.15.27:0/1043311131 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3c00b2e00 con 0x7fe3c00ce3d0 2023-07-05T23:35:22.342 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.331+0000 7fe3c49d6700 1 -- 172.21.15.27:0/1043311131 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe3c006a800 con 0x7fe3c00ce3d0 2023-07-05T23:35:22.342 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.331+0000 7fe3aeffd700 1 -- 172.21.15.27:0/1043311131 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe3b80213e0 con 0x7fe3c00ce3d0 2023-07-05T23:35:22.343 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.332+0000 7fe3aeffd700 1 --2- 172.21.15.27:0/1043311131 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fe3a006ace0 0x7fe3a006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:22.343 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.332+0000 7fe3aeffd700 1 -- 172.21.15.27:0/1043311131 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe3b8089ea0 con 0x7fe3c00ce3d0 2023-07-05T23:35:22.343 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.332+0000 7fe3aeffd700 1 --2- 172.21.15.27:0/1043311131 >> [v2:172.21.15.27:6808/2125656143,v1:172.21.15.27:6809/2125656143] conn(0x7fe3a00749f0 0x7fe3a0076e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:22.343 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.332+0000 7fe3aeffd700 1 -- 172.21.15.27:0/1043311131 --> [v2:172.21.15.27:6808/2125656143,v1:172.21.15.27:6809/2125656143] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe3a0077530 con 0x7fe3a00749f0 2023-07-05T23:35:22.344 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.332+0000 7fe3be59c700 1 --2- 172.21.15.27:0/1043311131 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fe3a006ace0 0x7fe3a006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:22.344 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.332+0000 7fe3aeffd700 1 -- 172.21.15.27:0/1043311131 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe3b808a2f0 con 0x7fe3c00ce3d0 2023-07-05T23:35:22.344 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.332+0000 7fe3bdd9b700 1 --2- 172.21.15.27:0/1043311131 >> [v2:172.21.15.27:6808/2125656143,v1:172.21.15.27:6809/2125656143] conn(0x7fe3a00749f0 0x7fe3a0076e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:22.344 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.333+0000 7fe3bdd9b700 1 --2- 172.21.15.27:0/1043311131 >> [v2:172.21.15.27:6808/2125656143,v1:172.21.15.27:6809/2125656143] conn(0x7fe3a00749f0 0x7fe3a0076e60 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:22.344 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.333+0000 7fe3be59c700 1 --2- 172.21.15.27:0/1043311131 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fe3a006ace0 0x7fe3a006d190 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe3c00c3400 tx=0x7fe3b4008070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:22.345 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.333+0000 7fe3aeffd700 1 -- 172.21.15.27:0/1043311131 <== osd.3 v2:172.21.15.27:6808/2125656143 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fe3a0077530 con 0x7fe3a00749f0 2023-07-05T23:35:22.350 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.348+0000 7fe3c49d6700 1 -- 172.21.15.27:0/1043311131 --> [v2:172.21.15.27:6808/2125656143,v1:172.21.15.27:6809/2125656143] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe3c00d0940 con 0x7fe3a00749f0 2023-07-05T23:35:22.350 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.348+0000 7fe3aeffd700 1 -- 172.21.15.27:0/1043311131 <== osd.3 v2:172.21.15.27:6808/2125656143 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fe3b0009930 con 0x7fe3a00749f0 2023-07-05T23:35:22.351 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2023-07-05T23:35:22.351 INFO:teuthology.orchestra.run.smithi027.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-05T23:35:22.352 INFO:teuthology.orchestra.run.smithi027.stdout:} 2023-07-05T23:35:22.352 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.348+0000 7fe3c49d6700 1 -- 172.21.15.27:0/1043311131 >> [v2:172.21.15.27:6808/2125656143,v1:172.21.15.27:6809/2125656143] conn(0x7fe3a00749f0 msgr2=0x7fe3a0076e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:22.353 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.348+0000 7fe3c49d6700 1 --2- 172.21.15.27:0/1043311131 >> [v2:172.21.15.27:6808/2125656143,v1:172.21.15.27:6809/2125656143] conn(0x7fe3a00749f0 0x7fe3a0076e60 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:22.353 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.348+0000 7fe3c49d6700 1 -- 172.21.15.27:0/1043311131 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fe3a006ace0 msgr2=0x7fe3a006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:22.353 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.348+0000 7fe3c49d6700 1 --2- 172.21.15.27:0/1043311131 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fe3a006ace0 0x7fe3a006d190 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe3c00c3400 tx=0x7fe3b4008070 comp rx=0 tx=0).stop 2023-07-05T23:35:22.354 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.348+0000 7fe3c49d6700 1 -- 172.21.15.27:0/1043311131 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe3c00ce3d0 msgr2=0x7fe3c00adb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:22.354 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.348+0000 7fe3c49d6700 1 --2- 172.21.15.27:0/1043311131 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe3c00ce3d0 0x7fe3c00adb90 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe3b800cc30 tx=0x7fe3b800a1f0 comp rx=0 tx=0).stop 2023-07-05T23:35:22.354 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.348+0000 7fe3bed9d700 1 -- 172.21.15.27:0/1043311131 reap_dead start 2023-07-05T23:35:22.354 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.348+0000 7fe3c49d6700 1 -- 172.21.15.27:0/1043311131 shutdown_connections 2023-07-05T23:35:22.354 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.348+0000 7fe3c49d6700 1 -- 172.21.15.27:0/1043311131 >> 172.21.15.27:0/1043311131 conn(0x7fe3c006b920 msgr2=0x7fe3c015ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:22.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.348+0000 7fe3c49d6700 1 -- 172.21.15.27:0/1043311131 shutdown_connections 2023-07-05T23:35:22.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.348+0000 7fe3c49d6700 1 -- 172.21.15.27:0/1043311131 wait complete. 2023-07-05T23:35:22.362 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-07-05T23:35:22.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.485+0000 7f94ac8ec700 1 Processor -- start 2023-07-05T23:35:22.488 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.485+0000 7f94ac8ec700 1 -- start start 2023-07-05T23:35:22.489 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.486+0000 7f94ac8ec700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f94a80aed30 0x7f94a8160580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:22.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.486+0000 7f94ac8ec700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f94a80cc1d0 0x7f94a80cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:22.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.486+0000 7f94ac8ec700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94a80ccb50 con 0x7f94a8156880 2023-07-05T23:35:22.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.486+0000 7f94ac8ec700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94a80cee80 con 0x7f94a80aed30 2023-07-05T23:35:22.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.486+0000 7f94ac8ec700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94a80cf100 con 0x7f94a80cc1d0 2023-07-05T23:35:22.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.486+0000 7f94a5d9b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f94a80aed30 0x7f94a8160580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:22.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.486+0000 7f94a5d9b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f94a80aed30 0x7f94a8160580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46586/0 (socket says 172.21.15.27:46586) 2023-07-05T23:35:22.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.486+0000 7f94a5d9b700 1 -- 172.21.15.27:0/1042589038 learned_addr learned my addr 172.21.15.27:0/1042589038 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:22.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.487+0000 7f94a6d9d700 1 --2- 172.21.15.27:0/1042589038 >> v2:172.21.15.162:3300/0 conn(0x7f94a80cc1d0 0x7f94a80cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:22.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.487+0000 7f94a5d9b700 1 -- 172.21.15.27:0/1042589038 >> v2:172.21.15.162:3300/0 conn(0x7f94a80cc1d0 msgr2=0x7f94a80cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:35:22.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.487+0000 7f94a5d9b700 1 --2- 172.21.15.27:0/1042589038 >> v2:172.21.15.162:3300/0 conn(0x7f94a80cc1d0 0x7f94a80cc610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:22.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.487+0000 7f94a5d9b700 1 -- 172.21.15.27:0/1042589038 >> v1:172.21.15.27:6789/0 conn(0x7f94a8156880 legacy=0x7f94a8069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:22.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.487+0000 7f94a5d9b700 1 -- 172.21.15.27:0/1042589038 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94a80cf3e0 con 0x7f94a80aed30 2023-07-05T23:35:22.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.487+0000 7f94a5d9b700 1 --2- 172.21.15.27:0/1042589038 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94a80aed30 0x7f94a8160580 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f94a815a260 tx=0x7f9498009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6e8b08a919d440e server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:22.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.487+0000 7f94a559a700 1 -- 172.21.15.27:0/1042589038 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949800b870 con 0x7f94a80aed30 2023-07-05T23:35:22.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.487+0000 7f94a559a700 1 -- 172.21.15.27:0/1042589038 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f949800b9d0 con 0x7f94a80aed30 2023-07-05T23:35:22.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.487+0000 7f94a559a700 1 -- 172.21.15.27:0/1042589038 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949800bd60 con 0x7f94a80aed30 2023-07-05T23:35:22.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.488+0000 7f94ac8ec700 1 -- 172.21.15.27:0/1042589038 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94a80aed30 msgr2=0x7f94a8160580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:22.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.488+0000 7f94ac8ec700 1 --2- 172.21.15.27:0/1042589038 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94a80aed30 0x7f94a8160580 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f94a815a260 tx=0x7f9498009bd0 comp rx=0 tx=0).stop 2023-07-05T23:35:22.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.488+0000 7f94ac8ec700 1 -- 172.21.15.27:0/1042589038 shutdown_connections 2023-07-05T23:35:22.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.488+0000 7f94ac8ec700 1 --2- 172.21.15.27:0/1042589038 >> v2:172.21.15.162:3300/0 conn(0x7f94a80cc1d0 0x7f94a80cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:22.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.488+0000 7f94ac8ec700 1 --2- 172.21.15.27:0/1042589038 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94a80aed30 0x7f94a8160580 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:22.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.488+0000 7f94ac8ec700 1 -- 172.21.15.27:0/1042589038 >> 172.21.15.27:0/1042589038 conn(0x7f94a806d4a0 msgr2=0x7f94a806d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:22.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.488+0000 7f94ac8ec700 1 -- 172.21.15.27:0/1042589038 shutdown_connections 2023-07-05T23:35:22.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.488+0000 7f94ac8ec700 1 -- 172.21.15.27:0/1042589038 wait complete. 2023-07-05T23:35:22.497 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.489+0000 7f94ac8ec700 1 Processor -- start 2023-07-05T23:35:22.497 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.489+0000 7f94ac8ec700 1 -- start start 2023-07-05T23:35:22.497 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.490+0000 7f94ac8ec700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f94a80aed30 0x7f94a814fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:22.498 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.490+0000 7f94ac8ec700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94a80cc1d0 0x7f94a814f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:22.498 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.490+0000 7f94ac8ec700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f94a8156880 0x7f94a8159220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:22.498 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.490+0000 7f94ac8ec700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94a814fb20 con 0x7f94a80cc1d0 2023-07-05T23:35:22.498 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.490+0000 7f94ac8ec700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94a81505b0 con 0x7f94a8156880 2023-07-05T23:35:22.498 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.490+0000 7f94ac8ec700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94a8159760 con 0x7f94a80aed30 2023-07-05T23:35:22.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.490+0000 7f94a5d9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94a80cc1d0 0x7f94a814f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:22.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.490+0000 7f94a5d9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94a80cc1d0 0x7f94a814f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46592/0 (socket says 172.21.15.27:46592) 2023-07-05T23:35:22.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.490+0000 7f94a5d9b700 1 -- 172.21.15.27:0/4010715483 learned_addr learned my addr 172.21.15.27:0/4010715483 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:22.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.490+0000 7f94a6d9d700 1 --2- 172.21.15.27:0/4010715483 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f94a8156880 0x7f94a8159220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:22.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.490+0000 7f94a659c700 1 --2- 172.21.15.27:0/4010715483 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f94a80aed30 0x7f94a814fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:22.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.490+0000 7f94a5d9b700 1 -- 172.21.15.27:0/4010715483 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f94a80aed30 msgr2=0x7f94a814fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:22.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.490+0000 7f94a5d9b700 1 --2- 172.21.15.27:0/4010715483 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f94a80aed30 0x7f94a814fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:22.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.490+0000 7f94a5d9b700 1 -- 172.21.15.27:0/4010715483 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f94a8156880 msgr2=0x7f94a8159220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:22.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.490+0000 7f94a5d9b700 1 --2- 172.21.15.27:0/4010715483 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f94a8156880 0x7f94a8159220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:22.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.490+0000 7f94a5d9b700 1 -- 172.21.15.27:0/4010715483 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9498009550 con 0x7f94a80cc1d0 2023-07-05T23:35:22.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.490+0000 7f94a5d9b700 1 --2- 172.21.15.27:0/4010715483 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94a80cc1d0 0x7f94a814f5e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f94a80ccf50 tx=0x7f9498004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:22.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.491+0000 7f9496ffd700 1 -- 172.21.15.27:0/4010715483 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9498004310 con 0x7f94a80cc1d0 2023-07-05T23:35:22.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.491+0000 7f9496ffd700 1 -- 172.21.15.27:0/4010715483 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f949801f070 con 0x7f94a80cc1d0 2023-07-05T23:35:22.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.491+0000 7f9496ffd700 1 -- 172.21.15.27:0/4010715483 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94980036a0 con 0x7f94a80cc1d0 2023-07-05T23:35:22.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.491+0000 7f94ac8ec700 1 -- 172.21.15.27:0/4010715483 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94a8159a20 con 0x7f94a80cc1d0 2023-07-05T23:35:22.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.491+0000 7f94ac8ec700 1 -- 172.21.15.27:0/4010715483 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94a80b3620 con 0x7f94a80cc1d0 2023-07-05T23:35:22.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.492+0000 7f94ac8ec700 1 -- 172.21.15.27:0/4010715483 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94a815fb70 con 0x7f94a80cc1d0 2023-07-05T23:35:22.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.492+0000 7f9496ffd700 1 -- 172.21.15.27:0/4010715483 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9498021030 con 0x7f94a80cc1d0 2023-07-05T23:35:22.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.492+0000 7f9496ffd700 1 --2- 172.21.15.27:0/4010715483 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f948806ace0 0x7f948806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:22.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.493+0000 7f9496ffd700 1 -- 172.21.15.27:0/4010715483 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f949808ab60 con 0x7f94a80cc1d0 2023-07-05T23:35:22.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.493+0000 7f94a659c700 1 --2- 172.21.15.27:0/4010715483 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f948806ace0 0x7f948806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:22.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.493+0000 7f94a659c700 1 --2- 172.21.15.27:0/4010715483 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f948806ace0 0x7f948806d190 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f949c007fd0 tx=0x7f949c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:22.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.497+0000 7f9496ffd700 1 -- 172.21.15.27:0/4010715483 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f94980558f0 con 0x7f94a80cc1d0 2023-07-05T23:35:22.694 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.692+0000 7f94ac8ec700 1 -- 172.21.15.27:0/4010715483 --> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f94a80cd670 con 0x7f948806ace0 2023-07-05T23:35:22.695 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.693+0000 7f9496ffd700 1 -- 172.21.15.27:0/4010715483 <== mgr.4105 v2:172.21.15.162:6832/3790028097 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f949c001cc0 con 0x7f948806ace0 2023-07-05T23:35:22.698 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.696+0000 7f94ac8ec700 1 -- 172.21.15.27:0/4010715483 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f948806ace0 msgr2=0x7f948806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:22.698 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.696+0000 7f94ac8ec700 1 --2- 172.21.15.27:0/4010715483 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f948806ace0 0x7f948806d190 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f949c007fd0 tx=0x7f949c009040 comp rx=0 tx=0).stop 2023-07-05T23:35:22.698 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.696+0000 7f94ac8ec700 1 -- 172.21.15.27:0/4010715483 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94a80cc1d0 msgr2=0x7f94a814f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:22.699 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.696+0000 7f94ac8ec700 1 --2- 172.21.15.27:0/4010715483 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94a80cc1d0 0x7f94a814f5e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f94a80ccf50 tx=0x7f9498004750 comp rx=0 tx=0).stop 2023-07-05T23:35:22.699 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.696+0000 7f94ac8ec700 1 -- 172.21.15.27:0/4010715483 shutdown_connections 2023-07-05T23:35:22.699 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.696+0000 7f94ac8ec700 1 --2- 172.21.15.27:0/4010715483 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f94a8156880 0x7f94a8159220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:22.699 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.696+0000 7f94ac8ec700 1 --2- 172.21.15.27:0/4010715483 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f948806ace0 0x7f948806d190 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:22.700 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.696+0000 7f94ac8ec700 1 --2- 172.21.15.27:0/4010715483 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f94a80aed30 0x7f94a814fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:22.700 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.696+0000 7f94ac8ec700 1 --2- 172.21.15.27:0/4010715483 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94a80cc1d0 0x7f94a814f5e0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:22.700 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.696+0000 7f94ac8ec700 1 -- 172.21.15.27:0/4010715483 >> 172.21.15.27:0/4010715483 conn(0x7f94a806d4a0 msgr2=0x7f94a806a600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:22.700 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.696+0000 7f94ac8ec700 1 -- 172.21.15.27:0/4010715483 shutdown_connections 2023-07-05T23:35:22.700 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.696+0000 7f94ac8ec700 1 -- 172.21.15.27:0/4010715483 wait complete. 2023-07-05T23:35:22.701 INFO:teuthology.orchestra.run.smithi027.stderr:instructed osd(s) 3 to deep-scrub 2023-07-05T23:35:22.710 INFO:tasks.ceph:Scrubbing osd.4 2023-07-05T23:35:22.711 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-07-05T23:35:22.764 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:35:22.767 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:35:22.846 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.844+0000 7f70bb8e6700 1 Processor -- start 2023-07-05T23:35:22.846 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.844+0000 7f70bb8e6700 1 -- start start 2023-07-05T23:35:22.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.845+0000 7f70bb8e6700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f70b406e970 0x7f70b406a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:22.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.845+0000 7f70bb8e6700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70b40ce620 con 0x7f70b40aecc0 2023-07-05T23:35:22.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.845+0000 7f70bb8e6700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70b4160580 con 0x7f70b415fc60 2023-07-05T23:35:22.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.845+0000 7f70bb8e6700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70b4160860 con 0x7f70b406e970 2023-07-05T23:35:22.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.845+0000 7f70b9e83700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f70b406e970 0x7f70b406a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:22.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.845+0000 7f70b9e83700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f70b406e970 0x7f70b406a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46602/0 (socket says 172.21.15.27:46602) 2023-07-05T23:35:22.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.845+0000 7f70b9e83700 1 -- 172.21.15.27:0/1024762458 learned_addr learned my addr 172.21.15.27:0/1024762458 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:22.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.845+0000 7f70b9e83700 1 -- 172.21.15.27:0/1024762458 >> v1:172.21.15.162:6789/0 conn(0x7f70b415fc60 legacy=0x7f70b406e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:22.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.845+0000 7f70b9e83700 1 -- 172.21.15.27:0/1024762458 >> v1:172.21.15.27:6789/0 conn(0x7f70b40aecc0 legacy=0x7f70b40cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:22.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.845+0000 7f70b9e83700 1 -- 172.21.15.27:0/1024762458 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b4160b40 con 0x7f70b406e970 2023-07-05T23:35:22.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.846+0000 7f70b9e83700 1 --2- 172.21.15.27:0/1024762458 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f70b406e970 0x7f70b406a900 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f70ac009e50 tx=0x7f70ac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1881cac3804701cd server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:22.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.846+0000 7f70abfff700 1 -- 172.21.15.27:0/1024762458 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ac00e070 con 0x7f70b406e970 2023-07-05T23:35:22.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.846+0000 7f70abfff700 1 -- 172.21.15.27:0/1024762458 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70ac00b9c0 con 0x7f70b406e970 2023-07-05T23:35:22.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.846+0000 7f70abfff700 1 -- 172.21.15.27:0/1024762458 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ac00bd70 con 0x7f70b406e970 2023-07-05T23:35:22.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.846+0000 7f70bb8e6700 1 -- 172.21.15.27:0/1024762458 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f70b406e970 msgr2=0x7f70b406a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:22.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.846+0000 7f70bb8e6700 1 --2- 172.21.15.27:0/1024762458 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f70b406e970 0x7f70b406a900 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f70ac009e50 tx=0x7f70ac00b330 comp rx=0 tx=0).stop 2023-07-05T23:35:22.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.846+0000 7f70bb8e6700 1 -- 172.21.15.27:0/1024762458 shutdown_connections 2023-07-05T23:35:22.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.846+0000 7f70bb8e6700 1 --2- 172.21.15.27:0/1024762458 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f70b406e970 0x7f70b406a900 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:22.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.846+0000 7f70bb8e6700 1 -- 172.21.15.27:0/1024762458 >> 172.21.15.27:0/1024762458 conn(0x7f70b406b920 msgr2=0x7f70b40cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:22.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.846+0000 7f70bb8e6700 1 -- 172.21.15.27:0/1024762458 shutdown_connections 2023-07-05T23:35:22.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.846+0000 7f70bb8e6700 1 -- 172.21.15.27:0/1024762458 wait complete. 2023-07-05T23:35:22.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.848+0000 7f70bb8e6700 1 Processor -- start 2023-07-05T23:35:22.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.848+0000 7f70bb8e6700 1 -- start start 2023-07-05T23:35:22.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.848+0000 7f70bb8e6700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f70b406e970 0x7f70b40cc070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:22.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.848+0000 7f70bb8e6700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f70b40aecc0 0x7f70b40b2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:22.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.848+0000 7f70bb8e6700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f70b415fc60 0x7f70b415a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:22.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.848+0000 7f70bb8e6700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b40cbc50 con 0x7f70b415fc60 2023-07-05T23:35:22.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.848+0000 7f70bb8e6700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b40cafd0 con 0x7f70b40aecc0 2023-07-05T23:35:22.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.848+0000 7f70bb8e6700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70b40cb2b0 con 0x7f70b406e970 2023-07-05T23:35:22.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.848+0000 7f70b9e83700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f70b415fc60 0x7f70b415a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:22.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.848+0000 7f70b9e83700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f70b415fc60 0x7f70b415a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46608/0 (socket says 172.21.15.27:46608) 2023-07-05T23:35:22.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.848+0000 7f70b9e83700 1 -- 172.21.15.27:0/4115404112 learned_addr learned my addr 172.21.15.27:0/4115404112 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:22.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.849+0000 7f70b8e81700 1 --2- 172.21.15.27:0/4115404112 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f70b40aecc0 0x7f70b40b2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:22.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.849+0000 7f70b9682700 1 --2- 172.21.15.27:0/4115404112 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f70b406e970 0x7f70b40cc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:22.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.849+0000 7f70b9e83700 1 -- 172.21.15.27:0/4115404112 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f70b406e970 msgr2=0x7f70b40cc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:22.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.849+0000 7f70b9e83700 1 --2- 172.21.15.27:0/4115404112 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f70b406e970 0x7f70b40cc070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:22.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.849+0000 7f70b9e83700 1 -- 172.21.15.27:0/4115404112 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f70b40aecc0 msgr2=0x7f70b40b2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:22.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.849+0000 7f70b9e83700 1 --2- 172.21.15.27:0/4115404112 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f70b40aecc0 0x7f70b40b2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:22.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.849+0000 7f70b9e83700 1 -- 172.21.15.27:0/4115404112 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70ac009b30 con 0x7f70b415fc60 2023-07-05T23:35:22.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.849+0000 7f70b9682700 1 --2- 172.21.15.27:0/4115404112 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f70b406e970 0x7f70b40cc070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T23:35:22.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.849+0000 7f70b8e81700 1 --2- 172.21.15.27:0/4115404112 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f70b40aecc0 0x7f70b40b2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T23:35:22.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.849+0000 7f70b9e83700 1 --2- 172.21.15.27:0/4115404112 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f70b415fc60 0x7f70b415a6c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f70ac012000 tx=0x7f70ac004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:22.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.849+0000 7f70a9ffb700 1 -- 172.21.15.27:0/4115404112 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ac003ea0 con 0x7f70b415fc60 2023-07-05T23:35:22.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.849+0000 7f70a9ffb700 1 -- 172.21.15.27:0/4115404112 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70ac0099b0 con 0x7f70b415fc60 2023-07-05T23:35:22.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.849+0000 7f70a9ffb700 1 -- 172.21.15.27:0/4115404112 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ac01c660 con 0x7f70b415fc60 2023-07-05T23:35:22.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.849+0000 7f70bb8e6700 1 -- 172.21.15.27:0/4115404112 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70b40cb590 con 0x7f70b415fc60 2023-07-05T23:35:22.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.849+0000 7f70bb8e6700 1 -- 172.21.15.27:0/4115404112 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70b40cc5b0 con 0x7f70b415fc60 2023-07-05T23:35:22.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.850+0000 7f70bb8e6700 1 -- 172.21.15.27:0/4115404112 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f70b4160e20 con 0x7f70b415fc60 2023-07-05T23:35:22.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.851+0000 7f70a9ffb700 1 -- 172.21.15.27:0/4115404112 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f70ac01c7c0 con 0x7f70b415fc60 2023-07-05T23:35:22.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.851+0000 7f70a9ffb700 1 --2- 172.21.15.27:0/4115404112 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f709806ace0 0x7f709806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:22.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.851+0000 7f70a9ffb700 1 -- 172.21.15.27:0/4115404112 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f70ac08b260 con 0x7f70b415fc60 2023-07-05T23:35:22.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.851+0000 7f70a9ffb700 1 --2- 172.21.15.27:0/4115404112 >> [v2:172.21.15.162:6800/2111223016,v1:172.21.15.162:6801/2111223016] conn(0x7f70980749f0 0x7f7098076e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:22.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.851+0000 7f70a9ffb700 1 -- 172.21.15.27:0/4115404112 --> [v2:172.21.15.162:6800/2111223016,v1:172.21.15.162:6801/2111223016] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7098077530 con 0x7f70980749f0 2023-07-05T23:35:22.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.851+0000 7f70a9ffb700 1 -- 172.21.15.27:0/4115404112 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70ac08d920 con 0x7f70b415fc60 2023-07-05T23:35:22.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.851+0000 7f70b9682700 1 --2- 172.21.15.27:0/4115404112 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f709806ace0 0x7f709806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:22.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.852+0000 7f70b8e81700 1 --2- 172.21.15.27:0/4115404112 >> [v2:172.21.15.162:6800/2111223016,v1:172.21.15.162:6801/2111223016] conn(0x7f70980749f0 0x7f7098076e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:22.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.852+0000 7f70b9682700 1 --2- 172.21.15.27:0/4115404112 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f709806ace0 0x7f709806d190 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f70a4001730 tx=0x7f70a4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:22.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.852+0000 7f70b8e81700 1 --2- 172.21.15.27:0/4115404112 >> [v2:172.21.15.162:6800/2111223016,v1:172.21.15.162:6801/2111223016] conn(0x7f70980749f0 0x7f7098076e60 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:22.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.853+0000 7f70a9ffb700 1 -- 172.21.15.27:0/4115404112 <== osd.4 v2:172.21.15.162:6800/2111223016 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f7098077530 con 0x7f70980749f0 2023-07-05T23:35:22.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.867+0000 7f70bb8e6700 1 -- 172.21.15.27:0/4115404112 --> [v2:172.21.15.162:6800/2111223016,v1:172.21.15.162:6801/2111223016] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f70b404ea20 con 0x7f70980749f0 2023-07-05T23:35:22.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.868+0000 7f70a9ffb700 1 -- 172.21.15.27:0/4115404112 <== osd.4 v2:172.21.15.162:6800/2111223016 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f70b404ea20 con 0x7f70980749f0 2023-07-05T23:35:22.870 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2023-07-05T23:35:22.870 INFO:teuthology.orchestra.run.smithi027.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-05T23:35:22.870 INFO:teuthology.orchestra.run.smithi027.stdout:} 2023-07-05T23:35:22.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.868+0000 7f70bb8e6700 1 -- 172.21.15.27:0/4115404112 >> [v2:172.21.15.162:6800/2111223016,v1:172.21.15.162:6801/2111223016] conn(0x7f70980749f0 msgr2=0x7f7098076e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:22.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.868+0000 7f70bb8e6700 1 --2- 172.21.15.27:0/4115404112 >> [v2:172.21.15.162:6800/2111223016,v1:172.21.15.162:6801/2111223016] conn(0x7f70980749f0 0x7f7098076e60 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:22.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.868+0000 7f70bb8e6700 1 -- 172.21.15.27:0/4115404112 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f709806ace0 msgr2=0x7f709806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:22.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.868+0000 7f70bb8e6700 1 --2- 172.21.15.27:0/4115404112 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f709806ace0 0x7f709806d190 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f70a4001730 tx=0x7f70a4009040 comp rx=0 tx=0).stop 2023-07-05T23:35:22.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.868+0000 7f70bb8e6700 1 -- 172.21.15.27:0/4115404112 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f70b415fc60 msgr2=0x7f70b415a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:22.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.868+0000 7f70bb8e6700 1 --2- 172.21.15.27:0/4115404112 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f70b415fc60 0x7f70b415a6c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f70ac012000 tx=0x7f70ac004ad0 comp rx=0 tx=0).stop 2023-07-05T23:35:22.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.868+0000 7f70b9e83700 1 -- 172.21.15.27:0/4115404112 reap_dead start 2023-07-05T23:35:22.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.868+0000 7f70bb8e6700 1 -- 172.21.15.27:0/4115404112 shutdown_connections 2023-07-05T23:35:22.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.868+0000 7f70bb8e6700 1 -- 172.21.15.27:0/4115404112 >> 172.21.15.27:0/4115404112 conn(0x7f70b406b920 msgr2=0x7f70b40ac670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:22.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.868+0000 7f70bb8e6700 1 -- 172.21.15.27:0/4115404112 shutdown_connections 2023-07-05T23:35:22.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:22.868+0000 7f70bb8e6700 1 -- 172.21.15.27:0/4115404112 wait complete. 2023-07-05T23:35:22.882 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-07-05T23:35:23.048 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.046+0000 7f873eb27700 1 Processor -- start 2023-07-05T23:35:23.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.046+0000 7f873eb27700 1 -- start start 2023-07-05T23:35:23.051 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.047+0000 7f873eb27700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8738156880 0x7f8738069ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:23.051 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.047+0000 7f873eb27700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f87380aed30 0x7f8738160580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:23.051 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.047+0000 7f873eb27700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87380cee80 con 0x7f87380cc1d0 2023-07-05T23:35:23.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.047+0000 7f873eb27700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87380cf100 con 0x7f87380aed30 2023-07-05T23:35:23.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.047+0000 7f873eb27700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87380cf3e0 con 0x7f8738156880 2023-07-05T23:35:23.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.048+0000 7f873c8c3700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8738156880 0x7f8738069ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:23.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.048+0000 7f8737fff700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f87380aed30 0x7f8738160580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:23.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.048+0000 7f873d0c4700 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f87380cc1d0 0x7f873815cb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.27:34752/0 (socket says 172.21.15.27:34752) 2023-07-05T23:35:23.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.048+0000 7f873d0c4700 1 -- 172.21.15.27:0/3256951041 learned_addr learned my addr 172.21.15.27:0/3256951041 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-07-05T23:35:23.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.048+0000 7f87377fe700 1 -- 172.21.15.27:0/3256951041 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 125063450 0 0) 0x7f87380cee80 con 0x7f87380cc1d0 2023-07-05T23:35:23.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.048+0000 7f873c8c3700 1 -- 172.21.15.27:0/3256951041 >> v2:172.21.15.162:3300/0 conn(0x7f87380aed30 msgr2=0x7f8738160580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:35:23.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.048+0000 7f873c8c3700 1 --2- 172.21.15.27:0/3256951041 >> v2:172.21.15.162:3300/0 conn(0x7f87380aed30 0x7f8738160580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:23.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.048+0000 7f873c8c3700 1 -- 172.21.15.27:0/3256951041 >> v1:172.21.15.162:6789/0 conn(0x7f87380cc1d0 legacy=0x7f873815cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:23.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.048+0000 7f873c8c3700 1 -- 172.21.15.27:0/3256951041 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87380cd390 con 0x7f8738156880 2023-07-05T23:35:23.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.048+0000 7f8737fff700 1 --2- 172.21.15.27:0/3256951041 >> v2:172.21.15.162:3300/0 conn(0x7f87380aed30 0x7f8738160580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-05T23:35:23.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.048+0000 7f873c8c3700 1 --2- 172.21.15.27:0/3256951041 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8738156880 0x7f8738069ef0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f872c009840 tx=0x7f872c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0c57646649daa84 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:23.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.048+0000 7f87377fe700 1 -- 172.21.15.27:0/3256951041 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872c011830 con 0x7f8738156880 2023-07-05T23:35:23.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.048+0000 7f87377fe700 1 -- 172.21.15.27:0/3256951041 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f872c011990 con 0x7f8738156880 2023-07-05T23:35:23.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.048+0000 7f87377fe700 1 -- 172.21.15.27:0/3256951041 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872c011d20 con 0x7f8738156880 2023-07-05T23:35:23.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.049+0000 7f873eb27700 1 -- 172.21.15.27:0/3256951041 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8738156880 msgr2=0x7f8738069ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:23.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.049+0000 7f873eb27700 1 --2- 172.21.15.27:0/3256951041 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8738156880 0x7f8738069ef0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f872c009840 tx=0x7f872c009b50 comp rx=0 tx=0).stop 2023-07-05T23:35:23.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.049+0000 7f873eb27700 1 -- 172.21.15.27:0/3256951041 shutdown_connections 2023-07-05T23:35:23.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.049+0000 7f873eb27700 1 --2- 172.21.15.27:0/3256951041 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8738156880 0x7f8738069ef0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:23.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.049+0000 7f873eb27700 1 --2- 172.21.15.27:0/3256951041 >> v2:172.21.15.162:3300/0 conn(0x7f87380aed30 0x7f8738160580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:23.057 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.049+0000 7f873eb27700 1 -- 172.21.15.27:0/3256951041 >> 172.21.15.27:0/3256951041 conn(0x7f873806d4a0 msgr2=0x7f873806d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:23.057 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.049+0000 7f873eb27700 1 -- 172.21.15.27:0/3256951041 shutdown_connections 2023-07-05T23:35:23.057 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.049+0000 7f873eb27700 1 -- 172.21.15.27:0/3256951041 wait complete. 2023-07-05T23:35:23.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.050+0000 7f873eb27700 1 Processor -- start 2023-07-05T23:35:23.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.050+0000 7f873eb27700 1 -- start start 2023-07-05T23:35:23.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.051+0000 7f873eb27700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f87380aed30 0x7f87380c52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:23.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.051+0000 7f873eb27700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87380cc1d0 0x7f873806dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:23.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.051+0000 7f873eb27700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8738156880 0x7f87381f5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:23.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.051+0000 7f873eb27700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87380b3420 con 0x7f8738156880 2023-07-05T23:35:23.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.051+0000 7f873eb27700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87380b2b80 con 0x7f87380cc1d0 2023-07-05T23:35:23.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.051+0000 7f873eb27700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87380b2e60 con 0x7f87380aed30 2023-07-05T23:35:23.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.051+0000 7f873d0c4700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8738156880 0x7f87381f5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:23.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.051+0000 7f873d0c4700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8738156880 0x7f87381f5120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46624/0 (socket says 172.21.15.27:46624) 2023-07-05T23:35:23.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.051+0000 7f873d0c4700 1 -- 172.21.15.27:0/851681988 learned_addr learned my addr 172.21.15.27:0/851681988 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:23.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.052+0000 7f8737fff700 1 --2- 172.21.15.27:0/851681988 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87380cc1d0 0x7f873806dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:23.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.052+0000 7f873c8c3700 1 --2- 172.21.15.27:0/851681988 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f87380aed30 0x7f87380c52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:23.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.052+0000 7f873d0c4700 1 -- 172.21.15.27:0/851681988 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f87380aed30 msgr2=0x7f87380c52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:23.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.052+0000 7f873d0c4700 1 --2- 172.21.15.27:0/851681988 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f87380aed30 0x7f87380c52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:23.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.052+0000 7f873d0c4700 1 -- 172.21.15.27:0/851681988 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87380cc1d0 msgr2=0x7f873806dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:23.063 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.052+0000 7f873d0c4700 1 --2- 172.21.15.27:0/851681988 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87380cc1d0 0x7f873806dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:23.063 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.052+0000 7f873d0c4700 1 -- 172.21.15.27:0/851681988 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87240094a0 con 0x7f8738156880 2023-07-05T23:35:23.063 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.052+0000 7f873c8c3700 1 --2- 172.21.15.27:0/851681988 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f87380aed30 0x7f87380c52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T23:35:23.063 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.052+0000 7f873d0c4700 1 --2- 172.21.15.27:0/851681988 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8738156880 0x7f87381f5120 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f873000cca0 tx=0x7f873000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:23.063 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.052+0000 7f87357fa700 1 -- 172.21.15.27:0/851681988 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873000ac20 con 0x7f8738156880 2023-07-05T23:35:23.064 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.052+0000 7f87357fa700 1 -- 172.21.15.27:0/851681988 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f873000ad80 con 0x7f8738156880 2023-07-05T23:35:23.064 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.052+0000 7f873eb27700 1 -- 172.21.15.27:0/851681988 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f872c0094a0 con 0x7f8738156880 2023-07-05T23:35:23.064 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.052+0000 7f87357fa700 1 -- 172.21.15.27:0/851681988 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8730007310 con 0x7f8738156880 2023-07-05T23:35:23.064 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.052+0000 7f873eb27700 1 -- 172.21.15.27:0/851681988 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87381f1c60 con 0x7f8738156880 2023-07-05T23:35:23.064 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.053+0000 7f873eb27700 1 -- 172.21.15.27:0/851681988 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87381f1e50 con 0x7f8738156880 2023-07-05T23:35:23.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.054+0000 7f87357fa700 1 -- 172.21.15.27:0/851681988 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8730007470 con 0x7f8738156880 2023-07-05T23:35:23.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.054+0000 7f87357fa700 1 --2- 172.21.15.27:0/851681988 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f871c06ace0 0x7f871c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:23.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.054+0000 7f87357fa700 1 -- 172.21.15.27:0/851681988 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8730089650 con 0x7f8738156880 2023-07-05T23:35:23.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.054+0000 7f873c8c3700 1 --2- 172.21.15.27:0/851681988 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f871c06ace0 0x7f871c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:23.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.055+0000 7f873c8c3700 1 --2- 172.21.15.27:0/851681988 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f871c06ace0 0x7f871c06d190 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f872c000c00 tx=0x7f872c008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:23.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.059+0000 7f87357fa700 1 -- 172.21.15.27:0/851681988 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f87300543d0 con 0x7f8738156880 2023-07-05T23:35:23.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.255+0000 7f873eb27700 1 -- 172.21.15.27:0/851681988 --> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f87380cd950 con 0x7f871c06ace0 2023-07-05T23:35:23.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.256+0000 7f87357fa700 1 -- 172.21.15.27:0/851681988 <== mgr.4105 v2:172.21.15.162:6832/3790028097 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f872c011cb0 con 0x7f871c06ace0 2023-07-05T23:35:23.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.257+0000 7f873eb27700 1 -- 172.21.15.27:0/851681988 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f871c06ace0 msgr2=0x7f871c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:23.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.258+0000 7f873eb27700 1 --2- 172.21.15.27:0/851681988 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f871c06ace0 0x7f871c06d190 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f872c000c00 tx=0x7f872c008030 comp rx=0 tx=0).stop 2023-07-05T23:35:23.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.258+0000 7f873eb27700 1 -- 172.21.15.27:0/851681988 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8738156880 msgr2=0x7f87381f5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:23.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.258+0000 7f873eb27700 1 --2- 172.21.15.27:0/851681988 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8738156880 0x7f87381f5120 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f873000cca0 tx=0x7f873000a060 comp rx=0 tx=0).stop 2023-07-05T23:35:23.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.258+0000 7f873eb27700 1 -- 172.21.15.27:0/851681988 shutdown_connections 2023-07-05T23:35:23.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.258+0000 7f873eb27700 1 --2- 172.21.15.27:0/851681988 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f871c06ace0 0x7f871c06d190 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:23.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.258+0000 7f873eb27700 1 --2- 172.21.15.27:0/851681988 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8738156880 0x7f87381f5120 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:23.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.258+0000 7f873eb27700 1 --2- 172.21.15.27:0/851681988 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f87380aed30 0x7f87380c52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:23.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.258+0000 7f873eb27700 1 --2- 172.21.15.27:0/851681988 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87380cc1d0 0x7f873806dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:23.262 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.258+0000 7f873eb27700 1 -- 172.21.15.27:0/851681988 >> 172.21.15.27:0/851681988 conn(0x7f873806d4a0 msgr2=0x7f8738072990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:23.262 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.258+0000 7f873eb27700 1 -- 172.21.15.27:0/851681988 shutdown_connections 2023-07-05T23:35:23.262 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.258+0000 7f873eb27700 1 -- 172.21.15.27:0/851681988 wait complete. 2023-07-05T23:35:23.262 INFO:teuthology.orchestra.run.smithi027.stderr:instructed osd(s) 4 to deep-scrub 2023-07-05T23:35:23.272 INFO:tasks.ceph:Scrubbing osd.5 2023-07-05T23:35:23.272 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-07-05T23:35:23.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.399+0000 7fa32deca700 1 Processor -- start 2023-07-05T23:35:23.402 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.399+0000 7fa32deca700 1 -- start start 2023-07-05T23:35:23.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.400+0000 7fa32deca700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa32806ccd0 0x7fa32815b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:23.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.400+0000 7fa32deca700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3280cb380 con 0x7fa3280cfd80 2023-07-05T23:35:23.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.400+0000 7fa32deca700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3280c97f0 con 0x7fa328069ef0 2023-07-05T23:35:23.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.400+0000 7fa32deca700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa32815b7a0 con 0x7fa32806ccd0 2023-07-05T23:35:23.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.400+0000 7fa3277fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa32806ccd0 0x7fa32815b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:23.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.400+0000 7fa3277fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa32806ccd0 0x7fa32815b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46628/0 (socket says 172.21.15.27:46628) 2023-07-05T23:35:23.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.400+0000 7fa3277fe700 1 -- 172.21.15.27:0/4003833099 learned_addr learned my addr 172.21.15.27:0/4003833099 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:23.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.400+0000 7fa3277fe700 1 -- 172.21.15.27:0/4003833099 >> v1:172.21.15.162:6789/0 conn(0x7fa328069ef0 legacy=0x7fa32806a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:23.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.400+0000 7fa3277fe700 1 -- 172.21.15.27:0/4003833099 >> v1:172.21.15.27:6789/0 conn(0x7fa3280cfd80 legacy=0x7fa32806d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:23.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.400+0000 7fa3277fe700 1 -- 172.21.15.27:0/4003833099 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3280cb620 con 0x7fa32806ccd0 2023-07-05T23:35:23.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.400+0000 7fa3277fe700 1 --2- 172.21.15.27:0/4003833099 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa32806ccd0 0x7fa32815b1c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa3180098f0 tx=0x7fa318009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4661e35e6fe2a70 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:23.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.400+0000 7fa3267fc700 1 -- 172.21.15.27:0/4003833099 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa31800b8a0 con 0x7fa32806ccd0 2023-07-05T23:35:23.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.400+0000 7fa3267fc700 1 -- 172.21.15.27:0/4003833099 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa31800ba00 con 0x7fa32806ccd0 2023-07-05T23:35:23.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.400+0000 7fa3267fc700 1 -- 172.21.15.27:0/4003833099 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa31800bd90 con 0x7fa32806ccd0 2023-07-05T23:35:23.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.401+0000 7fa32deca700 1 -- 172.21.15.27:0/4003833099 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa32806ccd0 msgr2=0x7fa32815b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:23.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.401+0000 7fa32deca700 1 --2- 172.21.15.27:0/4003833099 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa32806ccd0 0x7fa32815b1c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa3180098f0 tx=0x7fa318009c00 comp rx=0 tx=0).stop 2023-07-05T23:35:23.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.401+0000 7fa32deca700 1 -- 172.21.15.27:0/4003833099 shutdown_connections 2023-07-05T23:35:23.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.401+0000 7fa32deca700 1 --2- 172.21.15.27:0/4003833099 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa32806ccd0 0x7fa32815b1c0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:23.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.401+0000 7fa32deca700 1 -- 172.21.15.27:0/4003833099 >> 172.21.15.27:0/4003833099 conn(0x7fa3280b1990 msgr2=0x7fa3280cf1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:23.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.401+0000 7fa32deca700 1 -- 172.21.15.27:0/4003833099 shutdown_connections 2023-07-05T23:35:23.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.401+0000 7fa32deca700 1 -- 172.21.15.27:0/4003833099 wait complete. 2023-07-05T23:35:23.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.402+0000 7fa32deca700 1 Processor -- start 2023-07-05T23:35:23.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.402+0000 7fa32deca700 1 -- start start 2023-07-05T23:35:23.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.403+0000 7fa32deca700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa328069ef0 0x7fa3280ac270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:23.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.403+0000 7fa32deca700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa32806ccd0 0x7fa3280c8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:23.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.403+0000 7fa32deca700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa3280cfd80 0x7fa3280ccd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:23.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.403+0000 7fa32deca700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3280abf30 con 0x7fa3280cfd80 2023-07-05T23:35:23.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.403+0000 7fa32deca700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3280ab970 con 0x7fa32806ccd0 2023-07-05T23:35:23.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.403+0000 7fa32deca700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3280abc50 con 0x7fa328069ef0 2023-07-05T23:35:23.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.403+0000 7fa327fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa3280cfd80 0x7fa3280ccd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:23.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.403+0000 7fa327fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa3280cfd80 0x7fa3280ccd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46638/0 (socket says 172.21.15.27:46638) 2023-07-05T23:35:23.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.403+0000 7fa327fff700 1 -- 172.21.15.27:0/3115899005 learned_addr learned my addr 172.21.15.27:0/3115899005 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:23.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.403+0000 7fa3277fe700 1 --2- 172.21.15.27:0/3115899005 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa328069ef0 0x7fa3280ac270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:23.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.403+0000 7fa326ffd700 1 --2- 172.21.15.27:0/3115899005 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa32806ccd0 0x7fa3280c8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:23.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.403+0000 7fa327fff700 1 -- 172.21.15.27:0/3115899005 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa328069ef0 msgr2=0x7fa3280ac270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:23.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.403+0000 7fa327fff700 1 --2- 172.21.15.27:0/3115899005 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa328069ef0 0x7fa3280ac270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:23.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.403+0000 7fa327fff700 1 -- 172.21.15.27:0/3115899005 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa32806ccd0 msgr2=0x7fa3280c8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:23.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.403+0000 7fa327fff700 1 --2- 172.21.15.27:0/3115899005 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa32806ccd0 0x7fa3280c8a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:23.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.403+0000 7fa327fff700 1 -- 172.21.15.27:0/3115899005 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa318009550 con 0x7fa3280cfd80 2023-07-05T23:35:23.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.404+0000 7fa326ffd700 1 --2- 172.21.15.27:0/3115899005 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa32806ccd0 0x7fa3280c8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T23:35:23.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.404+0000 7fa327fff700 1 --2- 172.21.15.27:0/3115899005 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa3280cfd80 0x7fa3280ccd70 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa32000cb50 tx=0x7fa32000ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:23.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.404+0000 7fa30ffff700 1 -- 172.21.15.27:0/3115899005 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa320003c00 con 0x7fa3280cfd80 2023-07-05T23:35:23.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.404+0000 7fa30ffff700 1 -- 172.21.15.27:0/3115899005 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa320003d60 con 0x7fa3280cfd80 2023-07-05T23:35:23.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.404+0000 7fa32deca700 1 -- 172.21.15.27:0/3115899005 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa328159480 con 0x7fa3280cfd80 2023-07-05T23:35:23.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.404+0000 7fa30ffff700 1 -- 172.21.15.27:0/3115899005 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32000aac0 con 0x7fa3280cfd80 2023-07-05T23:35:23.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.404+0000 7fa32deca700 1 -- 172.21.15.27:0/3115899005 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3280ac7b0 con 0x7fa3280cfd80 2023-07-05T23:35:23.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.405+0000 7fa32deca700 1 -- 172.21.15.27:0/3115899005 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa3280c9a90 con 0x7fa3280cfd80 2023-07-05T23:35:23.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.405+0000 7fa30ffff700 1 -- 172.21.15.27:0/3115899005 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa32000ac20 con 0x7fa3280cfd80 2023-07-05T23:35:23.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.406+0000 7fa30ffff700 1 --2- 172.21.15.27:0/3115899005 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fa31406ace0 0x7fa31406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:23.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.406+0000 7fa30ffff700 1 -- 172.21.15.27:0/3115899005 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa32008a280 con 0x7fa3280cfd80 2023-07-05T23:35:23.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.406+0000 7fa30ffff700 1 --2- 172.21.15.27:0/3115899005 >> [v2:172.21.15.162:6824/3102609008,v1:172.21.15.162:6825/3102609008] conn(0x7fa3140749f0 0x7fa314076e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:23.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.406+0000 7fa30ffff700 1 -- 172.21.15.27:0/3115899005 --> [v2:172.21.15.162:6824/3102609008,v1:172.21.15.162:6825/3102609008] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa314077530 con 0x7fa3140749f0 2023-07-05T23:35:23.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.406+0000 7fa30ffff700 1 -- 172.21.15.27:0/3115899005 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa32008a6d0 con 0x7fa3280cfd80 2023-07-05T23:35:23.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.406+0000 7fa3277fe700 1 --2- 172.21.15.27:0/3115899005 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fa31406ace0 0x7fa31406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:23.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.406+0000 7fa326ffd700 1 --2- 172.21.15.27:0/3115899005 >> [v2:172.21.15.162:6824/3102609008,v1:172.21.15.162:6825/3102609008] conn(0x7fa3140749f0 0x7fa314076e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:23.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.407+0000 7fa326ffd700 1 --2- 172.21.15.27:0/3115899005 >> [v2:172.21.15.162:6824/3102609008,v1:172.21.15.162:6825/3102609008] conn(0x7fa3140749f0 0x7fa314076e60 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:23.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.407+0000 7fa3277fe700 1 --2- 172.21.15.27:0/3115899005 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fa31406ace0 0x7fa31406d190 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa318000c00 tx=0x7fa318008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:23.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.407+0000 7fa30ffff700 1 -- 172.21.15.27:0/3115899005 <== osd.5 v2:172.21.15.162:6824/3102609008 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fa314077530 con 0x7fa3140749f0 2023-07-05T23:35:23.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.422+0000 7fa32deca700 1 -- 172.21.15.27:0/3115899005 --> [v2:172.21.15.162:6824/3102609008,v1:172.21.15.162:6825/3102609008] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa3280cb900 con 0x7fa3140749f0 2023-07-05T23:35:23.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.422+0000 7fa30ffff700 1 -- 172.21.15.27:0/3115899005 <== osd.5 v2:172.21.15.162:6824/3102609008 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fa31c0050f0 con 0x7fa3140749f0 2023-07-05T23:35:23.426 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2023-07-05T23:35:23.427 INFO:teuthology.orchestra.run.smithi027.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-05T23:35:23.427 INFO:teuthology.orchestra.run.smithi027.stdout:} 2023-07-05T23:35:23.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.422+0000 7fa32deca700 1 -- 172.21.15.27:0/3115899005 >> [v2:172.21.15.162:6824/3102609008,v1:172.21.15.162:6825/3102609008] conn(0x7fa3140749f0 msgr2=0x7fa314076e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:23.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.422+0000 7fa32deca700 1 --2- 172.21.15.27:0/3115899005 >> [v2:172.21.15.162:6824/3102609008,v1:172.21.15.162:6825/3102609008] conn(0x7fa3140749f0 0x7fa314076e60 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:23.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.422+0000 7fa32deca700 1 -- 172.21.15.27:0/3115899005 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fa31406ace0 msgr2=0x7fa31406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:23.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.422+0000 7fa32deca700 1 --2- 172.21.15.27:0/3115899005 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fa31406ace0 0x7fa31406d190 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa318000c00 tx=0x7fa318008030 comp rx=0 tx=0).stop 2023-07-05T23:35:23.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.422+0000 7fa32deca700 1 -- 172.21.15.27:0/3115899005 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa3280cfd80 msgr2=0x7fa3280ccd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:23.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.422+0000 7fa32deca700 1 --2- 172.21.15.27:0/3115899005 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa3280cfd80 0x7fa3280ccd70 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa32000cb50 tx=0x7fa32000ce60 comp rx=0 tx=0).stop 2023-07-05T23:35:23.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.422+0000 7fa327fff700 1 -- 172.21.15.27:0/3115899005 reap_dead start 2023-07-05T23:35:23.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.422+0000 7fa32deca700 1 -- 172.21.15.27:0/3115899005 shutdown_connections 2023-07-05T23:35:23.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.422+0000 7fa32deca700 1 -- 172.21.15.27:0/3115899005 >> 172.21.15.27:0/3115899005 conn(0x7fa3280b1990 msgr2=0x7fa328070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:23.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.423+0000 7fa32deca700 1 -- 172.21.15.27:0/3115899005 shutdown_connections 2023-07-05T23:35:23.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.423+0000 7fa32deca700 1 -- 172.21.15.27:0/3115899005 wait complete. 2023-07-05T23:35:23.436 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-07-05T23:35:23.562 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.560+0000 7f8e08382700 1 Processor -- start 2023-07-05T23:35:23.563 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.560+0000 7f8e08382700 1 -- start start 2023-07-05T23:35:23.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.561+0000 7f8e08382700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e000711f0 0x7f8e00164d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:23.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.561+0000 7f8e08382700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e000cb580 con 0x7f8e00157a90 2023-07-05T23:35:23.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.561+0000 7f8e08382700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e000cafb0 con 0x7f8e00069ef0 2023-07-05T23:35:23.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.561+0000 7f8e08382700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0006db80 con 0x7f8e000711f0 2023-07-05T23:35:23.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.561+0000 7f8e0611e700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f8e00157a90 0x7f8e0015e5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:53810/0 (socket says 172.21.15.27:53810) 2023-07-05T23:35:23.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.561+0000 7f8e0611e700 1 -- 172.21.15.27:0/1547778976 learned_addr learned my addr 172.21.15.27:0/1547778976 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-07-05T23:35:23.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.561+0000 7f8e0691f700 1 --2- 172.21.15.27:0/1547778976 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e000711f0 0x7f8e00164d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:23.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.561+0000 7f8e0511c700 1 -- 172.21.15.27:0/1547778976 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 666214012 0 0) 0x7f8e000cb580 con 0x7f8e00157a90 2023-07-05T23:35:23.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.561+0000 7f8e0511c700 1 -- 172.21.15.27:0/1547778976 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8dec0035b0 con 0x7f8e00157a90 2023-07-05T23:35:23.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.561+0000 7f8e0511c700 1 -- 172.21.15.27:0/1547778976 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 580672047 0 0) 0x7f8e000cafb0 con 0x7f8e00069ef0 2023-07-05T23:35:23.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.561+0000 7f8e0511c700 1 -- 172.21.15.27:0/1547778976 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e000cb580 con 0x7f8e00069ef0 2023-07-05T23:35:23.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.562+0000 7f8e0691f700 1 -- 172.21.15.27:0/1547778976 >> v1:172.21.15.162:6789/0 conn(0x7f8e00069ef0 legacy=0x7f8e00070ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:23.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.562+0000 7f8e0691f700 1 -- 172.21.15.27:0/1547778976 >> v1:172.21.15.27:6789/0 conn(0x7f8e00157a90 legacy=0x7f8e0015e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:23.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.562+0000 7f8e0511c700 1 -- 172.21.15.27:0/1547778976 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1574548526 0 0) 0x7f8dec0035b0 con 0x7f8e00157a90 2023-07-05T23:35:23.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.562+0000 7f8e0691f700 1 -- 172.21.15.27:0/1547778976 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e000cb250 con 0x7f8e000711f0 2023-07-05T23:35:23.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.562+0000 7f8e0691f700 1 --2- 172.21.15.27:0/1547778976 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e000711f0 0x7f8e00164d40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8df8009dc0 tx=0x7f8df800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fbce18d2404ab8c6 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:23.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.562+0000 7f8e0511c700 1 -- 172.21.15.27:0/1547778976 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df800e070 con 0x7f8e000711f0 2023-07-05T23:35:23.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.562+0000 7f8e0511c700 1 -- 172.21.15.27:0/1547778976 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8df8003a20 con 0x7f8e000711f0 2023-07-05T23:35:23.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.562+0000 7f8e0511c700 1 -- 172.21.15.27:0/1547778976 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df0001670 con 0x7f8e000711f0 2023-07-05T23:35:23.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.563+0000 7f8e08382700 1 -- 172.21.15.27:0/1547778976 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e000711f0 msgr2=0x7f8e00164d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:23.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.563+0000 7f8e08382700 1 --2- 172.21.15.27:0/1547778976 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e000711f0 0x7f8e00164d40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8df8009dc0 tx=0x7f8df800b330 comp rx=0 tx=0).stop 2023-07-05T23:35:23.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.563+0000 7f8e08382700 1 -- 172.21.15.27:0/1547778976 shutdown_connections 2023-07-05T23:35:23.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.563+0000 7f8e08382700 1 --2- 172.21.15.27:0/1547778976 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e000711f0 0x7f8e00164d40 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:23.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.563+0000 7f8e08382700 1 -- 172.21.15.27:0/1547778976 >> 172.21.15.27:0/1547778976 conn(0x7f8e000b1740 msgr2=0x7f8e0006cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:23.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.563+0000 7f8e08382700 1 -- 172.21.15.27:0/1547778976 shutdown_connections 2023-07-05T23:35:23.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.563+0000 7f8e08382700 1 -- 172.21.15.27:0/1547778976 wait complete. 2023-07-05T23:35:23.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.564+0000 7f8e08382700 1 Processor -- start 2023-07-05T23:35:23.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.564+0000 7f8e08382700 1 -- start start 2023-07-05T23:35:23.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.565+0000 7f8e08382700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e00069ef0 0x7f8e000c5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:23.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.565+0000 7f8e08382700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e000711f0 0x7f8e000b1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:23.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.565+0000 7f8e08382700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8e00157a90 0x7f8e001ef750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:23.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.565+0000 7f8e08382700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e000b32d0 con 0x7f8e00157a90 2023-07-05T23:35:23.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.565+0000 7f8e08382700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e000b36f0 con 0x7f8e000711f0 2023-07-05T23:35:23.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.565+0000 7f8e08382700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e000b2650 con 0x7f8e00069ef0 2023-07-05T23:35:23.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.565+0000 7f8e0691f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8e00157a90 0x7f8e001ef750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:23.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.565+0000 7f8e0691f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8e00157a90 0x7f8e001ef750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46652/0 (socket says 172.21.15.27:46652) 2023-07-05T23:35:23.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.565+0000 7f8e0691f700 1 -- 172.21.15.27:0/1223753123 learned_addr learned my addr 172.21.15.27:0/1223753123 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:23.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.565+0000 7f8e0591d700 1 --2- 172.21.15.27:0/1223753123 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e000711f0 0x7f8e000b1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:23.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.565+0000 7f8e0611e700 1 --2- 172.21.15.27:0/1223753123 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e00069ef0 0x7f8e000c5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:23.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.565+0000 7f8e0691f700 1 -- 172.21.15.27:0/1223753123 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e00069ef0 msgr2=0x7f8e000c5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:23.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.565+0000 7f8e0691f700 1 --2- 172.21.15.27:0/1223753123 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e00069ef0 0x7f8e000c5470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:23.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.565+0000 7f8e0691f700 1 -- 172.21.15.27:0/1223753123 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e000711f0 msgr2=0x7f8e000b1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:23.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.565+0000 7f8e0691f700 1 --2- 172.21.15.27:0/1223753123 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e000711f0 0x7f8e000b1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:23.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.565+0000 7f8e0691f700 1 -- 172.21.15.27:0/1223753123 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8df8009a70 con 0x7f8e00157a90 2023-07-05T23:35:23.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.565+0000 7f8e0591d700 1 --2- 172.21.15.27:0/1223753123 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e000711f0 0x7f8e000b1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T23:35:23.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.565+0000 7f8e0691f700 1 --2- 172.21.15.27:0/1223753123 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8e00157a90 0x7f8e001ef750 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8df8004000 tx=0x7f8df8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:23.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.565+0000 7f8df6ffd700 1 -- 172.21.15.27:0/1223753123 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df80045c0 con 0x7f8e00157a90 2023-07-05T23:35:23.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.565+0000 7f8df6ffd700 1 -- 172.21.15.27:0/1223753123 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8df8004720 con 0x7f8e00157a90 2023-07-05T23:35:23.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.565+0000 7f8e08382700 1 -- 172.21.15.27:0/1223753123 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e000b2930 con 0x7f8e00157a90 2023-07-05T23:35:23.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.565+0000 7f8df6ffd700 1 -- 172.21.15.27:0/1223753123 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df801d470 con 0x7f8e00157a90 2023-07-05T23:35:23.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.566+0000 7f8e08382700 1 -- 172.21.15.27:0/1223753123 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e000b2ef0 con 0x7f8e00157a90 2023-07-05T23:35:23.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.566+0000 7f8e08382700 1 -- 172.21.15.27:0/1223753123 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e000b3410 con 0x7f8e00157a90 2023-07-05T23:35:23.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.567+0000 7f8df6ffd700 1 -- 172.21.15.27:0/1223753123 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8df801d5d0 con 0x7f8e00157a90 2023-07-05T23:35:23.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.567+0000 7f8df6ffd700 1 --2- 172.21.15.27:0/1223753123 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f8de406ace0 0x7f8de406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:23.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.568+0000 7f8df6ffd700 1 -- 172.21.15.27:0/1223753123 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8df808adc0 con 0x7f8e00157a90 2023-07-05T23:35:23.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.568+0000 7f8e0611e700 1 --2- 172.21.15.27:0/1223753123 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f8de406ace0 0x7f8de406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:23.579 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.568+0000 7f8e0611e700 1 --2- 172.21.15.27:0/1223753123 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f8de406ace0 0x7f8de406d190 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8df00017a0 tx=0x7f8df0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:23.579 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.572+0000 7f8df6ffd700 1 -- 172.21.15.27:0/1223753123 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8e000b3410 con 0x7f8e00157a90 2023-07-05T23:35:23.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.766+0000 7f8e08382700 1 -- 172.21.15.27:0/1223753123 --> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f8e0006d8a0 con 0x7f8de406ace0 2023-07-05T23:35:23.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.766+0000 7f8df6ffd700 1 -- 172.21.15.27:0/1223753123 <== mgr.4105 v2:172.21.15.162:6832/3790028097 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8df0001b30 con 0x7f8de406ace0 2023-07-05T23:35:23.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.768+0000 7f8e08382700 1 -- 172.21.15.27:0/1223753123 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f8de406ace0 msgr2=0x7f8de406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:23.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.768+0000 7f8e08382700 1 --2- 172.21.15.27:0/1223753123 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f8de406ace0 0x7f8de406d190 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8df00017a0 tx=0x7f8df0009040 comp rx=0 tx=0).stop 2023-07-05T23:35:23.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.768+0000 7f8e08382700 1 -- 172.21.15.27:0/1223753123 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8e00157a90 msgr2=0x7f8e001ef750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:23.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.768+0000 7f8e08382700 1 --2- 172.21.15.27:0/1223753123 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8e00157a90 0x7f8e001ef750 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8df8004000 tx=0x7f8df8004ad0 comp rx=0 tx=0).stop 2023-07-05T23:35:23.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.768+0000 7f8e08382700 1 -- 172.21.15.27:0/1223753123 shutdown_connections 2023-07-05T23:35:23.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.768+0000 7f8e08382700 1 --2- 172.21.15.27:0/1223753123 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f8de406ace0 0x7f8de406d190 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:23.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.768+0000 7f8e08382700 1 --2- 172.21.15.27:0/1223753123 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8e00157a90 0x7f8e001ef750 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:23.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.768+0000 7f8e08382700 1 --2- 172.21.15.27:0/1223753123 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e00069ef0 0x7f8e000c5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:23.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.768+0000 7f8e08382700 1 --2- 172.21.15.27:0/1223753123 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e000711f0 0x7f8e000b1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:23.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.768+0000 7f8e08382700 1 -- 172.21.15.27:0/1223753123 >> 172.21.15.27:0/1223753123 conn(0x7f8e000b1740 msgr2=0x7f8e0006b080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:23.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.768+0000 7f8e08382700 1 -- 172.21.15.27:0/1223753123 shutdown_connections 2023-07-05T23:35:23.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.769+0000 7f8e08382700 1 -- 172.21.15.27:0/1223753123 wait complete. 2023-07-05T23:35:23.773 INFO:teuthology.orchestra.run.smithi027.stderr:instructed osd(s) 5 to deep-scrub 2023-07-05T23:35:23.782 INFO:tasks.ceph:Scrubbing osd.6 2023-07-05T23:35:23.783 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-07-05T23:35:23.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.910+0000 7f2b4d052700 1 Processor -- start 2023-07-05T23:35:23.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.910+0000 7f2b4d052700 1 -- start start 2023-07-05T23:35:23.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.911+0000 7f2b4d052700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2b4806e970 0x7f2b4806a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:23.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.911+0000 7f2b4d052700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b480ce620 con 0x7f2b480aecc0 2023-07-05T23:35:23.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.911+0000 7f2b4d052700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b48160580 con 0x7f2b4815fc60 2023-07-05T23:35:23.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.911+0000 7f2b4d052700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b48160860 con 0x7f2b4806e970 2023-07-05T23:35:23.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.911+0000 7f2b4659c700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f2b480aecc0 0x7f2b480cea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:53824/0 (socket says 172.21.15.27:53824) 2023-07-05T23:35:23.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.911+0000 7f2b4659c700 1 -- 172.21.15.27:0/1667714192 learned_addr learned my addr 172.21.15.27:0/1667714192 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-07-05T23:35:23.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.911+0000 7f2b4759e700 1 --2- 172.21.15.27:0/1667714192 >> v2:172.21.15.27:3300/0 conn(0x7f2b4806e970 0x7f2b4806a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:23.916 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.911+0000 7f2b45d9b700 1 -- 172.21.15.27:0/1667714192 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2346548351 0 0) 0x7f2b480ce620 con 0x7f2b480aecc0 2023-07-05T23:35:23.916 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.911+0000 7f2b45d9b700 1 -- 172.21.15.27:0/1667714192 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b300035b0 con 0x7f2b480aecc0 2023-07-05T23:35:23.916 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.911+0000 7f2b4759e700 1 -- 172.21.15.27:0/1667714192 >> v1:172.21.15.162:6789/0 conn(0x7f2b4815fc60 legacy=0x7f2b4806e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:23.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.911+0000 7f2b4759e700 1 -- 172.21.15.27:0/1667714192 >> v1:172.21.15.27:6789/0 conn(0x7f2b480aecc0 legacy=0x7f2b480cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:23.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.911+0000 7f2b4759e700 1 -- 172.21.15.27:0/1667714192 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b48160b40 con 0x7f2b4806e970 2023-07-05T23:35:23.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.911+0000 7f2b4759e700 1 --2- 172.21.15.27:0/1667714192 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2b4806e970 0x7f2b4806a900 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2b40009d90 tx=0x7f2b4000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=142c5b28877c00b server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:23.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.911+0000 7f2b45d9b700 1 -- 172.21.15.27:0/1667714192 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4000e070 con 0x7f2b4806e970 2023-07-05T23:35:23.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.911+0000 7f2b45d9b700 1 -- 172.21.15.27:0/1667714192 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b4000bb20 con 0x7f2b4806e970 2023-07-05T23:35:23.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.911+0000 7f2b45d9b700 1 -- 172.21.15.27:0/1667714192 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b40012430 con 0x7f2b4806e970 2023-07-05T23:35:23.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.912+0000 7f2b4d052700 1 -- 172.21.15.27:0/1667714192 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2b4806e970 msgr2=0x7f2b4806a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:23.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.912+0000 7f2b4d052700 1 --2- 172.21.15.27:0/1667714192 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2b4806e970 0x7f2b4806a900 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2b40009d90 tx=0x7f2b4000b330 comp rx=0 tx=0).stop 2023-07-05T23:35:23.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.912+0000 7f2b4d052700 1 -- 172.21.15.27:0/1667714192 shutdown_connections 2023-07-05T23:35:23.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.912+0000 7f2b4d052700 1 --2- 172.21.15.27:0/1667714192 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2b4806e970 0x7f2b4806a900 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:23.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.912+0000 7f2b4d052700 1 -- 172.21.15.27:0/1667714192 >> 172.21.15.27:0/1667714192 conn(0x7f2b4806b920 msgr2=0x7f2b480cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:23.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.912+0000 7f2b4d052700 1 -- 172.21.15.27:0/1667714192 shutdown_connections 2023-07-05T23:35:23.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.912+0000 7f2b4d052700 1 -- 172.21.15.27:0/1667714192 wait complete. 2023-07-05T23:35:23.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.913+0000 7f2b4d052700 1 Processor -- start 2023-07-05T23:35:23.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.914+0000 7f2b4d052700 1 -- start start 2023-07-05T23:35:23.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.914+0000 7f2b4d052700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b4806e970 0x7f2b481e6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:23.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.914+0000 7f2b4d052700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2b480aecc0 0x7f2b480b4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:23.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.914+0000 7f2b4d052700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b4815fc60 0x7f2b480b2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:23.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.914+0000 7f2b4d052700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b481e6870 con 0x7f2b480aecc0 2023-07-05T23:35:23.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.914+0000 7f2b4d052700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b481e5f10 con 0x7f2b4806e970 2023-07-05T23:35:23.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.914+0000 7f2b4d052700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b481f38b0 con 0x7f2b4815fc60 2023-07-05T23:35:23.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.914+0000 7f2b4659c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2b480aecc0 0x7f2b480b4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:23.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.914+0000 7f2b4659c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2b480aecc0 0x7f2b480b4e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46664/0 (socket says 172.21.15.27:46664) 2023-07-05T23:35:23.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.914+0000 7f2b4659c700 1 -- 172.21.15.27:0/2284344846 learned_addr learned my addr 172.21.15.27:0/2284344846 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:23.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.915+0000 7f2b4759e700 1 --2- 172.21.15.27:0/2284344846 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b4815fc60 0x7f2b480b2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:23.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.915+0000 7f2b46d9d700 1 --2- 172.21.15.27:0/2284344846 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b4806e970 0x7f2b481e6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:23.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.915+0000 7f2b4659c700 1 -- 172.21.15.27:0/2284344846 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b4815fc60 msgr2=0x7f2b480b2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:23.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.915+0000 7f2b4659c700 1 --2- 172.21.15.27:0/2284344846 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b4815fc60 0x7f2b480b2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:23.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.915+0000 7f2b4659c700 1 -- 172.21.15.27:0/2284344846 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b4806e970 msgr2=0x7f2b481e6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:23.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.915+0000 7f2b4659c700 1 --2- 172.21.15.27:0/2284344846 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b4806e970 0x7f2b481e6c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:23.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.915+0000 7f2b4659c700 1 -- 172.21.15.27:0/2284344846 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b40009a70 con 0x7f2b480aecc0 2023-07-05T23:35:23.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.915+0000 7f2b4659c700 1 --2- 172.21.15.27:0/2284344846 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2b480aecc0 0x7f2b480b4e30 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c00c700 tx=0x7f2b3c00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:23.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.915+0000 7f2b2f7fe700 1 -- 172.21.15.27:0/2284344846 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b3c005d70 con 0x7f2b480aecc0 2023-07-05T23:35:23.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.915+0000 7f2b2f7fe700 1 -- 172.21.15.27:0/2284344846 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b3c0070d0 con 0x7f2b480aecc0 2023-07-05T23:35:23.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.915+0000 7f2b4d052700 1 -- 172.21.15.27:0/2284344846 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b481e61b0 con 0x7f2b480aecc0 2023-07-05T23:35:23.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.915+0000 7f2b2f7fe700 1 -- 172.21.15.27:0/2284344846 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b3c007460 con 0x7f2b480aecc0 2023-07-05T23:35:23.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.915+0000 7f2b4d052700 1 -- 172.21.15.27:0/2284344846 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b481e71d0 con 0x7f2b480aecc0 2023-07-05T23:35:23.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.916+0000 7f2b4d052700 1 -- 172.21.15.27:0/2284344846 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2b48160e20 con 0x7f2b480aecc0 2023-07-05T23:35:23.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.917+0000 7f2b2f7fe700 1 -- 172.21.15.27:0/2284344846 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2b3c0075c0 con 0x7f2b480aecc0 2023-07-05T23:35:23.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.917+0000 7f2b2f7fe700 1 --2- 172.21.15.27:0/2284344846 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f2b3406ace0 0x7f2b3406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:23.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.917+0000 7f2b2f7fe700 1 -- 172.21.15.27:0/2284344846 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2b3c089270 con 0x7f2b480aecc0 2023-07-05T23:35:23.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.917+0000 7f2b2f7fe700 1 --2- 172.21.15.27:0/2284344846 >> [v2:172.21.15.162:6808/2657688865,v1:172.21.15.162:6809/2657688865] conn(0x7f2b340749f0 0x7f2b34076e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:23.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.917+0000 7f2b2f7fe700 1 -- 172.21.15.27:0/2284344846 --> [v2:172.21.15.162:6808/2657688865,v1:172.21.15.162:6809/2657688865] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2b34077530 con 0x7f2b340749f0 2023-07-05T23:35:23.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.917+0000 7f2b2f7fe700 1 -- 172.21.15.27:0/2284344846 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b3c0896c0 con 0x7f2b480aecc0 2023-07-05T23:35:23.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.917+0000 7f2b46d9d700 1 --2- 172.21.15.27:0/2284344846 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f2b3406ace0 0x7f2b3406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:23.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.917+0000 7f2b4759e700 1 --2- 172.21.15.27:0/2284344846 >> [v2:172.21.15.162:6808/2657688865,v1:172.21.15.162:6809/2657688865] conn(0x7f2b340749f0 0x7f2b34076e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:23.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.918+0000 7f2b46d9d700 1 --2- 172.21.15.27:0/2284344846 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f2b3406ace0 0x7f2b3406d190 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2b38000fb0 tx=0x7f2b38009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:23.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.918+0000 7f2b4759e700 1 --2- 172.21.15.27:0/2284344846 >> [v2:172.21.15.162:6808/2657688865,v1:172.21.15.162:6809/2657688865] conn(0x7f2b340749f0 0x7f2b34076e60 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:23.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.919+0000 7f2b2f7fe700 1 -- 172.21.15.27:0/2284344846 <== osd.6 v2:172.21.15.162:6808/2657688865 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f2b34077530 con 0x7f2b340749f0 2023-07-05T23:35:23.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.933+0000 7f2b4d052700 1 -- 172.21.15.27:0/2284344846 --> [v2:172.21.15.162:6808/2657688865,v1:172.21.15.162:6809/2657688865] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2b481e69b0 con 0x7f2b340749f0 2023-07-05T23:35:23.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.934+0000 7f2b2f7fe700 1 -- 172.21.15.27:0/2284344846 <== osd.6 v2:172.21.15.162:6808/2657688865 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f2b481e69b0 con 0x7f2b340749f0 2023-07-05T23:35:23.936 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2023-07-05T23:35:23.937 INFO:teuthology.orchestra.run.smithi027.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-05T23:35:23.937 INFO:teuthology.orchestra.run.smithi027.stdout:} 2023-07-05T23:35:23.938 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.934+0000 7f2b4d052700 1 -- 172.21.15.27:0/2284344846 >> [v2:172.21.15.162:6808/2657688865,v1:172.21.15.162:6809/2657688865] conn(0x7f2b340749f0 msgr2=0x7f2b34076e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:23.938 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.934+0000 7f2b4d052700 1 --2- 172.21.15.27:0/2284344846 >> [v2:172.21.15.162:6808/2657688865,v1:172.21.15.162:6809/2657688865] conn(0x7f2b340749f0 0x7f2b34076e60 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:23.938 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.934+0000 7f2b4d052700 1 -- 172.21.15.27:0/2284344846 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f2b3406ace0 msgr2=0x7f2b3406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:23.938 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.934+0000 7f2b4d052700 1 --2- 172.21.15.27:0/2284344846 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f2b3406ace0 0x7f2b3406d190 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2b38000fb0 tx=0x7f2b38009040 comp rx=0 tx=0).stop 2023-07-05T23:35:23.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.934+0000 7f2b4d052700 1 -- 172.21.15.27:0/2284344846 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2b480aecc0 msgr2=0x7f2b480b4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:23.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.934+0000 7f2b4d052700 1 --2- 172.21.15.27:0/2284344846 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2b480aecc0 0x7f2b480b4e30 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c00c700 tx=0x7f2b3c00ca10 comp rx=0 tx=0).stop 2023-07-05T23:35:23.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.934+0000 7f2b4759e700 1 -- 172.21.15.27:0/2284344846 reap_dead start 2023-07-05T23:35:23.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.934+0000 7f2b4d052700 1 -- 172.21.15.27:0/2284344846 shutdown_connections 2023-07-05T23:35:23.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.934+0000 7f2b4d052700 1 -- 172.21.15.27:0/2284344846 >> 172.21.15.27:0/2284344846 conn(0x7f2b4806b920 msgr2=0x7f2b48069ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:23.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.934+0000 7f2b4d052700 1 -- 172.21.15.27:0/2284344846 shutdown_connections 2023-07-05T23:35:23.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:23.934+0000 7f2b4d052700 1 -- 172.21.15.27:0/2284344846 wait complete. 2023-07-05T23:35:23.948 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-07-05T23:35:24.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.074+0000 7fb8fed2e700 1 Processor -- start 2023-07-05T23:35:24.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.074+0000 7fb8fed2e700 1 -- start start 2023-07-05T23:35:24.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.075+0000 7fb8fed2e700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb8f80aed30 0x7fb8f8160580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:24.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.075+0000 7fb8fed2e700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8f80cee80 con 0x7fb8f8156880 2023-07-05T23:35:24.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.075+0000 7fb8fed2e700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8f80cf100 con 0x7fb8f80cc1d0 2023-07-05T23:35:24.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.075+0000 7fb8fed2e700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8f80cf3e0 con 0x7fb8f80aed30 2023-07-05T23:35:24.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.075+0000 7fb8fcaca700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fb8f8156880 0x7fb8f8069ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:53838/0 (socket says 172.21.15.27:53838) 2023-07-05T23:35:24.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.075+0000 7fb8fcaca700 1 -- 172.21.15.27:0/1532414950 learned_addr learned my addr 172.21.15.27:0/1532414950 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-07-05T23:35:24.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.075+0000 7fb8f77fe700 1 -- 172.21.15.27:0/1532414950 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2886424309 0 0) 0x7fb8f80cee80 con 0x7fb8f8156880 2023-07-05T23:35:24.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.076+0000 7fb8f7fff700 1 --2- 172.21.15.27:0/1532414950 >> v2:172.21.15.162:3300/0 conn(0x7fb8f80aed30 0x7fb8f8160580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:24.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.076+0000 7fb8f77fe700 1 -- 172.21.15.27:0/1532414950 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8e80035b0 con 0x7fb8f8156880 2023-07-05T23:35:24.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.076+0000 7fb8f77fe700 1 -- 172.21.15.27:0/1532414950 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4000497999 0 0) 0x7fb8e80035b0 con 0x7fb8f8156880 2023-07-05T23:35:24.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.076+0000 7fb8f77fe700 1 -- 172.21.15.27:0/1532414950 >> v2:172.21.15.162:3300/0 conn(0x7fb8f80aed30 msgr2=0x7fb8f8160580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:35:24.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.076+0000 7fb8f77fe700 1 --2- 172.21.15.27:0/1532414950 >> v2:172.21.15.162:3300/0 conn(0x7fb8f80aed30 0x7fb8f8160580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:24.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.076+0000 7fb8f77fe700 1 -- 172.21.15.27:0/1532414950 >> v1:172.21.15.162:6789/0 conn(0x7fb8f80cc1d0 legacy=0x7fb8f815cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:24.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.076+0000 7fb8f77fe700 1 -- 172.21.15.27:0/1532414950 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f80cd390 con 0x7fb8f8156880 2023-07-05T23:35:24.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.076+0000 7fb8f77fe700 1 -- 172.21.15.27:0/1532414950 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1246168953 0 0) 0x7fb8ec001670 con 0x7fb8f8156880 2023-07-05T23:35:24.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.076+0000 7fb8f77fe700 1 -- 172.21.15.27:0/1532414950 >> v1:172.21.15.27:6789/0 conn(0x7fb8f8156880 legacy=0x7fb8f8069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:24.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.076+0000 7fb8f77fe700 1 --2- 172.21.15.27:0/1532414950 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8e8003a00 0x7fb8e8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:24.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.076+0000 7fb8f77fe700 1 --2- 172.21.15.27:0/1532414950 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb8e8004850 0x7fb8e8004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:24.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.076+0000 7fb8f77fe700 1 --2- 172.21.15.27:0/1532414950 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8e8005200 0x7fb8e800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:24.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.076+0000 7fb8f77fe700 1 -- 172.21.15.27:0/1532414950 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f80cf3e0 con 0x7fb8e8004850 2023-07-05T23:35:24.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.076+0000 7fb8f77fe700 1 -- 172.21.15.27:0/1532414950 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e800c080 con 0x7fb8e8003a00 2023-07-05T23:35:24.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.076+0000 7fb8f77fe700 1 -- 172.21.15.27:0/1532414950 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e800c240 con 0x7fb8e8005200 2023-07-05T23:35:24.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.076+0000 7fb8f7fff700 1 --2- 172.21.15.27:0/1532414950 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb8e8004850 0x7fb8e8004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:24.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.076+0000 7fb8fcaca700 1 --2- 172.21.15.27:0/1532414950 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8e8003a00 0x7fb8e8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:24.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.076+0000 7fb8fd2cb700 1 --2- 172.21.15.27:0/1532414950 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8e8005200 0x7fb8e800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:24.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.076+0000 7fb8f7fff700 1 -- 172.21.15.27:0/1532414950 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8e8005200 msgr2=0x7fb8e800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:35:24.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.076+0000 7fb8f7fff700 1 --2- 172.21.15.27:0/1532414950 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8e8005200 0x7fb8e800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:24.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.076+0000 7fb8f7fff700 1 -- 172.21.15.27:0/1532414950 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8e8003a00 msgr2=0x7fb8e8003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:35:24.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.076+0000 7fb8f7fff700 1 --2- 172.21.15.27:0/1532414950 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8e8003a00 0x7fb8e8003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:24.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.076+0000 7fb8fd2cb700 1 -- 172.21.15.27:0/1532414950 reap_dead start 2023-07-05T23:35:24.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.076+0000 7fb8f7fff700 1 -- 172.21.15.27:0/1532414950 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e80035b0 con 0x7fb8e8004850 2023-07-05T23:35:24.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.077+0000 7fb8f7fff700 1 --2- 172.21.15.27:0/1532414950 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb8e8004850 0x7fb8e8004cc0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fb8e4009b60 tx=0x7fb8e8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44eaa2db7d2ab33d server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:24.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.077+0000 7fb8f77fe700 1 -- 172.21.15.27:0/1532414950 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e400e6c0 con 0x7fb8e8004850 2023-07-05T23:35:24.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.077+0000 7fb8f77fe700 1 -- 172.21.15.27:0/1532414950 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8e400e820 con 0x7fb8e8004850 2023-07-05T23:35:24.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.077+0000 7fb8f77fe700 1 -- 172.21.15.27:0/1532414950 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e400eb90 con 0x7fb8e8004850 2023-07-05T23:35:24.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.077+0000 7fb8fed2e700 1 -- 172.21.15.27:0/1532414950 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb8e8004850 msgr2=0x7fb8e8004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:24.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.077+0000 7fb8fed2e700 1 --2- 172.21.15.27:0/1532414950 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb8e8004850 0x7fb8e8004cc0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fb8e4009b60 tx=0x7fb8e8005880 comp rx=0 tx=0).stop 2023-07-05T23:35:24.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.077+0000 7fb8fed2e700 1 -- 172.21.15.27:0/1532414950 shutdown_connections 2023-07-05T23:35:24.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.077+0000 7fb8fed2e700 1 --2- 172.21.15.27:0/1532414950 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb8e8004850 0x7fb8e8004cc0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:24.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.077+0000 7fb8fed2e700 1 -- 172.21.15.27:0/1532414950 >> 172.21.15.27:0/1532414950 conn(0x7fb8f806d4a0 msgr2=0x7fb8f806d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:24.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.077+0000 7fb8fed2e700 1 -- 172.21.15.27:0/1532414950 shutdown_connections 2023-07-05T23:35:24.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.077+0000 7fb8fed2e700 1 -- 172.21.15.27:0/1532414950 wait complete. 2023-07-05T23:35:24.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.079+0000 7fb8fed2e700 1 Processor -- start 2023-07-05T23:35:24.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.079+0000 7fb8fed2e700 1 -- start start 2023-07-05T23:35:24.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.079+0000 7fb8fed2e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb8e8004850 0x7fb8f80c40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:24.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.079+0000 7fb8fed2e700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8f814fb30 0x7fb8f81e5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:24.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.079+0000 7fb8fed2e700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8f81e6070 0x7fb8f80b2610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:24.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.079+0000 7fb8fed2e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f81e64e0 con 0x7fb8e8004850 2023-07-05T23:35:24.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.079+0000 7fb8fed2e700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f80c4620 con 0x7fb8f81e6070 2023-07-05T23:35:24.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.079+0000 7fb8fed2e700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f80c4850 con 0x7fb8f814fb30 2023-07-05T23:35:24.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.080+0000 7fb8fcaca700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb8e8004850 0x7fb8f80c40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:24.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.080+0000 7fb8fcaca700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb8e8004850 0x7fb8f80c40e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46684/0 (socket says 172.21.15.27:46684) 2023-07-05T23:35:24.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.080+0000 7fb8fcaca700 1 -- 172.21.15.27:0/3722973834 learned_addr learned my addr 172.21.15.27:0/3722973834 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:24.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.080+0000 7fb8fd2cb700 1 --2- 172.21.15.27:0/3722973834 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8f81e6070 0x7fb8f80b2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:24.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.080+0000 7fb8f7fff700 1 --2- 172.21.15.27:0/3722973834 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8f814fb30 0x7fb8f81e5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:24.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.080+0000 7fb8fcaca700 1 -- 172.21.15.27:0/3722973834 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8f814fb30 msgr2=0x7fb8f81e5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:24.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.080+0000 7fb8fcaca700 1 --2- 172.21.15.27:0/3722973834 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8f814fb30 0x7fb8f81e5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:24.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.080+0000 7fb8fcaca700 1 -- 172.21.15.27:0/3722973834 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8f81e6070 msgr2=0x7fb8f80b2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:24.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.080+0000 7fb8fcaca700 1 --2- 172.21.15.27:0/3722973834 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8f81e6070 0x7fb8f80b2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:24.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.080+0000 7fb8fcaca700 1 -- 172.21.15.27:0/3722973834 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f80c4b30 con 0x7fb8e8004850 2023-07-05T23:35:24.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.080+0000 7fb8fd2cb700 1 --2- 172.21.15.27:0/3722973834 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8f81e6070 0x7fb8f80b2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T23:35:24.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.080+0000 7fb8fcaca700 1 --2- 172.21.15.27:0/3722973834 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb8e8004850 0x7fb8f80c40e0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec0072c0 tx=0x7fb8ec0075d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:24.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.080+0000 7fb8f57fa700 1 -- 172.21.15.27:0/3722973834 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8ec00f640 con 0x7fb8e8004850 2023-07-05T23:35:24.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.080+0000 7fb8f57fa700 1 -- 172.21.15.27:0/3722973834 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8ec00f800 con 0x7fb8e8004850 2023-07-05T23:35:24.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.080+0000 7fb8fed2e700 1 -- 172.21.15.27:0/3722973834 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8f80c4e10 con 0x7fb8e8004850 2023-07-05T23:35:24.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.080+0000 7fb8f57fa700 1 -- 172.21.15.27:0/3722973834 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8ec00fbb0 con 0x7fb8e8004850 2023-07-05T23:35:24.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.080+0000 7fb8fed2e700 1 -- 172.21.15.27:0/3722973834 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8f80c53d0 con 0x7fb8e8004850 2023-07-05T23:35:24.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.081+0000 7fb8fed2e700 1 -- 172.21.15.27:0/3722973834 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8f8073910 con 0x7fb8e8004850 2023-07-05T23:35:24.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.082+0000 7fb8f57fa700 1 -- 172.21.15.27:0/3722973834 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb8ec00fd10 con 0x7fb8e8004850 2023-07-05T23:35:24.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.082+0000 7fb8f57fa700 1 --2- 172.21.15.27:0/3722973834 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fb8dc06ace0 0x7fb8dc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:24.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.082+0000 7fb8f57fa700 1 -- 172.21.15.27:0/3722973834 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb8ec0896c0 con 0x7fb8e8004850 2023-07-05T23:35:24.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.082+0000 7fb8f7fff700 1 --2- 172.21.15.27:0/3722973834 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fb8dc06ace0 0x7fb8dc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:24.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.083+0000 7fb8f7fff700 1 --2- 172.21.15.27:0/3722973834 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fb8dc06ace0 0x7fb8dc06d190 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb8e40090b0 tx=0x7fb8e4008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:24.106 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.087+0000 7fb8f57fa700 1 -- 172.21.15.27:0/3722973834 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb8ec054440 con 0x7fb8e8004850 2023-07-05T23:35:24.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.284+0000 7fb8fed2e700 1 -- 172.21.15.27:0/3722973834 --> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fb8f80cd950 con 0x7fb8dc06ace0 2023-07-05T23:35:24.287 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.285+0000 7fb8f57fa700 1 -- 172.21.15.27:0/3722973834 <== mgr.4105 v2:172.21.15.162:6832/3790028097 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb8e400ea90 con 0x7fb8dc06ace0 2023-07-05T23:35:24.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.287+0000 7fb8fed2e700 1 -- 172.21.15.27:0/3722973834 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fb8dc06ace0 msgr2=0x7fb8dc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:24.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.287+0000 7fb8fed2e700 1 --2- 172.21.15.27:0/3722973834 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fb8dc06ace0 0x7fb8dc06d190 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb8e40090b0 tx=0x7fb8e4008030 comp rx=0 tx=0).stop 2023-07-05T23:35:24.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.287+0000 7fb8fed2e700 1 -- 172.21.15.27:0/3722973834 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb8e8004850 msgr2=0x7fb8f80c40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:24.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.287+0000 7fb8fed2e700 1 --2- 172.21.15.27:0/3722973834 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb8e8004850 0x7fb8f80c40e0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec0072c0 tx=0x7fb8ec0075d0 comp rx=0 tx=0).stop 2023-07-05T23:35:24.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.287+0000 7fb8fed2e700 1 -- 172.21.15.27:0/3722973834 shutdown_connections 2023-07-05T23:35:24.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.287+0000 7fb8fed2e700 1 --2- 172.21.15.27:0/3722973834 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8f81e6070 0x7fb8f80b2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:24.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.287+0000 7fb8fed2e700 1 --2- 172.21.15.27:0/3722973834 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fb8dc06ace0 0x7fb8dc06d190 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:24.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.287+0000 7fb8fed2e700 1 --2- 172.21.15.27:0/3722973834 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb8e8004850 0x7fb8f80c40e0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:24.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.287+0000 7fb8fed2e700 1 --2- 172.21.15.27:0/3722973834 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8f814fb30 0x7fb8f81e5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:24.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.287+0000 7fb8fed2e700 1 -- 172.21.15.27:0/3722973834 >> 172.21.15.27:0/3722973834 conn(0x7fb8f806d4a0 msgr2=0x7fb8f815beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:24.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.287+0000 7fb8fed2e700 1 -- 172.21.15.27:0/3722973834 shutdown_connections 2023-07-05T23:35:24.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.287+0000 7fb8fed2e700 1 -- 172.21.15.27:0/3722973834 wait complete. 2023-07-05T23:35:24.292 INFO:teuthology.orchestra.run.smithi027.stderr:instructed osd(s) 6 to deep-scrub 2023-07-05T23:35:24.301 INFO:tasks.ceph:Scrubbing osd.7 2023-07-05T23:35:24.302 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-07-05T23:35:24.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.435+0000 7fe4637ec700 1 Processor -- start 2023-07-05T23:35:24.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.435+0000 7fe4637ec700 1 -- start start 2023-07-05T23:35:24.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.436+0000 7fe4637ec700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe45c0cd330 0x7fe45c070980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:24.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.436+0000 7fe4637ec700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe45c0caf70 con 0x7fe45c0afc40 2023-07-05T23:35:24.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.436+0000 7fe4637ec700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe45c0cb210 con 0x7fe45c15a330 2023-07-05T23:35:24.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.436+0000 7fe4637ec700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe45c15e360 con 0x7fe45c0cd330 2023-07-05T23:35:24.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.436+0000 7fe461d89700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fe45c0afc40 0x7fe45c15dc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:53862/0 (socket says 172.21.15.27:53862) 2023-07-05T23:35:24.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.436+0000 7fe461d89700 1 -- 172.21.15.27:0/3274487046 learned_addr learned my addr 172.21.15.27:0/3274487046 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-07-05T23:35:24.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.437+0000 7fe461588700 1 --2- 172.21.15.27:0/3274487046 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe45c0cd330 0x7fe45c070980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:24.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.437+0000 7fe453fff700 1 -- 172.21.15.27:0/3274487046 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2111322706 0 0) 0x7fe45c0caf70 con 0x7fe45c0afc40 2023-07-05T23:35:24.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.437+0000 7fe453fff700 1 -- 172.21.15.27:0/3274487046 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4480035b0 con 0x7fe45c0afc40 2023-07-05T23:35:24.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.437+0000 7fe453fff700 1 -- 172.21.15.27:0/3274487046 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2588962261 0 0) 0x7fe45c0cb210 con 0x7fe45c15a330 2023-07-05T23:35:24.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.437+0000 7fe453fff700 1 -- 172.21.15.27:0/3274487046 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe45c0caf70 con 0x7fe45c15a330 2023-07-05T23:35:24.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.437+0000 7fe461588700 1 -- 172.21.15.27:0/3274487046 >> v1:172.21.15.162:6789/0 conn(0x7fe45c15a330 legacy=0x7fe45c0cd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:24.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.437+0000 7fe453fff700 1 -- 172.21.15.27:0/3274487046 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3234221473 0 0) 0x7fe4480035b0 con 0x7fe45c0afc40 2023-07-05T23:35:24.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.437+0000 7fe461588700 1 -- 172.21.15.27:0/3274487046 >> v1:172.21.15.27:6789/0 conn(0x7fe45c0afc40 legacy=0x7fe45c15dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:24.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.437+0000 7fe461588700 1 -- 172.21.15.27:0/3274487046 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe45c0ccc20 con 0x7fe45c0cd330 2023-07-05T23:35:24.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.437+0000 7fe461588700 1 --2- 172.21.15.27:0/3274487046 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe45c0cd330 0x7fe45c070980 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe44c009870 tx=0x7fe44c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b055e8a0eee4f42 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:24.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.437+0000 7fe453fff700 1 -- 172.21.15.27:0/3274487046 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4540019f0 con 0x7fe45c0cd330 2023-07-05T23:35:24.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.437+0000 7fe453fff700 1 -- 172.21.15.27:0/3274487046 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe44c004030 con 0x7fe45c0cd330 2023-07-05T23:35:24.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.437+0000 7fe453fff700 1 -- 172.21.15.27:0/3274487046 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe44c0043a0 con 0x7fe45c0cd330 2023-07-05T23:35:24.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.438+0000 7fe4637ec700 1 -- 172.21.15.27:0/3274487046 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe45c0cd330 msgr2=0x7fe45c070980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:24.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.438+0000 7fe4637ec700 1 --2- 172.21.15.27:0/3274487046 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe45c0cd330 0x7fe45c070980 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe44c009870 tx=0x7fe44c009b80 comp rx=0 tx=0).stop 2023-07-05T23:35:24.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.438+0000 7fe4637ec700 1 -- 172.21.15.27:0/3274487046 shutdown_connections 2023-07-05T23:35:24.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.438+0000 7fe4637ec700 1 --2- 172.21.15.27:0/3274487046 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe45c0cd330 0x7fe45c070980 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:24.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.438+0000 7fe4637ec700 1 -- 172.21.15.27:0/3274487046 >> 172.21.15.27:0/3274487046 conn(0x7fe45c06e5c0 msgr2=0x7fe45c06e990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:24.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.438+0000 7fe4637ec700 1 -- 172.21.15.27:0/3274487046 shutdown_connections 2023-07-05T23:35:24.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.438+0000 7fe4637ec700 1 -- 172.21.15.27:0/3274487046 wait complete. 2023-07-05T23:35:24.447 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.440+0000 7fe4637ec700 1 Processor -- start 2023-07-05T23:35:24.447 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.440+0000 7fe4637ec700 1 -- start start 2023-07-05T23:35:24.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.441+0000 7fe4637ec700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe45c0afc40 0x7fe45c15a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:24.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.441+0000 7fe4637ec700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe45c0cd330 0x7fe45c143e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:24.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.441+0000 7fe4637ec700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe45c15a330 0x7fe45c1443c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:24.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.441+0000 7fe4637ec700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe45c142700 con 0x7fe45c15a330 2023-07-05T23:35:24.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.441+0000 7fe4637ec700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe45c141af0 con 0x7fe45c0cd330 2023-07-05T23:35:24.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.441+0000 7fe4637ec700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe45c141dd0 con 0x7fe45c0afc40 2023-07-05T23:35:24.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.441+0000 7fe461d89700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe45c15a330 0x7fe45c1443c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:24.451 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.441+0000 7fe461d89700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe45c15a330 0x7fe45c1443c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46702/0 (socket says 172.21.15.27:46702) 2023-07-05T23:35:24.451 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.441+0000 7fe461d89700 1 -- 172.21.15.27:0/4042982980 learned_addr learned my addr 172.21.15.27:0/4042982980 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:24.451 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.441+0000 7fe460d87700 1 --2- 172.21.15.27:0/4042982980 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe45c0cd330 0x7fe45c143e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:24.451 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.441+0000 7fe461588700 1 --2- 172.21.15.27:0/4042982980 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe45c0afc40 0x7fe45c15a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:24.451 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.441+0000 7fe461d89700 1 -- 172.21.15.27:0/4042982980 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe45c0afc40 msgr2=0x7fe45c15a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:24.452 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.441+0000 7fe461d89700 1 --2- 172.21.15.27:0/4042982980 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe45c0afc40 0x7fe45c15a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:24.452 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.441+0000 7fe461d89700 1 -- 172.21.15.27:0/4042982980 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe45c0cd330 msgr2=0x7fe45c143e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:24.452 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.441+0000 7fe461d89700 1 --2- 172.21.15.27:0/4042982980 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe45c0cd330 0x7fe45c143e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:24.452 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.441+0000 7fe461d89700 1 -- 172.21.15.27:0/4042982980 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe44c0094a0 con 0x7fe45c15a330 2023-07-05T23:35:24.452 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.441+0000 7fe460d87700 1 --2- 172.21.15.27:0/4042982980 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe45c0cd330 0x7fe45c143e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T23:35:24.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.441+0000 7fe461d89700 1 --2- 172.21.15.27:0/4042982980 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe45c15a330 0x7fe45c1443c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fe45400cc50 tx=0x7fe45400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:24.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.441+0000 7fe451ffb700 1 -- 172.21.15.27:0/4042982980 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe45400ade0 con 0x7fe45c15a330 2023-07-05T23:35:24.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.441+0000 7fe451ffb700 1 -- 172.21.15.27:0/4042982980 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe45400ce50 con 0x7fe45c15a330 2023-07-05T23:35:24.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.441+0000 7fe4637ec700 1 -- 172.21.15.27:0/4042982980 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe45c1420b0 con 0x7fe45c15a330 2023-07-05T23:35:24.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.441+0000 7fe451ffb700 1 -- 172.21.15.27:0/4042982980 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe454007310 con 0x7fe45c15a330 2023-07-05T23:35:24.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.442+0000 7fe4637ec700 1 -- 172.21.15.27:0/4042982980 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe45c144900 con 0x7fe45c15a330 2023-07-05T23:35:24.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.442+0000 7fe4637ec700 1 -- 172.21.15.27:0/4042982980 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe45c0cc8d0 con 0x7fe45c15a330 2023-07-05T23:35:24.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.443+0000 7fe451ffb700 1 -- 172.21.15.27:0/4042982980 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe454007470 con 0x7fe45c15a330 2023-07-05T23:35:24.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.443+0000 7fe451ffb700 1 --2- 172.21.15.27:0/4042982980 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fe44006ace0 0x7fe44006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:24.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.443+0000 7fe451ffb700 1 -- 172.21.15.27:0/4042982980 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe454089780 con 0x7fe45c15a330 2023-07-05T23:35:24.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.443+0000 7fe451ffb700 1 --2- 172.21.15.27:0/4042982980 >> [v2:172.21.15.162:6816/2096609978,v1:172.21.15.162:6817/2096609978] conn(0x7fe4400749f0 0x7fe440076e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:24.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.443+0000 7fe451ffb700 1 -- 172.21.15.27:0/4042982980 --> [v2:172.21.15.162:6816/2096609978,v1:172.21.15.162:6817/2096609978] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe440077530 con 0x7fe4400749f0 2023-07-05T23:35:24.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.443+0000 7fe451ffb700 1 -- 172.21.15.27:0/4042982980 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe45408bd60 con 0x7fe45c15a330 2023-07-05T23:35:24.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.443+0000 7fe461588700 1 --2- 172.21.15.27:0/4042982980 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fe44006ace0 0x7fe44006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:24.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.444+0000 7fe460d87700 1 --2- 172.21.15.27:0/4042982980 >> [v2:172.21.15.162:6816/2096609978,v1:172.21.15.162:6817/2096609978] conn(0x7fe4400749f0 0x7fe440076e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:24.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.444+0000 7fe460d87700 1 --2- 172.21.15.27:0/4042982980 >> [v2:172.21.15.162:6816/2096609978,v1:172.21.15.162:6817/2096609978] conn(0x7fe4400749f0 0x7fe440076e60 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:24.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.444+0000 7fe461588700 1 --2- 172.21.15.27:0/4042982980 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fe44006ace0 0x7fe44006d190 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe44c0097c0 tx=0x7fe44c008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:24.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.445+0000 7fe451ffb700 1 -- 172.21.15.27:0/4042982980 <== osd.7 v2:172.21.15.162:6816/2096609978 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fe440077530 con 0x7fe4400749f0 2023-07-05T23:35:24.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.459+0000 7fe4637ec700 1 -- 172.21.15.27:0/4042982980 --> [v2:172.21.15.162:6816/2096609978,v1:172.21.15.162:6817/2096609978] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe45c0ccf00 con 0x7fe4400749f0 2023-07-05T23:35:24.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.460+0000 7fe451ffb700 1 -- 172.21.15.27:0/4042982980 <== osd.7 v2:172.21.15.162:6816/2096609978 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fe458001890 con 0x7fe4400749f0 2023-07-05T23:35:24.462 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2023-07-05T23:35:24.462 INFO:teuthology.orchestra.run.smithi027.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-05T23:35:24.463 INFO:teuthology.orchestra.run.smithi027.stdout:} 2023-07-05T23:35:24.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.460+0000 7fe4637ec700 1 -- 172.21.15.27:0/4042982980 >> [v2:172.21.15.162:6816/2096609978,v1:172.21.15.162:6817/2096609978] conn(0x7fe4400749f0 msgr2=0x7fe440076e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:24.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.460+0000 7fe4637ec700 1 --2- 172.21.15.27:0/4042982980 >> [v2:172.21.15.162:6816/2096609978,v1:172.21.15.162:6817/2096609978] conn(0x7fe4400749f0 0x7fe440076e60 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:24.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.460+0000 7fe4637ec700 1 -- 172.21.15.27:0/4042982980 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fe44006ace0 msgr2=0x7fe44006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:24.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.460+0000 7fe4637ec700 1 --2- 172.21.15.27:0/4042982980 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fe44006ace0 0x7fe44006d190 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe44c0097c0 tx=0x7fe44c008030 comp rx=0 tx=0).stop 2023-07-05T23:35:24.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.460+0000 7fe4637ec700 1 -- 172.21.15.27:0/4042982980 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe45c15a330 msgr2=0x7fe45c1443c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:24.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.460+0000 7fe4637ec700 1 --2- 172.21.15.27:0/4042982980 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe45c15a330 0x7fe45c1443c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fe45400cc50 tx=0x7fe45400a340 comp rx=0 tx=0).stop 2023-07-05T23:35:24.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.460+0000 7fe461d89700 1 -- 172.21.15.27:0/4042982980 reap_dead start 2023-07-05T23:35:24.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.460+0000 7fe4637ec700 1 -- 172.21.15.27:0/4042982980 shutdown_connections 2023-07-05T23:35:24.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.460+0000 7fe4637ec700 1 -- 172.21.15.27:0/4042982980 >> 172.21.15.27:0/4042982980 conn(0x7fe45c06e5c0 msgr2=0x7fe45c0cb650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:24.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.460+0000 7fe4637ec700 1 -- 172.21.15.27:0/4042982980 shutdown_connections 2023-07-05T23:35:24.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.460+0000 7fe4637ec700 1 -- 172.21.15.27:0/4042982980 wait complete. 2023-07-05T23:35:24.475 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-07-05T23:35:24.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.602+0000 7f6689e9f700 1 Processor -- start 2023-07-05T23:35:24.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.602+0000 7f6689e9f700 1 -- start start 2023-07-05T23:35:24.616 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.603+0000 7f6689e9f700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f668415c420 0x7f6684069ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:24.616 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.603+0000 7f6689e9f700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66840cf2a0 con 0x7f66840b08d0 2023-07-05T23:35:24.616 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.603+0000 7f6689e9f700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66840cce40 con 0x7f66840cae00 2023-07-05T23:35:24.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.603+0000 7f6689e9f700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66840ce690 con 0x7f668415c420 2023-07-05T23:35:24.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.603+0000 7f6682ffd700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f66840b08d0 0x7f66840cc020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:53878/0 (socket says 172.21.15.27:53878) 2023-07-05T23:35:24.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.603+0000 7f6682ffd700 1 -- 172.21.15.27:0/4093457038 learned_addr learned my addr 172.21.15.27:0/4093457038 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-07-05T23:35:24.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.603+0000 7f66837fe700 1 --2- 172.21.15.27:0/4093457038 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f668415c420 0x7f6684069ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:24.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.604+0000 7f66827fc700 1 -- 172.21.15.27:0/4093457038 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 357786763 0 0) 0x7f66840cf2a0 con 0x7f66840b08d0 2023-07-05T23:35:24.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.604+0000 7f66827fc700 1 -- 172.21.15.27:0/4093457038 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66700035b0 con 0x7f66840b08d0 2023-07-05T23:35:24.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.604+0000 7f66827fc700 1 -- 172.21.15.27:0/4093457038 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1911686050 0 0) 0x7f66840cce40 con 0x7f66840cae00 2023-07-05T23:35:24.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.604+0000 7f66827fc700 1 -- 172.21.15.27:0/4093457038 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66840cf2a0 con 0x7f66840cae00 2023-07-05T23:35:24.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.604+0000 7f66827fc700 1 -- 172.21.15.27:0/4093457038 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4280145450 0 0) 0x7f66700035b0 con 0x7f66840b08d0 2023-07-05T23:35:24.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.604+0000 7f66827fc700 1 -- 172.21.15.27:0/4093457038 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f668415c420 msgr2=0x7f6684069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:35:24.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.604+0000 7f66827fc700 1 --2- 172.21.15.27:0/4093457038 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f668415c420 0x7f6684069ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:24.619 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.604+0000 7f66827fc700 1 -- 172.21.15.27:0/4093457038 >> v1:172.21.15.162:6789/0 conn(0x7f66840cae00 legacy=0x7f66840cc730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:24.619 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.604+0000 7f66827fc700 1 -- 172.21.15.27:0/4093457038 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66840ce970 con 0x7f66840b08d0 2023-07-05T23:35:24.619 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.604+0000 7f66827fc700 1 -- 172.21.15.27:0/4093457038 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1246168953 0 0) 0x7f666c001670 con 0x7f66840b08d0 2023-07-05T23:35:24.619 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.604+0000 7f66827fc700 1 -- 172.21.15.27:0/4093457038 >> v1:172.21.15.27:6789/0 conn(0x7f66840b08d0 legacy=0x7f66840cc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:24.619 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.604+0000 7f66827fc700 1 --2- 172.21.15.27:0/4093457038 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6670003bc0 0x7f6670003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:24.620 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.604+0000 7f66827fc700 1 --2- 172.21.15.27:0/4093457038 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6670004850 0x7f6670004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:24.620 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.604+0000 7f66827fc700 1 --2- 172.21.15.27:0/4093457038 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f668415c420 0x7f6670005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:24.620 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.604+0000 7f66827fc700 1 -- 172.21.15.27:0/4093457038 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66840ce690 con 0x7f6670004850 2023-07-05T23:35:24.620 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.604+0000 7f66827fc700 1 -- 172.21.15.27:0/4093457038 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f667000baf0 con 0x7f6670003bc0 2023-07-05T23:35:24.621 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.604+0000 7f66827fc700 1 -- 172.21.15.27:0/4093457038 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f667000bcb0 con 0x7f668415c420 2023-07-05T23:35:24.621 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.604+0000 7f6682ffd700 1 --2- 172.21.15.27:0/4093457038 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6670004850 0x7f6670004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:24.621 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.604+0000 7f66837fe700 1 --2- 172.21.15.27:0/4093457038 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6670003bc0 0x7f6670003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:24.621 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.604+0000 7f6683fff700 1 --2- 172.21.15.27:0/4093457038 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f668415c420 0x7f6670005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:24.621 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.604+0000 7f6682ffd700 1 -- 172.21.15.27:0/4093457038 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f668415c420 msgr2=0x7f6670005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:35:24.622 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.604+0000 7f6682ffd700 1 --2- 172.21.15.27:0/4093457038 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f668415c420 0x7f6670005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:24.622 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.604+0000 7f6682ffd700 1 -- 172.21.15.27:0/4093457038 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6670003bc0 msgr2=0x7f6670003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:35:24.622 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.604+0000 7f6682ffd700 1 --2- 172.21.15.27:0/4093457038 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6670003bc0 0x7f6670003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:24.622 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.604+0000 7f6682ffd700 1 -- 172.21.15.27:0/4093457038 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66700035b0 con 0x7f6670004850 2023-07-05T23:35:24.622 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.605+0000 7f6682ffd700 1 --2- 172.21.15.27:0/4093457038 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6670004850 0x7f6670004cc0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f666c00c210 tx=0x7f6670005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b0904b7ee05e292 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:24.623 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.605+0000 7f66827fc700 1 -- 172.21.15.27:0/4093457038 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666c00cd50 con 0x7f6670004850 2023-07-05T23:35:24.623 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.605+0000 7f66827fc700 1 -- 172.21.15.27:0/4093457038 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f666c001af0 con 0x7f6670004850 2023-07-05T23:35:24.623 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.605+0000 7f66827fc700 1 -- 172.21.15.27:0/4093457038 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666c005ba0 con 0x7f6670004850 2023-07-05T23:35:24.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.605+0000 7f6689e9f700 1 -- 172.21.15.27:0/4093457038 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6670004850 msgr2=0x7f6670004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:24.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.605+0000 7f6689e9f700 1 --2- 172.21.15.27:0/4093457038 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6670004850 0x7f6670004cc0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f666c00c210 tx=0x7f6670005880 comp rx=0 tx=0).stop 2023-07-05T23:35:24.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.605+0000 7f6683fff700 1 -- 172.21.15.27:0/4093457038 reap_dead start 2023-07-05T23:35:24.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.605+0000 7f6689e9f700 1 -- 172.21.15.27:0/4093457038 shutdown_connections 2023-07-05T23:35:24.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.605+0000 7f6689e9f700 1 -- 172.21.15.27:0/4093457038 >> 172.21.15.27:0/4093457038 conn(0x7f668406b920 msgr2=0x7f66840cf7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:24.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.605+0000 7f6689e9f700 1 -- 172.21.15.27:0/4093457038 shutdown_connections 2023-07-05T23:35:24.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.605+0000 7f6689e9f700 1 -- 172.21.15.27:0/4093457038 wait complete. 2023-07-05T23:35:24.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.607+0000 7f6689e9f700 1 Processor -- start 2023-07-05T23:35:24.628 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.607+0000 7f6689e9f700 1 -- start start 2023-07-05T23:35:24.628 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.607+0000 7f6689e9f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6670004850 0x7f6684157ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:24.628 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.607+0000 7f6689e9f700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66841e4b40 0x7f6684152f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:24.628 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.607+0000 7f6689e9f700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66841e4fb0 0x7f6684153480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:24.628 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.607+0000 7f6689e9f700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66841e6700 con 0x7f6670004850 2023-07-05T23:35:24.629 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.607+0000 7f6689e9f700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66841e3aa0 con 0x7f66841e4b40 2023-07-05T23:35:24.629 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.607+0000 7f6689e9f700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66841e3d80 con 0x7f66841e4fb0 2023-07-05T23:35:24.629 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.608+0000 7f66837fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6670004850 0x7f6684157ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:24.629 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.608+0000 7f66837fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6670004850 0x7f6684157ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46720/0 (socket says 172.21.15.27:46720) 2023-07-05T23:35:24.629 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.608+0000 7f66837fe700 1 -- 172.21.15.27:0/2291569257 learned_addr learned my addr 172.21.15.27:0/2291569257 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:24.630 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.608+0000 7f6683fff700 1 --2- 172.21.15.27:0/2291569257 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66841e4fb0 0x7f6684153480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:24.630 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.608+0000 7f6682ffd700 1 --2- 172.21.15.27:0/2291569257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66841e4b40 0x7f6684152f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:24.630 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.608+0000 7f66837fe700 1 -- 172.21.15.27:0/2291569257 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66841e4fb0 msgr2=0x7f6684153480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:24.630 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.608+0000 7f66837fe700 1 --2- 172.21.15.27:0/2291569257 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66841e4fb0 0x7f6684153480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:24.630 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.608+0000 7f66837fe700 1 -- 172.21.15.27:0/2291569257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66841e4b40 msgr2=0x7f6684152f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:24.631 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.608+0000 7f66837fe700 1 --2- 172.21.15.27:0/2291569257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66841e4b40 0x7f6684152f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:24.631 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.608+0000 7f66837fe700 1 -- 172.21.15.27:0/2291569257 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66841e4060 con 0x7f6670004850 2023-07-05T23:35:24.631 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.608+0000 7f6683fff700 1 --2- 172.21.15.27:0/2291569257 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66841e4fb0 0x7f6684153480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T23:35:24.631 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.608+0000 7f6682ffd700 1 --2- 172.21.15.27:0/2291569257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66841e4b40 0x7f6684152f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T23:35:24.631 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.608+0000 7f66837fe700 1 --2- 172.21.15.27:0/2291569257 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6670004850 0x7f6684157ba0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f66740119a0 tx=0x7f6674011d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:24.632 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.608+0000 7f667bfff700 1 -- 172.21.15.27:0/2291569257 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667400f940 con 0x7f6670004850 2023-07-05T23:35:24.632 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.608+0000 7f667bfff700 1 -- 172.21.15.27:0/2291569257 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f667400faa0 con 0x7f6670004850 2023-07-05T23:35:24.632 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.608+0000 7f667bfff700 1 -- 172.21.15.27:0/2291569257 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667400fe30 con 0x7f6670004850 2023-07-05T23:35:24.632 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.608+0000 7f6689e9f700 1 -- 172.21.15.27:0/2291569257 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66841e4340 con 0x7f6670004850 2023-07-05T23:35:24.632 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.608+0000 7f6689e9f700 1 -- 172.21.15.27:0/2291569257 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66841580e0 con 0x7f6670004850 2023-07-05T23:35:24.633 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.609+0000 7f6689e9f700 1 -- 172.21.15.27:0/2291569257 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6684073910 con 0x7f6670004850 2023-07-05T23:35:24.633 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.610+0000 7f667bfff700 1 -- 172.21.15.27:0/2291569257 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6674014440 con 0x7f6670004850 2023-07-05T23:35:24.633 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.610+0000 7f667bfff700 1 --2- 172.21.15.27:0/2291569257 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f666406ace0 0x7f666406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:24.633 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.610+0000 7f667bfff700 1 -- 172.21.15.27:0/2291569257 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6674089d60 con 0x7f6670004850 2023-07-05T23:35:24.633 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.610+0000 7f6682ffd700 1 --2- 172.21.15.27:0/2291569257 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f666406ace0 0x7f666406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:24.634 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.611+0000 7f6682ffd700 1 --2- 172.21.15.27:0/2291569257 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f666406ace0 0x7f666406d190 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f66841e6320 tx=0x7f666c00a000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:24.634 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.615+0000 7f667bfff700 1 -- 172.21.15.27:0/2291569257 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6674054b70 con 0x7f6670004850 2023-07-05T23:35:24.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.812+0000 7f6689e9f700 1 -- 172.21.15.27:0/2291569257 --> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f66840cef30 con 0x7f666406ace0 2023-07-05T23:35:24.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.812+0000 7f667bfff700 1 -- 172.21.15.27:0/2291569257 <== mgr.4105 v2:172.21.15.162:6832/3790028097 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f666c0014b0 con 0x7f666406ace0 2023-07-05T23:35:24.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.815+0000 7f6689e9f700 1 -- 172.21.15.27:0/2291569257 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f666406ace0 msgr2=0x7f666406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:24.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.815+0000 7f6689e9f700 1 --2- 172.21.15.27:0/2291569257 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f666406ace0 0x7f666406d190 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f66841e6320 tx=0x7f666c00a000 comp rx=0 tx=0).stop 2023-07-05T23:35:24.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.815+0000 7f6689e9f700 1 -- 172.21.15.27:0/2291569257 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6670004850 msgr2=0x7f6684157ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:24.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.815+0000 7f6689e9f700 1 --2- 172.21.15.27:0/2291569257 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6670004850 0x7f6684157ba0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f66740119a0 tx=0x7f6674011d60 comp rx=0 tx=0).stop 2023-07-05T23:35:24.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.815+0000 7f6689e9f700 1 -- 172.21.15.27:0/2291569257 shutdown_connections 2023-07-05T23:35:24.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.815+0000 7f6689e9f700 1 --2- 172.21.15.27:0/2291569257 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f666406ace0 0x7f666406d190 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:24.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.815+0000 7f6689e9f700 1 --2- 172.21.15.27:0/2291569257 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66841e4fb0 0x7f6684153480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:24.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.815+0000 7f6689e9f700 1 --2- 172.21.15.27:0/2291569257 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6670004850 0x7f6684157ba0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:24.820 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.815+0000 7f6689e9f700 1 --2- 172.21.15.27:0/2291569257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66841e4b40 0x7f6684152f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:24.820 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.815+0000 7f6689e9f700 1 -- 172.21.15.27:0/2291569257 >> 172.21.15.27:0/2291569257 conn(0x7f668406b920 msgr2=0x7f66840b4f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:24.820 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.815+0000 7f6689e9f700 1 -- 172.21.15.27:0/2291569257 shutdown_connections 2023-07-05T23:35:24.820 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.815+0000 7f6689e9f700 1 -- 172.21.15.27:0/2291569257 wait complete. 2023-07-05T23:35:24.821 INFO:teuthology.orchestra.run.smithi027.stderr:instructed osd(s) 7 to deep-scrub 2023-07-05T23:35:24.832 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-05T23:35:24.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.960+0000 7f4f98385700 1 Processor -- start 2023-07-05T23:35:24.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.960+0000 7f4f98385700 1 -- start start 2023-07-05T23:35:24.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.961+0000 7f4f98385700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4f9006a890 0x7f4f9006acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:24.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.961+0000 7f4f98385700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f9015cc30 con 0x7f4f90158850 2023-07-05T23:35:24.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.961+0000 7f4f98385700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f9015cf10 con 0x7f4f900ccf90 2023-07-05T23:35:24.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.961+0000 7f4f98385700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f9015d1f0 con 0x7f4f9006a890 2023-07-05T23:35:24.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.961+0000 7f4f95920700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f4f90158850 0x7f4f9015c1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:53896/0 (socket says 172.21.15.27:53896) 2023-07-05T23:35:24.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.961+0000 7f4f95920700 1 -- 172.21.15.27:0/2946694596 learned_addr learned my addr 172.21.15.27:0/2946694596 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-07-05T23:35:24.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.962+0000 7f4f96922700 1 --2- 172.21.15.27:0/2946694596 >> v2:172.21.15.162:3300/0 conn(0x7f4f9006a890 0x7f4f9006acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:24.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.962+0000 7f4f9511f700 1 -- 172.21.15.27:0/2946694596 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2367417056 0 0) 0x7f4f9015cc30 con 0x7f4f90158850 2023-07-05T23:35:24.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.962+0000 7f4f9511f700 1 -- 172.21.15.27:0/2946694596 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f7c0035b0 con 0x7f4f90158850 2023-07-05T23:35:24.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.962+0000 7f4f9511f700 1 -- 172.21.15.27:0/2946694596 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 449540084 0 0) 0x7f4f7c0035b0 con 0x7f4f90158850 2023-07-05T23:35:24.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.962+0000 7f4f9511f700 1 -- 172.21.15.27:0/2946694596 >> v2:172.21.15.162:3300/0 conn(0x7f4f9006a890 msgr2=0x7f4f9006acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:35:24.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.962+0000 7f4f9511f700 1 --2- 172.21.15.27:0/2946694596 >> v2:172.21.15.162:3300/0 conn(0x7f4f9006a890 0x7f4f9006acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:24.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.962+0000 7f4f9511f700 1 -- 172.21.15.27:0/2946694596 >> v1:172.21.15.162:6789/0 conn(0x7f4f900ccf90 legacy=0x7f4f900cd360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:24.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.962+0000 7f4f9511f700 1 -- 172.21.15.27:0/2946694596 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f9006a090 con 0x7f4f90158850 2023-07-05T23:35:24.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.962+0000 7f4f9511f700 1 -- 172.21.15.27:0/2946694596 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1246168953 0 0) 0x7f4f8c001670 con 0x7f4f90158850 2023-07-05T23:35:24.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.962+0000 7f4f9511f700 1 -- 172.21.15.27:0/2946694596 >> v1:172.21.15.27:6789/0 conn(0x7f4f90158850 legacy=0x7f4f9015c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:24.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.962+0000 7f4f9511f700 1 --2- 172.21.15.27:0/2946694596 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4f7c003a00 0x7f4f7c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:24.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.962+0000 7f4f9511f700 1 --2- 172.21.15.27:0/2946694596 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4f7c004850 0x7f4f7c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:24.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.962+0000 7f4f9511f700 1 --2- 172.21.15.27:0/2946694596 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f7c005200 0x7f4f7c00cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:24.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.962+0000 7f4f9511f700 1 -- 172.21.15.27:0/2946694596 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9015d1f0 con 0x7f4f7c004850 2023-07-05T23:35:24.977 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.962+0000 7f4f9511f700 1 -- 172.21.15.27:0/2946694596 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7c00d190 con 0x7f4f7c005200 2023-07-05T23:35:24.977 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.962+0000 7f4f9511f700 1 -- 172.21.15.27:0/2946694596 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7c00d350 con 0x7f4f7c003a00 2023-07-05T23:35:24.977 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.962+0000 7f4f95920700 1 --2- 172.21.15.27:0/2946694596 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4f7c004850 0x7f4f7c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:24.977 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.962+0000 7f4f96922700 1 --2- 172.21.15.27:0/2946694596 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f7c005200 0x7f4f7c00cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:24.977 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.962+0000 7f4f96121700 1 --2- 172.21.15.27:0/2946694596 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4f7c003a00 0x7f4f7c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:24.978 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.962+0000 7f4f95920700 1 -- 172.21.15.27:0/2946694596 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4f7c003a00 msgr2=0x7f4f7c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:35:24.978 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.962+0000 7f4f95920700 1 --2- 172.21.15.27:0/2946694596 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4f7c003a00 0x7f4f7c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:24.978 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.962+0000 7f4f95920700 1 -- 172.21.15.27:0/2946694596 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f7c005200 msgr2=0x7f4f7c00cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:35:24.978 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.962+0000 7f4f95920700 1 --2- 172.21.15.27:0/2946694596 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f7c005200 0x7f4f7c00cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:24.978 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.962+0000 7f4f95920700 1 -- 172.21.15.27:0/2946694596 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f7c0035b0 con 0x7f4f7c004850 2023-07-05T23:35:24.979 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.962+0000 7f4f96922700 1 -- 172.21.15.27:0/2946694596 reap_dead start 2023-07-05T23:35:24.979 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.963+0000 7f4f95920700 1 --2- 172.21.15.27:0/2946694596 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4f7c004850 0x7f4f7c004cc0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c00c240 tx=0x7f4f7c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb976c343626f24a server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:24.979 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.963+0000 7f4f9511f700 1 -- 172.21.15.27:0/2946694596 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c007c10 con 0x7f4f7c004850 2023-07-05T23:35:24.979 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.963+0000 7f4f9511f700 1 -- 172.21.15.27:0/2946694596 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f8c00cd60 con 0x7f4f7c004850 2023-07-05T23:35:24.979 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.963+0000 7f4f9511f700 1 -- 172.21.15.27:0/2946694596 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c005ba0 con 0x7f4f7c004850 2023-07-05T23:35:24.982 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.963+0000 7f4f98385700 1 -- 172.21.15.27:0/2946694596 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4f7c004850 msgr2=0x7f4f7c004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:24.982 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.963+0000 7f4f98385700 1 --2- 172.21.15.27:0/2946694596 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4f7c004850 0x7f4f7c004cc0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c00c240 tx=0x7f4f7c005880 comp rx=0 tx=0).stop 2023-07-05T23:35:24.982 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.963+0000 7f4f98385700 1 -- 172.21.15.27:0/2946694596 shutdown_connections 2023-07-05T23:35:24.982 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.963+0000 7f4f98385700 1 --2- 172.21.15.27:0/2946694596 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4f7c004850 0x7f4f7c004cc0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:24.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.963+0000 7f4f98385700 1 -- 172.21.15.27:0/2946694596 >> 172.21.15.27:0/2946694596 conn(0x7f4f900b1740 msgr2=0x7f4f9006cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:24.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.963+0000 7f4f98385700 1 -- 172.21.15.27:0/2946694596 shutdown_connections 2023-07-05T23:35:24.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.963+0000 7f4f98385700 1 -- 172.21.15.27:0/2946694596 wait complete. 2023-07-05T23:35:24.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.965+0000 7f4f98385700 1 Processor -- start 2023-07-05T23:35:24.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.965+0000 7f4f98385700 1 -- start start 2023-07-05T23:35:24.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.965+0000 7f4f98385700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4f7c004850 0x7f4f900a74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:24.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.965+0000 7f4f98385700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4f900ca9b0 0x7f4f90153470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:24.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.965+0000 7f4f98385700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f90156e70 0x7f4f901572e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:24.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.965+0000 7f4f98385700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9015a070 con 0x7f4f900ca9b0 2023-07-05T23:35:24.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.965+0000 7f4f98385700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f90157820 con 0x7f4f90156e70 2023-07-05T23:35:24.985 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.965+0000 7f4f98385700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9015be90 con 0x7f4f7c004850 2023-07-05T23:35:24.985 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.966+0000 7f4f95920700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4f900ca9b0 0x7f4f90153470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:24.985 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.966+0000 7f4f95920700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4f900ca9b0 0x7f4f90153470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46742/0 (socket says 172.21.15.27:46742) 2023-07-05T23:35:24.985 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.966+0000 7f4f95920700 1 -- 172.21.15.27:0/139350327 learned_addr learned my addr 172.21.15.27:0/139350327 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:24.985 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.966+0000 7f4f96121700 1 --2- 172.21.15.27:0/139350327 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4f7c004850 0x7f4f900a74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:24.986 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.966+0000 7f4f96922700 1 --2- 172.21.15.27:0/139350327 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f90156e70 0x7f4f901572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:24.986 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.966+0000 7f4f95920700 1 -- 172.21.15.27:0/139350327 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4f7c004850 msgr2=0x7f4f900a74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:24.986 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.966+0000 7f4f95920700 1 --2- 172.21.15.27:0/139350327 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4f7c004850 0x7f4f900a74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:24.986 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.966+0000 7f4f95920700 1 -- 172.21.15.27:0/139350327 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f90156e70 msgr2=0x7f4f901572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:24.986 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.966+0000 7f4f95920700 1 --2- 172.21.15.27:0/139350327 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f90156e70 0x7f4f901572e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:24.987 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.966+0000 7f4f95920700 1 -- 172.21.15.27:0/139350327 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f9006b750 con 0x7f4f900ca9b0 2023-07-05T23:35:24.987 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.966+0000 7f4f96922700 1 --2- 172.21.15.27:0/139350327 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f90156e70 0x7f4f901572e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T23:35:24.987 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.966+0000 7f4f95920700 1 --2- 172.21.15.27:0/139350327 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4f900ca9b0 0x7f4f90153470 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c0011d0 tx=0x7f4f8c001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:24.987 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.966+0000 7f4f86ffd700 1 -- 172.21.15.27:0/139350327 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c00ced0 con 0x7f4f900ca9b0 2023-07-05T23:35:24.987 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.966+0000 7f4f86ffd700 1 -- 172.21.15.27:0/139350327 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f8c001640 con 0x7f4f900ca9b0 2023-07-05T23:35:24.988 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.966+0000 7f4f98385700 1 -- 172.21.15.27:0/139350327 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f900a7bc0 con 0x7f4f900ca9b0 2023-07-05T23:35:24.988 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.966+0000 7f4f86ffd700 1 -- 172.21.15.27:0/139350327 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c0072f0 con 0x7f4f900ca9b0 2023-07-05T23:35:24.988 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.966+0000 7f4f98385700 1 -- 172.21.15.27:0/139350327 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f901599b0 con 0x7f4f900ca9b0 2023-07-05T23:35:24.988 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.967+0000 7f4f98385700 1 -- 172.21.15.27:0/139350327 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f90073910 con 0x7f4f900ca9b0 2023-07-05T23:35:24.988 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.968+0000 7f4f86ffd700 1 -- 172.21.15.27:0/139350327 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4f8c007450 con 0x7f4f900ca9b0 2023-07-05T23:35:24.989 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.968+0000 7f4f86ffd700 1 --2- 172.21.15.27:0/139350327 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f4f7406ace0 0x7f4f7406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:24.989 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.968+0000 7f4f86ffd700 1 -- 172.21.15.27:0/139350327 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4f8c08a720 con 0x7f4f900ca9b0 2023-07-05T23:35:24.989 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.969+0000 7f4f96121700 1 --2- 172.21.15.27:0/139350327 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f4f7406ace0 0x7f4f7406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:24.989 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.969+0000 7f4f96121700 1 --2- 172.21.15.27:0/139350327 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f4f7406ace0 0x7f4f7406d190 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4f80007fd0 tx=0x7f4f80009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:24.989 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:24.973+0000 7f4f86ffd700 1 -- 172.21.15.27:0/139350327 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4f8c0554b0 con 0x7f4f900ca9b0 2023-07-05T23:35:25.170 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:25.167+0000 7f4f98385700 1 -- 172.21.15.27:0/139350327 --> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4f9006b5d0 con 0x7f4f7406ace0 2023-07-05T23:35:25.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:25.179+0000 7f4f86ffd700 1 -- 172.21.15.27:0/139350327 <== mgr.4105 v2:172.21.15.162:6832/3790028097 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+391944 (secure 0 0 0) 0x7f4f80001d00 con 0x7f4f7406ace0 2023-07-05T23:35:25.183 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:35:25.191 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:25.182+0000 7f4f98385700 1 -- 172.21.15.27:0/139350327 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f4f7406ace0 msgr2=0x7f4f7406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:25.192 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:25.182+0000 7f4f98385700 1 --2- 172.21.15.27:0/139350327 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f4f7406ace0 0x7f4f7406d190 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4f80007fd0 tx=0x7f4f80009040 comp rx=0 tx=0).stop 2023-07-05T23:35:25.192 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:25.182+0000 7f4f98385700 1 -- 172.21.15.27:0/139350327 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4f900ca9b0 msgr2=0x7f4f90153470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:25.192 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:25.182+0000 7f4f98385700 1 --2- 172.21.15.27:0/139350327 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4f900ca9b0 0x7f4f90153470 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c0011d0 tx=0x7f4f8c001a00 comp rx=0 tx=0).stop 2023-07-05T23:35:25.192 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:25.182+0000 7f4f98385700 1 -- 172.21.15.27:0/139350327 shutdown_connections 2023-07-05T23:35:25.192 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:25.182+0000 7f4f98385700 1 --2- 172.21.15.27:0/139350327 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f90156e70 0x7f4f901572e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:25.193 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:25.182+0000 7f4f98385700 1 --2- 172.21.15.27:0/139350327 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f4f7406ace0 0x7f4f7406d190 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:25.193 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:25.182+0000 7f4f98385700 1 --2- 172.21.15.27:0/139350327 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4f7c004850 0x7f4f900a74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:25.193 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:25.182+0000 7f4f98385700 1 --2- 172.21.15.27:0/139350327 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4f900ca9b0 0x7f4f90153470 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:25.193 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:25.182+0000 7f4f98385700 1 -- 172.21.15.27:0/139350327 >> 172.21.15.27:0/139350327 conn(0x7f4f900b1740 msgr2=0x7f4f900ae970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:25.193 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:25.182+0000 7f4f98385700 1 -- 172.21.15.27:0/139350327 shutdown_connections 2023-07-05T23:35:25.194 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:25.182+0000 7f4f98385700 1 -- 172.21.15.27:0/139350327 wait complete. 2023-07-05T23:35:25.194 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2023-07-05T23:35:25.197 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":105,"stamp":"2023-07-05T23:35:23.677180+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":102735331,"num_objects":49,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":131,"num_read_kb":117,"num_write":1238,"num_write_kb":1290312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17729,"ondisk_log_size":17729,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":463952,"kb_used_data":203280,"kb_used_omap":0,"kb_used_meta":260608,"kb_avail":754510768,"statfs":{"total":773094113280,"available":772619026432,"internally_reserved":0,"allocated":208158720,"data_stored":206581430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":266862592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":57,"apply_latency_ms":57,"commit_latency_ns":57000000,"apply_latency_ns":57000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-230534952,"num_objects":-55,"num_object_clones":0,"num_object_copies":-220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-55,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":365,"num_write_kb":493754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003519"},"pg_stats":[{"pgid":"4.3f","version":"30'28","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.290927+0000","last_change":"2023-07-05T23:32:53.342316+0000","last_active":"2023-07-05T23:35:17.290927+0000","last_peered":"2023-07-05T23:35:17.290927+0000","last_clean":"2023-07-05T23:35:17.290927+0000","last_became_active":"2023-07-05T23:32:53.342061+0000","last_became_peered":"2023-07-05T23:32:53.342061+0000","last_unstale":"2023-07-05T23:35:17.290927+0000","last_undegraded":"2023-07-05T23:35:17.290927+0000","last_fullsized":"2023-07-05T23:35:17.290927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:27:59.144444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"30'27","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.297181+0000","last_change":"2023-07-05T23:32:53.343107+0000","last_active":"2023-07-05T23:35:17.297181+0000","last_peered":"2023-07-05T23:35:17.297181+0000","last_clean":"2023-07-05T23:35:17.297181+0000","last_became_active":"2023-07-05T23:32:53.342843+0000","last_became_peered":"2023-07-05T23:32:53.342843+0000","last_unstale":"2023-07-05T23:35:17.297181+0000","last_undegraded":"2023-07-05T23:35:17.297181+0000","last_fullsized":"2023-07-05T23:35:17.297181+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:34:18.782861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"30'43","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.284940+0000","last_change":"2023-07-05T23:32:53.339304+0000","last_active":"2023-07-05T23:35:17.284940+0000","last_peered":"2023-07-05T23:35:17.284940+0000","last_clean":"2023-07-05T23:35:17.284940+0000","last_became_active":"2023-07-05T23:32:53.338973+0000","last_became_peered":"2023-07-05T23:32:53.338973+0000","last_unstale":"2023-07-05T23:35:17.284940+0000","last_undegraded":"2023-07-05T23:35:17.284940+0000","last_fullsized":"2023-07-05T23:35:17.284940+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:28:30.568393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"30'24","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.268525+0000","last_change":"2023-07-05T23:32:53.334788+0000","last_active":"2023-07-05T23:35:17.268525+0000","last_peered":"2023-07-05T23:35:17.268525+0000","last_clean":"2023-07-05T23:35:17.268525+0000","last_became_active":"2023-07-05T23:32:53.334473+0000","last_became_peered":"2023-07-05T23:32:53.334473+0000","last_unstale":"2023-07-05T23:35:17.268525+0000","last_undegraded":"2023-07-05T23:35:17.268525+0000","last_fullsized":"2023-07-05T23:35:17.268525+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:32:19.839362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"30'34","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.288024+0000","last_change":"2023-07-05T23:32:53.346034+0000","last_active":"2023-07-05T23:35:17.288024+0000","last_peered":"2023-07-05T23:35:17.288024+0000","last_clean":"2023-07-05T23:35:17.288024+0000","last_became_active":"2023-07-05T23:32:53.345743+0000","last_became_peered":"2023-07-05T23:32:53.345743+0000","last_unstale":"2023-07-05T23:35:17.288024+0000","last_undegraded":"2023-07-05T23:35:17.288024+0000","last_fullsized":"2023-07-05T23:35:17.288024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:09:06.821067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"30'39","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.288517+0000","last_change":"2023-07-05T23:32:53.335744+0000","last_active":"2023-07-05T23:35:17.288517+0000","last_peered":"2023-07-05T23:35:17.288517+0000","last_clean":"2023-07-05T23:35:17.288517+0000","last_became_active":"2023-07-05T23:32:53.335456+0000","last_became_peered":"2023-07-05T23:32:53.335456+0000","last_unstale":"2023-07-05T23:35:17.288517+0000","last_undegraded":"2023-07-05T23:35:17.288517+0000","last_fullsized":"2023-07-05T23:35:17.288517+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:29:41.800131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"30'27","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.295829+0000","last_change":"2023-07-05T23:32:53.341154+0000","last_active":"2023-07-05T23:35:17.295829+0000","last_peered":"2023-07-05T23:35:17.295829+0000","last_clean":"2023-07-05T23:35:17.295829+0000","last_became_active":"2023-07-05T23:32:53.340639+0000","last_became_peered":"2023-07-05T23:32:53.340639+0000","last_unstale":"2023-07-05T23:35:17.295829+0000","last_undegraded":"2023-07-05T23:35:17.295829+0000","last_fullsized":"2023-07-05T23:35:17.295829+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:06:29.575306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"30'31","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.289329+0000","last_change":"2023-07-05T23:32:53.336514+0000","last_active":"2023-07-05T23:35:17.289329+0000","last_peered":"2023-07-05T23:35:17.289329+0000","last_clean":"2023-07-05T23:35:17.289329+0000","last_became_active":"2023-07-05T23:32:53.336216+0000","last_became_peered":"2023-07-05T23:32:53.336216+0000","last_unstale":"2023-07-05T23:35:17.289329+0000","last_undegraded":"2023-07-05T23:35:17.289329+0000","last_fullsized":"2023-07-05T23:35:17.289329+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:09:56.721492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"30'38","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.290673+0000","last_change":"2023-07-05T23:32:53.348265+0000","last_active":"2023-07-05T23:35:17.290673+0000","last_peered":"2023-07-05T23:35:17.290673+0000","last_clean":"2023-07-05T23:35:17.290673+0000","last_became_active":"2023-07-05T23:32:53.347948+0000","last_became_peered":"2023-07-05T23:32:53.347948+0000","last_unstale":"2023-07-05T23:35:17.290673+0000","last_undegraded":"2023-07-05T23:35:17.290673+0000","last_fullsized":"2023-07-05T23:35:17.290673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:30:02.990759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"30'44","reported_seq":68,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.285246+0000","last_change":"2023-07-05T23:32:53.330422+0000","last_active":"2023-07-05T23:35:17.285246+0000","last_peered":"2023-07-05T23:35:17.285246+0000","last_clean":"2023-07-05T23:35:17.285246+0000","last_became_active":"2023-07-05T23:32:53.330135+0000","last_became_peered":"2023-07-05T23:32:53.330135+0000","last_unstale":"2023-07-05T23:35:17.285246+0000","last_undegraded":"2023-07-05T23:35:17.285246+0000","last_fullsized":"2023-07-05T23:35:17.285246+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:32:03.040658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"30'25","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.296987+0000","last_change":"2023-07-05T23:32:53.341815+0000","last_active":"2023-07-05T23:35:17.296987+0000","last_peered":"2023-07-05T23:35:17.296987+0000","last_clean":"2023-07-05T23:35:17.296987+0000","last_became_active":"2023-07-05T23:32:53.341526+0000","last_became_peered":"2023-07-05T23:32:53.341526+0000","last_unstale":"2023-07-05T23:35:17.296987+0000","last_undegraded":"2023-07-05T23:35:17.296987+0000","last_fullsized":"2023-07-05T23:35:17.296987+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:28:47.019912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"30'30","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.292500+0000","last_change":"2023-07-05T23:32:53.337552+0000","last_active":"2023-07-05T23:35:17.292500+0000","last_peered":"2023-07-05T23:35:17.292500+0000","last_clean":"2023-07-05T23:35:17.292500+0000","last_became_active":"2023-07-05T23:32:53.337279+0000","last_became_peered":"2023-07-05T23:32:53.337279+0000","last_unstale":"2023-07-05T23:35:17.292500+0000","last_undegraded":"2023-07-05T23:35:17.292500+0000","last_fullsized":"2023-07-05T23:35:17.292500+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:24:31.034513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"30'30","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.291557+0000","last_change":"2023-07-05T23:32:53.336366+0000","last_active":"2023-07-05T23:35:17.291557+0000","last_peered":"2023-07-05T23:35:17.291557+0000","last_clean":"2023-07-05T23:35:17.291557+0000","last_became_active":"2023-07-05T23:32:53.336083+0000","last_became_peered":"2023-07-05T23:32:53.336083+0000","last_unstale":"2023-07-05T23:35:17.291557+0000","last_undegraded":"2023-07-05T23:35:17.291557+0000","last_fullsized":"2023-07-05T23:35:17.291557+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:32:24.944898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"30'32","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.292349+0000","last_change":"2023-07-05T23:32:53.328235+0000","last_active":"2023-07-05T23:35:17.292349+0000","last_peered":"2023-07-05T23:35:17.292349+0000","last_clean":"2023-07-05T23:35:17.292349+0000","last_became_active":"2023-07-05T23:32:53.327918+0000","last_became_peered":"2023-07-05T23:32:53.327918+0000","last_unstale":"2023-07-05T23:35:17.292349+0000","last_undegraded":"2023-07-05T23:35:17.292349+0000","last_fullsized":"2023-07-05T23:35:17.292349+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:00:42.415370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"30'31","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.295690+0000","last_change":"2023-07-05T23:32:53.340929+0000","last_active":"2023-07-05T23:35:17.295690+0000","last_peered":"2023-07-05T23:35:17.295690+0000","last_clean":"2023-07-05T23:35:17.295690+0000","last_became_active":"2023-07-05T23:32:53.340246+0000","last_became_peered":"2023-07-05T23:32:53.340246+0000","last_unstale":"2023-07-05T23:35:17.295690+0000","last_undegraded":"2023-07-05T23:35:17.295690+0000","last_fullsized":"2023-07-05T23:35:17.295690+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:48:30.276766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"30'39","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.293871+0000","last_change":"2023-07-05T23:32:53.336278+0000","last_active":"2023-07-05T23:35:17.293871+0000","last_peered":"2023-07-05T23:35:17.293871+0000","last_clean":"2023-07-05T23:35:17.293871+0000","last_became_active":"2023-07-05T23:32:53.336006+0000","last_became_peered":"2023-07-05T23:32:53.336006+0000","last_unstale":"2023-07-05T23:35:17.293871+0000","last_undegraded":"2023-07-05T23:35:17.293871+0000","last_fullsized":"2023-07-05T23:35:17.293871+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:28:30.623573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"30'34","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.290463+0000","last_change":"2023-07-05T23:32:53.346115+0000","last_active":"2023-07-05T23:35:17.290463+0000","last_peered":"2023-07-05T23:35:17.290463+0000","last_clean":"2023-07-05T23:35:17.290463+0000","last_became_active":"2023-07-05T23:32:53.345848+0000","last_became_peered":"2023-07-05T23:32:53.345848+0000","last_unstale":"2023-07-05T23:35:17.290463+0000","last_undegraded":"2023-07-05T23:35:17.290463+0000","last_fullsized":"2023-07-05T23:35:17.290463+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:27:22.570990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"30'29","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.292485+0000","last_change":"2023-07-05T23:32:53.339001+0000","last_active":"2023-07-05T23:35:17.292485+0000","last_peered":"2023-07-05T23:35:17.292485+0000","last_clean":"2023-07-05T23:35:17.292485+0000","last_became_active":"2023-07-05T23:32:53.335535+0000","last_became_peered":"2023-07-05T23:32:53.335535+0000","last_unstale":"2023-07-05T23:35:17.292485+0000","last_undegraded":"2023-07-05T23:35:17.292485+0000","last_fullsized":"2023-07-05T23:35:17.292485+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:40:11.653019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"30'31","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.292929+0000","last_change":"2023-07-05T23:32:53.338403+0000","last_active":"2023-07-05T23:35:17.292929+0000","last_peered":"2023-07-05T23:35:17.292929+0000","last_clean":"2023-07-05T23:35:17.292929+0000","last_became_active":"2023-07-05T23:32:53.338095+0000","last_became_peered":"2023-07-05T23:32:53.338095+0000","last_unstale":"2023-07-05T23:35:17.292929+0000","last_undegraded":"2023-07-05T23:35:17.292929+0000","last_fullsized":"2023-07-05T23:35:17.292929+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:52:25.342366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"30'34","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.287715+0000","last_change":"2023-07-05T23:32:53.341961+0000","last_active":"2023-07-05T23:35:17.287715+0000","last_peered":"2023-07-05T23:35:17.287715+0000","last_clean":"2023-07-05T23:35:17.287715+0000","last_became_active":"2023-07-05T23:32:53.341783+0000","last_became_peered":"2023-07-05T23:32:53.341783+0000","last_unstale":"2023-07-05T23:35:17.287715+0000","last_undegraded":"2023-07-05T23:35:17.287715+0000","last_fullsized":"2023-07-05T23:35:17.287715+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:42:23.689201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"30'40","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.290875+0000","last_change":"2023-07-05T23:32:53.348405+0000","last_active":"2023-07-05T23:35:17.290875+0000","last_peered":"2023-07-05T23:35:17.290875+0000","last_clean":"2023-07-05T23:35:17.290875+0000","last_became_active":"2023-07-05T23:32:53.348108+0000","last_became_peered":"2023-07-05T23:32:53.348108+0000","last_unstale":"2023-07-05T23:35:17.290875+0000","last_undegraded":"2023-07-05T23:35:17.290875+0000","last_fullsized":"2023-07-05T23:35:17.290875+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:09:56.721492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"30'32","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.296288+0000","last_change":"2023-07-05T23:32:53.340963+0000","last_active":"2023-07-05T23:35:17.296288+0000","last_peered":"2023-07-05T23:35:17.296288+0000","last_clean":"2023-07-05T23:35:17.296288+0000","last_became_active":"2023-07-05T23:32:53.340698+0000","last_became_peered":"2023-07-05T23:32:53.340698+0000","last_unstale":"2023-07-05T23:35:17.296288+0000","last_undegraded":"2023-07-05T23:35:17.296288+0000","last_fullsized":"2023-07-05T23:35:17.296288+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:34:43.735212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"30'36","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.286094+0000","last_change":"2023-07-05T23:32:53.345981+0000","last_active":"2023-07-05T23:35:17.286094+0000","last_peered":"2023-07-05T23:35:17.286094+0000","last_clean":"2023-07-05T23:35:17.286094+0000","last_became_active":"2023-07-05T23:32:53.345403+0000","last_became_peered":"2023-07-05T23:32:53.345403+0000","last_unstale":"2023-07-05T23:35:17.286094+0000","last_undegraded":"2023-07-05T23:35:17.286094+0000","last_fullsized":"2023-07-05T23:35:17.286094+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:09:56.721492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"30'31","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.291581+0000","last_change":"2023-07-05T23:32:53.348335+0000","last_active":"2023-07-05T23:35:17.291581+0000","last_peered":"2023-07-05T23:35:17.291581+0000","last_clean":"2023-07-05T23:35:17.291581+0000","last_became_active":"2023-07-05T23:32:53.348053+0000","last_became_peered":"2023-07-05T23:32:53.348053+0000","last_unstale":"2023-07-05T23:35:17.291581+0000","last_undegraded":"2023-07-05T23:35:17.291581+0000","last_fullsized":"2023-07-05T23:35:17.291581+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:03:45.831512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"30'25","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.294917+0000","last_change":"2023-07-05T23:32:53.339227+0000","last_active":"2023-07-05T23:35:17.294917+0000","last_peered":"2023-07-05T23:35:17.294917+0000","last_clean":"2023-07-05T23:35:17.294917+0000","last_became_active":"2023-07-05T23:32:53.338935+0000","last_became_peered":"2023-07-05T23:32:53.338935+0000","last_unstale":"2023-07-05T23:35:17.294917+0000","last_undegraded":"2023-07-05T23:35:17.294917+0000","last_fullsized":"2023-07-05T23:35:17.294917+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:38:49.816055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"30'38","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.291925+0000","last_change":"2023-07-05T23:33:34.898632+0000","last_active":"2023-07-05T23:35:17.291925+0000","last_peered":"2023-07-05T23:35:17.291925+0000","last_clean":"2023-07-05T23:35:17.291925+0000","last_became_active":"2023-07-05T23:33:34.898383+0000","last_became_peered":"2023-07-05T23:33:34.898383+0000","last_unstale":"2023-07-05T23:35:17.291925+0000","last_undegraded":"2023-07-05T23:35:17.291925+0000","last_fullsized":"2023-07-05T23:35:17.291925+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:19:45.125125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.25","version":"30'26","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.282794+0000","last_change":"2023-07-05T23:32:53.336623+0000","last_active":"2023-07-05T23:35:17.282794+0000","last_peered":"2023-07-05T23:35:17.282794+0000","last_clean":"2023-07-05T23:35:17.282794+0000","last_became_active":"2023-07-05T23:32:53.335857+0000","last_became_peered":"2023-07-05T23:32:53.335857+0000","last_unstale":"2023-07-05T23:35:17.282794+0000","last_undegraded":"2023-07-05T23:35:17.282794+0000","last_fullsized":"2023-07-05T23:35:17.282794+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:53:37.219658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"30'479","reported_seq":496,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:13.555953+0000","last_change":"2023-07-05T23:32:57.365825+0000","last_active":"2023-07-05T23:35:13.555953+0000","last_peered":"2023-07-05T23:35:13.555953+0000","last_clean":"2023-07-05T23:35:13.555953+0000","last_became_active":"2023-07-05T23:32:57.365409+0000","last_became_peered":"2023-07-05T23:32:57.365409+0000","last_unstale":"2023-07-05T23:35:13.555953+0000","last_undegraded":"2023-07-05T23:35:13.555953+0000","last_fullsized":"2023-07-05T23:35:13.555953+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:43:38.161766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.205650+0000","last_change":"2023-07-05T23:32:52.901348+0000","last_active":"2023-07-05T23:33:35.205650+0000","last_peered":"2023-07-05T23:33:35.205650+0000","last_clean":"2023-07-05T23:33:35.205650+0000","last_became_active":"2023-07-05T23:32:52.901080+0000","last_became_peered":"2023-07-05T23:32:52.901080+0000","last_unstale":"2023-07-05T23:33:35.205650+0000","last_undegraded":"2023-07-05T23:33:35.205650+0000","last_fullsized":"2023-07-05T23:33:35.205650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:43:25.294641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'39","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.297828+0000","last_change":"2023-07-05T23:32:53.339739+0000","last_active":"2023-07-05T23:35:17.297828+0000","last_peered":"2023-07-05T23:35:17.297828+0000","last_clean":"2023-07-05T23:35:17.297828+0000","last_became_active":"2023-07-05T23:32:53.339464+0000","last_became_peered":"2023-07-05T23:32:53.339464+0000","last_unstale":"2023-07-05T23:35:17.297828+0000","last_undegraded":"2023-07-05T23:35:17.297828+0000","last_fullsized":"2023-07-05T23:35:17.297828+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:53:37.219658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"30'446","reported_seq":464,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:13.540073+0000","last_change":"2023-07-05T23:32:57.354002+0000","last_active":"2023-07-05T23:35:13.540073+0000","last_peered":"2023-07-05T23:35:13.540073+0000","last_clean":"2023-07-05T23:35:13.540073+0000","last_became_active":"2023-07-05T23:32:57.353465+0000","last_became_peered":"2023-07-05T23:32:57.353465+0000","last_unstale":"2023-07-05T23:35:13.540073+0000","last_undegraded":"2023-07-05T23:35:13.540073+0000","last_fullsized":"2023-07-05T23:35:13.540073+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:14:15.951550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.229178+0000","last_change":"2023-07-05T23:32:52.909685+0000","last_active":"2023-07-05T23:33:35.229178+0000","last_peered":"2023-07-05T23:33:35.229178+0000","last_clean":"2023-07-05T23:33:35.229178+0000","last_became_active":"2023-07-05T23:32:52.909347+0000","last_became_peered":"2023-07-05T23:32:52.909347+0000","last_unstale":"2023-07-05T23:33:35.229178+0000","last_undegraded":"2023-07-05T23:33:35.229178+0000","last_fullsized":"2023-07-05T23:33:35.229178+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:06:28.570968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"30'31","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.290708+0000","last_change":"2023-07-05T23:32:53.339219+0000","last_active":"2023-07-05T23:35:17.290708+0000","last_peered":"2023-07-05T23:35:17.290708+0000","last_clean":"2023-07-05T23:35:17.290708+0000","last_became_active":"2023-07-05T23:32:53.338825+0000","last_became_peered":"2023-07-05T23:32:53.338825+0000","last_unstale":"2023-07-05T23:35:17.290708+0000","last_undegraded":"2023-07-05T23:35:17.290708+0000","last_fullsized":"2023-07-05T23:35:17.290708+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:09:56.721492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"30'462","reported_seq":480,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.496181+0000","last_change":"2023-07-05T23:32:57.359406+0000","last_active":"2023-07-05T23:35:17.496181+0000","last_peered":"2023-07-05T23:35:17.496181+0000","last_clean":"2023-07-05T23:35:17.496181+0000","last_became_active":"2023-07-05T23:32:57.358965+0000","last_became_peered":"2023-07-05T23:32:57.358965+0000","last_unstale":"2023-07-05T23:35:17.496181+0000","last_undegraded":"2023-07-05T23:35:17.496181+0000","last_fullsized":"2023-07-05T23:35:17.496181+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:00:45.855064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"30'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:10.408606+0000","last_change":"2023-07-05T23:32:52.909226+0000","last_active":"2023-07-05T23:35:10.408606+0000","last_peered":"2023-07-05T23:35:10.408606+0000","last_clean":"2023-07-05T23:35:10.408606+0000","last_became_active":"2023-07-05T23:32:52.908756+0000","last_became_peered":"2023-07-05T23:32:52.908756+0000","last_unstale":"2023-07-05T23:35:10.408606+0000","last_undegraded":"2023-07-05T23:35:10.408606+0000","last_fullsized":"2023-07-05T23:35:10.408606+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:11:59.892651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"30'30","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.286831+0000","last_change":"2023-07-05T23:32:53.337872+0000","last_active":"2023-07-05T23:35:17.286831+0000","last_peered":"2023-07-05T23:35:17.286831+0000","last_clean":"2023-07-05T23:35:17.286831+0000","last_became_active":"2023-07-05T23:32:53.337480+0000","last_became_peered":"2023-07-05T23:32:53.337480+0000","last_unstale":"2023-07-05T23:35:17.286831+0000","last_undegraded":"2023-07-05T23:35:17.286831+0000","last_fullsized":"2023-07-05T23:35:17.286831+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:19:33.519319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"30'473","reported_seq":491,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:13.560373+0000","last_change":"2023-07-05T23:32:57.356296+0000","last_active":"2023-07-05T23:35:13.560373+0000","last_peered":"2023-07-05T23:35:13.560373+0000","last_clean":"2023-07-05T23:35:13.560373+0000","last_became_active":"2023-07-05T23:32:57.355940+0000","last_became_peered":"2023-07-05T23:32:57.355940+0000","last_unstale":"2023-07-05T23:35:13.560373+0000","last_undegraded":"2023-07-05T23:35:13.560373+0000","last_fullsized":"2023-07-05T23:35:13.560373+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:37:49.101240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"30'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:02.470188+0000","last_change":"2023-07-05T23:32:52.904533+0000","last_active":"2023-07-05T23:35:02.470188+0000","last_peered":"2023-07-05T23:35:02.470188+0000","last_clean":"2023-07-05T23:35:02.470188+0000","last_became_active":"2023-07-05T23:32:52.904140+0000","last_became_peered":"2023-07-05T23:32:52.904140+0000","last_unstale":"2023-07-05T23:35:02.470188+0000","last_undegraded":"2023-07-05T23:35:02.470188+0000","last_fullsized":"2023-07-05T23:35:02.470188+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:47:23.267517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"30'27","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.298056+0000","last_change":"2023-07-05T23:32:53.338517+0000","last_active":"2023-07-05T23:35:17.298056+0000","last_peered":"2023-07-05T23:35:17.298056+0000","last_clean":"2023-07-05T23:35:17.298056+0000","last_became_active":"2023-07-05T23:32:53.338248+0000","last_became_peered":"2023-07-05T23:32:53.338248+0000","last_unstale":"2023-07-05T23:35:17.298056+0000","last_undegraded":"2023-07-05T23:35:17.298056+0000","last_fullsized":"2023-07-05T23:35:17.298056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:27:22.570990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"30'457","reported_seq":475,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.500266+0000","last_change":"2023-07-05T23:32:57.357483+0000","last_active":"2023-07-05T23:35:17.500266+0000","last_peered":"2023-07-05T23:35:17.500266+0000","last_clean":"2023-07-05T23:35:17.500266+0000","last_became_active":"2023-07-05T23:32:57.357039+0000","last_became_peered":"2023-07-05T23:32:57.357039+0000","last_unstale":"2023-07-05T23:35:17.500266+0000","last_undegraded":"2023-07-05T23:35:17.500266+0000","last_fullsized":"2023-07-05T23:35:17.500266+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:34:47.174905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:34.898028+0000","last_change":"2023-07-05T23:32:52.900665+0000","last_active":"2023-07-05T23:33:34.898028+0000","last_peered":"2023-07-05T23:33:34.898028+0000","last_clean":"2023-07-05T23:33:34.898028+0000","last_became_active":"2023-07-05T23:32:52.900352+0000","last_became_peered":"2023-07-05T23:32:52.900352+0000","last_unstale":"2023-07-05T23:33:34.898028+0000","last_undegraded":"2023-07-05T23:33:34.898028+0000","last_fullsized":"2023-07-05T23:33:34.898028+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:30:46.205291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"30'36","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.291274+0000","last_change":"2023-07-05T23:32:53.346621+0000","last_active":"2023-07-05T23:35:17.291274+0000","last_peered":"2023-07-05T23:35:17.291274+0000","last_clean":"2023-07-05T23:35:17.291274+0000","last_became_active":"2023-07-05T23:32:53.346373+0000","last_became_peered":"2023-07-05T23:32:53.346373+0000","last_unstale":"2023-07-05T23:35:17.291274+0000","last_undegraded":"2023-07-05T23:35:17.291274+0000","last_fullsized":"2023-07-05T23:35:17.291274+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:19:45.125125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"30'483","reported_seq":501,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.512457+0000","last_change":"2023-07-05T23:32:57.365669+0000","last_active":"2023-07-05T23:35:17.512457+0000","last_peered":"2023-07-05T23:35:17.512457+0000","last_clean":"2023-07-05T23:35:17.512457+0000","last_became_active":"2023-07-05T23:32:57.365200+0000","last_became_peered":"2023-07-05T23:32:57.365200+0000","last_unstale":"2023-07-05T23:35:17.512457+0000","last_undegraded":"2023-07-05T23:35:17.512457+0000","last_fullsized":"2023-07-05T23:35:17.512457+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:29:56.164375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"30'13","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.520762+0000","last_change":"2023-07-05T23:32:52.913055+0000","last_active":"2023-07-05T23:35:17.520762+0000","last_peered":"2023-07-05T23:35:17.520762+0000","last_clean":"2023-07-05T23:35:17.520762+0000","last_became_active":"2023-07-05T23:32:52.912749+0000","last_became_peered":"2023-07-05T23:32:52.912749+0000","last_unstale":"2023-07-05T23:35:17.520762+0000","last_undegraded":"2023-07-05T23:35:17.520762+0000","last_fullsized":"2023-07-05T23:35:17.520762+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:30:01.986422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"30'42","reported_seq":66,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.295913+0000","last_change":"2023-07-05T23:32:53.339331+0000","last_active":"2023-07-05T23:35:17.295913+0000","last_peered":"2023-07-05T23:35:17.295913+0000","last_clean":"2023-07-05T23:35:17.295913+0000","last_became_active":"2023-07-05T23:32:53.339001+0000","last_became_peered":"2023-07-05T23:32:53.339001+0000","last_unstale":"2023-07-05T23:35:17.295913+0000","last_undegraded":"2023-07-05T23:35:17.295913+0000","last_fullsized":"2023-07-05T23:35:17.295913+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:55:46.508107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"30'476","reported_seq":494,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.509437+0000","last_change":"2023-07-05T23:32:57.354307+0000","last_active":"2023-07-05T23:35:17.509437+0000","last_peered":"2023-07-05T23:35:17.509437+0000","last_clean":"2023-07-05T23:35:17.509437+0000","last_became_active":"2023-07-05T23:32:57.353848+0000","last_became_peered":"2023-07-05T23:32:57.353848+0000","last_unstale":"2023-07-05T23:35:17.509437+0000","last_undegraded":"2023-07-05T23:35:17.509437+0000","last_fullsized":"2023-07-05T23:35:17.509437+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":476,"log_dups_size":0,"ondisk_log_size":476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:13:40.247704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"30'379","reported_seq":405,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.923904+0000","last_change":"2023-07-05T23:32:52.904627+0000","last_active":"2023-07-05T23:35:17.923904+0000","last_peered":"2023-07-05T23:35:17.923904+0000","last_clean":"2023-07-05T23:35:17.923904+0000","last_became_active":"2023-07-05T23:32:52.904318+0000","last_became_peered":"2023-07-05T23:32:52.904318+0000","last_unstale":"2023-07-05T23:35:17.923904+0000","last_undegraded":"2023-07-05T23:35:17.923904+0000","last_fullsized":"2023-07-05T23:35:17.923904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:14:59.460164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1473117,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":378,"num_write_kb":1701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"30'41","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.288023+0000","last_change":"2023-07-05T23:32:53.339884+0000","last_active":"2023-07-05T23:35:17.288023+0000","last_peered":"2023-07-05T23:35:17.288023+0000","last_clean":"2023-07-05T23:35:17.288023+0000","last_became_active":"2023-07-05T23:32:53.339583+0000","last_became_peered":"2023-07-05T23:32:53.339583+0000","last_unstale":"2023-07-05T23:35:17.288023+0000","last_undegraded":"2023-07-05T23:35:17.288023+0000","last_fullsized":"2023-07-05T23:35:17.288023+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:41:33.847577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"30'441","reported_seq":458,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.508825+0000","last_change":"2023-07-05T23:32:57.365703+0000","last_active":"2023-07-05T23:35:17.508825+0000","last_peered":"2023-07-05T23:35:17.508825+0000","last_clean":"2023-07-05T23:35:17.508825+0000","last_became_active":"2023-07-05T23:32:57.365204+0000","last_became_peered":"2023-07-05T23:32:57.365204+0000","last_unstale":"2023-07-05T23:35:17.508825+0000","last_undegraded":"2023-07-05T23:35:17.508825+0000","last_fullsized":"2023-07-05T23:35:17.508825+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:10:37.483135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"30'3","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:06.836727+0000","last_change":"2023-07-05T23:32:52.908276+0000","last_active":"2023-07-05T23:35:06.836727+0000","last_peered":"2023-07-05T23:35:06.836727+0000","last_clean":"2023-07-05T23:35:06.836727+0000","last_became_active":"2023-07-05T23:32:52.907970+0000","last_became_peered":"2023-07-05T23:32:52.907970+0000","last_unstale":"2023-07-05T23:35:06.836727+0000","last_undegraded":"2023-07-05T23:35:06.836727+0000","last_fullsized":"2023-07-05T23:35:06.836727+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:09:05.816729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"30'29","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.298251+0000","last_change":"2023-07-05T23:32:53.340093+0000","last_active":"2023-07-05T23:35:17.298251+0000","last_peered":"2023-07-05T23:35:17.298251+0000","last_clean":"2023-07-05T23:35:17.298251+0000","last_became_active":"2023-07-05T23:32:53.339827+0000","last_became_peered":"2023-07-05T23:32:53.339827+0000","last_unstale":"2023-07-05T23:35:17.298251+0000","last_undegraded":"2023-07-05T23:35:17.298251+0000","last_fullsized":"2023-07-05T23:35:17.298251+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:10:34.043441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"30'475","reported_seq":493,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.505749+0000","last_change":"2023-07-05T23:32:57.354664+0000","last_active":"2023-07-05T23:35:17.505749+0000","last_peered":"2023-07-05T23:35:17.505749+0000","last_clean":"2023-07-05T23:35:17.505749+0000","last_became_active":"2023-07-05T23:32:57.354235+0000","last_became_peered":"2023-07-05T23:32:57.354235+0000","last_unstale":"2023-07-05T23:35:17.505749+0000","last_undegraded":"2023-07-05T23:35:17.505749+0000","last_fullsized":"2023-07-05T23:35:17.505749+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:35:51.306550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.228314+0000","last_change":"2023-07-05T23:32:52.900677+0000","last_active":"2023-07-05T23:33:35.228314+0000","last_peered":"2023-07-05T23:33:35.228314+0000","last_clean":"2023-07-05T23:33:35.228314+0000","last_became_active":"2023-07-05T23:32:52.900387+0000","last_became_peered":"2023-07-05T23:32:52.900387+0000","last_unstale":"2023-07-05T23:33:35.228314+0000","last_undegraded":"2023-07-05T23:33:35.228314+0000","last_fullsized":"2023-07-05T23:33:35.228314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:02:05.581169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"30'33","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.286491+0000","last_change":"2023-07-05T23:32:53.335865+0000","last_active":"2023-07-05T23:35:17.286491+0000","last_peered":"2023-07-05T23:35:17.286491+0000","last_clean":"2023-07-05T23:35:17.286491+0000","last_became_active":"2023-07-05T23:32:53.335513+0000","last_became_peered":"2023-07-05T23:32:53.335513+0000","last_unstale":"2023-07-05T23:35:17.286491+0000","last_undegraded":"2023-07-05T23:35:17.286491+0000","last_fullsized":"2023-07-05T23:35:17.286491+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:29:52.724682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"30'450","reported_seq":467,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:13.488697+0000","last_change":"2023-07-05T23:32:57.362840+0000","last_active":"2023-07-05T23:35:13.488697+0000","last_peered":"2023-07-05T23:35:13.488697+0000","last_clean":"2023-07-05T23:35:13.488697+0000","last_became_active":"2023-07-05T23:32:57.362407+0000","last_became_peered":"2023-07-05T23:32:57.362407+0000","last_unstale":"2023-07-05T23:35:13.488697+0000","last_undegraded":"2023-07-05T23:35:13.488697+0000","last_fullsized":"2023-07-05T23:35:13.488697+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:30:50.649322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"30'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:06.833400+0000","last_change":"2023-07-05T23:32:52.905899+0000","last_active":"2023-07-05T23:35:06.833400+0000","last_peered":"2023-07-05T23:35:06.833400+0000","last_clean":"2023-07-05T23:35:06.833400+0000","last_became_active":"2023-07-05T23:32:52.905595+0000","last_became_peered":"2023-07-05T23:32:52.905595+0000","last_unstale":"2023-07-05T23:35:06.833400+0000","last_undegraded":"2023-07-05T23:35:06.833400+0000","last_fullsized":"2023-07-05T23:35:06.833400+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:55:45.503769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"30'40","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.492800+0000","last_change":"2023-07-05T23:32:53.342284+0000","last_active":"2023-07-05T23:35:17.492800+0000","last_peered":"2023-07-05T23:35:17.492800+0000","last_clean":"2023-07-05T23:35:17.492800+0000","last_became_active":"2023-07-05T23:32:53.342033+0000","last_became_peered":"2023-07-05T23:32:53.342033+0000","last_unstale":"2023-07-05T23:35:17.492800+0000","last_undegraded":"2023-07-05T23:35:17.492800+0000","last_fullsized":"2023-07-05T23:35:17.492800+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:19:45.125125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"30'495","reported_seq":512,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.515835+0000","last_change":"2023-07-05T23:32:57.360505+0000","last_active":"2023-07-05T23:35:17.515835+0000","last_peered":"2023-07-05T23:35:17.515835+0000","last_clean":"2023-07-05T23:35:17.515835+0000","last_became_active":"2023-07-05T23:32:57.359532+0000","last_became_peered":"2023-07-05T23:32:57.359532+0000","last_unstale":"2023-07-05T23:35:17.515835+0000","last_undegraded":"2023-07-05T23:35:17.515835+0000","last_fullsized":"2023-07-05T23:35:17.515835+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:48:54.916611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":46080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.228388+0000","last_change":"2023-07-05T23:32:52.903656+0000","last_active":"2023-07-05T23:33:35.228388+0000","last_peered":"2023-07-05T23:33:35.228388+0000","last_clean":"2023-07-05T23:33:35.228388+0000","last_became_active":"2023-07-05T23:32:52.903419+0000","last_became_peered":"2023-07-05T23:32:52.903419+0000","last_unstale":"2023-07-05T23:33:35.228388+0000","last_undegraded":"2023-07-05T23:33:35.228388+0000","last_fullsized":"2023-07-05T23:33:35.228388+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:32:23.940560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"30'32","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.291705+0000","last_change":"2023-07-05T23:32:53.341509+0000","last_active":"2023-07-05T23:35:17.291705+0000","last_peered":"2023-07-05T23:35:17.291705+0000","last_clean":"2023-07-05T23:35:17.291705+0000","last_became_active":"2023-07-05T23:32:53.341162+0000","last_became_peered":"2023-07-05T23:32:53.341162+0000","last_unstale":"2023-07-05T23:35:17.291705+0000","last_undegraded":"2023-07-05T23:35:17.291705+0000","last_fullsized":"2023-07-05T23:35:17.291705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:34:18.782861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"30'445","reported_seq":463,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:15.505583+0000","last_change":"2023-07-05T23:32:57.358009+0000","last_active":"2023-07-05T23:35:15.505583+0000","last_peered":"2023-07-05T23:35:15.505583+0000","last_clean":"2023-07-05T23:35:15.505583+0000","last_became_active":"2023-07-05T23:32:57.357082+0000","last_became_peered":"2023-07-05T23:32:57.357082+0000","last_unstale":"2023-07-05T23:35:15.505583+0000","last_undegraded":"2023-07-05T23:35:15.505583+0000","last_fullsized":"2023-07-05T23:35:15.505583+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:37:40.938898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.011998+0000","last_change":"2023-07-05T23:32:52.907916+0000","last_active":"2023-07-05T23:33:35.011998+0000","last_peered":"2023-07-05T23:33:35.011998+0000","last_clean":"2023-07-05T23:33:35.011998+0000","last_became_active":"2023-07-05T23:32:52.907397+0000","last_became_peered":"2023-07-05T23:32:52.907397+0000","last_unstale":"2023-07-05T23:33:35.011998+0000","last_undegraded":"2023-07-05T23:33:35.011998+0000","last_fullsized":"2023-07-05T23:33:35.011998+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:34:31.075112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"30'29","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.286802+0000","last_change":"2023-07-05T23:32:53.334487+0000","last_active":"2023-07-05T23:35:17.286802+0000","last_peered":"2023-07-05T23:35:17.286802+0000","last_clean":"2023-07-05T23:35:17.286802+0000","last_became_active":"2023-07-05T23:32:53.333978+0000","last_became_peered":"2023-07-05T23:32:53.333978+0000","last_unstale":"2023-07-05T23:35:17.286802+0000","last_undegraded":"2023-07-05T23:35:17.286802+0000","last_fullsized":"2023-07-05T23:35:17.286802+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:09:06.821067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"30'423","reported_seq":441,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:15.493883+0000","last_change":"2023-07-05T23:32:57.362413+0000","last_active":"2023-07-05T23:35:15.493883+0000","last_peered":"2023-07-05T23:35:15.493883+0000","last_clean":"2023-07-05T23:35:15.493883+0000","last_became_active":"2023-07-05T23:32:57.361892+0000","last_became_peered":"2023-07-05T23:32:57.361892+0000","last_unstale":"2023-07-05T23:35:15.493883+0000","last_undegraded":"2023-07-05T23:35:15.493883+0000","last_fullsized":"2023-07-05T23:35:15.493883+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:23:07.824943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.011790+0000","last_change":"2023-07-05T23:32:52.908261+0000","last_active":"2023-07-05T23:33:35.011790+0000","last_peered":"2023-07-05T23:33:35.011790+0000","last_clean":"2023-07-05T23:33:35.011790+0000","last_became_active":"2023-07-05T23:32:52.907975+0000","last_became_peered":"2023-07-05T23:32:52.907975+0000","last_unstale":"2023-07-05T23:33:35.011790+0000","last_undegraded":"2023-07-05T23:33:35.011790+0000","last_fullsized":"2023-07-05T23:33:35.011790+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:27:21.566652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"30'32","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.297535+0000","last_change":"2023-07-05T23:32:53.339917+0000","last_active":"2023-07-05T23:35:17.297535+0000","last_peered":"2023-07-05T23:35:17.297535+0000","last_clean":"2023-07-05T23:35:17.297535+0000","last_became_active":"2023-07-05T23:32:53.339543+0000","last_became_peered":"2023-07-05T23:32:53.339543+0000","last_unstale":"2023-07-05T23:35:17.297535+0000","last_undegraded":"2023-07-05T23:35:17.297535+0000","last_fullsized":"2023-07-05T23:35:17.297535+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:49:46.894720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"30'472","reported_seq":490,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.505904+0000","last_change":"2023-07-05T23:32:57.361110+0000","last_active":"2023-07-05T23:35:17.505904+0000","last_peered":"2023-07-05T23:35:17.505904+0000","last_clean":"2023-07-05T23:35:17.505904+0000","last_became_active":"2023-07-05T23:32:57.360614+0000","last_became_peered":"2023-07-05T23:32:57.360614+0000","last_unstale":"2023-07-05T23:35:17.505904+0000","last_undegraded":"2023-07-05T23:35:17.505904+0000","last_fullsized":"2023-07-05T23:35:17.505904+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:11:32.788099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.011936+0000","last_change":"2023-07-05T23:32:52.907840+0000","last_active":"2023-07-05T23:33:35.011936+0000","last_peered":"2023-07-05T23:33:35.011936+0000","last_clean":"2023-07-05T23:33:35.011936+0000","last_became_active":"2023-07-05T23:32:52.907441+0000","last_became_peered":"2023-07-05T23:32:52.907441+0000","last_unstale":"2023-07-05T23:33:35.011936+0000","last_undegraded":"2023-07-05T23:33:35.011936+0000","last_fullsized":"2023-07-05T23:33:35.011936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:55:01.034913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"30'32","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.298040+0000","last_change":"2023-07-05T23:32:53.343984+0000","last_active":"2023-07-05T23:35:17.298040+0000","last_peered":"2023-07-05T23:35:17.298040+0000","last_clean":"2023-07-05T23:35:17.298040+0000","last_became_active":"2023-07-05T23:32:53.343566+0000","last_became_peered":"2023-07-05T23:32:53.343566+0000","last_unstale":"2023-07-05T23:35:17.298040+0000","last_undegraded":"2023-07-05T23:35:17.298040+0000","last_fullsized":"2023-07-05T23:35:17.298040+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:27:59.144444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"30'486","reported_seq":504,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.489657+0000","last_change":"2023-07-05T23:32:57.356615+0000","last_active":"2023-07-05T23:35:17.489657+0000","last_peered":"2023-07-05T23:35:17.489657+0000","last_clean":"2023-07-05T23:35:17.489657+0000","last_became_active":"2023-07-05T23:32:57.356091+0000","last_became_peered":"2023-07-05T23:32:57.356091+0000","last_unstale":"2023-07-05T23:35:17.489657+0000","last_undegraded":"2023-07-05T23:35:17.489657+0000","last_fullsized":"2023-07-05T23:35:17.489657+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:10:51.090665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"30'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:02.479617+0000","last_change":"2023-07-05T23:32:52.906210+0000","last_active":"2023-07-05T23:35:02.479617+0000","last_peered":"2023-07-05T23:35:02.479617+0000","last_clean":"2023-07-05T23:35:02.479617+0000","last_became_active":"2023-07-05T23:32:52.905988+0000","last_became_peered":"2023-07-05T23:32:52.905988+0000","last_unstale":"2023-07-05T23:35:02.479617+0000","last_undegraded":"2023-07-05T23:35:02.479617+0000","last_fullsized":"2023-07-05T23:35:02.479617+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:30:01.986422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"30'32","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.296814+0000","last_change":"2023-07-05T23:32:53.339662+0000","last_active":"2023-07-05T23:35:17.296814+0000","last_peered":"2023-07-05T23:35:17.296814+0000","last_clean":"2023-07-05T23:35:17.296814+0000","last_became_active":"2023-07-05T23:32:53.339382+0000","last_became_peered":"2023-07-05T23:32:53.339382+0000","last_unstale":"2023-07-05T23:35:17.296814+0000","last_undegraded":"2023-07-05T23:35:17.296814+0000","last_fullsized":"2023-07-05T23:35:17.296814+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:06:29.575306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"30'472","reported_seq":490,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.510914+0000","last_change":"2023-07-05T23:32:57.354958+0000","last_active":"2023-07-05T23:35:17.510914+0000","last_peered":"2023-07-05T23:35:17.510914+0000","last_clean":"2023-07-05T23:35:17.510914+0000","last_became_active":"2023-07-05T23:32:57.354576+0000","last_became_peered":"2023-07-05T23:32:57.354576+0000","last_unstale":"2023-07-05T23:35:17.510914+0000","last_undegraded":"2023-07-05T23:35:17.510914+0000","last_fullsized":"2023-07-05T23:35:17.510914+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:32:54.986804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":27648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"30'4","reported_seq":30,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:05.478083+0000","last_change":"2023-07-05T23:32:52.906470+0000","last_active":"2023-07-05T23:35:05.478083+0000","last_peered":"2023-07-05T23:35:05.478083+0000","last_clean":"2023-07-05T23:35:05.478083+0000","last_became_active":"2023-07-05T23:32:52.906187+0000","last_became_peered":"2023-07-05T23:32:52.906187+0000","last_unstale":"2023-07-05T23:35:05.478083+0000","last_undegraded":"2023-07-05T23:35:05.478083+0000","last_fullsized":"2023-07-05T23:35:05.478083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:34:31.075112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"30'27","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.291461+0000","last_change":"2023-07-05T23:32:53.344178+0000","last_active":"2023-07-05T23:35:17.291461+0000","last_peered":"2023-07-05T23:35:17.291461+0000","last_clean":"2023-07-05T23:35:17.291461+0000","last_became_active":"2023-07-05T23:32:53.343393+0000","last_became_peered":"2023-07-05T23:32:53.343393+0000","last_unstale":"2023-07-05T23:35:17.291461+0000","last_undegraded":"2023-07-05T23:35:17.291461+0000","last_fullsized":"2023-07-05T23:35:17.291461+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:26:46.815538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"30'457","reported_seq":475,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:13.558128+0000","last_change":"2023-07-05T23:32:57.362812+0000","last_active":"2023-07-05T23:35:13.558128+0000","last_peered":"2023-07-05T23:35:13.558128+0000","last_clean":"2023-07-05T23:35:13.558128+0000","last_became_active":"2023-07-05T23:32:57.362431+0000","last_became_peered":"2023-07-05T23:32:57.362431+0000","last_unstale":"2023-07-05T23:35:13.558128+0000","last_undegraded":"2023-07-05T23:35:13.558128+0000","last_fullsized":"2023-07-05T23:35:13.558128+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:37:40.938898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"30'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:05.621978+0000","last_change":"2023-07-05T23:32:52.908272+0000","last_active":"2023-07-05T23:35:05.621978+0000","last_peered":"2023-07-05T23:35:05.621978+0000","last_clean":"2023-07-05T23:35:05.621978+0000","last_became_active":"2023-07-05T23:32:52.907983+0000","last_became_peered":"2023-07-05T23:32:52.907983+0000","last_unstale":"2023-07-05T23:35:05.621978+0000","last_undegraded":"2023-07-05T23:35:05.621978+0000","last_fullsized":"2023-07-05T23:35:05.621978+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:01:15.727729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"30'30","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.292814+0000","last_change":"2023-07-05T23:32:53.339766+0000","last_active":"2023-07-05T23:35:17.292814+0000","last_peered":"2023-07-05T23:35:17.292814+0000","last_clean":"2023-07-05T23:35:17.292814+0000","last_became_active":"2023-07-05T23:32:53.338903+0000","last_became_peered":"2023-07-05T23:32:53.338903+0000","last_unstale":"2023-07-05T23:35:17.292814+0000","last_undegraded":"2023-07-05T23:35:17.292814+0000","last_fullsized":"2023-07-05T23:35:17.292814+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:21:39.351826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'492","reported_seq":510,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.249961+0000","last_change":"2023-07-05T23:32:57.357001+0000","last_active":"2023-07-05T23:35:17.249961+0000","last_peered":"2023-07-05T23:35:17.249961+0000","last_clean":"2023-07-05T23:35:17.249961+0000","last_became_active":"2023-07-05T23:32:57.356611+0000","last_became_peered":"2023-07-05T23:32:57.356611+0000","last_unstale":"2023-07-05T23:35:17.249961+0000","last_undegraded":"2023-07-05T23:35:17.249961+0000","last_fullsized":"2023-07-05T23:35:17.249961+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:18:00.591410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":51200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.205209+0000","last_change":"2023-07-05T23:32:52.907064+0000","last_active":"2023-07-05T23:33:35.205209+0000","last_peered":"2023-07-05T23:33:35.205209+0000","last_clean":"2023-07-05T23:33:35.205209+0000","last_became_active":"2023-07-05T23:32:52.906779+0000","last_became_peered":"2023-07-05T23:32:52.906779+0000","last_unstale":"2023-07-05T23:33:35.205209+0000","last_undegraded":"2023-07-05T23:33:35.205209+0000","last_fullsized":"2023-07-05T23:33:35.205209+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:21:56.357294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"30'17","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.286793+0000","last_change":"2023-07-05T23:32:53.341824+0000","last_active":"2023-07-05T23:35:17.286793+0000","last_peered":"2023-07-05T23:35:17.286793+0000","last_clean":"2023-07-05T23:35:17.286793+0000","last_became_active":"2023-07-05T23:32:53.339869+0000","last_became_peered":"2023-07-05T23:32:53.339869+0000","last_unstale":"2023-07-05T23:35:17.286793+0000","last_undegraded":"2023-07-05T23:35:17.286793+0000","last_fullsized":"2023-07-05T23:35:17.286793+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:06:11.729572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"30'497","reported_seq":515,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.515460+0000","last_change":"2023-07-05T23:32:57.363813+0000","last_active":"2023-07-05T23:35:17.515460+0000","last_peered":"2023-07-05T23:35:17.515460+0000","last_clean":"2023-07-05T23:35:17.515460+0000","last_became_active":"2023-07-05T23:32:57.363409+0000","last_became_peered":"2023-07-05T23:32:57.363409+0000","last_unstale":"2023-07-05T23:35:17.515460+0000","last_undegraded":"2023-07-05T23:35:17.515460+0000","last_fullsized":"2023-07-05T23:35:17.515460+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":497,"log_dups_size":0,"ondisk_log_size":497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:07:41.069844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.229959+0000","last_change":"2023-07-05T23:32:52.910057+0000","last_active":"2023-07-05T23:33:35.229959+0000","last_peered":"2023-07-05T23:33:35.229959+0000","last_clean":"2023-07-05T23:33:35.229959+0000","last_became_active":"2023-07-05T23:32:52.909169+0000","last_became_peered":"2023-07-05T23:32:52.909169+0000","last_unstale":"2023-07-05T23:33:35.229959+0000","last_undegraded":"2023-07-05T23:33:35.229959+0000","last_fullsized":"2023-07-05T23:33:35.229959+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:30:01.986422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"30'28","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.295091+0000","last_change":"2023-07-05T23:32:53.342851+0000","last_active":"2023-07-05T23:35:17.295091+0000","last_peered":"2023-07-05T23:35:17.295091+0000","last_clean":"2023-07-05T23:35:17.295091+0000","last_became_active":"2023-07-05T23:32:53.342420+0000","last_became_peered":"2023-07-05T23:32:53.342420+0000","last_unstale":"2023-07-05T23:35:17.295091+0000","last_undegraded":"2023-07-05T23:35:17.295091+0000","last_fullsized":"2023-07-05T23:35:17.295091+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:48:30.276766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"30'504","reported_seq":522,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.493016+0000","last_change":"2023-07-05T23:32:57.358997+0000","last_active":"2023-07-05T23:35:17.493016+0000","last_peered":"2023-07-05T23:35:17.493016+0000","last_clean":"2023-07-05T23:35:17.493016+0000","last_became_active":"2023-07-05T23:32:57.358647+0000","last_became_peered":"2023-07-05T23:32:57.358647+0000","last_unstale":"2023-07-05T23:35:17.493016+0000","last_undegraded":"2023-07-05T23:35:17.493016+0000","last_fullsized":"2023-07-05T23:35:17.493016+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:48:33.716459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.229445+0000","last_change":"2023-07-05T23:32:47.790871+0000","last_active":"2023-07-05T23:33:35.229445+0000","last_peered":"2023-07-05T23:33:35.229445+0000","last_clean":"2023-07-05T23:33:35.229445+0000","last_became_active":"2023-07-05T23:32:47.790546+0000","last_became_peered":"2023-07-05T23:32:47.790546+0000","last_unstale":"2023-07-05T23:33:35.229445+0000","last_undegraded":"2023-07-05T23:33:35.229445+0000","last_fullsized":"2023-07-05T23:33:35.229445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_clean_scrub_stamp":"2023-07-05T23:32:46.741565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:28:20.777630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"30'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:00.632835+0000","last_change":"2023-07-05T23:32:52.912985+0000","last_active":"2023-07-05T23:35:00.632835+0000","last_peered":"2023-07-05T23:35:00.632835+0000","last_clean":"2023-07-05T23:35:00.632835+0000","last_became_active":"2023-07-05T23:32:52.912682+0000","last_became_peered":"2023-07-05T23:32:52.912682+0000","last_unstale":"2023-07-05T23:35:00.632835+0000","last_undegraded":"2023-07-05T23:35:00.632835+0000","last_fullsized":"2023-07-05T23:35:00.632835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:19:27.040484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"30'30","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.295180+0000","last_change":"2023-07-05T23:32:53.335398+0000","last_active":"2023-07-05T23:35:17.295180+0000","last_peered":"2023-07-05T23:35:17.295180+0000","last_clean":"2023-07-05T23:35:17.295180+0000","last_became_active":"2023-07-05T23:32:53.335073+0000","last_became_peered":"2023-07-05T23:32:53.335073+0000","last_unstale":"2023-07-05T23:35:17.295180+0000","last_undegraded":"2023-07-05T23:35:17.295180+0000","last_fullsized":"2023-07-05T23:35:17.295180+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:02:06.585507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"30'450","reported_seq":468,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.485615+0000","last_change":"2023-07-05T23:32:57.368301+0000","last_active":"2023-07-05T23:35:17.485615+0000","last_peered":"2023-07-05T23:35:17.485615+0000","last_clean":"2023-07-05T23:35:17.485615+0000","last_became_active":"2023-07-05T23:32:57.368030+0000","last_became_peered":"2023-07-05T23:32:57.368030+0000","last_unstale":"2023-07-05T23:35:17.485615+0000","last_undegraded":"2023-07-05T23:35:17.485615+0000","last_fullsized":"2023-07-05T23:35:17.485615+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:55:49.947801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:34.897517+0000","last_change":"2023-07-05T23:32:47.762370+0000","last_active":"2023-07-05T23:33:34.897517+0000","last_peered":"2023-07-05T23:33:34.897517+0000","last_clean":"2023-07-05T23:33:34.897517+0000","last_became_active":"2023-07-05T23:32:47.761996+0000","last_became_peered":"2023-07-05T23:32:47.761996+0000","last_unstale":"2023-07-05T23:33:34.897517+0000","last_undegraded":"2023-07-05T23:33:34.897517+0000","last_fullsized":"2023-07-05T23:33:34.897517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_clean_scrub_stamp":"2023-07-05T23:32:46.741565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:27:16.430272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.206217+0000","last_change":"2023-07-05T23:32:52.904472+0000","last_active":"2023-07-05T23:33:35.206217+0000","last_peered":"2023-07-05T23:33:35.206217+0000","last_clean":"2023-07-05T23:33:35.206217+0000","last_became_active":"2023-07-05T23:32:52.904202+0000","last_became_peered":"2023-07-05T23:32:52.904202+0000","last_unstale":"2023-07-05T23:33:35.206217+0000","last_undegraded":"2023-07-05T23:33:35.206217+0000","last_fullsized":"2023-07-05T23:33:35.206217+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:21:26.927343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"30'30","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.295347+0000","last_change":"2023-07-05T23:32:53.341847+0000","last_active":"2023-07-05T23:35:17.295347+0000","last_peered":"2023-07-05T23:35:17.295347+0000","last_clean":"2023-07-05T23:35:17.295347+0000","last_became_active":"2023-07-05T23:32:53.338626+0000","last_became_peered":"2023-07-05T23:32:53.338626+0000","last_unstale":"2023-07-05T23:35:17.295347+0000","last_undegraded":"2023-07-05T23:35:17.295347+0000","last_fullsized":"2023-07-05T23:35:17.295347+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:09:06.821067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"30'489","reported_seq":507,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.487945+0000","last_change":"2023-07-05T23:32:57.356351+0000","last_active":"2023-07-05T23:35:17.487945+0000","last_peered":"2023-07-05T23:35:17.487945+0000","last_clean":"2023-07-05T23:35:17.487945+0000","last_became_active":"2023-07-05T23:32:57.355882+0000","last_became_peered":"2023-07-05T23:32:57.355882+0000","last_unstale":"2023-07-05T23:35:17.487945+0000","last_undegraded":"2023-07-05T23:35:17.487945+0000","last_fullsized":"2023-07-05T23:35:17.487945+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":489,"log_dups_size":0,"ondisk_log_size":489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:53:02.594417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":55296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:34.894615+0000","last_change":"2023-07-05T23:32:47.979611+0000","last_active":"2023-07-05T23:33:34.894615+0000","last_peered":"2023-07-05T23:33:34.894615+0000","last_clean":"2023-07-05T23:33:34.894615+0000","last_became_active":"2023-07-05T23:32:47.979348+0000","last_became_peered":"2023-07-05T23:32:47.979348+0000","last_unstale":"2023-07-05T23:33:34.894615+0000","last_undegraded":"2023-07-05T23:33:34.894615+0000","last_fullsized":"2023-07-05T23:33:34.894615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_clean_scrub_stamp":"2023-07-05T23:32:46.741565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:49:32.444450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.228652+0000","last_change":"2023-07-05T23:32:52.907652+0000","last_active":"2023-07-05T23:33:35.228652+0000","last_peered":"2023-07-05T23:33:35.228652+0000","last_clean":"2023-07-05T23:33:35.228652+0000","last_became_active":"2023-07-05T23:32:52.907307+0000","last_became_peered":"2023-07-05T23:32:52.907307+0000","last_unstale":"2023-07-05T23:33:35.228652+0000","last_undegraded":"2023-07-05T23:33:35.228652+0000","last_fullsized":"2023-07-05T23:33:35.228652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:50:56.145233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"30'29","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.295251+0000","last_change":"2023-07-05T23:32:53.338185+0000","last_active":"2023-07-05T23:35:17.295251+0000","last_peered":"2023-07-05T23:35:17.295251+0000","last_clean":"2023-07-05T23:35:17.295251+0000","last_became_active":"2023-07-05T23:32:53.337896+0000","last_became_peered":"2023-07-05T23:32:53.337896+0000","last_unstale":"2023-07-05T23:35:17.295251+0000","last_undegraded":"2023-07-05T23:35:17.295251+0000","last_fullsized":"2023-07-05T23:35:17.295251+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-06T23:34:43.735212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"30'478","reported_seq":496,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:15.500629+0000","last_change":"2023-07-05T23:32:57.355885+0000","last_active":"2023-07-05T23:35:15.500629+0000","last_peered":"2023-07-05T23:35:15.500629+0000","last_clean":"2023-07-05T23:35:15.500629+0000","last_became_active":"2023-07-05T23:32:57.355475+0000","last_became_peered":"2023-07-05T23:32:57.355475+0000","last_unstale":"2023-07-05T23:35:15.500629+0000","last_undegraded":"2023-07-05T23:35:15.500629+0000","last_fullsized":"2023-07-05T23:35:15.500629+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:19:48.564819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:34.897784+0000","last_change":"2023-07-05T23:32:47.761727+0000","last_active":"2023-07-05T23:33:34.897784+0000","last_peered":"2023-07-05T23:33:34.897784+0000","last_clean":"2023-07-05T23:33:34.897784+0000","last_became_active":"2023-07-05T23:32:47.761392+0000","last_became_peered":"2023-07-05T23:32:47.761392+0000","last_unstale":"2023-07-05T23:33:34.897784+0000","last_undegraded":"2023-07-05T23:33:34.897784+0000","last_fullsized":"2023-07-05T23:33:34.897784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_clean_scrub_stamp":"2023-07-05T23:32:46.741565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:35:41.726138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":188,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.011378+0000","last_change":"2023-07-05T23:32:42.737690+0000","last_active":"2023-07-05T23:33:35.011378+0000","last_peered":"2023-07-05T23:33:35.011378+0000","last_clean":"2023-07-05T23:33:35.011378+0000","last_became_active":"2023-07-05T23:32:42.736736+0000","last_became_peered":"2023-07-05T23:32:42.736736+0000","last_unstale":"2023-07-05T23:33:35.011378+0000","last_undegraded":"2023-07-05T23:33:35.011378+0000","last_fullsized":"2023-07-05T23:33:35.011378+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:41.674741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:41.674741+0000","last_clean_scrub_stamp":"2023-07-05T23:32:41.674741+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:28:15.710806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.230450+0000","last_change":"2023-07-05T23:32:52.912999+0000","last_active":"2023-07-05T23:33:35.230450+0000","last_peered":"2023-07-05T23:33:35.230450+0000","last_clean":"2023-07-05T23:33:35.230450+0000","last_became_active":"2023-07-05T23:32:52.912684+0000","last_became_peered":"2023-07-05T23:32:52.912684+0000","last_unstale":"2023-07-05T23:33:35.230450+0000","last_undegraded":"2023-07-05T23:33:35.230450+0000","last_fullsized":"2023-07-05T23:33:35.230450+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:17:56.147379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"30'32","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.283324+0000","last_change":"2023-07-05T23:32:53.344142+0000","last_active":"2023-07-05T23:35:17.283324+0000","last_peered":"2023-07-05T23:35:17.283324+0000","last_clean":"2023-07-05T23:35:17.283324+0000","last_became_active":"2023-07-05T23:32:53.343848+0000","last_became_peered":"2023-07-05T23:32:53.343848+0000","last_unstale":"2023-07-05T23:35:17.283324+0000","last_undegraded":"2023-07-05T23:35:17.283324+0000","last_fullsized":"2023-07-05T23:35:17.283324+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:21:04.019035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"30'453","reported_seq":471,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.495359+0000","last_change":"2023-07-05T23:32:57.366415+0000","last_active":"2023-07-05T23:35:17.495359+0000","last_peered":"2023-07-05T23:35:17.495359+0000","last_clean":"2023-07-05T23:35:17.495359+0000","last_became_active":"2023-07-05T23:32:57.365013+0000","last_became_peered":"2023-07-05T23:32:57.365013+0000","last_unstale":"2023-07-05T23:35:17.495359+0000","last_undegraded":"2023-07-05T23:35:17.495359+0000","last_fullsized":"2023-07-05T23:35:17.495359+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:12:04.336682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.011554+0000","last_change":"2023-07-05T23:32:47.767600+0000","last_active":"2023-07-05T23:33:35.011554+0000","last_peered":"2023-07-05T23:33:35.011554+0000","last_clean":"2023-07-05T23:33:35.011554+0000","last_became_active":"2023-07-05T23:32:47.767297+0000","last_became_peered":"2023-07-05T23:32:47.767297+0000","last_unstale":"2023-07-05T23:33:35.011554+0000","last_undegraded":"2023-07-05T23:33:35.011554+0000","last_fullsized":"2023-07-05T23:33:35.011554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_clean_scrub_stamp":"2023-07-05T23:32:46.741565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:00:36.274653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"30'16","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.481811+0000","last_change":"2023-07-05T23:32:52.906517+0000","last_active":"2023-07-05T23:35:17.481811+0000","last_peered":"2023-07-05T23:35:17.481811+0000","last_clean":"2023-07-05T23:35:17.481811+0000","last_became_active":"2023-07-05T23:32:52.906204+0000","last_became_peered":"2023-07-05T23:32:52.906204+0000","last_unstale":"2023-07-05T23:35:17.481811+0000","last_undegraded":"2023-07-05T23:35:17.481811+0000","last_fullsized":"2023-07-05T23:35:17.481811+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:38:48.811718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7752,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":17,"num_write":15,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"30'28","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.296608+0000","last_change":"2023-07-05T23:32:53.340334+0000","last_active":"2023-07-05T23:35:17.296608+0000","last_peered":"2023-07-05T23:35:17.296608+0000","last_clean":"2023-07-05T23:35:17.296608+0000","last_became_active":"2023-07-05T23:32:53.340061+0000","last_became_peered":"2023-07-05T23:32:53.340061+0000","last_unstale":"2023-07-05T23:35:17.296608+0000","last_undegraded":"2023-07-05T23:35:17.296608+0000","last_fullsized":"2023-07-05T23:35:17.296608+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:37:37.499204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"30'503","reported_seq":521,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.508773+0000","last_change":"2023-07-05T23:32:57.362424+0000","last_active":"2023-07-05T23:35:17.508773+0000","last_peered":"2023-07-05T23:35:17.508773+0000","last_clean":"2023-07-05T23:35:17.508773+0000","last_became_active":"2023-07-05T23:32:57.361941+0000","last_became_peered":"2023-07-05T23:32:57.361941+0000","last_unstale":"2023-07-05T23:35:17.508773+0000","last_undegraded":"2023-07-05T23:35:17.508773+0000","last_fullsized":"2023-07-05T23:35:17.508773+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":503,"log_dups_size":0,"ondisk_log_size":503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:11:35.842714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.011798+0000","last_change":"2023-07-05T23:32:47.790754+0000","last_active":"2023-07-05T23:33:35.011798+0000","last_peered":"2023-07-05T23:33:35.011798+0000","last_clean":"2023-07-05T23:33:35.011798+0000","last_became_active":"2023-07-05T23:32:47.790408+0000","last_became_peered":"2023-07-05T23:32:47.790408+0000","last_unstale":"2023-07-05T23:33:35.011798+0000","last_undegraded":"2023-07-05T23:33:35.011798+0000","last_fullsized":"2023-07-05T23:33:35.011798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_clean_scrub_stamp":"2023-07-05T23:32:46.741565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:47:18.131137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"30'2","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:04.468711+0000","last_change":"2023-07-05T23:32:52.908711+0000","last_active":"2023-07-05T23:35:04.468711+0000","last_peered":"2023-07-05T23:35:04.468711+0000","last_clean":"2023-07-05T23:35:04.468711+0000","last_became_active":"2023-07-05T23:32:52.908379+0000","last_became_peered":"2023-07-05T23:32:52.908379+0000","last_unstale":"2023-07-05T23:35:04.468711+0000","last_undegraded":"2023-07-05T23:35:04.468711+0000","last_fullsized":"2023-07-05T23:35:04.468711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:19:44.120787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"30'34","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.289521+0000","last_change":"2023-07-05T23:32:53.331042+0000","last_active":"2023-07-05T23:35:17.289521+0000","last_peered":"2023-07-05T23:35:17.289521+0000","last_clean":"2023-07-05T23:35:17.289521+0000","last_became_active":"2023-07-05T23:32:53.330771+0000","last_became_peered":"2023-07-05T23:32:53.330771+0000","last_unstale":"2023-07-05T23:35:17.289521+0000","last_undegraded":"2023-07-05T23:35:17.289521+0000","last_fullsized":"2023-07-05T23:35:17.289521+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:28:26.918347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"30'487","reported_seq":505,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:13.536118+0000","last_change":"2023-07-05T23:32:57.357223+0000","last_active":"2023-07-05T23:35:13.536118+0000","last_peered":"2023-07-05T23:35:13.536118+0000","last_clean":"2023-07-05T23:35:13.536118+0000","last_became_active":"2023-07-05T23:32:57.356797+0000","last_became_peered":"2023-07-05T23:32:57.356797+0000","last_unstale":"2023-07-05T23:35:13.536118+0000","last_undegraded":"2023-07-05T23:35:13.536118+0000","last_fullsized":"2023-07-05T23:35:13.536118+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:04:21.723966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"30'3","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:05.629762+0000","last_change":"2023-07-05T23:32:52.906030+0000","last_active":"2023-07-05T23:35:05.629762+0000","last_peered":"2023-07-05T23:35:05.629762+0000","last_clean":"2023-07-05T23:35:05.629762+0000","last_became_active":"2023-07-05T23:32:52.905704+0000","last_became_peered":"2023-07-05T23:32:52.905704+0000","last_unstale":"2023-07-05T23:35:05.629762+0000","last_undegraded":"2023-07-05T23:35:05.629762+0000","last_fullsized":"2023-07-05T23:35:05.629762+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:48:50.472580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.229743+0000","last_change":"2023-07-05T23:32:47.769126+0000","last_active":"2023-07-05T23:33:35.229743+0000","last_peered":"2023-07-05T23:33:35.229743+0000","last_clean":"2023-07-05T23:33:35.229743+0000","last_became_active":"2023-07-05T23:32:47.768844+0000","last_became_peered":"2023-07-05T23:32:47.768844+0000","last_unstale":"2023-07-05T23:33:35.229743+0000","last_undegraded":"2023-07-05T23:33:35.229743+0000","last_fullsized":"2023-07-05T23:33:35.229743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_clean_scrub_stamp":"2023-07-05T23:32:46.741565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:09:50.580774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"30'25","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.293263+0000","last_change":"2023-07-05T23:33:35.012743+0000","last_active":"2023-07-05T23:35:17.293263+0000","last_peered":"2023-07-05T23:35:17.293263+0000","last_clean":"2023-07-05T23:35:17.293263+0000","last_became_active":"2023-07-05T23:33:35.012290+0000","last_became_peered":"2023-07-05T23:33:35.012290+0000","last_unstale":"2023-07-05T23:35:17.293263+0000","last_undegraded":"2023-07-05T23:35:17.293263+0000","last_fullsized":"2023-07-05T23:35:17.293263+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:22:31.213068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"30'449","reported_seq":467,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.515551+0000","last_change":"2023-07-05T23:32:57.362654+0000","last_active":"2023-07-05T23:35:17.515551+0000","last_peered":"2023-07-05T23:35:17.515551+0000","last_clean":"2023-07-05T23:35:17.515551+0000","last_became_active":"2023-07-05T23:32:57.362112+0000","last_became_peered":"2023-07-05T23:32:57.362112+0000","last_unstale":"2023-07-05T23:35:17.515551+0000","last_undegraded":"2023-07-05T23:35:17.515551+0000","last_fullsized":"2023-07-05T23:35:17.515551+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:00:45.855064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":46080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.228846+0000","last_change":"2023-07-05T23:32:47.769537+0000","last_active":"2023-07-05T23:33:35.228846+0000","last_peered":"2023-07-05T23:33:35.228846+0000","last_clean":"2023-07-05T23:33:35.228846+0000","last_became_active":"2023-07-05T23:32:47.769141+0000","last_became_peered":"2023-07-05T23:32:47.769141+0000","last_unstale":"2023-07-05T23:33:35.228846+0000","last_undegraded":"2023-07-05T23:33:35.228846+0000","last_fullsized":"2023-07-05T23:33:35.228846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:46.741565+0000","last_clean_scrub_stamp":"2023-07-05T23:32:46.741565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:24:40.558028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"30'12","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:12.900717+0000","last_change":"2023-07-05T23:32:52.905759+0000","last_active":"2023-07-05T23:35:12.900717+0000","last_peered":"2023-07-05T23:35:12.900717+0000","last_clean":"2023-07-05T23:35:12.900717+0000","last_became_active":"2023-07-05T23:32:52.905451+0000","last_became_peered":"2023-07-05T23:32:52.905451+0000","last_unstale":"2023-07-05T23:35:12.900717+0000","last_undegraded":"2023-07-05T23:35:12.900717+0000","last_fullsized":"2023-07-05T23:35:12.900717+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:03:44.827174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"30'21","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.287341+0000","last_change":"2023-07-05T23:32:53.332443+0000","last_active":"2023-07-05T23:35:17.287341+0000","last_peered":"2023-07-05T23:35:17.287341+0000","last_clean":"2023-07-05T23:35:17.287341+0000","last_became_active":"2023-07-05T23:32:53.332159+0000","last_became_peered":"2023-07-05T23:32:53.332159+0000","last_unstale":"2023-07-05T23:35:17.287341+0000","last_undegraded":"2023-07-05T23:35:17.287341+0000","last_fullsized":"2023-07-05T23:35:17.287341+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:20:52.387593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"30'470","reported_seq":487,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.496987+0000","last_change":"2023-07-05T23:32:57.363998+0000","last_active":"2023-07-05T23:35:17.496987+0000","last_peered":"2023-07-05T23:35:17.496987+0000","last_clean":"2023-07-05T23:35:17.496987+0000","last_became_active":"2023-07-05T23:32:57.363620+0000","last_became_peered":"2023-07-05T23:32:57.363620+0000","last_unstale":"2023-07-05T23:35:17.496987+0000","last_undegraded":"2023-07-05T23:35:17.496987+0000","last_fullsized":"2023-07-05T23:35:17.496987+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:47:48.642379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.228911+0000","last_change":"2023-07-05T23:32:52.908550+0000","last_active":"2023-07-05T23:33:35.228911+0000","last_peered":"2023-07-05T23:33:35.228911+0000","last_clean":"2023-07-05T23:33:35.228911+0000","last_became_active":"2023-07-05T23:32:52.908111+0000","last_became_peered":"2023-07-05T23:32:52.908111+0000","last_unstale":"2023-07-05T23:33:35.228911+0000","last_undegraded":"2023-07-05T23:33:35.228911+0000","last_fullsized":"2023-07-05T23:33:35.228911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:47:44.198348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"30'32","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.297765+0000","last_change":"2023-07-05T23:32:53.340098+0000","last_active":"2023-07-05T23:35:17.297765+0000","last_peered":"2023-07-05T23:35:17.297765+0000","last_clean":"2023-07-05T23:35:17.297765+0000","last_became_active":"2023-07-05T23:32:53.339686+0000","last_became_peered":"2023-07-05T23:32:53.339686+0000","last_unstale":"2023-07-05T23:35:17.297765+0000","last_undegraded":"2023-07-05T23:35:17.297765+0000","last_fullsized":"2023-07-05T23:35:17.297765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:37:45.661547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"30'478","reported_seq":495,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:13.535971+0000","last_change":"2023-07-05T23:32:57.356309+0000","last_active":"2023-07-05T23:35:13.535971+0000","last_peered":"2023-07-05T23:35:13.535971+0000","last_clean":"2023-07-05T23:35:13.535971+0000","last_became_active":"2023-07-05T23:32:57.355910+0000","last_became_peered":"2023-07-05T23:32:57.355910+0000","last_unstale":"2023-07-05T23:35:13.535971+0000","last_undegraded":"2023-07-05T23:35:13.535971+0000","last_fullsized":"2023-07-05T23:35:13.535971+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:47:48.642379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:34.897485+0000","last_change":"2023-07-05T23:32:52.899481+0000","last_active":"2023-07-05T23:33:34.897485+0000","last_peered":"2023-07-05T23:33:34.897485+0000","last_clean":"2023-07-05T23:33:34.897485+0000","last_became_active":"2023-07-05T23:32:52.899159+0000","last_became_peered":"2023-07-05T23:32:52.899159+0000","last_unstale":"2023-07-05T23:33:34.897485+0000","last_undegraded":"2023-07-05T23:33:34.897485+0000","last_fullsized":"2023-07-05T23:33:34.897485+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:55:01.034913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"30'24","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.292037+0000","last_change":"2023-07-05T23:32:53.343643+0000","last_active":"2023-07-05T23:35:17.292037+0000","last_peered":"2023-07-05T23:35:17.292037+0000","last_clean":"2023-07-05T23:35:17.292037+0000","last_became_active":"2023-07-05T23:32:53.343262+0000","last_became_peered":"2023-07-05T23:32:53.343262+0000","last_unstale":"2023-07-05T23:35:17.292037+0000","last_undegraded":"2023-07-05T23:35:17.292037+0000","last_fullsized":"2023-07-05T23:35:17.292037+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:24:39.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"30'465","reported_seq":482,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:14.465946+0000","last_change":"2023-07-05T23:32:57.365478+0000","last_active":"2023-07-05T23:35:14.465946+0000","last_peered":"2023-07-05T23:35:14.465946+0000","last_clean":"2023-07-05T23:35:14.465946+0000","last_became_active":"2023-07-05T23:32:57.365087+0000","last_became_peered":"2023-07-05T23:32:57.365087+0000","last_unstale":"2023-07-05T23:35:14.465946+0000","last_undegraded":"2023-07-05T23:35:14.465946+0000","last_fullsized":"2023-07-05T23:35:14.465946+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:47:27.711548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"30'3","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:34.897598+0000","last_change":"2023-07-05T23:32:52.902806+0000","last_active":"2023-07-05T23:33:34.897598+0000","last_peered":"2023-07-05T23:33:34.897598+0000","last_clean":"2023-07-05T23:33:34.897598+0000","last_became_active":"2023-07-05T23:32:52.901689+0000","last_became_peered":"2023-07-05T23:32:52.901689+0000","last_unstale":"2023-07-05T23:33:34.897598+0000","last_undegraded":"2023-07-05T23:33:34.897598+0000","last_fullsized":"2023-07-05T23:33:34.897598+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:34:31.075112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'23","reported_seq":46,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.291674+0000","last_change":"2023-07-05T23:32:53.346776+0000","last_active":"2023-07-05T23:35:17.291674+0000","last_peered":"2023-07-05T23:35:17.291674+0000","last_clean":"2023-07-05T23:35:17.291674+0000","last_became_active":"2023-07-05T23:32:53.346553+0000","last_became_peered":"2023-07-05T23:32:53.346553+0000","last_unstale":"2023-07-05T23:35:17.291674+0000","last_undegraded":"2023-07-05T23:35:17.291674+0000","last_fullsized":"2023-07-05T23:35:17.291674+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:23:00.312260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"30'487","reported_seq":504,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:15.502203+0000","last_change":"2023-07-05T23:32:57.353173+0000","last_active":"2023-07-05T23:35:15.502203+0000","last_peered":"2023-07-05T23:35:15.502203+0000","last_clean":"2023-07-05T23:35:15.502203+0000","last_became_active":"2023-07-05T23:32:57.352716+0000","last_became_peered":"2023-07-05T23:32:57.352716+0000","last_unstale":"2023-07-05T23:35:15.502203+0000","last_undegraded":"2023-07-05T23:35:15.502203+0000","last_fullsized":"2023-07-05T23:35:15.502203+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:41:41.820423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:33:35.231058+0000","last_change":"2023-07-05T23:32:52.906954+0000","last_active":"2023-07-05T23:33:35.231058+0000","last_peered":"2023-07-05T23:33:35.231058+0000","last_clean":"2023-07-05T23:33:35.231058+0000","last_became_active":"2023-07-05T23:32:52.906688+0000","last_became_peered":"2023-07-05T23:32:52.906688+0000","last_unstale":"2023-07-05T23:33:35.231058+0000","last_undegraded":"2023-07-05T23:33:35.231058+0000","last_fullsized":"2023-07-05T23:33:35.231058+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:32:02.036320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"30'32","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.291380+0000","last_change":"2023-07-05T23:32:53.348210+0000","last_active":"2023-07-05T23:35:17.291380+0000","last_peered":"2023-07-05T23:35:17.291380+0000","last_clean":"2023-07-05T23:35:17.291380+0000","last_became_active":"2023-07-05T23:32:53.346652+0000","last_became_peered":"2023-07-05T23:32:53.346652+0000","last_unstale":"2023-07-05T23:35:17.291380+0000","last_undegraded":"2023-07-05T23:35:17.291380+0000","last_fullsized":"2023-07-05T23:35:17.291380+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:55:02.039251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"30'495","reported_seq":512,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.509286+0000","last_change":"2023-07-05T23:32:57.357185+0000","last_active":"2023-07-05T23:35:17.509286+0000","last_peered":"2023-07-05T23:35:17.509286+0000","last_clean":"2023-07-05T23:35:17.509286+0000","last_became_active":"2023-07-05T23:32:57.356637+0000","last_became_peered":"2023-07-05T23:32:57.356637+0000","last_unstale":"2023-07-05T23:35:17.509286+0000","last_undegraded":"2023-07-05T23:35:17.509286+0000","last_fullsized":"2023-07-05T23:35:17.509286+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:03:49.271205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"30'5","reported_seq":31,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:00.628733+0000","last_change":"2023-07-05T23:32:52.904412+0000","last_active":"2023-07-05T23:35:00.628733+0000","last_peered":"2023-07-05T23:35:00.628733+0000","last_clean":"2023-07-05T23:35:00.628733+0000","last_became_active":"2023-07-05T23:32:52.903823+0000","last_became_peered":"2023-07-05T23:32:52.903823+0000","last_unstale":"2023-07-05T23:35:00.628733+0000","last_undegraded":"2023-07-05T23:35:00.628733+0000","last_fullsized":"2023-07-05T23:35:00.628733+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:55:01.034913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"30'42","reported_seq":66,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.292971+0000","last_change":"2023-07-05T23:32:53.342800+0000","last_active":"2023-07-05T23:35:17.292971+0000","last_peered":"2023-07-05T23:35:17.292971+0000","last_clean":"2023-07-05T23:35:17.292971+0000","last_became_active":"2023-07-05T23:32:53.339863+0000","last_became_peered":"2023-07-05T23:32:53.339863+0000","last_unstale":"2023-07-05T23:35:17.292971+0000","last_undegraded":"2023-07-05T23:35:17.292971+0000","last_fullsized":"2023-07-05T23:35:17.292971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:18:02.496050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"30'50","reported_seq":74,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.291442+0000","last_change":"2023-07-05T23:32:53.337066+0000","last_active":"2023-07-05T23:35:17.291442+0000","last_peered":"2023-07-05T23:35:17.291442+0000","last_clean":"2023-07-05T23:35:17.291442+0000","last_became_active":"2023-07-05T23:32:53.336759+0000","last_became_peered":"2023-07-05T23:32:53.336759+0000","last_unstale":"2023-07-05T23:35:17.291442+0000","last_undegraded":"2023-07-05T23:35:17.291442+0000","last_fullsized":"2023-07-05T23:35:17.291442+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:10:47.650972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"30'46","reported_seq":70,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.298865+0000","last_change":"2023-07-05T23:32:53.346160+0000","last_active":"2023-07-05T23:35:17.298865+0000","last_peered":"2023-07-05T23:35:17.298865+0000","last_clean":"2023-07-05T23:35:17.298865+0000","last_became_active":"2023-07-05T23:32:53.345711+0000","last_became_peered":"2023-07-05T23:32:53.345711+0000","last_unstale":"2023-07-05T23:35:17.298865+0000","last_undegraded":"2023-07-05T23:35:17.298865+0000","last_fullsized":"2023-07-05T23:35:17.298865+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:19:28.044822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"30'34","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.286947+0000","last_change":"2023-07-05T23:32:53.339729+0000","last_active":"2023-07-05T23:35:17.286947+0000","last_peered":"2023-07-05T23:35:17.286947+0000","last_clean":"2023-07-05T23:35:17.286947+0000","last_became_active":"2023-07-05T23:32:53.339431+0000","last_became_peered":"2023-07-05T23:32:53.339431+0000","last_unstale":"2023-07-05T23:35:17.286947+0000","last_undegraded":"2023-07-05T23:35:17.286947+0000","last_fullsized":"2023-07-05T23:35:17.286947+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:27:36.127458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"30'31","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.288342+0000","last_change":"2023-07-05T23:32:53.335512+0000","last_active":"2023-07-05T23:35:17.288342+0000","last_peered":"2023-07-05T23:35:17.288342+0000","last_clean":"2023-07-05T23:35:17.288342+0000","last_became_active":"2023-07-05T23:32:53.335181+0000","last_became_peered":"2023-07-05T23:32:53.335181+0000","last_unstale":"2023-07-05T23:35:17.288342+0000","last_undegraded":"2023-07-05T23:35:17.288342+0000","last_fullsized":"2023-07-05T23:35:17.288342+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:47:24.271855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"30'32","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.295416+0000","last_change":"2023-07-05T23:32:53.338171+0000","last_active":"2023-07-05T23:35:17.295416+0000","last_peered":"2023-07-05T23:35:17.295416+0000","last_clean":"2023-07-05T23:35:17.295416+0000","last_became_active":"2023-07-05T23:32:53.337835+0000","last_became_peered":"2023-07-05T23:32:53.337835+0000","last_unstale":"2023-07-05T23:35:17.295416+0000","last_undegraded":"2023-07-05T23:35:17.295416+0000","last_fullsized":"2023-07-05T23:35:17.295416+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:00:42.415370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":614,"num_write_kb":1286144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":201326592,"data_stored":201326592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15089,"ondisk_log_size":15089,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2060,"ondisk_log_size":2060,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1481667,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":15,"num_read_kb":17,"num_write":465,"num_write_kb":1752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3022848,"data_stored":2963334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":463,"ondisk_log_size":463,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574884,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68228,"kb_used_data":33084,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94303612,"statfs":{"total":96636764160,"available":96566898688,"internally_reserved":0,"allocated":33878016,"data_stored":33659827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 5 23:34:44 2023","interfaces":[{"interface":"back","average":{"1min":3.7120000000000002,"5min":1.2150000000000001,"15min":0.79900000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":12.042,"5min":12.042,"15min":12.042},"last":0.65900000000000003},{"interface":"front","average":{"1min":6.5010000000000003,"5min":2.4590000000000001,"15min":1.7849999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":26.367999999999999,"5min":26.367999999999999,"15min":26.367999999999999},"last":0.81699999999999995}]},{"osd":1,"last update":"Wed Jul 5 23:34:44 2023","interfaces":[{"interface":"back","average":{"1min":3.536,"5min":1.2789999999999999,"15min":0.90300000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":11.948,"5min":11.948,"15min":11.948},"last":0.83099999999999996},{"interface":"front","average":{"1min":4.0110000000000001,"5min":1.2789999999999999,"15min":0.82399999999999995},"min":{"1min":0.318,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":11.952,"5min":11.952,"15min":11.952},"last":0.72199999999999998}]},{"osd":2,"last update":"Wed Jul 5 23:34:44 2023","interfaces":[{"interface":"back","average":{"1min":4.0209999999999999,"5min":1.675,"15min":1.284},"min":{"1min":0.38500000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":11.997,"5min":11.997,"15min":11.997},"last":0.84499999999999997},{"interface":"front","average":{"1min":6.1189999999999998,"5min":1.7829999999999999,"15min":1.0600000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":26.419,"5min":26.419,"15min":26.419},"last":0.73699999999999999}]},{"osd":3,"last update":"Wed Jul 5 23:34:44 2023","interfaces":[{"interface":"back","average":{"1min":4.9889999999999999,"5min":1.51,"15min":0.93000000000000005},"min":{"1min":0.43099999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":24.094000000000001,"5min":24.094000000000001,"15min":24.094000000000001},"last":0.746},{"interface":"front","average":{"1min":5.3719999999999999,"5min":1.5780000000000001,"15min":0.94599999999999995},"min":{"1min":0.44700000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":22.588000000000001,"5min":22.588000000000001,"15min":22.588000000000001},"last":0.79300000000000004}]},{"osd":4,"last update":"Wed Jul 5 23:34:44 2023","interfaces":[{"interface":"back","average":{"1min":3.4390000000000001,"5min":1.111,"15min":0.72299999999999998},"min":{"1min":0.32500000000000001,"5min":0.318,"15min":0.318},"max":{"1min":12.173999999999999,"5min":12.173999999999999,"15min":12.173999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":3.4780000000000002,"5min":1.147,"15min":0.75900000000000001},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":12.151,"5min":12.151,"15min":12.151},"last":0.61099999999999999}]},{"osd":5,"last update":"Wed Jul 5 23:34:44 2023","interfaces":[{"interface":"back","average":{"1min":3.8519999999999999,"5min":1.222,"15min":0.78400000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":19.954999999999998,"5min":19.954999999999998,"15min":19.954999999999998},"last":0.76400000000000001},{"interface":"front","average":{"1min":3.6509999999999998,"5min":1.2150000000000001,"15min":0.80900000000000005},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":21.870999999999999,"5min":21.870999999999999,"15min":21.870999999999999},"last":0.70599999999999996}]},{"osd":6,"last update":"Wed Jul 5 23:34:44 2023","interfaces":[{"interface":"back","average":{"1min":5.4880000000000004,"5min":1.6060000000000001,"15min":0.95899999999999996},"min":{"1min":0.436,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":20.212,"5min":20.212,"15min":20.212},"last":0.68600000000000005},{"interface":"front","average":{"1min":2.4449999999999998,"5min":0.98399999999999999,"15min":0.73999999999999999},"min":{"1min":0.45700000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":12.010999999999999,"5min":12.010999999999999,"15min":12.010999999999999},"last":0.77700000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574884,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57992,"kb_used_data":26944,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94313848,"statfs":{"total":96636764160,"available":96577380352,"internally_reserved":0,"allocated":27590656,"data_stored":27401822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 5 23:34:42 2023","interfaces":[{"interface":"back","average":{"1min":7.4859999999999998,"5min":1.9059999999999999,"15min":0.97599999999999998},"min":{"1min":0.39800000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":24.012,"5min":24.012,"15min":24.012},"last":0.48999999999999999},{"interface":"front","average":{"1min":7.5389999999999997,"5min":1.909,"15min":0.97099999999999997},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":27.036000000000001,"5min":27.036000000000001,"15min":27.036000000000001},"last":0.46300000000000002}]},{"osd":1,"last update":"Wed Jul 5 23:34:42 2023","interfaces":[{"interface":"back","average":{"1min":7.0979999999999999,"5min":1.8220000000000001,"15min":0.94199999999999995},"min":{"1min":0.34499999999999997,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":20.021999999999998,"5min":20.021999999999998,"15min":20.021999999999998},"last":0.55000000000000004},{"interface":"front","average":{"1min":7.7549999999999999,"5min":1.9970000000000001,"15min":1.0369999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":23.943000000000001,"5min":23.943000000000001,"15min":23.943000000000001},"last":0.58899999999999997}]},{"osd":2,"last update":"Wed Jul 5 23:34:42 2023","interfaces":[{"interface":"back","average":{"1min":7.1660000000000004,"5min":1.871,"15min":0.98899999999999999},"min":{"1min":0.36699999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":25.658000000000001,"5min":25.658000000000001,"15min":25.658000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":5.9139999999999997,"5min":1.647,"15min":0.93600000000000005},"min":{"1min":0.40000000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":27.062000000000001,"5min":27.062000000000001,"15min":27.062000000000001},"last":0.57199999999999995}]},{"osd":3,"last update":"Wed Jul 5 23:34:42 2023","interfaces":[{"interface":"back","average":{"1min":6.657,"5min":1.7889999999999999,"15min":0.97699999999999998},"min":{"1min":0.443,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":27.108000000000001,"5min":27.108000000000001,"15min":27.108000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":7.6630000000000003,"5min":1.976,"15min":1.028},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":19.940000000000001,"5min":19.940000000000001,"15min":19.940000000000001},"last":0.68500000000000005}]},{"osd":4,"last update":"Wed Jul 5 23:34:42 2023","interfaces":[{"interface":"back","average":{"1min":8.0489999999999995,"5min":2.0430000000000001,"15min":1.042},"min":{"1min":0.34899999999999998,"5min":0.308,"15min":0.308},"max":{"1min":26,"5min":26,"15min":26},"last":0.78600000000000003},{"interface":"front","average":{"1min":5.0650000000000004,"5min":1.482,"15min":0.88500000000000001},"min":{"1min":0.376,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":27.085000000000001,"5min":27.085000000000001,"15min":27.085000000000001},"last":0.70999999999999996}]},{"osd":5,"last update":"Wed Jul 5 23:34:42 2023","interfaces":[{"interface":"back","average":{"1min":5.5750000000000002,"5min":1.5549999999999999,"15min":0.88500000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":19.975000000000001,"5min":19.975000000000001,"15min":19.975000000000001},"last":0.80100000000000005},{"interface":"front","average":{"1min":6.4349999999999996,"5min":1.7789999999999999,"15min":1.0029999999999999},"min":{"1min":0.41999999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":17.126999999999999,"5min":17.126999999999999,"15min":17.126999999999999},"last":0.81599999999999995}]},{"osd":7,"last update":"Wed Jul 5 23:34:42 2023","interfaces":[{"interface":"back","average":{"1min":5.7000000000000002,"5min":1.6240000000000001,"15min":0.94499999999999995},"min":{"1min":0.438,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":26.992000000000001,"5min":26.992000000000001,"15min":26.992000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":6.1929999999999996,"5min":1.7250000000000001,"15min":0.98099999999999998},"min":{"1min":0.44700000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":19.998999999999999,"5min":19.998999999999999,"15min":19.998999999999999},"last":0.76200000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574884,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53896,"kb_used_data":22848,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94317944,"statfs":{"total":96636764160,"available":96581574656,"internally_reserved":0,"allocated":23396352,"data_stored":23207518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 5 23:34:46 2023","interfaces":[{"interface":"back","average":{"1min":3.9239999999999999,"5min":1.0700000000000001,"15min":0.59399999999999997},"min":{"1min":0.29799999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":14.039999999999999,"5min":14.039999999999999,"15min":14.039999999999999},"last":0.36299999999999999},{"interface":"front","average":{"1min":3.871,"5min":1.0669999999999999,"15min":0.59899999999999998},"min":{"1min":0.27400000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":18.006,"5min":18.006,"15min":18.006},"last":0.34899999999999998}]},{"osd":2,"last update":"Wed Jul 5 23:34:46 2023","interfaces":[{"interface":"back","average":{"1min":4.3860000000000001,"5min":1.1839999999999999,"15min":0.65000000000000002},"min":{"1min":0.32200000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":14.092000000000001,"5min":14.092000000000001,"15min":14.092000000000001},"last":0.26600000000000001},{"interface":"front","average":{"1min":4.3929999999999998,"5min":1.173,"15min":0.63600000000000001},"min":{"1min":0.33500000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":17.994,"5min":17.994,"15min":17.994},"last":0.32900000000000001}]},{"osd":3,"last update":"Wed Jul 5 23:34:46 2023","interfaces":[{"interface":"back","average":{"1min":4.9980000000000002,"5min":1.3180000000000001,"15min":0.70399999999999996},"min":{"1min":0.29999999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":17.949999999999999,"5min":17.949999999999999,"15min":17.949999999999999},"last":0.39100000000000001},{"interface":"front","average":{"1min":3.2240000000000002,"5min":0.96999999999999997,"15min":0.59399999999999997},"min":{"1min":0.38800000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":14.377000000000001,"5min":14.377000000000001,"15min":14.377000000000001},"last":0.31900000000000001}]},{"osd":4,"last update":"Wed Jul 5 23:34:46 2023","interfaces":[{"interface":"back","average":{"1min":5.0419999999999998,"5min":1.4790000000000001,"15min":0.88500000000000001},"min":{"1min":0.436,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":14.004,"5min":14.004,"15min":14.004},"last":0.48599999999999999},{"interface":"front","average":{"1min":5.75,"5min":1.6100000000000001,"15min":0.92000000000000004},"min":{"1min":0.49399999999999999,"5min":0.371,"15min":0.371},"max":{"1min":20.943999999999999,"5min":20.943999999999999,"15min":20.943999999999999},"last":0.45200000000000001}]},{"osd":5,"last update":"Wed Jul 5 23:34:46 2023","interfaces":[{"interface":"back","average":{"1min":5.2549999999999999,"5min":1.5509999999999999,"15min":0.93400000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":24.949999999999999,"5min":24.949999999999999,"15min":24.949999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":5.9710000000000001,"5min":1.7190000000000001,"15min":1.0109999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":21.945,"5min":21.945,"15min":21.945},"last":0.505}]},{"osd":6,"last update":"Wed Jul 5 23:34:46 2023","interfaces":[{"interface":"back","average":{"1min":4.2859999999999996,"5min":1.3420000000000001,"15min":0.85099999999999998},"min":{"1min":0.42799999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":17.981999999999999,"5min":17.981999999999999,"15min":17.981999999999999},"last":0.40799999999999997},{"interface":"front","average":{"1min":6.0060000000000002,"5min":1.714,"15min":0.998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":24.943000000000001,"5min":24.943000000000001,"15min":24.943000000000001},"last":0.43099999999999999}]},{"osd":7,"last update":"Wed Jul 5 23:34:46 2023","interfaces":[{"interface":"back","average":{"1min":5.6079999999999997,"5min":1.621,"15min":0.95699999999999996},"min":{"1min":0.52700000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":18.045000000000002,"5min":18.045000000000002,"15min":18.045000000000002},"last":0.49299999999999999},{"interface":"front","average":{"1min":3.9289999999999998,"5min":1.2769999999999999,"15min":0.83499999999999996},"min":{"1min":0.46000000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":14.352,"5min":14.352,"15min":14.352},"last":0.442}]}]},{"osd":0,"up_from":13,"seq":55834574884,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54488,"kb_used_data":23440,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94317352,"statfs":{"total":96636764160,"available":96580968448,"internally_reserved":0,"allocated":24002560,"data_stored":23806220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Jul 5 23:34:41 2023","interfaces":[{"interface":"back","average":{"1min":4.0949999999999998,"5min":1.081,"15min":0.57899999999999996},"min":{"1min":0.254,"5min":0.185,"15min":0.185},"max":{"1min":23.974,"5min":23.974,"15min":23.974},"last":0.36299999999999999},{"interface":"front","average":{"1min":5.0419999999999998,"5min":1.282,"15min":0.65500000000000003},"min":{"1min":0.28999999999999998,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":32.256999999999998,"5min":32.256999999999998,"15min":32.256999999999998},"last":0.28699999999999998}]},{"osd":2,"last update":"Wed Jul 5 23:34:41 2023","interfaces":[{"interface":"back","average":{"1min":3.4060000000000001,"5min":0.97899999999999998,"15min":0.57499999999999996},"min":{"1min":0.31,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":16.157,"5min":16.157,"15min":16.157},"last":0.307},{"interface":"front","average":{"1min":3.6739999999999999,"5min":1.0269999999999999,"15min":0.58599999999999997},"min":{"1min":0.28899999999999998,"5min":0.254,"15min":0.254},"max":{"1min":14.91,"5min":14.91,"15min":14.91},"last":0.34899999999999998}]},{"osd":3,"last update":"Wed Jul 5 23:34:41 2023","interfaces":[{"interface":"back","average":{"1min":6.1820000000000004,"5min":1.534,"15min":0.75900000000000001},"min":{"1min":0.35299999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":16.928999999999998,"5min":16.928999999999998,"15min":16.928999999999998},"last":0.39400000000000002},{"interface":"front","average":{"1min":2.4399999999999999,"5min":0.83199999999999996,"15min":0.56399999999999995},"min":{"1min":0.38500000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":11.923999999999999,"5min":11.923999999999999,"15min":11.923999999999999},"last":0.40699999999999997}]},{"osd":4,"last update":"Wed Jul 5 23:34:41 2023","interfaces":[{"interface":"back","average":{"1min":4.6520000000000001,"5min":1.3899999999999999,"15min":0.84599999999999997},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":16.838000000000001,"5min":16.838000000000001,"15min":16.838000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":5.7990000000000004,"5min":1.633,"15min":0.93899999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":23.905999999999999,"5min":23.905999999999999,"15min":23.905999999999999},"last":0.59699999999999998}]},{"osd":5,"last update":"Wed Jul 5 23:34:41 2023","interfaces":[{"interface":"back","average":{"1min":4.7140000000000004,"5min":1.4299999999999999,"15min":0.88200000000000001},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":17.824000000000002,"5min":17.824000000000002,"15min":17.824000000000002},"last":0.629},{"interface":"front","average":{"1min":5.0519999999999996,"5min":1.5,"15min":0.90800000000000003},"min":{"1min":0.498,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":16.905000000000001,"5min":16.905000000000001,"15min":16.905000000000001},"last":0.57899999999999996}]},{"osd":6,"last update":"Wed Jul 5 23:34:41 2023","interfaces":[{"interface":"back","average":{"1min":2.7469999999999999,"5min":1.0389999999999999,"15min":0.754},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":10.102,"5min":10.102,"15min":10.102},"last":0.65200000000000002},{"interface":"front","average":{"1min":5.2690000000000001,"5min":1.5529999999999999,"15min":0.93300000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":32.298999999999999,"5min":32.298999999999999,"15min":32.298999999999999},"last":0.56399999999999995}]},{"osd":7,"last update":"Wed Jul 5 23:34:41 2023","interfaces":[{"interface":"back","average":{"1min":4.7759999999999998,"5min":1.464,"15min":0.91200000000000003},"min":{"1min":0.51000000000000001,"5min":0.503,"15min":0.503},"max":{"1min":14.946,"5min":14.946,"15min":14.946},"last":0.58999999999999997},{"interface":"front","average":{"1min":5.8360000000000003,"5min":1.657,"15min":0.96099999999999997},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":16.878,"5min":16.878,"15min":16.878},"last":0.64000000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574885,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55944,"kb_used_data":24896,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94315896,"statfs":{"total":96636764160,"available":96579477504,"internally_reserved":0,"allocated":25493504,"data_stored":25304670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 5 23:34:45 2023","interfaces":[{"interface":"back","average":{"1min":6.4109999999999996,"5min":1.728,"15min":0.94799999999999995},"min":{"1min":0.27600000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":29.716000000000001,"5min":29.716000000000001,"15min":29.716000000000001},"last":0.27600000000000002},{"interface":"front","average":{"1min":6.1890000000000001,"5min":1.7290000000000001,"15min":0.98599999999999999},"min":{"1min":0.26800000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":21.699000000000002,"5min":21.699000000000002,"15min":21.699000000000002},"last":0.309}]},{"osd":1,"last update":"Wed Jul 5 23:34:45 2023","interfaces":[{"interface":"back","average":{"1min":6.0640000000000001,"5min":1.718,"15min":0.99399999999999999},"min":{"1min":0.35999999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":23.053000000000001,"5min":23.053000000000001,"15min":23.053000000000001},"last":0.40699999999999997},{"interface":"front","average":{"1min":5.3579999999999997,"5min":1.5720000000000001,"15min":0.94099999999999995},"min":{"1min":0.32800000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":29.632999999999999,"5min":29.632999999999999,"15min":29.632999999999999},"last":0.37}]},{"osd":3,"last update":"Wed Jul 5 23:34:45 2023","interfaces":[{"interface":"back","average":{"1min":3.52,"5min":1.1559999999999999,"15min":0.76200000000000001},"min":{"1min":0.29799999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":22.018000000000001,"5min":22.018000000000001,"15min":22.018000000000001},"last":0.33300000000000002},{"interface":"front","average":{"1min":4.9390000000000001,"5min":1.5429999999999999,"15min":0.97699999999999998},"min":{"1min":0.41399999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":29.686,"5min":29.686,"15min":29.686},"last":0.34899999999999998}]},{"osd":4,"last update":"Wed Jul 5 23:34:45 2023","interfaces":[{"interface":"back","average":{"1min":6.9909999999999997,"5min":2.0550000000000002,"15min":1.2330000000000001},"min":{"1min":0.46200000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":29.768999999999998,"5min":29.768999999999998,"15min":29.768999999999998},"last":0.44500000000000001},{"interface":"front","average":{"1min":7.3170000000000002,"5min":2.141,"15min":1.278},"min":{"1min":0.44600000000000001,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":21.16,"5min":21.16,"15min":21.16},"last":0.55800000000000005}]},{"osd":5,"last update":"Wed Jul 5 23:34:45 2023","interfaces":[{"interface":"back","average":{"1min":8.359,"5min":2.331,"15min":1.3260000000000001},"min":{"1min":0.502,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":22.927,"5min":22.927,"15min":22.927},"last":0.59099999999999997},{"interface":"front","average":{"1min":5.6970000000000001,"5min":1.8140000000000001,"15min":1.167},"min":{"1min":0.52400000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":23.120000000000001,"5min":23.120000000000001,"15min":23.120000000000001},"last":0.54700000000000004}]},{"osd":6,"last update":"Wed Jul 5 23:34:45 2023","interfaces":[{"interface":"back","average":{"1min":6.0430000000000001,"5min":1.889,"15min":1.1970000000000001},"min":{"1min":0.54200000000000004,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":23.173999999999999,"5min":23.173999999999999,"15min":23.173999999999999},"last":0.58099999999999996},{"interface":"front","average":{"1min":8.3699999999999992,"5min":2.3570000000000002,"15min":1.355},"min":{"1min":0.59599999999999997,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":29.742999999999999,"5min":29.742999999999999,"15min":29.742999999999999},"last":0.47799999999999998}]},{"osd":7,"last update":"Wed Jul 5 23:34:45 2023","interfaces":[{"interface":"back","average":{"1min":8.6240000000000006,"5min":2.4140000000000001,"15min":1.379},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":32.924999999999997,"5min":32.924999999999997,"15min":32.924999999999997},"last":0.623},{"interface":"front","average":{"1min":7.1630000000000003,"5min":2.1419999999999999,"15min":1.3049999999999999},"min":{"1min":0.53000000000000003,"5min":0.436,"15min":0.436},"max":{"1min":30.594999999999999,"5min":30.594999999999999,"15min":30.594999999999999},"last":0.60999999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574884,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51852,"kb_used_data":20804,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94319988,"statfs":{"total":96636764160,"available":96583667712,"internally_reserved":0,"allocated":21303296,"data_stored":21110456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 5 23:34:48 2023","interfaces":[{"interface":"back","average":{"1min":4.9059999999999997,"5min":1.333,"15min":0.73699999999999999},"min":{"1min":0.33100000000000002,"5min":0.25,"15min":0.25},"max":{"1min":22.948,"5min":22.948,"15min":22.948},"last":0.28699999999999998},{"interface":"front","average":{"1min":4.9850000000000003,"5min":1.3799999999999999,"15min":0.77900000000000003},"min":{"1min":0.34699999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":23.036000000000001,"5min":23.036000000000001,"15min":23.036000000000001},"last":0.36899999999999999}]},{"osd":1,"last update":"Wed Jul 5 23:34:48 2023","interfaces":[{"interface":"back","average":{"1min":4.1429999999999998,"5min":1.405,"15min":0.94899999999999995},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":18.981999999999999,"5min":18.981999999999999,"15min":18.981999999999999},"last":0.247},{"interface":"front","average":{"1min":4.5170000000000003,"5min":1.512,"15min":1.0109999999999999},"min":{"1min":0.38300000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":25.253,"5min":25.253,"15min":25.253},"last":0.38700000000000001}]},{"osd":2,"last update":"Wed Jul 5 23:34:48 2023","interfaces":[{"interface":"back","average":{"1min":4.101,"5min":1.234,"15min":0.75600000000000001},"min":{"1min":0.30499999999999999,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":25.32,"5min":25.32,"15min":25.32},"last":0.26200000000000001},{"interface":"front","average":{"1min":4.048,"5min":1.2010000000000001,"15min":0.72699999999999998},"min":{"1min":0.42499999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":12.010999999999999,"5min":12.010999999999999,"15min":12.010999999999999},"last":0.41899999999999998}]},{"osd":4,"last update":"Wed Jul 5 23:34:48 2023","interfaces":[{"interface":"back","average":{"1min":4.343,"5min":1.379,"15min":0.88500000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":19.007999999999999,"5min":19.007999999999999,"15min":19.007999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":5.3330000000000002,"5min":1.6080000000000001,"15min":0.98699999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":22.882000000000001,"5min":22.882000000000001,"15min":22.882000000000001},"last":0.56299999999999994}]},{"osd":5,"last update":"Wed Jul 5 23:34:48 2023","interfaces":[{"interface":"back","average":{"1min":6.7869999999999999,"5min":1.919,"15min":1.1080000000000001},"min":{"1min":0.46600000000000003,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":23.004999999999999,"5min":23.004999999999999,"15min":23.004999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":5.7699999999999996,"5min":1.7330000000000001,"15min":1.0600000000000001},"min":{"1min":0.61499999999999999,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":18.959,"5min":18.959,"15min":18.959},"last":0.623}]},{"osd":6,"last update":"Wed Jul 5 23:34:48 2023","interfaces":[{"interface":"back","average":{"1min":4.2370000000000001,"5min":1.429,"15min":0.96099999999999997},"min":{"1min":0.60699999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":18.923999999999999,"5min":18.923999999999999,"15min":18.923999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":5.5460000000000003,"5min":1.6539999999999999,"15min":1.006},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":18.978000000000002,"5min":18.978000000000002,"15min":18.978000000000002},"last":0.51400000000000001}]},{"osd":7,"last update":"Wed Jul 5 23:34:48 2023","interfaces":[{"interface":"back","average":{"1min":5.2569999999999997,"5min":1.585,"15min":0.97299999999999998},"min":{"1min":0.47499999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":19.937999999999999,"5min":19.937999999999999,"15min":19.937999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":5.9630000000000001,"5min":1.7749999999999999,"15min":1.077},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":22.974,"5min":22.974,"15min":22.974},"last":0.53500000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574885,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61504,"kb_used_data":26360,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94310336,"statfs":{"total":96636764160,"available":96573784064,"internally_reserved":0,"allocated":26992640,"data_stored":26785595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 5 23:34:44 2023","interfaces":[{"interface":"back","average":{"1min":5.1120000000000001,"5min":1.4319999999999999,"15min":0.81799999999999995},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":16.655999999999999,"5min":16.655999999999999,"15min":16.655999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":5.5030000000000001,"5min":1.5149999999999999,"15min":0.85099999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":18.661999999999999,"5min":18.661999999999999,"15min":18.661999999999999},"last":0.46400000000000002}]},{"osd":1,"last update":"Wed Jul 5 23:34:44 2023","interfaces":[{"interface":"back","average":{"1min":5.3860000000000001,"5min":1.47,"15min":0.81799999999999995},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":18.991,"5min":18.991,"15min":18.991},"last":0.55300000000000005},{"interface":"front","average":{"1min":7.1799999999999997,"5min":1.8400000000000001,"15min":0.94999999999999996},"min":{"1min":0.371,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":23.879000000000001,"5min":23.879000000000001,"15min":23.879000000000001},"last":0.43099999999999999}]},{"osd":2,"last update":"Wed Jul 5 23:34:44 2023","interfaces":[{"interface":"back","average":{"1min":6.8799999999999999,"5min":1.8320000000000001,"15min":0.98999999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":23.805,"5min":23.805,"15min":23.805},"last":0.58599999999999997},{"interface":"front","average":{"1min":6.1379999999999999,"5min":1.6659999999999999,"15min":0.92100000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":18.707000000000001,"5min":18.707000000000001,"15min":18.707000000000001},"last":0.36799999999999999}]},{"osd":3,"last update":"Wed Jul 5 23:34:44 2023","interfaces":[{"interface":"back","average":{"1min":6.0090000000000003,"5min":1.6220000000000001,"15min":0.89100000000000001},"min":{"1min":0.373,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":22.966999999999999,"5min":22.966999999999999,"15min":22.966999999999999},"last":0.41199999999999998},{"interface":"front","average":{"1min":6.0899999999999999,"5min":1.6799999999999999,"15min":0.94499999999999995},"min":{"1min":0.33800000000000002,"5min":0.314,"15min":0.314},"max":{"1min":23.843,"5min":23.843,"15min":23.843},"last":0.51000000000000001}]},{"osd":5,"last update":"Wed Jul 5 23:34:44 2023","interfaces":[{"interface":"back","average":{"1min":4.7779999999999996,"5min":1.3280000000000001,"15min":0.753},"min":{"1min":0.39500000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":16.574999999999999,"5min":16.574999999999999,"15min":16.574999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":3.8380000000000001,"5min":1.1870000000000001,"15min":0.745},"min":{"1min":0.40100000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":18.693999999999999,"5min":18.693999999999999,"15min":18.693999999999999},"last":0.53100000000000003}]},{"osd":6,"last update":"Wed Jul 5 23:34:44 2023","interfaces":[{"interface":"back","average":{"1min":5.016,"5min":1.425,"15min":0.82699999999999996},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":17.983000000000001,"5min":17.983000000000001,"15min":17.983000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":4.4509999999999996,"5min":1.3300000000000001,"15min":0.81000000000000005},"min":{"1min":0.44500000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":16.622,"5min":16.622,"15min":16.622},"last":0.73099999999999998}]},{"osd":7,"last update":"Wed Jul 5 23:34:44 2023","interfaces":[{"interface":"back","average":{"1min":3.9460000000000002,"5min":1.226,"15min":0.77300000000000002},"min":{"1min":0.46500000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":22.931000000000001,"5min":22.931000000000001,"15min":22.931000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":4.2030000000000003,"5min":1.3069999999999999,"15min":0.82499999999999996},"min":{"1min":0.40400000000000003,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":18.966000000000001,"5min":18.966000000000001,"15min":18.966000000000001},"last":0.64800000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574884,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60048,"kb_used_data":24904,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94311792,"statfs":{"total":96636764160,"available":96575275008,"internally_reserved":0,"allocated":25501696,"data_stored":25305322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 5 23:34:40 2023","interfaces":[{"interface":"back","average":{"1min":5.9340000000000002,"5min":1.5860000000000001,"15min":0.86099999999999999},"min":{"1min":0.42999999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":18.867999999999999,"5min":18.867999999999999,"15min":18.867999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":4.109,"5min":1.3380000000000001,"15min":0.876},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":18.099,"5min":18.099,"15min":18.099},"last":0.64500000000000002}]},{"osd":1,"last update":"Wed Jul 5 23:34:40 2023","interfaces":[{"interface":"back","average":{"1min":3.8809999999999998,"5min":1.244,"15min":0.80400000000000005},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":18.071999999999999,"5min":18.071999999999999,"15min":18.071999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":4.7530000000000001,"5min":1.444,"15min":0.89200000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":16.869,"5min":16.869,"15min":16.869},"last":0.54900000000000004}]},{"osd":2,"last update":"Wed Jul 5 23:34:40 2023","interfaces":[{"interface":"back","average":{"1min":5.4950000000000001,"5min":1.556,"15min":0.90000000000000002},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":22.177,"5min":22.177,"15min":22.177},"last":0.63300000000000001},{"interface":"front","average":{"1min":5.4589999999999996,"5min":1.5589999999999999,"15min":0.90900000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":18.902999999999999,"5min":18.902999999999999,"15min":18.902999999999999},"last":0.56399999999999995}]},{"osd":3,"last update":"Wed Jul 5 23:34:40 2023","interfaces":[{"interface":"back","average":{"1min":4.3230000000000004,"5min":1.333,"15min":0.83499999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":18.032,"5min":18.032,"15min":18.032},"last":0.70699999999999996},{"interface":"front","average":{"1min":4.2400000000000002,"5min":1.399,"15min":0.92500000000000004},"min":{"1min":0.46700000000000003,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":16.905000000000001,"5min":16.905000000000001,"15min":16.905000000000001},"last":0.57699999999999996}]},{"osd":4,"last update":"Wed Jul 5 23:34:40 2023","interfaces":[{"interface":"back","average":{"1min":5.4420000000000002,"5min":1.51,"15min":0.85499999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":18.957000000000001,"5min":18.957000000000001,"15min":18.957000000000001},"last":0.38800000000000001},{"interface":"front","average":{"1min":3.6560000000000001,"5min":1.2,"15min":0.79100000000000004},"min":{"1min":0.38400000000000001,"5min":0.377,"15min":0.377},"max":{"1min":18.123999999999999,"5min":18.123999999999999,"15min":18.123999999999999},"last":0.433}]},{"osd":6,"last update":"Wed Jul 5 23:34:40 2023","interfaces":[{"interface":"back","average":{"1min":4.1299999999999999,"5min":1.29,"15min":0.81599999999999995},"min":{"1min":0.41999999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":16.952000000000002,"5min":16.952000000000002,"15min":16.952000000000002},"last":0.46600000000000003},{"interface":"front","average":{"1min":5.1159999999999997,"5min":1.488,"15min":0.88300000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":18.928000000000001,"5min":18.928000000000001,"15min":18.928000000000001},"last":0.48799999999999999}]},{"osd":7,"last update":"Wed Jul 5 23:34:40 2023","interfaces":[{"interface":"back","average":{"1min":2.4380000000000002,"5min":0.96299999999999997,"15min":0.71699999999999997},"min":{"1min":0.40899999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":10.324999999999999,"5min":10.324999999999999,"15min":10.324999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":2.8799999999999999,"5min":1.077,"15min":0.77700000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":13.013,"5min":13.013,"15min":13.013},"last":0.51600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":8334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1499136,"data_stored":1480925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1499136,"data_stored":1473333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":23068672,"data_stored":23068672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23068672,"data_stored":23068672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":25165824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":25165824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":25165824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":27262976,"data_stored":27262976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":31457280,"data_stored":31457280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-05T23:35:25.208 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.209 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.209 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.209 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.210 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.210 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.210 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.211 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.211 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.211 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.211 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.212 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.212 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.212 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.213 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.213 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.213 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.213 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.214 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.214 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.214 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.215 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.215 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.215 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.216 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.216 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.216 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.216 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.217 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-07-05T23:32:51.877945+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=51, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.217 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.217 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.218 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-07-05T23:32:51.877945+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=51, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.218 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.218 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.218 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-07-05T23:32:51.877945+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=51, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.219 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.219 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.219 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-07-05T23:32:51.877945+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=51, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.220 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.220 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.220 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-07-05T23:32:51.877945+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=51, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.220 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.221 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.221 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-07-05T23:32:51.877945+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=51, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.221 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.222 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.222 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-07-05T23:32:51.877945+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=51, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.222 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.222 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.223 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-07-05T23:32:51.877945+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=51, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.223 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.223 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.224 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-07-05T23:32:51.877945+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=51, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.224 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.224 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.225 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-07-05T23:32:51.877945+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=51, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.225 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.225 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.225 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-07-05T23:32:51.877945+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=51, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.226 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.226 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.226 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-07-05T23:32:51.877945+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=51, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.227 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.227 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.227 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-07-05T23:32:51.877945+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=51, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.227 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.228 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.228 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-07-05T23:32:51.877945+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=51, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.228 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.229 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.229 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-07-05T23:32:51.877945+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=51, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.229 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.229 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.230 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-07-05T23:32:51.877945+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=51, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.230 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.230 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.231 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-07-05T23:32:51.877945+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=51, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.231 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.231 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.231 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-07-05T23:32:51.877945+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=51, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.232 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.232 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.232 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-07-05T23:32:51.877945+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=51, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.233 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.233 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.233 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-07-05T23:32:46.741565+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=46, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.233 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-07-05T23:32:51.877945+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=51, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.234 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.234 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.235 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-07-05T23:32:46.741565+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=46, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.235 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-07-05T23:32:51.877945+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=51, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.235 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.236 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.236 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-07-05T23:32:46.741565+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=46, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.236 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-07-05T23:32:51.877945+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=51, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.236 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.237 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.237 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-07-05T23:32:46.741565+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=46, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.237 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-07-05T23:32:41.674741+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=41, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.238 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-07-05T23:32:51.877945+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=51, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.238 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.238 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.238 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-07-05T23:32:46.741565+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=46, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.239 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-07-05T23:32:51.877945+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=51, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.239 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.239 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.240 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-07-05T23:32:46.741565+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=46, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.240 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-07-05T23:32:51.877945+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=51, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.240 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.240 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.241 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-07-05T23:32:51.877945+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=51, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.241 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-07-05T23:32:46.741565+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=46, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.241 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.242 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.242 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-07-05T23:32:46.741565+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=46, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.242 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-07-05T23:32:51.877945+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=51, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.242 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.243 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.243 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-07-05T23:32:51.877945+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=51, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.243 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.244 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.244 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-07-05T23:32:51.877945+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=51, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.244 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.244 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.245 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-07-05T23:32:51.877945+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=51, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.245 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.245 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.246 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-07-05T23:32:51.877945+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=51, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.246 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.246 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.247 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-07-05T23:32:51.877945+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=51, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.247 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.247 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.248 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.248 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.248 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.248 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:25.249 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-07-05T23:35:45.250 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-05T23:35:45.392 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:45.389+0000 7f775c7b7700 1 Processor -- start 2023-07-05T23:35:45.392 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:45.389+0000 7f775c7b7700 1 -- start start 2023-07-05T23:35:45.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:45.390+0000 7f775c7b7700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f77540709f0 0x7f77540cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:45.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:45.390+0000 7f775c7b7700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77540c9510 con 0x7f7754158ef0 2023-07-05T23:35:45.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:45.390+0000 7f775c7b7700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77540cd6a0 con 0x7f775406c060 2023-07-05T23:35:45.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:45.390+0000 7f775c7b7700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77540cd980 con 0x7f77540709f0 2023-07-05T23:35:45.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:45.390+0000 7f775a553700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f7754158ef0 0x7f77540702e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:53914/0 (socket says 172.21.15.27:53914) 2023-07-05T23:35:45.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:45.390+0000 7f775a553700 1 -- 172.21.15.27:0/529335396 learned_addr learned my addr 172.21.15.27:0/529335396 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-07-05T23:35:45.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:45.390+0000 7f7759d52700 1 --2- 172.21.15.27:0/529335396 >> v2:172.21.15.162:3300/0 conn(0x7f77540709f0 0x7f77540cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:45.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:45.391+0000 7f7759551700 1 -- 172.21.15.27:0/529335396 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2684292885 0 0) 0x7f77540c9510 con 0x7f7754158ef0 2023-07-05T23:35:45.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:45.391+0000 7f7759551700 1 -- 172.21.15.27:0/529335396 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77400035b0 con 0x7f7754158ef0 2023-07-05T23:35:45.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:45.391+0000 7f7759d52700 1 -- 172.21.15.27:0/529335396 >> v1:172.21.15.162:6789/0 conn(0x7f775406c060 legacy=0x7f77540ca290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:45.402 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:45.391+0000 7f7759d52700 1 -- 172.21.15.27:0/529335396 >> v1:172.21.15.27:6789/0 conn(0x7f7754158ef0 legacy=0x7f77540702e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:45.402 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:45.391+0000 7f7759d52700 1 -- 172.21.15.27:0/529335396 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77540c97b0 con 0x7f77540709f0 2023-07-05T23:35:45.402 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:45.391+0000 7f7759d52700 1 --2- 172.21.15.27:0/529335396 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77540709f0 0x7f77540cf1e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f774400bae0 tx=0x7f774400bdf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=794ab50cca3fc16b server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:45.403 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:45.391+0000 7f7759551700 1 -- 172.21.15.27:0/529335396 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f774400dc70 con 0x7f77540709f0 2023-07-05T23:35:45.403 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:45.391+0000 7f7759551700 1 -- 172.21.15.27:0/529335396 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f774400ddd0 con 0x7f77540709f0 2023-07-05T23:35:45.403 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:45.391+0000 7f7759551700 1 -- 172.21.15.27:0/529335396 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7744010690 con 0x7f77540709f0 2023-07-05T23:35:45.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:45.392+0000 7f775c7b7700 1 -- 172.21.15.27:0/529335396 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77540709f0 msgr2=0x7f77540cf1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:45.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:45.392+0000 7f775c7b7700 1 --2- 172.21.15.27:0/529335396 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77540709f0 0x7f77540cf1e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f774400bae0 tx=0x7f774400bdf0 comp rx=0 tx=0).stop 2023-07-05T23:35:45.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:45.392+0000 7f775c7b7700 1 -- 172.21.15.27:0/529335396 shutdown_connections 2023-07-05T23:35:45.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:45.392+0000 7f775c7b7700 1 --2- 172.21.15.27:0/529335396 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77540709f0 0x7f77540cf1e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:45.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:45.392+0000 7f775c7b7700 1 -- 172.21.15.27:0/529335396 >> 172.21.15.27:0/529335396 conn(0x7f77540b0ef0 msgr2=0x7f77540ce690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:45.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:45.392+0000 7f775c7b7700 1 -- 172.21.15.27:0/529335396 shutdown_connections 2023-07-05T23:35:45.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:45.392+0000 7f775c7b7700 1 -- 172.21.15.27:0/529335396 wait complete. 2023-07-05T23:35:45.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:45.393+0000 7f775c7b7700 1 Processor -- start 2023-07-05T23:35:45.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:45.393+0000 7f775c7b7700 1 -- start start 2023-07-05T23:35:45.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:45.394+0000 7f775c7b7700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f775406c060 0x7f77540c8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:45.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:45.394+0000 7f775c7b7700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f77540709f0 0x7f77540c6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:45.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:45.394+0000 7f775c7b7700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7754158ef0 0x7f775414a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:45.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:45.394+0000 7f775c7b7700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77540c65b0 con 0x7f77540709f0 2023-07-05T23:35:45.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:45.394+0000 7f775c7b7700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77541578c0 con 0x7f775406c060 2023-07-05T23:35:45.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:45.394+0000 7f775c7b7700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77540c67e0 con 0x7f7754158ef0 2023-07-05T23:35:45.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:45.394+0000 7f7759d52700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f77540709f0 0x7f77540c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:45.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:45.394+0000 7f7759d52700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f77540709f0 0x7f77540c6070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46756/0 (socket says 172.21.15.27:46756) 2023-07-05T23:35:45.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:45.394+0000 7f7759d52700 1 -- 172.21.15.27:0/4005789292 learned_addr learned my addr 172.21.15.27:0/4005789292 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:35:45.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:45.395+0000 7f775a553700 1 --2- 172.21.15.27:0/4005789292 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f775406c060 0x7f77540c8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:45.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:45.395+0000 7f775ad54700 1 --2- 172.21.15.27:0/4005789292 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7754158ef0 0x7f775414a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:45.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:45.395+0000 7f7759d52700 1 -- 172.21.15.27:0/4005789292 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7754158ef0 msgr2=0x7f775414a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:45.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:45.395+0000 7f7759d52700 1 --2- 172.21.15.27:0/4005789292 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7754158ef0 0x7f775414a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:45.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:45.395+0000 7f7759d52700 1 -- 172.21.15.27:0/4005789292 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f775406c060 msgr2=0x7f77540c8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:45.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:45.395+0000 7f7759d52700 1 --2- 172.21.15.27:0/4005789292 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f775406c060 0x7f77540c8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:45.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:45.395+0000 7f7759d52700 1 -- 172.21.15.27:0/4005789292 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f774400b740 con 0x7f77540709f0 2023-07-05T23:35:45.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:45.395+0000 7f775a553700 1 --2- 172.21.15.27:0/4005789292 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f775406c060 0x7f77540c8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T23:35:45.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:45.395+0000 7f7759d52700 1 --2- 172.21.15.27:0/4005789292 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f77540709f0 0x7f77540c6070 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f774400b2c0 tx=0x7f7744004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:45.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:45.395+0000 7f774affd700 1 -- 172.21.15.27:0/4005789292 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7744003c70 con 0x7f77540709f0 2023-07-05T23:35:45.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:45.395+0000 7f774affd700 1 -- 172.21.15.27:0/4005789292 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7744003dd0 con 0x7f77540709f0 2023-07-05T23:35:45.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:45.395+0000 7f775c7b7700 1 -- 172.21.15.27:0/4005789292 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7754156f90 con 0x7f77540709f0 2023-07-05T23:35:45.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:45.395+0000 7f774affd700 1 -- 172.21.15.27:0/4005789292 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7744010670 con 0x7f77540709f0 2023-07-05T23:35:45.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:45.395+0000 7f775c7b7700 1 -- 172.21.15.27:0/4005789292 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7754157550 con 0x7f77540709f0 2023-07-05T23:35:45.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:45.396+0000 7f775c7b7700 1 -- 172.21.15.27:0/4005789292 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7754157710 con 0x7f77540709f0 2023-07-05T23:35:45.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:45.397+0000 7f774affd700 1 -- 172.21.15.27:0/4005789292 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7744019400 con 0x7f77540709f0 2023-07-05T23:35:45.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:45.397+0000 7f774affd700 1 --2- 172.21.15.27:0/4005789292 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f773806ace0 0x7f773806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:35:45.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:45.397+0000 7f774affd700 1 -- 172.21.15.27:0/4005789292 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f774408b270 con 0x7f77540709f0 2023-07-05T23:35:45.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:45.397+0000 7f775a553700 1 --2- 172.21.15.27:0/4005789292 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f773806ace0 0x7f773806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:35:45.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:45.398+0000 7f775a553700 1 --2- 172.21.15.27:0/4005789292 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f773806ace0 0x7f773806d190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f77500011e0 tx=0x7f7750009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:35:45.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:45.402+0000 7f774affd700 1 -- 172.21.15.27:0/4005789292 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7744056080 con 0x7f77540709f0 2023-07-05T23:35:45.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:45.596+0000 7f775c7b7700 1 -- 172.21.15.27:0/4005789292 --> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f77540c9d70 con 0x7f773806ace0 2023-07-05T23:35:45.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:45.608+0000 7f774affd700 1 -- 172.21.15.27:0/4005789292 <== mgr.4105 v2:172.21.15.162:6832/3790028097 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+390157 (secure 0 0 0) 0x7f7750001c70 con 0x7f773806ace0 2023-07-05T23:35:45.615 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:35:45.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:45.612+0000 7f775c7b7700 1 -- 172.21.15.27:0/4005789292 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f773806ace0 msgr2=0x7f773806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:45.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:45.612+0000 7f775c7b7700 1 --2- 172.21.15.27:0/4005789292 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f773806ace0 0x7f773806d190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f77500011e0 tx=0x7f7750009040 comp rx=0 tx=0).stop 2023-07-05T23:35:45.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:45.612+0000 7f775c7b7700 1 -- 172.21.15.27:0/4005789292 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f77540709f0 msgr2=0x7f77540c6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:35:45.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:45.612+0000 7f775c7b7700 1 --2- 172.21.15.27:0/4005789292 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f77540709f0 0x7f77540c6070 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f774400b2c0 tx=0x7f7744004750 comp rx=0 tx=0).stop 2023-07-05T23:35:45.620 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:45.612+0000 7f775c7b7700 1 -- 172.21.15.27:0/4005789292 shutdown_connections 2023-07-05T23:35:45.620 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:45.612+0000 7f775c7b7700 1 --2- 172.21.15.27:0/4005789292 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f775406c060 0x7f77540c8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:45.620 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:45.612+0000 7f775c7b7700 1 --2- 172.21.15.27:0/4005789292 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f773806ace0 0x7f773806d190 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:45.620 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:45.612+0000 7f775c7b7700 1 --2- 172.21.15.27:0/4005789292 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7754158ef0 0x7f775414a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:45.621 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:45.612+0000 7f775c7b7700 1 --2- 172.21.15.27:0/4005789292 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f77540709f0 0x7f77540c6070 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:35:45.621 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:45.612+0000 7f775c7b7700 1 -- 172.21.15.27:0/4005789292 >> 172.21.15.27:0/4005789292 conn(0x7f77540b0ef0 msgr2=0x7f77540ce640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:35:45.621 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:45.612+0000 7f775c7b7700 1 -- 172.21.15.27:0/4005789292 shutdown_connections 2023-07-05T23:35:45.621 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:35:45.612+0000 7f775c7b7700 1 -- 172.21.15.27:0/4005789292 wait complete. 2023-07-05T23:35:45.622 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2023-07-05T23:35:45.628 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":115,"stamp":"2023-07-05T23:35:43.683436+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":102790929,"num_objects":49,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":131,"num_read_kb":117,"num_write":1261,"num_write_kb":1290376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17764,"ondisk_log_size":17764,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":464064,"kb_used_data":203392,"kb_used_omap":0,"kb_used_meta":260608,"kb_avail":754510656,"statfs":{"total":773094113280,"available":772618911744,"internally_reserved":0,"allocated":208273408,"data_stored":206692626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":266862592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":9460,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003997"},"pg_stats":[{"pgid":"4.3f","version":"30'28","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:28.077809+0000","last_change":"2023-07-05T23:35:28.077860+0000","last_active":"2023-07-05T23:35:28.077809+0000","last_peered":"2023-07-05T23:35:28.077809+0000","last_clean":"2023-07-05T23:35:28.077809+0000","last_became_active":"2023-07-05T23:32:53.342061+0000","last_became_peered":"2023-07-05T23:32:53.342061+0000","last_unstale":"2023-07-05T23:35:28.077809+0000","last_undegraded":"2023-07-05T23:35:28.077809+0000","last_fullsized":"2023-07-05T23:35:28.077809+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'28","last_scrub_stamp":"2023-07-05T23:35:28.077703+0000","last_deep_scrub":"30'28","last_deep_scrub_stamp":"2023-07-05T23:35:28.077703+0000","last_clean_scrub_stamp":"2023-07-05T23:35:28.077703+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:53:22.483440+0000","scrub_duration":0.0019331699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"30'27","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:26.826504+0000","last_change":"2023-07-05T23:35:26.826592+0000","last_active":"2023-07-05T23:35:26.826504+0000","last_peered":"2023-07-05T23:35:26.826504+0000","last_clean":"2023-07-05T23:35:26.826504+0000","last_became_active":"2023-07-05T23:32:53.342843+0000","last_became_peered":"2023-07-05T23:32:53.342843+0000","last_unstale":"2023-07-05T23:35:26.826504+0000","last_undegraded":"2023-07-05T23:35:26.826504+0000","last_fullsized":"2023-07-05T23:35:26.826504+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'27","last_scrub_stamp":"2023-07-05T23:35:26.826382+0000","last_deep_scrub":"30'27","last_deep_scrub_stamp":"2023-07-05T23:35:26.826382+0000","last_clean_scrub_stamp":"2023-07-05T23:35:26.826382+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:27:33.841616+0000","scrub_duration":0.002058448,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"30'43","reported_seq":68,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.285039+0000","last_change":"2023-07-05T23:32:53.339304+0000","last_active":"2023-07-05T23:35:17.285039+0000","last_peered":"2023-07-05T23:35:17.285039+0000","last_clean":"2023-07-05T23:35:17.285039+0000","last_became_active":"2023-07-05T23:32:53.338973+0000","last_became_peered":"2023-07-05T23:32:53.338973+0000","last_unstale":"2023-07-05T23:35:17.285039+0000","last_undegraded":"2023-07-05T23:35:17.285039+0000","last_fullsized":"2023-07-05T23:35:17.285039+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"30'24","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:33.415555+0000","last_change":"2023-07-05T23:35:33.415615+0000","last_active":"2023-07-05T23:35:33.415555+0000","last_peered":"2023-07-05T23:35:33.415555+0000","last_clean":"2023-07-05T23:35:33.415555+0000","last_became_active":"2023-07-05T23:32:53.334473+0000","last_became_peered":"2023-07-05T23:32:53.334473+0000","last_unstale":"2023-07-05T23:35:33.415555+0000","last_undegraded":"2023-07-05T23:35:33.415555+0000","last_fullsized":"2023-07-05T23:35:33.415555+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'24","last_scrub_stamp":"2023-07-05T23:35:33.415463+0000","last_deep_scrub":"30'24","last_deep_scrub_stamp":"2023-07-05T23:35:33.415463+0000","last_clean_scrub_stamp":"2023-07-05T23:35:33.415463+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:35:57.145092+0000","scrub_duration":0.0017828779999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"30'34","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:21.145675+0000","last_change":"2023-07-05T23:32:53.346034+0000","last_active":"2023-07-05T23:35:21.145675+0000","last_peered":"2023-07-05T23:35:21.145675+0000","last_clean":"2023-07-05T23:35:21.145675+0000","last_became_active":"2023-07-05T23:32:53.345743+0000","last_became_peered":"2023-07-05T23:32:53.345743+0000","last_unstale":"2023-07-05T23:35:21.145675+0000","last_undegraded":"2023-07-05T23:35:21.145675+0000","last_fullsized":"2023-07-05T23:35:21.145675+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"30'39","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:23.256592+0000","last_change":"2023-07-05T23:32:53.335744+0000","last_active":"2023-07-05T23:35:23.256592+0000","last_peered":"2023-07-05T23:35:23.256592+0000","last_clean":"2023-07-05T23:35:23.256592+0000","last_became_active":"2023-07-05T23:32:53.335456+0000","last_became_peered":"2023-07-05T23:32:53.335456+0000","last_unstale":"2023-07-05T23:35:23.256592+0000","last_undegraded":"2023-07-05T23:35:23.256592+0000","last_fullsized":"2023-07-05T23:35:23.256592+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"30'27","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:24.813471+0000","last_change":"2023-07-05T23:32:53.341154+0000","last_active":"2023-07-05T23:35:24.813471+0000","last_peered":"2023-07-05T23:35:24.813471+0000","last_clean":"2023-07-05T23:35:24.813471+0000","last_became_active":"2023-07-05T23:32:53.340639+0000","last_became_peered":"2023-07-05T23:32:53.340639+0000","last_unstale":"2023-07-05T23:35:24.813471+0000","last_undegraded":"2023-07-05T23:35:24.813471+0000","last_fullsized":"2023-07-05T23:35:24.813471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"30'31","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:29.789118+0000","last_change":"2023-07-05T23:35:29.789172+0000","last_active":"2023-07-05T23:35:29.789118+0000","last_peered":"2023-07-05T23:35:29.789118+0000","last_clean":"2023-07-05T23:35:29.789118+0000","last_became_active":"2023-07-05T23:32:53.336216+0000","last_became_peered":"2023-07-05T23:32:53.336216+0000","last_unstale":"2023-07-05T23:35:29.789118+0000","last_undegraded":"2023-07-05T23:35:29.789118+0000","last_fullsized":"2023-07-05T23:35:29.789118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'31","last_scrub_stamp":"2023-07-05T23:35:29.789015+0000","last_deep_scrub":"30'31","last_deep_scrub_stamp":"2023-07-05T23:35:29.789015+0000","last_clean_scrub_stamp":"2023-07-05T23:35:29.789015+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:06:48.212448+0000","scrub_duration":0.001571259,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"30'38","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:20.630963+0000","last_change":"2023-07-05T23:32:53.348265+0000","last_active":"2023-07-05T23:35:20.630963+0000","last_peered":"2023-07-05T23:35:20.630963+0000","last_clean":"2023-07-05T23:35:20.630963+0000","last_became_active":"2023-07-05T23:32:53.347948+0000","last_became_peered":"2023-07-05T23:32:53.347948+0000","last_unstale":"2023-07-05T23:35:20.630963+0000","last_undegraded":"2023-07-05T23:35:20.630963+0000","last_fullsized":"2023-07-05T23:35:20.630963+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"30'44","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:20.635102+0000","last_change":"2023-07-05T23:32:53.330422+0000","last_active":"2023-07-05T23:35:20.635102+0000","last_peered":"2023-07-05T23:35:20.635102+0000","last_clean":"2023-07-05T23:35:20.635102+0000","last_became_active":"2023-07-05T23:32:53.330135+0000","last_became_peered":"2023-07-05T23:32:53.330135+0000","last_unstale":"2023-07-05T23:35:20.635102+0000","last_undegraded":"2023-07-05T23:35:20.635102+0000","last_fullsized":"2023-07-05T23:35:20.635102+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"30'25","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:20.624238+0000","last_change":"2023-07-05T23:32:53.341815+0000","last_active":"2023-07-05T23:35:20.624238+0000","last_peered":"2023-07-05T23:35:20.624238+0000","last_clean":"2023-07-05T23:35:20.624238+0000","last_became_active":"2023-07-05T23:32:53.341526+0000","last_became_peered":"2023-07-05T23:32:53.341526+0000","last_unstale":"2023-07-05T23:35:20.624238+0000","last_undegraded":"2023-07-05T23:35:20.624238+0000","last_fullsized":"2023-07-05T23:35:20.624238+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"30'30","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:39.129286+0000","last_change":"2023-07-05T23:35:39.129369+0000","last_active":"2023-07-05T23:35:39.129286+0000","last_peered":"2023-07-05T23:35:39.129286+0000","last_clean":"2023-07-05T23:35:39.129286+0000","last_became_active":"2023-07-05T23:32:53.337279+0000","last_became_peered":"2023-07-05T23:32:53.337279+0000","last_unstale":"2023-07-05T23:35:39.129286+0000","last_undegraded":"2023-07-05T23:35:39.129286+0000","last_fullsized":"2023-07-05T23:35:39.129286+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'30","last_scrub_stamp":"2023-07-05T23:35:39.129160+0000","last_deep_scrub":"30'30","last_deep_scrub_stamp":"2023-07-05T23:35:39.129160+0000","last_clean_scrub_stamp":"2023-07-05T23:35:39.129160+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:01:23.384296+0000","scrub_duration":0.0019447869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"30'30","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:31.043742+0000","last_change":"2023-07-05T23:35:31.043789+0000","last_active":"2023-07-05T23:35:31.043742+0000","last_peered":"2023-07-05T23:35:31.043742+0000","last_clean":"2023-07-05T23:35:31.043742+0000","last_became_active":"2023-07-05T23:32:53.336083+0000","last_became_peered":"2023-07-05T23:32:53.336083+0000","last_unstale":"2023-07-05T23:35:31.043742+0000","last_undegraded":"2023-07-05T23:35:31.043742+0000","last_fullsized":"2023-07-05T23:35:31.043742+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'30","last_scrub_stamp":"2023-07-05T23:35:31.043651+0000","last_deep_scrub":"30'30","last_deep_scrub_stamp":"2023-07-05T23:35:31.043651+0000","last_clean_scrub_stamp":"2023-07-05T23:35:31.043651+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:00:14.136508+0000","scrub_duration":0.001589949,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"30'32","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.292456+0000","last_change":"2023-07-05T23:32:53.328235+0000","last_active":"2023-07-05T23:35:17.292456+0000","last_peered":"2023-07-05T23:35:17.292456+0000","last_clean":"2023-07-05T23:35:17.292456+0000","last_became_active":"2023-07-05T23:32:53.327918+0000","last_became_peered":"2023-07-05T23:32:53.327918+0000","last_unstale":"2023-07-05T23:35:17.292456+0000","last_undegraded":"2023-07-05T23:35:17.292456+0000","last_fullsized":"2023-07-05T23:35:17.292456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"30'31","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.295807+0000","last_change":"2023-07-05T23:32:53.340929+0000","last_active":"2023-07-05T23:35:17.295807+0000","last_peered":"2023-07-05T23:35:17.295807+0000","last_clean":"2023-07-05T23:35:17.295807+0000","last_became_active":"2023-07-05T23:32:53.340246+0000","last_became_peered":"2023-07-05T23:32:53.340246+0000","last_unstale":"2023-07-05T23:35:17.295807+0000","last_undegraded":"2023-07-05T23:35:17.295807+0000","last_fullsized":"2023-07-05T23:35:17.295807+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"30'39","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.293979+0000","last_change":"2023-07-05T23:32:53.336278+0000","last_active":"2023-07-05T23:35:17.293979+0000","last_peered":"2023-07-05T23:35:17.293979+0000","last_clean":"2023-07-05T23:35:17.293979+0000","last_became_active":"2023-07-05T23:32:53.336006+0000","last_became_peered":"2023-07-05T23:32:53.336006+0000","last_unstale":"2023-07-05T23:35:17.293979+0000","last_undegraded":"2023-07-05T23:35:17.293979+0000","last_fullsized":"2023-07-05T23:35:17.293979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"30'34","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.290778+0000","last_change":"2023-07-05T23:32:53.346115+0000","last_active":"2023-07-05T23:35:17.290778+0000","last_peered":"2023-07-05T23:35:17.290778+0000","last_clean":"2023-07-05T23:35:17.290778+0000","last_became_active":"2023-07-05T23:32:53.345848+0000","last_became_peered":"2023-07-05T23:32:53.345848+0000","last_unstale":"2023-07-05T23:35:17.290778+0000","last_undegraded":"2023-07-05T23:35:17.290778+0000","last_fullsized":"2023-07-05T23:35:17.290778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"30'29","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.292602+0000","last_change":"2023-07-05T23:32:53.339001+0000","last_active":"2023-07-05T23:35:17.292602+0000","last_peered":"2023-07-05T23:35:17.292602+0000","last_clean":"2023-07-05T23:35:17.292602+0000","last_became_active":"2023-07-05T23:32:53.335535+0000","last_became_peered":"2023-07-05T23:32:53.335535+0000","last_unstale":"2023-07-05T23:35:17.292602+0000","last_undegraded":"2023-07-05T23:35:17.292602+0000","last_fullsized":"2023-07-05T23:35:17.292602+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"30'31","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:27.082265+0000","last_change":"2023-07-05T23:35:27.082315+0000","last_active":"2023-07-05T23:35:27.082265+0000","last_peered":"2023-07-05T23:35:27.082265+0000","last_clean":"2023-07-05T23:35:27.082265+0000","last_became_active":"2023-07-05T23:32:53.338095+0000","last_became_peered":"2023-07-05T23:32:53.338095+0000","last_unstale":"2023-07-05T23:35:27.082265+0000","last_undegraded":"2023-07-05T23:35:27.082265+0000","last_fullsized":"2023-07-05T23:35:27.082265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'31","last_scrub_stamp":"2023-07-05T23:35:27.082179+0000","last_deep_scrub":"30'31","last_deep_scrub_stamp":"2023-07-05T23:35:27.082179+0000","last_clean_scrub_stamp":"2023-07-05T23:35:27.082179+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:05:57.887925+0000","scrub_duration":0.0021665159999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"30'34","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:32.375023+0000","last_change":"2023-07-05T23:35:32.375073+0000","last_active":"2023-07-05T23:35:32.375023+0000","last_peered":"2023-07-05T23:35:32.375023+0000","last_clean":"2023-07-05T23:35:32.375023+0000","last_became_active":"2023-07-05T23:32:53.341783+0000","last_became_peered":"2023-07-05T23:32:53.341783+0000","last_unstale":"2023-07-05T23:35:32.375023+0000","last_undegraded":"2023-07-05T23:35:32.375023+0000","last_fullsized":"2023-07-05T23:35:32.375023+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'34","last_scrub_stamp":"2023-07-05T23:35:32.374915+0000","last_deep_scrub":"30'34","last_deep_scrub_stamp":"2023-07-05T23:35:32.374915+0000","last_clean_scrub_stamp":"2023-07-05T23:35:32.374915+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:37:36.010693+0000","scrub_duration":0.0016638619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"30'40","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.291720+0000","last_change":"2023-07-05T23:32:53.348405+0000","last_active":"2023-07-05T23:35:17.291720+0000","last_peered":"2023-07-05T23:35:17.291720+0000","last_clean":"2023-07-05T23:35:17.291720+0000","last_became_active":"2023-07-05T23:32:53.348108+0000","last_became_peered":"2023-07-05T23:32:53.348108+0000","last_unstale":"2023-07-05T23:35:17.291720+0000","last_undegraded":"2023-07-05T23:35:17.291720+0000","last_fullsized":"2023-07-05T23:35:17.291720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"30'32","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:39.617241+0000","last_change":"2023-07-05T23:35:39.617299+0000","last_active":"2023-07-05T23:35:39.617241+0000","last_peered":"2023-07-05T23:35:39.617241+0000","last_clean":"2023-07-05T23:35:39.617241+0000","last_became_active":"2023-07-05T23:32:53.340698+0000","last_became_peered":"2023-07-05T23:32:53.340698+0000","last_unstale":"2023-07-05T23:35:39.617241+0000","last_undegraded":"2023-07-05T23:35:39.617241+0000","last_fullsized":"2023-07-05T23:35:39.617241+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-07-05T23:35:39.617135+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-07-05T23:35:39.617135+0000","last_clean_scrub_stamp":"2023-07-05T23:35:39.617135+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:23:59.478196+0000","scrub_duration":0.001562581,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"30'36","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.286201+0000","last_change":"2023-07-05T23:32:53.345981+0000","last_active":"2023-07-05T23:35:17.286201+0000","last_peered":"2023-07-05T23:35:17.286201+0000","last_clean":"2023-07-05T23:35:17.286201+0000","last_became_active":"2023-07-05T23:32:53.345403+0000","last_became_peered":"2023-07-05T23:32:53.345403+0000","last_unstale":"2023-07-05T23:35:17.286201+0000","last_undegraded":"2023-07-05T23:35:17.286201+0000","last_fullsized":"2023-07-05T23:35:17.286201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"30'31","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.291687+0000","last_change":"2023-07-05T23:32:53.348335+0000","last_active":"2023-07-05T23:35:17.291687+0000","last_peered":"2023-07-05T23:35:17.291687+0000","last_clean":"2023-07-05T23:35:17.291687+0000","last_became_active":"2023-07-05T23:32:53.348053+0000","last_became_peered":"2023-07-05T23:32:53.348053+0000","last_unstale":"2023-07-05T23:35:17.291687+0000","last_undegraded":"2023-07-05T23:35:17.291687+0000","last_fullsized":"2023-07-05T23:35:17.291687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"30'25","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.295204+0000","last_change":"2023-07-05T23:32:53.339227+0000","last_active":"2023-07-05T23:35:17.295204+0000","last_peered":"2023-07-05T23:35:17.295204+0000","last_clean":"2023-07-05T23:35:17.295204+0000","last_became_active":"2023-07-05T23:32:53.338935+0000","last_became_peered":"2023-07-05T23:32:53.338935+0000","last_unstale":"2023-07-05T23:35:17.295204+0000","last_undegraded":"2023-07-05T23:35:17.295204+0000","last_fullsized":"2023-07-05T23:35:17.295204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"30'38","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.292030+0000","last_change":"2023-07-05T23:33:34.898632+0000","last_active":"2023-07-05T23:35:17.292030+0000","last_peered":"2023-07-05T23:35:17.292030+0000","last_clean":"2023-07-05T23:35:17.292030+0000","last_became_active":"2023-07-05T23:33:34.898383+0000","last_became_peered":"2023-07-05T23:33:34.898383+0000","last_unstale":"2023-07-05T23:35:17.292030+0000","last_undegraded":"2023-07-05T23:35:17.292030+0000","last_fullsized":"2023-07-05T23:35:17.292030+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.25","version":"30'26","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:23.832669+0000","last_change":"2023-07-05T23:35:23.832721+0000","last_active":"2023-07-05T23:35:23.832669+0000","last_peered":"2023-07-05T23:35:23.832669+0000","last_clean":"2023-07-05T23:35:23.832669+0000","last_became_active":"2023-07-05T23:32:53.335857+0000","last_became_peered":"2023-07-05T23:32:53.335857+0000","last_unstale":"2023-07-05T23:35:23.832669+0000","last_undegraded":"2023-07-05T23:35:23.832669+0000","last_fullsized":"2023-07-05T23:35:23.832669+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'26","last_scrub_stamp":"2023-07-05T23:35:23.832558+0000","last_deep_scrub":"30'26","last_deep_scrub_stamp":"2023-07-05T23:35:23.832558+0000","last_clean_scrub_stamp":"2023-07-05T23:35:23.832558+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:24:02.493000+0000","scrub_duration":0.001482206,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"30'479","reported_seq":498,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:23.256642+0000","last_change":"2023-07-05T23:32:57.365825+0000","last_active":"2023-07-05T23:35:23.256642+0000","last_peered":"2023-07-05T23:35:23.256642+0000","last_clean":"2023-07-05T23:35:23.256642+0000","last_became_active":"2023-07-05T23:32:57.365409+0000","last_became_peered":"2023-07-05T23:32:57.365409+0000","last_unstale":"2023-07-05T23:35:23.256642+0000","last_undegraded":"2023-07-05T23:35:23.256642+0000","last_fullsized":"2023-07-05T23:35:23.256642+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:23.256351+0000","last_change":"2023-07-05T23:32:52.901348+0000","last_active":"2023-07-05T23:35:23.256351+0000","last_peered":"2023-07-05T23:35:23.256351+0000","last_clean":"2023-07-05T23:35:23.256351+0000","last_became_active":"2023-07-05T23:32:52.901080+0000","last_became_peered":"2023-07-05T23:32:52.901080+0000","last_unstale":"2023-07-05T23:35:23.256351+0000","last_undegraded":"2023-07-05T23:35:23.256351+0000","last_fullsized":"2023-07-05T23:35:23.256351+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'39","reported_seq":72,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:22.793480+0000","last_change":"2023-07-05T23:35:22.793480+0000","last_active":"2023-07-05T23:35:22.793480+0000","last_peered":"2023-07-05T23:35:22.793480+0000","last_clean":"2023-07-05T23:35:22.793480+0000","last_became_active":"2023-07-05T23:32:53.339464+0000","last_became_peered":"2023-07-05T23:32:53.339464+0000","last_unstale":"2023-07-05T23:35:22.793480+0000","last_undegraded":"2023-07-05T23:35:22.793480+0000","last_fullsized":"2023-07-05T23:35:22.793480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'39","last_scrub_stamp":"2023-07-05T23:35:22.793364+0000","last_deep_scrub":"30'39","last_deep_scrub_stamp":"2023-07-05T23:35:22.793364+0000","last_clean_scrub_stamp":"2023-07-05T23:35:22.793364+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:46:08.645177+0000","scrub_duration":0.0015116330000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"30'446","reported_seq":465,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:15.488901+0000","last_change":"2023-07-05T23:32:57.354002+0000","last_active":"2023-07-05T23:35:15.488901+0000","last_peered":"2023-07-05T23:35:15.488901+0000","last_clean":"2023-07-05T23:35:15.488901+0000","last_became_active":"2023-07-05T23:32:57.353465+0000","last_became_peered":"2023-07-05T23:32:57.353465+0000","last_unstale":"2023-07-05T23:35:15.488901+0000","last_undegraded":"2023-07-05T23:35:15.488901+0000","last_fullsized":"2023-07-05T23:35:15.488901+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:33.568592+0000","last_change":"2023-07-05T23:35:33.568640+0000","last_active":"2023-07-05T23:35:33.568592+0000","last_peered":"2023-07-05T23:35:33.568592+0000","last_clean":"2023-07-05T23:35:33.568592+0000","last_became_active":"2023-07-05T23:32:52.909347+0000","last_became_peered":"2023-07-05T23:32:52.909347+0000","last_unstale":"2023-07-05T23:35:33.568592+0000","last_undegraded":"2023-07-05T23:35:33.568592+0000","last_fullsized":"2023-07-05T23:35:33.568592+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:35:33.568495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:35:33.568495+0000","last_clean_scrub_stamp":"2023-07-05T23:35:33.568495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:02:17.042409+0000","scrub_duration":0.001426716,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"30'31","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:21.633620+0000","last_change":"2023-07-05T23:35:21.633689+0000","last_active":"2023-07-05T23:35:21.633620+0000","last_peered":"2023-07-05T23:35:21.633620+0000","last_clean":"2023-07-05T23:35:21.633620+0000","last_became_active":"2023-07-05T23:32:53.338825+0000","last_became_peered":"2023-07-05T23:32:53.338825+0000","last_unstale":"2023-07-05T23:35:21.633620+0000","last_undegraded":"2023-07-05T23:35:21.633620+0000","last_fullsized":"2023-07-05T23:35:21.633620+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'31","last_scrub_stamp":"2023-07-05T23:35:21.633532+0000","last_deep_scrub":"30'31","last_deep_scrub_stamp":"2023-07-05T23:35:21.633532+0000","last_clean_scrub_stamp":"2023-07-05T23:35:21.633532+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:17:27.662797+0000","scrub_duration":0.001837602,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"30'462","reported_seq":481,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.519555+0000","last_change":"2023-07-05T23:32:57.359406+0000","last_active":"2023-07-05T23:35:17.519555+0000","last_peered":"2023-07-05T23:35:17.519555+0000","last_clean":"2023-07-05T23:35:17.519555+0000","last_became_active":"2023-07-05T23:32:57.358965+0000","last_became_peered":"2023-07-05T23:32:57.358965+0000","last_unstale":"2023-07-05T23:35:17.519555+0000","last_undegraded":"2023-07-05T23:35:17.519555+0000","last_fullsized":"2023-07-05T23:35:17.519555+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"30'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:33.640451+0000","last_change":"2023-07-05T23:35:33.640503+0000","last_active":"2023-07-05T23:35:33.640451+0000","last_peered":"2023-07-05T23:35:33.640451+0000","last_clean":"2023-07-05T23:35:33.640451+0000","last_became_active":"2023-07-05T23:32:52.908756+0000","last_became_peered":"2023-07-05T23:32:52.908756+0000","last_unstale":"2023-07-05T23:35:33.640451+0000","last_undegraded":"2023-07-05T23:35:33.640451+0000","last_fullsized":"2023-07-05T23:35:33.640451+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2023-07-05T23:35:33.640351+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2023-07-05T23:35:33.640351+0000","last_clean_scrub_stamp":"2023-07-05T23:35:33.640351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:23:53.501412+0000","scrub_duration":0.001423014,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"30'30","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.286946+0000","last_change":"2023-07-05T23:32:53.337872+0000","last_active":"2023-07-05T23:35:17.286946+0000","last_peered":"2023-07-05T23:35:17.286946+0000","last_clean":"2023-07-05T23:35:17.286946+0000","last_became_active":"2023-07-05T23:32:53.337480+0000","last_became_peered":"2023-07-05T23:32:53.337480+0000","last_unstale":"2023-07-05T23:35:17.286946+0000","last_undegraded":"2023-07-05T23:35:17.286946+0000","last_fullsized":"2023-07-05T23:35:17.286946+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"30'473","reported_seq":492,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:20.623566+0000","last_change":"2023-07-05T23:32:57.356296+0000","last_active":"2023-07-05T23:35:20.623566+0000","last_peered":"2023-07-05T23:35:20.623566+0000","last_clean":"2023-07-05T23:35:20.623566+0000","last_became_active":"2023-07-05T23:32:57.355940+0000","last_became_peered":"2023-07-05T23:32:57.355940+0000","last_unstale":"2023-07-05T23:35:20.623566+0000","last_undegraded":"2023-07-05T23:35:20.623566+0000","last_fullsized":"2023-07-05T23:35:20.623566+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"30'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:36.599539+0000","last_change":"2023-07-05T23:35:36.599624+0000","last_active":"2023-07-05T23:35:36.599539+0000","last_peered":"2023-07-05T23:35:36.599539+0000","last_clean":"2023-07-05T23:35:36.599539+0000","last_became_active":"2023-07-05T23:32:52.904140+0000","last_became_peered":"2023-07-05T23:32:52.904140+0000","last_unstale":"2023-07-05T23:35:36.599539+0000","last_undegraded":"2023-07-05T23:35:36.599539+0000","last_fullsized":"2023-07-05T23:35:36.599539+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2023-07-05T23:35:36.599420+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2023-07-05T23:35:36.599420+0000","last_clean_scrub_stamp":"2023-07-05T23:35:36.599420+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:06:55.022852+0000","scrub_duration":0.0020385260000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"30'27","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:37.731303+0000","last_change":"2023-07-05T23:35:37.731363+0000","last_active":"2023-07-05T23:35:37.731303+0000","last_peered":"2023-07-05T23:35:37.731303+0000","last_clean":"2023-07-05T23:35:37.731303+0000","last_became_active":"2023-07-05T23:32:53.338248+0000","last_became_peered":"2023-07-05T23:32:53.338248+0000","last_unstale":"2023-07-05T23:35:37.731303+0000","last_undegraded":"2023-07-05T23:35:37.731303+0000","last_fullsized":"2023-07-05T23:35:37.731303+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'27","last_scrub_stamp":"2023-07-05T23:35:37.731211+0000","last_deep_scrub":"30'27","last_deep_scrub_stamp":"2023-07-05T23:35:37.731211+0000","last_clean_scrub_stamp":"2023-07-05T23:35:37.731211+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:55:31.804023+0000","scrub_duration":0.001714728,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"30'457","reported_seq":476,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:20.630970+0000","last_change":"2023-07-05T23:32:57.357483+0000","last_active":"2023-07-05T23:35:20.630970+0000","last_peered":"2023-07-05T23:35:20.630970+0000","last_clean":"2023-07-05T23:35:20.630970+0000","last_became_active":"2023-07-05T23:32:57.357039+0000","last_became_peered":"2023-07-05T23:32:57.357039+0000","last_unstale":"2023-07-05T23:35:20.630970+0000","last_undegraded":"2023-07-05T23:35:20.630970+0000","last_fullsized":"2023-07-05T23:35:20.630970+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:37.856933+0000","last_change":"2023-07-05T23:35:37.857007+0000","last_active":"2023-07-05T23:35:37.856933+0000","last_peered":"2023-07-05T23:35:37.856933+0000","last_clean":"2023-07-05T23:35:37.856933+0000","last_became_active":"2023-07-05T23:32:52.900352+0000","last_became_peered":"2023-07-05T23:32:52.900352+0000","last_unstale":"2023-07-05T23:35:37.856933+0000","last_undegraded":"2023-07-05T23:35:37.856933+0000","last_fullsized":"2023-07-05T23:35:37.856933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:35:37.856826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:35:37.856826+0000","last_clean_scrub_stamp":"2023-07-05T23:35:37.856826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:47:38.944891+0000","scrub_duration":0.001391553,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"30'36","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.291478+0000","last_change":"2023-07-05T23:32:53.346621+0000","last_active":"2023-07-05T23:35:17.291478+0000","last_peered":"2023-07-05T23:35:17.291478+0000","last_clean":"2023-07-05T23:35:17.291478+0000","last_became_active":"2023-07-05T23:32:53.346373+0000","last_became_peered":"2023-07-05T23:32:53.346373+0000","last_unstale":"2023-07-05T23:35:17.291478+0000","last_undegraded":"2023-07-05T23:35:17.291478+0000","last_fullsized":"2023-07-05T23:35:17.291478+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"30'483","reported_seq":502,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:20.631469+0000","last_change":"2023-07-05T23:32:57.365669+0000","last_active":"2023-07-05T23:35:20.631469+0000","last_peered":"2023-07-05T23:35:20.631469+0000","last_clean":"2023-07-05T23:35:20.631469+0000","last_became_active":"2023-07-05T23:32:57.365200+0000","last_became_peered":"2023-07-05T23:32:57.365200+0000","last_unstale":"2023-07-05T23:35:20.631469+0000","last_undegraded":"2023-07-05T23:35:20.631469+0000","last_fullsized":"2023-07-05T23:35:20.631469+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"30'13","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:20.631082+0000","last_change":"2023-07-05T23:32:52.913055+0000","last_active":"2023-07-05T23:35:20.631082+0000","last_peered":"2023-07-05T23:35:20.631082+0000","last_clean":"2023-07-05T23:35:20.631082+0000","last_became_active":"2023-07-05T23:32:52.912749+0000","last_became_peered":"2023-07-05T23:32:52.912749+0000","last_unstale":"2023-07-05T23:35:20.631082+0000","last_undegraded":"2023-07-05T23:35:20.631082+0000","last_fullsized":"2023-07-05T23:35:20.631082+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"30'42","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.296021+0000","last_change":"2023-07-05T23:32:53.339331+0000","last_active":"2023-07-05T23:35:17.296021+0000","last_peered":"2023-07-05T23:35:17.296021+0000","last_clean":"2023-07-05T23:35:17.296021+0000","last_became_active":"2023-07-05T23:32:53.339001+0000","last_became_peered":"2023-07-05T23:32:53.339001+0000","last_unstale":"2023-07-05T23:35:17.296021+0000","last_undegraded":"2023-07-05T23:35:17.296021+0000","last_fullsized":"2023-07-05T23:35:17.296021+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"30'476","reported_seq":495,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:20.608269+0000","last_change":"2023-07-05T23:32:57.354307+0000","last_active":"2023-07-05T23:35:20.608269+0000","last_peered":"2023-07-05T23:35:20.608269+0000","last_clean":"2023-07-05T23:35:20.608269+0000","last_became_active":"2023-07-05T23:32:57.353848+0000","last_became_peered":"2023-07-05T23:32:57.353848+0000","last_unstale":"2023-07-05T23:35:20.608269+0000","last_undegraded":"2023-07-05T23:35:20.608269+0000","last_fullsized":"2023-07-05T23:35:20.608269+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":476,"log_dups_size":0,"ondisk_log_size":476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"30'400","reported_seq":427,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:32.903827+0000","last_change":"2023-07-05T23:32:52.904627+0000","last_active":"2023-07-05T23:35:32.903827+0000","last_peered":"2023-07-05T23:35:32.903827+0000","last_clean":"2023-07-05T23:35:32.903827+0000","last_became_active":"2023-07-05T23:32:52.904318+0000","last_became_peered":"2023-07-05T23:32:52.904318+0000","last_unstale":"2023-07-05T23:35:32.903827+0000","last_undegraded":"2023-07-05T23:35:32.903827+0000","last_fullsized":"2023-07-05T23:35:32.903827+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1528715,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":399,"num_write_kb":1765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"30'41","reported_seq":74,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:38.344828+0000","last_change":"2023-07-05T23:35:38.344911+0000","last_active":"2023-07-05T23:35:38.344828+0000","last_peered":"2023-07-05T23:35:38.344828+0000","last_clean":"2023-07-05T23:35:38.344828+0000","last_became_active":"2023-07-05T23:32:53.339583+0000","last_became_peered":"2023-07-05T23:32:53.339583+0000","last_unstale":"2023-07-05T23:35:38.344828+0000","last_undegraded":"2023-07-05T23:35:38.344828+0000","last_fullsized":"2023-07-05T23:35:38.344828+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'41","last_scrub_stamp":"2023-07-05T23:35:38.344698+0000","last_deep_scrub":"30'41","last_deep_scrub_stamp":"2023-07-05T23:35:38.344698+0000","last_clean_scrub_stamp":"2023-07-05T23:35:38.344698+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:55:53.973802+0000","scrub_duration":0.001677949,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"30'441","reported_seq":460,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:23.767349+0000","last_change":"2023-07-05T23:32:57.365703+0000","last_active":"2023-07-05T23:35:23.767349+0000","last_peered":"2023-07-05T23:35:23.767349+0000","last_clean":"2023-07-05T23:35:23.767349+0000","last_became_active":"2023-07-05T23:32:57.365204+0000","last_became_peered":"2023-07-05T23:32:57.365204+0000","last_unstale":"2023-07-05T23:35:23.767349+0000","last_undegraded":"2023-07-05T23:35:23.767349+0000","last_fullsized":"2023-07-05T23:35:23.767349+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"30'3","reported_seq":30,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:15.630333+0000","last_change":"2023-07-05T23:32:52.908276+0000","last_active":"2023-07-05T23:35:15.630333+0000","last_peered":"2023-07-05T23:35:15.630333+0000","last_clean":"2023-07-05T23:35:15.630333+0000","last_became_active":"2023-07-05T23:32:52.907970+0000","last_became_peered":"2023-07-05T23:32:52.907970+0000","last_unstale":"2023-07-05T23:35:15.630333+0000","last_undegraded":"2023-07-05T23:35:15.630333+0000","last_fullsized":"2023-07-05T23:35:15.630333+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"30'29","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:27.578398+0000","last_change":"2023-07-05T23:35:27.578448+0000","last_active":"2023-07-05T23:35:27.578398+0000","last_peered":"2023-07-05T23:35:27.578398+0000","last_clean":"2023-07-05T23:35:27.578398+0000","last_became_active":"2023-07-05T23:32:53.339827+0000","last_became_peered":"2023-07-05T23:32:53.339827+0000","last_unstale":"2023-07-05T23:35:27.578398+0000","last_undegraded":"2023-07-05T23:35:27.578398+0000","last_fullsized":"2023-07-05T23:35:27.578398+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'29","last_scrub_stamp":"2023-07-05T23:35:27.578299+0000","last_deep_scrub":"30'29","last_deep_scrub_stamp":"2023-07-05T23:35:27.578299+0000","last_clean_scrub_stamp":"2023-07-05T23:35:27.578299+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:27:34.593533+0000","scrub_duration":0.0015027510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"30'475","reported_seq":494,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:20.631485+0000","last_change":"2023-07-05T23:32:57.354664+0000","last_active":"2023-07-05T23:35:20.631485+0000","last_peered":"2023-07-05T23:35:20.631485+0000","last_clean":"2023-07-05T23:35:20.631485+0000","last_became_active":"2023-07-05T23:32:57.354235+0000","last_became_peered":"2023-07-05T23:32:57.354235+0000","last_unstale":"2023-07-05T23:35:20.631485+0000","last_undegraded":"2023-07-05T23:35:20.631485+0000","last_fullsized":"2023-07-05T23:35:20.631485+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:31.639525+0000","last_change":"2023-07-05T23:35:31.639611+0000","last_active":"2023-07-05T23:35:31.639525+0000","last_peered":"2023-07-05T23:35:31.639525+0000","last_clean":"2023-07-05T23:35:31.639525+0000","last_became_active":"2023-07-05T23:32:52.900387+0000","last_became_peered":"2023-07-05T23:32:52.900387+0000","last_unstale":"2023-07-05T23:35:31.639525+0000","last_undegraded":"2023-07-05T23:35:31.639525+0000","last_fullsized":"2023-07-05T23:35:31.639525+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:35:31.639414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:35:31.639414+0000","last_clean_scrub_stamp":"2023-07-05T23:35:31.639414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:02:15.113328+0000","scrub_duration":0.0019919690000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"30'33","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:20.635039+0000","last_change":"2023-07-05T23:32:53.335865+0000","last_active":"2023-07-05T23:35:20.635039+0000","last_peered":"2023-07-05T23:35:20.635039+0000","last_clean":"2023-07-05T23:35:20.635039+0000","last_became_active":"2023-07-05T23:32:53.335513+0000","last_became_peered":"2023-07-05T23:32:53.335513+0000","last_unstale":"2023-07-05T23:35:20.635039+0000","last_undegraded":"2023-07-05T23:35:20.635039+0000","last_fullsized":"2023-07-05T23:35:20.635039+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"30'450","reported_seq":469,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:22.694429+0000","last_change":"2023-07-05T23:32:57.362840+0000","last_active":"2023-07-05T23:35:22.694429+0000","last_peered":"2023-07-05T23:35:22.694429+0000","last_clean":"2023-07-05T23:35:22.694429+0000","last_became_active":"2023-07-05T23:32:57.362407+0000","last_became_peered":"2023-07-05T23:32:57.362407+0000","last_unstale":"2023-07-05T23:35:22.694429+0000","last_undegraded":"2023-07-05T23:35:22.694429+0000","last_fullsized":"2023-07-05T23:35:22.694429+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"30'1","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:15.630279+0000","last_change":"2023-07-05T23:32:52.905899+0000","last_active":"2023-07-05T23:35:15.630279+0000","last_peered":"2023-07-05T23:35:15.630279+0000","last_clean":"2023-07-05T23:35:15.630279+0000","last_became_active":"2023-07-05T23:32:52.905595+0000","last_became_peered":"2023-07-05T23:32:52.905595+0000","last_unstale":"2023-07-05T23:35:15.630279+0000","last_undegraded":"2023-07-05T23:35:15.630279+0000","last_fullsized":"2023-07-05T23:35:15.630279+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"30'40","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:20.630928+0000","last_change":"2023-07-05T23:32:53.342284+0000","last_active":"2023-07-05T23:35:20.630928+0000","last_peered":"2023-07-05T23:35:20.630928+0000","last_clean":"2023-07-05T23:35:20.630928+0000","last_became_active":"2023-07-05T23:32:53.342033+0000","last_became_peered":"2023-07-05T23:32:53.342033+0000","last_unstale":"2023-07-05T23:35:20.630928+0000","last_undegraded":"2023-07-05T23:35:20.630928+0000","last_fullsized":"2023-07-05T23:35:20.630928+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"30'495","reported_seq":514,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:23.767447+0000","last_change":"2023-07-05T23:32:57.360505+0000","last_active":"2023-07-05T23:35:23.767447+0000","last_peered":"2023-07-05T23:35:23.767447+0000","last_clean":"2023-07-05T23:35:23.767447+0000","last_became_active":"2023-07-05T23:32:57.359532+0000","last_became_peered":"2023-07-05T23:32:57.359532+0000","last_unstale":"2023-07-05T23:35:23.767447+0000","last_undegraded":"2023-07-05T23:35:23.767447+0000","last_fullsized":"2023-07-05T23:35:23.767447+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":46080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"30'12","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:27.409720+0000","last_change":"2023-07-05T23:35:27.409779+0000","last_active":"2023-07-05T23:35:27.409720+0000","last_peered":"2023-07-05T23:35:27.409720+0000","last_clean":"2023-07-05T23:35:27.409720+0000","last_became_active":"2023-07-05T23:32:52.903419+0000","last_became_peered":"2023-07-05T23:32:52.903419+0000","last_unstale":"2023-07-05T23:35:27.409720+0000","last_undegraded":"2023-07-05T23:35:27.409720+0000","last_fullsized":"2023-07-05T23:35:27.409720+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'12","last_scrub_stamp":"2023-07-05T23:35:27.409640+0000","last_deep_scrub":"30'12","last_deep_scrub_stamp":"2023-07-05T23:35:27.409640+0000","last_clean_scrub_stamp":"2023-07-05T23:35:27.409640+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:48:23.989282+0000","scrub_duration":0.0045973059999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"30'32","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:25.668033+0000","last_change":"2023-07-05T23:35:25.668080+0000","last_active":"2023-07-05T23:35:25.668033+0000","last_peered":"2023-07-05T23:35:25.668033+0000","last_clean":"2023-07-05T23:35:25.668033+0000","last_became_active":"2023-07-05T23:32:53.341162+0000","last_became_peered":"2023-07-05T23:32:53.341162+0000","last_unstale":"2023-07-05T23:35:25.668033+0000","last_undegraded":"2023-07-05T23:35:25.668033+0000","last_fullsized":"2023-07-05T23:35:25.668033+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-07-05T23:35:25.667940+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-07-05T23:35:25.667940+0000","last_clean_scrub_stamp":"2023-07-05T23:35:25.667940+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:02:09.141854+0000","scrub_duration":0.0023076949999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"30'445","reported_seq":464,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.508452+0000","last_change":"2023-07-05T23:32:57.358009+0000","last_active":"2023-07-05T23:35:17.508452+0000","last_peered":"2023-07-05T23:35:17.508452+0000","last_clean":"2023-07-05T23:35:17.508452+0000","last_became_active":"2023-07-05T23:32:57.357082+0000","last_became_peered":"2023-07-05T23:32:57.357082+0000","last_unstale":"2023-07-05T23:35:17.508452+0000","last_undegraded":"2023-07-05T23:35:17.508452+0000","last_fullsized":"2023-07-05T23:35:17.508452+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"30'2","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:27.155588+0000","last_change":"2023-07-05T23:35:27.155648+0000","last_active":"2023-07-05T23:35:27.155588+0000","last_peered":"2023-07-05T23:35:27.155588+0000","last_clean":"2023-07-05T23:35:27.155588+0000","last_became_active":"2023-07-05T23:32:52.907397+0000","last_became_peered":"2023-07-05T23:32:52.907397+0000","last_unstale":"2023-07-05T23:35:27.155588+0000","last_undegraded":"2023-07-05T23:35:27.155588+0000","last_fullsized":"2023-07-05T23:35:27.155588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2023-07-05T23:35:27.155474+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2023-07-05T23:35:27.155474+0000","last_clean_scrub_stamp":"2023-07-05T23:35:27.155474+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:58:59.604184+0000","scrub_duration":0.00301433,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"30'29","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:24.804906+0000","last_change":"2023-07-05T23:35:24.804959+0000","last_active":"2023-07-05T23:35:24.804906+0000","last_peered":"2023-07-05T23:35:24.804906+0000","last_clean":"2023-07-05T23:35:24.804906+0000","last_became_active":"2023-07-05T23:32:53.333978+0000","last_became_peered":"2023-07-05T23:32:53.333978+0000","last_unstale":"2023-07-05T23:35:24.804906+0000","last_undegraded":"2023-07-05T23:35:24.804906+0000","last_fullsized":"2023-07-05T23:35:24.804906+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'29","last_scrub_stamp":"2023-07-05T23:35:24.804794+0000","last_deep_scrub":"30'29","last_deep_scrub_stamp":"2023-07-05T23:35:24.804794+0000","last_clean_scrub_stamp":"2023-07-05T23:35:24.804794+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:02:08.278708+0000","scrub_duration":0.001601922,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"30'423","reported_seq":442,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:15.500142+0000","last_change":"2023-07-05T23:32:57.362413+0000","last_active":"2023-07-05T23:35:15.500142+0000","last_peered":"2023-07-05T23:35:15.500142+0000","last_clean":"2023-07-05T23:35:15.500142+0000","last_became_active":"2023-07-05T23:32:57.361892+0000","last_became_peered":"2023-07-05T23:32:57.361892+0000","last_unstale":"2023-07-05T23:35:15.500142+0000","last_undegraded":"2023-07-05T23:35:15.500142+0000","last_fullsized":"2023-07-05T23:35:15.500142+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:10.629706+0000","last_change":"2023-07-05T23:32:52.908261+0000","last_active":"2023-07-05T23:35:10.629706+0000","last_peered":"2023-07-05T23:35:10.629706+0000","last_clean":"2023-07-05T23:35:10.629706+0000","last_became_active":"2023-07-05T23:32:52.907975+0000","last_became_peered":"2023-07-05T23:32:52.907975+0000","last_unstale":"2023-07-05T23:35:10.629706+0000","last_undegraded":"2023-07-05T23:35:10.629706+0000","last_fullsized":"2023-07-05T23:35:10.629706+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"30'32","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.297605+0000","last_change":"2023-07-05T23:32:53.339917+0000","last_active":"2023-07-05T23:35:17.297605+0000","last_peered":"2023-07-05T23:35:17.297605+0000","last_clean":"2023-07-05T23:35:17.297605+0000","last_became_active":"2023-07-05T23:32:53.339543+0000","last_became_peered":"2023-07-05T23:32:53.339543+0000","last_unstale":"2023-07-05T23:35:17.297605+0000","last_undegraded":"2023-07-05T23:35:17.297605+0000","last_fullsized":"2023-07-05T23:35:17.297605+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"30'472","reported_seq":491,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.519455+0000","last_change":"2023-07-05T23:32:57.361110+0000","last_active":"2023-07-05T23:35:17.519455+0000","last_peered":"2023-07-05T23:35:17.519455+0000","last_clean":"2023-07-05T23:35:17.519455+0000","last_became_active":"2023-07-05T23:32:57.360614+0000","last_became_peered":"2023-07-05T23:32:57.360614+0000","last_unstale":"2023-07-05T23:35:17.519455+0000","last_undegraded":"2023-07-05T23:35:17.519455+0000","last_fullsized":"2023-07-05T23:35:17.519455+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:10.629689+0000","last_change":"2023-07-05T23:32:52.907840+0000","last_active":"2023-07-05T23:35:10.629689+0000","last_peered":"2023-07-05T23:35:10.629689+0000","last_clean":"2023-07-05T23:35:10.629689+0000","last_became_active":"2023-07-05T23:32:52.907441+0000","last_became_peered":"2023-07-05T23:32:52.907441+0000","last_unstale":"2023-07-05T23:35:10.629689+0000","last_undegraded":"2023-07-05T23:35:10.629689+0000","last_fullsized":"2023-07-05T23:35:10.629689+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"30'32","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:38.470273+0000","last_change":"2023-07-05T23:35:38.470324+0000","last_active":"2023-07-05T23:35:38.470273+0000","last_peered":"2023-07-05T23:35:38.470273+0000","last_clean":"2023-07-05T23:35:38.470273+0000","last_became_active":"2023-07-05T23:32:53.343566+0000","last_became_peered":"2023-07-05T23:32:53.343566+0000","last_unstale":"2023-07-05T23:35:38.470273+0000","last_undegraded":"2023-07-05T23:35:38.470273+0000","last_fullsized":"2023-07-05T23:35:38.470273+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-07-05T23:35:38.470192+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-07-05T23:35:38.470192+0000","last_clean_scrub_stamp":"2023-07-05T23:35:38.470192+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:00:40.790153+0000","scrub_duration":0.0021110870000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"30'486","reported_seq":505,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.515781+0000","last_change":"2023-07-05T23:32:57.356615+0000","last_active":"2023-07-05T23:35:17.515781+0000","last_peered":"2023-07-05T23:35:17.515781+0000","last_clean":"2023-07-05T23:35:17.515781+0000","last_became_active":"2023-07-05T23:32:57.356091+0000","last_became_peered":"2023-07-05T23:32:57.356091+0000","last_unstale":"2023-07-05T23:35:17.515781+0000","last_undegraded":"2023-07-05T23:35:17.515781+0000","last_fullsized":"2023-07-05T23:35:17.515781+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"30'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:32.851440+0000","last_change":"2023-07-05T23:35:32.851538+0000","last_active":"2023-07-05T23:35:32.851440+0000","last_peered":"2023-07-05T23:35:32.851440+0000","last_clean":"2023-07-05T23:35:32.851440+0000","last_became_active":"2023-07-05T23:32:52.905988+0000","last_became_peered":"2023-07-05T23:32:52.905988+0000","last_unstale":"2023-07-05T23:35:32.851440+0000","last_undegraded":"2023-07-05T23:35:32.851440+0000","last_fullsized":"2023-07-05T23:35:32.851440+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2023-07-05T23:35:32.851307+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2023-07-05T23:35:32.851307+0000","last_clean_scrub_stamp":"2023-07-05T23:35:32.851307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:23:52.712368+0000","scrub_duration":0.00186185,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"30'32","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:24.662045+0000","last_change":"2023-07-05T23:35:24.662084+0000","last_active":"2023-07-05T23:35:24.662045+0000","last_peered":"2023-07-05T23:35:24.662045+0000","last_clean":"2023-07-05T23:35:24.662045+0000","last_became_active":"2023-07-05T23:32:53.339382+0000","last_became_peered":"2023-07-05T23:32:53.339382+0000","last_unstale":"2023-07-05T23:35:24.662045+0000","last_undegraded":"2023-07-05T23:35:24.662045+0000","last_fullsized":"2023-07-05T23:35:24.662045+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-07-05T23:35:24.661961+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-07-05T23:35:24.661961+0000","last_clean_scrub_stamp":"2023-07-05T23:35:24.661961+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:58:57.110671+0000","scrub_duration":0.0012445749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"30'472","reported_seq":491,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.513085+0000","last_change":"2023-07-05T23:32:57.354958+0000","last_active":"2023-07-05T23:35:17.513085+0000","last_peered":"2023-07-05T23:35:17.513085+0000","last_clean":"2023-07-05T23:35:17.513085+0000","last_became_active":"2023-07-05T23:32:57.354576+0000","last_became_peered":"2023-07-05T23:32:57.354576+0000","last_unstale":"2023-07-05T23:35:17.513085+0000","last_undegraded":"2023-07-05T23:35:17.513085+0000","last_fullsized":"2023-07-05T23:35:17.513085+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":27648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"30'5","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:30.548358+0000","last_change":"2023-07-05T23:35:30.548410+0000","last_active":"2023-07-05T23:35:30.548358+0000","last_peered":"2023-07-05T23:35:30.548358+0000","last_clean":"2023-07-05T23:35:30.548358+0000","last_became_active":"2023-07-05T23:32:52.906187+0000","last_became_peered":"2023-07-05T23:32:52.906187+0000","last_unstale":"2023-07-05T23:35:30.548358+0000","last_undegraded":"2023-07-05T23:35:30.548358+0000","last_fullsized":"2023-07-05T23:35:30.548358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'5","last_scrub_stamp":"2023-07-05T23:35:30.548235+0000","last_deep_scrub":"30'5","last_deep_scrub_stamp":"2023-07-05T23:35:30.548235+0000","last_clean_scrub_stamp":"2023-07-05T23:35:30.548235+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:06:48.971667+0000","scrub_duration":0.0031165590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"30'27","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:36.389104+0000","last_change":"2023-07-05T23:35:36.389175+0000","last_active":"2023-07-05T23:35:36.389104+0000","last_peered":"2023-07-05T23:35:36.389104+0000","last_clean":"2023-07-05T23:35:36.389104+0000","last_became_active":"2023-07-05T23:32:53.343393+0000","last_became_peered":"2023-07-05T23:32:53.343393+0000","last_unstale":"2023-07-05T23:35:36.389104+0000","last_undegraded":"2023-07-05T23:35:36.389104+0000","last_fullsized":"2023-07-05T23:35:36.389104+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'27","last_scrub_stamp":"2023-07-05T23:35:36.388980+0000","last_deep_scrub":"30'27","last_deep_scrub_stamp":"2023-07-05T23:35:36.388980+0000","last_clean_scrub_stamp":"2023-07-05T23:35:36.388980+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:48:16.805544+0000","scrub_duration":0.0021672190000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"30'457","reported_seq":476,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:15.607503+0000","last_change":"2023-07-05T23:32:57.362812+0000","last_active":"2023-07-05T23:35:15.607503+0000","last_peered":"2023-07-05T23:35:15.607503+0000","last_clean":"2023-07-05T23:35:15.607503+0000","last_became_active":"2023-07-05T23:32:57.362431+0000","last_became_peered":"2023-07-05T23:32:57.362431+0000","last_unstale":"2023-07-05T23:35:15.607503+0000","last_undegraded":"2023-07-05T23:35:15.607503+0000","last_fullsized":"2023-07-05T23:35:15.607503+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"30'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:28.449465+0000","last_change":"2023-07-05T23:35:28.449517+0000","last_active":"2023-07-05T23:35:28.449465+0000","last_peered":"2023-07-05T23:35:28.449465+0000","last_clean":"2023-07-05T23:35:28.449465+0000","last_became_active":"2023-07-05T23:32:52.907983+0000","last_became_peered":"2023-07-05T23:32:52.907983+0000","last_unstale":"2023-07-05T23:35:28.449465+0000","last_undegraded":"2023-07-05T23:35:28.449465+0000","last_fullsized":"2023-07-05T23:35:28.449465+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2023-07-05T23:35:28.449359+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2023-07-05T23:35:28.449359+0000","last_clean_scrub_stamp":"2023-07-05T23:35:28.449359+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:35:25.750621+0000","scrub_duration":0.001700666,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"30'30","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:35.360758+0000","last_change":"2023-07-05T23:35:35.360814+0000","last_active":"2023-07-05T23:35:35.360758+0000","last_peered":"2023-07-05T23:35:35.360758+0000","last_clean":"2023-07-05T23:35:35.360758+0000","last_became_active":"2023-07-05T23:32:53.338903+0000","last_became_peered":"2023-07-05T23:32:53.338903+0000","last_unstale":"2023-07-05T23:35:35.360758+0000","last_undegraded":"2023-07-05T23:35:35.360758+0000","last_fullsized":"2023-07-05T23:35:35.360758+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'30","last_scrub_stamp":"2023-07-05T23:35:35.360651+0000","last_deep_scrub":"30'30","last_deep_scrub_stamp":"2023-07-05T23:35:35.360651+0000","last_clean_scrub_stamp":"2023-07-05T23:35:35.360651+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:58:04.216771+0000","scrub_duration":0.001803224,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'492","reported_seq":511,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.503463+0000","last_change":"2023-07-05T23:32:57.357001+0000","last_active":"2023-07-05T23:35:17.503463+0000","last_peered":"2023-07-05T23:35:17.503463+0000","last_clean":"2023-07-05T23:35:17.503463+0000","last_became_active":"2023-07-05T23:32:57.356611+0000","last_became_peered":"2023-07-05T23:32:57.356611+0000","last_unstale":"2023-07-05T23:35:17.503463+0000","last_undegraded":"2023-07-05T23:35:17.503463+0000","last_fullsized":"2023-07-05T23:35:17.503463+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":51200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:05.622449+0000","last_change":"2023-07-05T23:32:52.907064+0000","last_active":"2023-07-05T23:35:05.622449+0000","last_peered":"2023-07-05T23:35:05.622449+0000","last_clean":"2023-07-05T23:35:05.622449+0000","last_became_active":"2023-07-05T23:32:52.906779+0000","last_became_peered":"2023-07-05T23:32:52.906779+0000","last_unstale":"2023-07-05T23:35:05.622449+0000","last_undegraded":"2023-07-05T23:35:05.622449+0000","last_fullsized":"2023-07-05T23:35:05.622449+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"30'17","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:23.577489+0000","last_change":"2023-07-05T23:35:23.577540+0000","last_active":"2023-07-05T23:35:23.577489+0000","last_peered":"2023-07-05T23:35:23.577489+0000","last_clean":"2023-07-05T23:35:23.577489+0000","last_became_active":"2023-07-05T23:32:53.339869+0000","last_became_peered":"2023-07-05T23:32:53.339869+0000","last_unstale":"2023-07-05T23:35:23.577489+0000","last_undegraded":"2023-07-05T23:35:23.577489+0000","last_fullsized":"2023-07-05T23:35:23.577489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'17","last_scrub_stamp":"2023-07-05T23:35:23.577389+0000","last_deep_scrub":"30'17","last_deep_scrub_stamp":"2023-07-05T23:35:23.577389+0000","last_clean_scrub_stamp":"2023-07-05T23:35:23.577389+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:47:24.665455+0000","scrub_duration":0.0013589629999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"30'497","reported_seq":516,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.516208+0000","last_change":"2023-07-05T23:32:57.363813+0000","last_active":"2023-07-05T23:35:17.516208+0000","last_peered":"2023-07-05T23:35:17.516208+0000","last_clean":"2023-07-05T23:35:17.516208+0000","last_became_active":"2023-07-05T23:32:57.363409+0000","last_became_peered":"2023-07-05T23:32:57.363409+0000","last_unstale":"2023-07-05T23:35:17.516208+0000","last_undegraded":"2023-07-05T23:35:17.516208+0000","last_fullsized":"2023-07-05T23:35:17.516208+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":497,"log_dups_size":0,"ondisk_log_size":497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:35.704543+0000","last_change":"2023-07-05T23:35:35.704595+0000","last_active":"2023-07-05T23:35:35.704543+0000","last_peered":"2023-07-05T23:35:35.704543+0000","last_clean":"2023-07-05T23:35:35.704543+0000","last_became_active":"2023-07-05T23:32:52.909169+0000","last_became_peered":"2023-07-05T23:32:52.909169+0000","last_unstale":"2023-07-05T23:35:35.704543+0000","last_undegraded":"2023-07-05T23:35:35.704543+0000","last_fullsized":"2023-07-05T23:35:35.704543+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:35:35.704430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:35:35.704430+0000","last_clean_scrub_stamp":"2023-07-05T23:35:35.704430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:47:31.633741+0000","scrub_duration":0.0014660249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"30'28","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.295356+0000","last_change":"2023-07-05T23:32:53.342851+0000","last_active":"2023-07-05T23:35:17.295356+0000","last_peered":"2023-07-05T23:35:17.295356+0000","last_clean":"2023-07-05T23:35:17.295356+0000","last_became_active":"2023-07-05T23:32:53.342420+0000","last_became_peered":"2023-07-05T23:32:53.342420+0000","last_unstale":"2023-07-05T23:35:17.295356+0000","last_undegraded":"2023-07-05T23:35:17.295356+0000","last_fullsized":"2023-07-05T23:35:17.295356+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"30'504","reported_seq":523,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.518520+0000","last_change":"2023-07-05T23:32:57.358997+0000","last_active":"2023-07-05T23:35:17.518520+0000","last_peered":"2023-07-05T23:35:17.518520+0000","last_clean":"2023-07-05T23:35:17.518520+0000","last_became_active":"2023-07-05T23:32:57.358647+0000","last_became_peered":"2023-07-05T23:32:57.358647+0000","last_unstale":"2023-07-05T23:35:17.518520+0000","last_undegraded":"2023-07-05T23:35:17.518520+0000","last_fullsized":"2023-07-05T23:35:17.518520+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:26.562376+0000","last_change":"2023-07-05T23:35:26.562422+0000","last_active":"2023-07-05T23:35:26.562376+0000","last_peered":"2023-07-05T23:35:26.562376+0000","last_clean":"2023-07-05T23:35:26.562376+0000","last_became_active":"2023-07-05T23:32:47.790546+0000","last_became_peered":"2023-07-05T23:32:47.790546+0000","last_unstale":"2023-07-05T23:35:26.562376+0000","last_undegraded":"2023-07-05T23:35:26.562376+0000","last_fullsized":"2023-07-05T23:35:26.562376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:35:26.562263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:35:26.562263+0000","last_clean_scrub_stamp":"2023-07-05T23:35:26.562263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:58:59.010972+0000","scrub_duration":0.0014801910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"30'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:35.839097+0000","last_change":"2023-07-05T23:35:35.839146+0000","last_active":"2023-07-05T23:35:35.839097+0000","last_peered":"2023-07-05T23:35:35.839097+0000","last_clean":"2023-07-05T23:35:35.839097+0000","last_became_active":"2023-07-05T23:32:52.912682+0000","last_became_peered":"2023-07-05T23:32:52.912682+0000","last_unstale":"2023-07-05T23:35:35.839097+0000","last_undegraded":"2023-07-05T23:35:35.839097+0000","last_fullsized":"2023-07-05T23:35:35.839097+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2023-07-05T23:35:35.838992+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2023-07-05T23:35:35.838992+0000","last_clean_scrub_stamp":"2023-07-05T23:35:35.838992+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:44:17.723660+0000","scrub_duration":0.001818807,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"30'30","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:39.577561+0000","last_change":"2023-07-05T23:35:39.577622+0000","last_active":"2023-07-05T23:35:39.577561+0000","last_peered":"2023-07-05T23:35:39.577561+0000","last_clean":"2023-07-05T23:35:39.577561+0000","last_became_active":"2023-07-05T23:32:53.335073+0000","last_became_peered":"2023-07-05T23:32:53.335073+0000","last_unstale":"2023-07-05T23:35:39.577561+0000","last_undegraded":"2023-07-05T23:35:39.577561+0000","last_fullsized":"2023-07-05T23:35:39.577561+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'30","last_scrub_stamp":"2023-07-05T23:35:39.577456+0000","last_deep_scrub":"30'30","last_deep_scrub_stamp":"2023-07-05T23:35:39.577456+0000","last_clean_scrub_stamp":"2023-07-05T23:35:39.577456+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:58:33.987361+0000","scrub_duration":0.002451389,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"30'450","reported_seq":469,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.493140+0000","last_change":"2023-07-05T23:32:57.368301+0000","last_active":"2023-07-05T23:35:17.493140+0000","last_peered":"2023-07-05T23:35:17.493140+0000","last_clean":"2023-07-05T23:35:17.493140+0000","last_became_active":"2023-07-05T23:32:57.368030+0000","last_became_peered":"2023-07-05T23:32:57.368030+0000","last_unstale":"2023-07-05T23:35:17.493140+0000","last_undegraded":"2023-07-05T23:35:17.493140+0000","last_fullsized":"2023-07-05T23:35:17.493140+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:31.801037+0000","last_change":"2023-07-05T23:35:31.801102+0000","last_active":"2023-07-05T23:35:31.801037+0000","last_peered":"2023-07-05T23:35:31.801037+0000","last_clean":"2023-07-05T23:35:31.801037+0000","last_became_active":"2023-07-05T23:32:47.761996+0000","last_became_peered":"2023-07-05T23:32:47.761996+0000","last_unstale":"2023-07-05T23:35:31.801037+0000","last_undegraded":"2023-07-05T23:35:31.801037+0000","last_fullsized":"2023-07-05T23:35:31.801037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:35:31.800926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:35:31.800926+0000","last_clean_scrub_stamp":"2023-07-05T23:35:31.800926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:13:08.513911+0000","scrub_duration":0.0015452980000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:00.622047+0000","last_change":"2023-07-05T23:32:52.904472+0000","last_active":"2023-07-05T23:35:00.622047+0000","last_peered":"2023-07-05T23:35:00.622047+0000","last_clean":"2023-07-05T23:35:00.622047+0000","last_became_active":"2023-07-05T23:32:52.904202+0000","last_became_peered":"2023-07-05T23:32:52.904202+0000","last_unstale":"2023-07-05T23:35:00.622047+0000","last_undegraded":"2023-07-05T23:35:00.622047+0000","last_fullsized":"2023-07-05T23:35:00.622047+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:51.877945+0000","last_clean_scrub_stamp":"2023-07-05T23:32:51.877945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"30'30","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:38.621680+0000","last_change":"2023-07-05T23:35:38.621729+0000","last_active":"2023-07-05T23:35:38.621680+0000","last_peered":"2023-07-05T23:35:38.621680+0000","last_clean":"2023-07-05T23:35:38.621680+0000","last_became_active":"2023-07-05T23:32:53.338626+0000","last_became_peered":"2023-07-05T23:32:53.338626+0000","last_unstale":"2023-07-05T23:35:38.621680+0000","last_undegraded":"2023-07-05T23:35:38.621680+0000","last_fullsized":"2023-07-05T23:35:38.621680+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'30","last_scrub_stamp":"2023-07-05T23:35:38.621586+0000","last_deep_scrub":"30'30","last_deep_scrub_stamp":"2023-07-05T23:35:38.621586+0000","last_clean_scrub_stamp":"2023-07-05T23:35:38.621586+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:06:57.045018+0000","scrub_duration":0.001417272,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"30'489","reported_seq":508,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.519418+0000","last_change":"2023-07-05T23:32:57.356351+0000","last_active":"2023-07-05T23:35:17.519418+0000","last_peered":"2023-07-05T23:35:17.519418+0000","last_clean":"2023-07-05T23:35:17.519418+0000","last_became_active":"2023-07-05T23:32:57.355882+0000","last_became_peered":"2023-07-05T23:32:57.355882+0000","last_unstale":"2023-07-05T23:35:17.519418+0000","last_undegraded":"2023-07-05T23:35:17.519418+0000","last_fullsized":"2023-07-05T23:35:17.519418+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":489,"log_dups_size":0,"ondisk_log_size":489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":55296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:22.970005+0000","last_change":"2023-07-05T23:35:22.970044+0000","last_active":"2023-07-05T23:35:22.970005+0000","last_peered":"2023-07-05T23:35:22.970005+0000","last_clean":"2023-07-05T23:35:22.970005+0000","last_became_active":"2023-07-05T23:32:47.979348+0000","last_became_peered":"2023-07-05T23:32:47.979348+0000","last_unstale":"2023-07-05T23:35:22.970005+0000","last_undegraded":"2023-07-05T23:35:22.970005+0000","last_fullsized":"2023-07-05T23:35:22.970005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:35:22.969930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:35:22.969930+0000","last_clean_scrub_stamp":"2023-07-05T23:35:22.969930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:04:30.215991+0000","scrub_duration":0.0013098879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:30.605928+0000","last_change":"2023-07-05T23:35:30.605974+0000","last_active":"2023-07-05T23:35:30.605928+0000","last_peered":"2023-07-05T23:35:30.605928+0000","last_clean":"2023-07-05T23:35:30.605928+0000","last_became_active":"2023-07-05T23:32:52.907307+0000","last_became_peered":"2023-07-05T23:32:52.907307+0000","last_unstale":"2023-07-05T23:35:30.605928+0000","last_undegraded":"2023-07-05T23:35:30.605928+0000","last_fullsized":"2023-07-05T23:35:30.605928+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:35:30.605843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:35:30.605843+0000","last_clean_scrub_stamp":"2023-07-05T23:35:30.605843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:46:16.457656+0000","scrub_duration":0.0017402780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"30'29","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.295300+0000","last_change":"2023-07-05T23:32:53.338185+0000","last_active":"2023-07-05T23:35:17.295300+0000","last_peered":"2023-07-05T23:35:17.295300+0000","last_clean":"2023-07-05T23:35:17.295300+0000","last_became_active":"2023-07-05T23:32:53.337896+0000","last_became_peered":"2023-07-05T23:32:53.337896+0000","last_unstale":"2023-07-05T23:35:17.295300+0000","last_undegraded":"2023-07-05T23:35:17.295300+0000","last_fullsized":"2023-07-05T23:35:17.295300+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"30'478","reported_seq":497,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.515981+0000","last_change":"2023-07-05T23:32:57.355885+0000","last_active":"2023-07-05T23:35:17.515981+0000","last_peered":"2023-07-05T23:35:17.515981+0000","last_clean":"2023-07-05T23:35:17.515981+0000","last_became_active":"2023-07-05T23:32:57.355475+0000","last_became_peered":"2023-07-05T23:32:57.355475+0000","last_unstale":"2023-07-05T23:35:17.515981+0000","last_undegraded":"2023-07-05T23:35:17.515981+0000","last_fullsized":"2023-07-05T23:35:17.515981+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:30.765164+0000","last_change":"2023-07-05T23:35:30.765209+0000","last_active":"2023-07-05T23:35:30.765164+0000","last_peered":"2023-07-05T23:35:30.765164+0000","last_clean":"2023-07-05T23:35:30.765164+0000","last_became_active":"2023-07-05T23:32:47.761392+0000","last_became_peered":"2023-07-05T23:32:47.761392+0000","last_unstale":"2023-07-05T23:35:30.765164+0000","last_undegraded":"2023-07-05T23:35:30.765164+0000","last_fullsized":"2023-07-05T23:35:30.765164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:35:30.765068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:35:30.765068+0000","last_clean_scrub_stamp":"2023-07-05T23:35:30.765068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:58:25.174973+0000","scrub_duration":0.0016083200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"30'119","reported_seq":199,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:31.132448+0000","last_change":"2023-07-05T23:35:31.132526+0000","last_active":"2023-07-05T23:35:31.132448+0000","last_peered":"2023-07-05T23:35:31.132448+0000","last_clean":"2023-07-05T23:35:31.132448+0000","last_became_active":"2023-07-05T23:32:42.736736+0000","last_became_peered":"2023-07-05T23:32:42.736736+0000","last_unstale":"2023-07-05T23:35:31.132448+0000","last_undegraded":"2023-07-05T23:35:31.132448+0000","last_fullsized":"2023-07-05T23:35:31.132448+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'119","last_scrub_stamp":"2023-07-05T23:35:31.132330+0000","last_deep_scrub":"30'119","last_deep_scrub_stamp":"2023-07-05T23:35:31.132330+0000","last_clean_scrub_stamp":"2023-07-05T23:35:31.132330+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:46:16.984143+0000","scrub_duration":0.00536033,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:36.754162+0000","last_change":"2023-07-05T23:35:36.754217+0000","last_active":"2023-07-05T23:35:36.754162+0000","last_peered":"2023-07-05T23:35:36.754162+0000","last_clean":"2023-07-05T23:35:36.754162+0000","last_became_active":"2023-07-05T23:32:52.912684+0000","last_became_peered":"2023-07-05T23:32:52.912684+0000","last_unstale":"2023-07-05T23:35:36.754162+0000","last_undegraded":"2023-07-05T23:35:36.754162+0000","last_fullsized":"2023-07-05T23:35:36.754162+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:35:36.754056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:35:36.754056+0000","last_clean_scrub_stamp":"2023-07-05T23:35:36.754056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:44:18.638725+0000","scrub_duration":0.0017168890000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"30'32","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.287373+0000","last_change":"2023-07-05T23:32:53.344142+0000","last_active":"2023-07-05T23:35:17.287373+0000","last_peered":"2023-07-05T23:35:17.287373+0000","last_clean":"2023-07-05T23:35:17.287373+0000","last_became_active":"2023-07-05T23:32:53.343848+0000","last_became_peered":"2023-07-05T23:32:53.343848+0000","last_unstale":"2023-07-05T23:35:17.287373+0000","last_undegraded":"2023-07-05T23:35:17.287373+0000","last_fullsized":"2023-07-05T23:35:17.287373+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"30'453","reported_seq":472,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.498226+0000","last_change":"2023-07-05T23:32:57.366415+0000","last_active":"2023-07-05T23:35:17.498226+0000","last_peered":"2023-07-05T23:35:17.498226+0000","last_clean":"2023-07-05T23:35:17.498226+0000","last_became_active":"2023-07-05T23:32:57.365013+0000","last_became_peered":"2023-07-05T23:32:57.365013+0000","last_unstale":"2023-07-05T23:35:17.498226+0000","last_undegraded":"2023-07-05T23:35:17.498226+0000","last_fullsized":"2023-07-05T23:35:17.498226+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:34.134050+0000","last_change":"2023-07-05T23:35:34.134097+0000","last_active":"2023-07-05T23:35:34.134050+0000","last_peered":"2023-07-05T23:35:34.134050+0000","last_clean":"2023-07-05T23:35:34.134050+0000","last_became_active":"2023-07-05T23:32:47.767297+0000","last_became_peered":"2023-07-05T23:32:47.767297+0000","last_unstale":"2023-07-05T23:35:34.134050+0000","last_undegraded":"2023-07-05T23:35:34.134050+0000","last_fullsized":"2023-07-05T23:35:34.134050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:35:34.133947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:35:34.133947+0000","last_clean_scrub_stamp":"2023-07-05T23:35:34.133947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:00:27.997249+0000","scrub_duration":0.0020560800000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"30'16","reported_seq":66,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:28.696907+0000","last_change":"2023-07-05T23:35:28.696959+0000","last_active":"2023-07-05T23:35:28.696907+0000","last_peered":"2023-07-05T23:35:28.696907+0000","last_clean":"2023-07-05T23:35:28.696907+0000","last_became_active":"2023-07-05T23:32:52.906204+0000","last_became_peered":"2023-07-05T23:32:52.906204+0000","last_unstale":"2023-07-05T23:35:28.696907+0000","last_undegraded":"2023-07-05T23:35:28.696907+0000","last_fullsized":"2023-07-05T23:35:28.696907+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'16","last_scrub_stamp":"2023-07-05T23:35:28.696811+0000","last_deep_scrub":"30'16","last_deep_scrub_stamp":"2023-07-05T23:35:28.696811+0000","last_clean_scrub_stamp":"2023-07-05T23:35:28.696811+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:46:14.548624+0000","scrub_duration":0.0020850030000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7752,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":17,"num_write":15,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"30'28","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.296742+0000","last_change":"2023-07-05T23:32:53.340334+0000","last_active":"2023-07-05T23:35:17.296742+0000","last_peered":"2023-07-05T23:35:17.296742+0000","last_clean":"2023-07-05T23:35:17.296742+0000","last_became_active":"2023-07-05T23:32:53.340061+0000","last_became_peered":"2023-07-05T23:32:53.340061+0000","last_unstale":"2023-07-05T23:35:17.296742+0000","last_undegraded":"2023-07-05T23:35:17.296742+0000","last_fullsized":"2023-07-05T23:35:17.296742+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"30'503","reported_seq":522,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.515440+0000","last_change":"2023-07-05T23:32:57.362424+0000","last_active":"2023-07-05T23:35:17.515440+0000","last_peered":"2023-07-05T23:35:17.515440+0000","last_clean":"2023-07-05T23:35:17.515440+0000","last_became_active":"2023-07-05T23:32:57.361941+0000","last_became_peered":"2023-07-05T23:32:57.361941+0000","last_unstale":"2023-07-05T23:35:17.515440+0000","last_undegraded":"2023-07-05T23:35:17.515440+0000","last_fullsized":"2023-07-05T23:35:17.515440+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":503,"log_dups_size":0,"ondisk_log_size":503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:35.179206+0000","last_change":"2023-07-05T23:35:35.179285+0000","last_active":"2023-07-05T23:35:35.179206+0000","last_peered":"2023-07-05T23:35:35.179206+0000","last_clean":"2023-07-05T23:35:35.179206+0000","last_became_active":"2023-07-05T23:32:47.790408+0000","last_became_peered":"2023-07-05T23:32:47.790408+0000","last_unstale":"2023-07-05T23:35:35.179206+0000","last_undegraded":"2023-07-05T23:35:35.179206+0000","last_fullsized":"2023-07-05T23:35:35.179206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:35:35.179072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:35:35.179072+0000","last_clean_scrub_stamp":"2023-07-05T23:35:35.179072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:27:42.194306+0000","scrub_duration":0.001815529,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"30'2","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:35.571238+0000","last_change":"2023-07-05T23:35:35.571330+0000","last_active":"2023-07-05T23:35:35.571238+0000","last_peered":"2023-07-05T23:35:35.571238+0000","last_clean":"2023-07-05T23:35:35.571238+0000","last_became_active":"2023-07-05T23:32:52.908379+0000","last_became_peered":"2023-07-05T23:32:52.908379+0000","last_unstale":"2023-07-05T23:35:35.571238+0000","last_undegraded":"2023-07-05T23:35:35.571238+0000","last_fullsized":"2023-07-05T23:35:35.571238+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2023-07-05T23:35:35.571122+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2023-07-05T23:35:35.571122+0000","last_clean_scrub_stamp":"2023-07-05T23:35:35.571122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:27:42.586356+0000","scrub_duration":0.0016887200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"30'34","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.291965+0000","last_change":"2023-07-05T23:32:53.331042+0000","last_active":"2023-07-05T23:35:17.291965+0000","last_peered":"2023-07-05T23:35:17.291965+0000","last_clean":"2023-07-05T23:35:17.291965+0000","last_became_active":"2023-07-05T23:32:53.330771+0000","last_became_peered":"2023-07-05T23:32:53.330771+0000","last_unstale":"2023-07-05T23:35:17.291965+0000","last_undegraded":"2023-07-05T23:35:17.291965+0000","last_fullsized":"2023-07-05T23:35:17.291965+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"30'487","reported_seq":506,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.514556+0000","last_change":"2023-07-05T23:32:57.357223+0000","last_active":"2023-07-05T23:35:17.514556+0000","last_peered":"2023-07-05T23:35:17.514556+0000","last_clean":"2023-07-05T23:35:17.514556+0000","last_became_active":"2023-07-05T23:32:57.356797+0000","last_became_peered":"2023-07-05T23:32:57.356797+0000","last_unstale":"2023-07-05T23:35:17.514556+0000","last_undegraded":"2023-07-05T23:35:17.514556+0000","last_fullsized":"2023-07-05T23:35:17.514556+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"30'4","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:32.616690+0000","last_change":"2023-07-05T23:35:32.616740+0000","last_active":"2023-07-05T23:35:32.616690+0000","last_peered":"2023-07-05T23:35:32.616690+0000","last_clean":"2023-07-05T23:35:32.616690+0000","last_became_active":"2023-07-05T23:32:52.905704+0000","last_became_peered":"2023-07-05T23:32:52.905704+0000","last_unstale":"2023-07-05T23:35:32.616690+0000","last_undegraded":"2023-07-05T23:35:32.616690+0000","last_fullsized":"2023-07-05T23:35:32.616690+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2023-07-05T23:35:32.616594+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2023-07-05T23:35:32.616594+0000","last_clean_scrub_stamp":"2023-07-05T23:35:32.616594+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:13:09.329579+0000","scrub_duration":0.0031987550000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:23.554123+0000","last_change":"2023-07-05T23:35:23.554182+0000","last_active":"2023-07-05T23:35:23.554123+0000","last_peered":"2023-07-05T23:35:23.554123+0000","last_clean":"2023-07-05T23:35:23.554123+0000","last_became_active":"2023-07-05T23:32:47.768844+0000","last_became_peered":"2023-07-05T23:32:47.768844+0000","last_unstale":"2023-07-05T23:35:23.554123+0000","last_undegraded":"2023-07-05T23:35:23.554123+0000","last_fullsized":"2023-07-05T23:35:23.554123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:35:23.554014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:35:23.554014+0000","last_clean_scrub_stamp":"2023-07-05T23:35:23.554014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:17:29.583280+0000","scrub_duration":0.0020942920000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"30'25","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:22.180392+0000","last_change":"2023-07-05T23:33:35.012743+0000","last_active":"2023-07-05T23:35:22.180392+0000","last_peered":"2023-07-05T23:35:22.180392+0000","last_clean":"2023-07-05T23:35:22.180392+0000","last_became_active":"2023-07-05T23:33:35.012290+0000","last_became_peered":"2023-07-05T23:33:35.012290+0000","last_unstale":"2023-07-05T23:35:22.180392+0000","last_undegraded":"2023-07-05T23:35:22.180392+0000","last_fullsized":"2023-07-05T23:35:22.180392+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"30'449","reported_seq":468,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.515640+0000","last_change":"2023-07-05T23:32:57.362654+0000","last_active":"2023-07-05T23:35:17.515640+0000","last_peered":"2023-07-05T23:35:17.515640+0000","last_clean":"2023-07-05T23:35:17.515640+0000","last_became_active":"2023-07-05T23:32:57.362112+0000","last_became_peered":"2023-07-05T23:32:57.362112+0000","last_unstale":"2023-07-05T23:35:17.515640+0000","last_undegraded":"2023-07-05T23:35:17.515640+0000","last_fullsized":"2023-07-05T23:35:17.515640+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":46080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:25.353416+0000","last_change":"2023-07-05T23:35:25.353461+0000","last_active":"2023-07-05T23:35:25.353416+0000","last_peered":"2023-07-05T23:35:25.353416+0000","last_clean":"2023-07-05T23:35:25.353416+0000","last_became_active":"2023-07-05T23:32:47.769141+0000","last_became_peered":"2023-07-05T23:32:47.769141+0000","last_unstale":"2023-07-05T23:35:25.353416+0000","last_undegraded":"2023-07-05T23:35:25.353416+0000","last_fullsized":"2023-07-05T23:35:25.353416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:35:25.353313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:35:25.353313+0000","last_clean_scrub_stamp":"2023-07-05T23:35:25.353313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:53:19.759050+0000","scrub_duration":0.0014175699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"30'13","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:38.600293+0000","last_change":"2023-07-05T23:35:38.600354+0000","last_active":"2023-07-05T23:35:38.600293+0000","last_peered":"2023-07-05T23:35:38.600293+0000","last_clean":"2023-07-05T23:35:38.600293+0000","last_became_active":"2023-07-05T23:32:52.905451+0000","last_became_peered":"2023-07-05T23:32:52.905451+0000","last_unstale":"2023-07-05T23:35:38.600293+0000","last_undegraded":"2023-07-05T23:35:38.600293+0000","last_fullsized":"2023-07-05T23:35:38.600293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'13","last_scrub_stamp":"2023-07-05T23:35:38.600196+0000","last_deep_scrub":"30'13","last_deep_scrub_stamp":"2023-07-05T23:35:38.600196+0000","last_clean_scrub_stamp":"2023-07-05T23:35:38.600196+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:13:15.313181+0000","scrub_duration":0.0019374049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"30'21","reported_seq":46,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.287954+0000","last_change":"2023-07-05T23:32:53.332443+0000","last_active":"2023-07-05T23:35:17.287954+0000","last_peered":"2023-07-05T23:35:17.287954+0000","last_clean":"2023-07-05T23:35:17.287954+0000","last_became_active":"2023-07-05T23:32:53.332159+0000","last_became_peered":"2023-07-05T23:32:53.332159+0000","last_unstale":"2023-07-05T23:35:17.287954+0000","last_undegraded":"2023-07-05T23:35:17.287954+0000","last_fullsized":"2023-07-05T23:35:17.287954+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"30'470","reported_seq":489,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:21.661528+0000","last_change":"2023-07-05T23:32:57.363998+0000","last_active":"2023-07-05T23:35:21.661528+0000","last_peered":"2023-07-05T23:35:21.661528+0000","last_clean":"2023-07-05T23:35:21.661528+0000","last_became_active":"2023-07-05T23:32:57.363620+0000","last_became_peered":"2023-07-05T23:32:57.363620+0000","last_unstale":"2023-07-05T23:35:21.661528+0000","last_undegraded":"2023-07-05T23:35:21.661528+0000","last_fullsized":"2023-07-05T23:35:21.661528+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:37.555778+0000","last_change":"2023-07-05T23:35:37.555838+0000","last_active":"2023-07-05T23:35:37.555778+0000","last_peered":"2023-07-05T23:35:37.555778+0000","last_clean":"2023-07-05T23:35:37.555778+0000","last_became_active":"2023-07-05T23:32:52.908111+0000","last_became_peered":"2023-07-05T23:32:52.908111+0000","last_unstale":"2023-07-05T23:35:37.555778+0000","last_undegraded":"2023-07-05T23:35:37.555778+0000","last_fullsized":"2023-07-05T23:35:37.555778+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2023-07-05T23:35:37.555686+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2023-07-05T23:35:37.555686+0000","last_clean_scrub_stamp":"2023-07-05T23:35:37.555686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:58:31.965591+0000","scrub_duration":0.0016203809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"30'32","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:32.063729+0000","last_change":"2023-07-05T23:35:32.063812+0000","last_active":"2023-07-05T23:35:32.063729+0000","last_peered":"2023-07-05T23:35:32.063729+0000","last_clean":"2023-07-05T23:35:32.063729+0000","last_became_active":"2023-07-05T23:32:53.339686+0000","last_became_peered":"2023-07-05T23:32:53.339686+0000","last_unstale":"2023-07-05T23:35:32.063729+0000","last_undegraded":"2023-07-05T23:35:32.063729+0000","last_fullsized":"2023-07-05T23:35:32.063729+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-07-05T23:35:32.063608+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-07-05T23:35:32.063608+0000","last_clean_scrub_stamp":"2023-07-05T23:35:32.063608+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:53:42.153964+0000","scrub_duration":0.0016321899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"30'478","reported_seq":497,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:24.813485+0000","last_change":"2023-07-05T23:32:57.356309+0000","last_active":"2023-07-05T23:35:24.813485+0000","last_peered":"2023-07-05T23:35:24.813485+0000","last_clean":"2023-07-05T23:35:24.813485+0000","last_became_active":"2023-07-05T23:32:57.355910+0000","last_became_peered":"2023-07-05T23:32:57.355910+0000","last_unstale":"2023-07-05T23:35:24.813485+0000","last_undegraded":"2023-07-05T23:35:24.813485+0000","last_fullsized":"2023-07-05T23:35:24.813485+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"30'3","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:34.865970+0000","last_change":"2023-07-05T23:35:34.866032+0000","last_active":"2023-07-05T23:35:34.865970+0000","last_peered":"2023-07-05T23:35:34.865970+0000","last_clean":"2023-07-05T23:35:34.865970+0000","last_became_active":"2023-07-05T23:32:52.899159+0000","last_became_peered":"2023-07-05T23:32:52.899159+0000","last_unstale":"2023-07-05T23:35:34.865970+0000","last_undegraded":"2023-07-05T23:35:34.865970+0000","last_fullsized":"2023-07-05T23:35:34.865970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2023-07-05T23:35:34.865874+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2023-07-05T23:35:34.865874+0000","last_clean_scrub_stamp":"2023-07-05T23:35:34.865874+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:47:30.795186+0000","scrub_duration":0.0029783230000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"30'24","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:37.340324+0000","last_change":"2023-07-05T23:35:37.340375+0000","last_active":"2023-07-05T23:35:37.340324+0000","last_peered":"2023-07-05T23:35:37.340324+0000","last_clean":"2023-07-05T23:35:37.340324+0000","last_became_active":"2023-07-05T23:32:53.343262+0000","last_became_peered":"2023-07-05T23:32:53.343262+0000","last_unstale":"2023-07-05T23:35:37.340324+0000","last_undegraded":"2023-07-05T23:35:37.340324+0000","last_fullsized":"2023-07-05T23:35:37.340324+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'24","last_scrub_stamp":"2023-07-05T23:35:37.340221+0000","last_deep_scrub":"30'24","last_deep_scrub_stamp":"2023-07-05T23:35:37.340221+0000","last_clean_scrub_stamp":"2023-07-05T23:35:37.340221+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:49:35.710493+0000","scrub_duration":0.0018883940000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"30'465","reported_seq":484,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:23.767447+0000","last_change":"2023-07-05T23:32:57.365478+0000","last_active":"2023-07-05T23:35:23.767447+0000","last_peered":"2023-07-05T23:35:23.767447+0000","last_clean":"2023-07-05T23:35:23.767447+0000","last_became_active":"2023-07-05T23:32:57.365087+0000","last_became_peered":"2023-07-05T23:32:57.365087+0000","last_unstale":"2023-07-05T23:35:23.767447+0000","last_undegraded":"2023-07-05T23:35:23.767447+0000","last_fullsized":"2023-07-05T23:35:23.767447+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"30'4","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:36.815441+0000","last_change":"2023-07-05T23:35:36.815520+0000","last_active":"2023-07-05T23:35:36.815441+0000","last_peered":"2023-07-05T23:35:36.815441+0000","last_clean":"2023-07-05T23:35:36.815441+0000","last_became_active":"2023-07-05T23:32:52.901689+0000","last_became_peered":"2023-07-05T23:32:52.901689+0000","last_unstale":"2023-07-05T23:35:36.815441+0000","last_undegraded":"2023-07-05T23:35:36.815441+0000","last_fullsized":"2023-07-05T23:35:36.815441+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2023-07-05T23:35:36.815346+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2023-07-05T23:35:36.815346+0000","last_clean_scrub_stamp":"2023-07-05T23:35:36.815346+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:55:30.888158+0000","scrub_duration":0.00274881,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'23","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:27.474074+0000","last_change":"2023-07-05T23:35:27.474123+0000","last_active":"2023-07-05T23:35:27.474074+0000","last_peered":"2023-07-05T23:35:27.474074+0000","last_clean":"2023-07-05T23:35:27.474074+0000","last_became_active":"2023-07-05T23:32:53.346553+0000","last_became_peered":"2023-07-05T23:32:53.346553+0000","last_unstale":"2023-07-05T23:35:27.474074+0000","last_undegraded":"2023-07-05T23:35:27.474074+0000","last_fullsized":"2023-07-05T23:35:27.474074+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'23","last_scrub_stamp":"2023-07-05T23:35:27.473982+0000","last_deep_scrub":"30'23","last_deep_scrub_stamp":"2023-07-05T23:35:27.473982+0000","last_clean_scrub_stamp":"2023-07-05T23:35:27.473982+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:59:09.834139+0000","scrub_duration":0.00189398,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"30'487","reported_seq":506,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:23.256652+0000","last_change":"2023-07-05T23:32:57.353173+0000","last_active":"2023-07-05T23:35:23.256652+0000","last_peered":"2023-07-05T23:35:23.256652+0000","last_clean":"2023-07-05T23:35:23.256652+0000","last_became_active":"2023-07-05T23:32:57.352716+0000","last_became_peered":"2023-07-05T23:32:57.352716+0000","last_unstale":"2023-07-05T23:35:23.256652+0000","last_undegraded":"2023-07-05T23:35:23.256652+0000","last_fullsized":"2023-07-05T23:35:23.256652+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:31.581893+0000","last_change":"2023-07-05T23:35:31.581975+0000","last_active":"2023-07-05T23:35:31.581893+0000","last_peered":"2023-07-05T23:35:31.581893+0000","last_clean":"2023-07-05T23:35:31.581893+0000","last_became_active":"2023-07-05T23:32:52.906688+0000","last_became_peered":"2023-07-05T23:32:52.906688+0000","last_unstale":"2023-07-05T23:35:31.581893+0000","last_undegraded":"2023-07-05T23:35:31.581893+0000","last_fullsized":"2023-07-05T23:35:31.581893+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2023-07-05T23:35:31.581776+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2023-07-05T23:35:31.581776+0000","last_clean_scrub_stamp":"2023-07-05T23:35:31.581776+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:58:25.991680+0000","scrub_duration":0.001758639,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"30'32","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:20.631412+0000","last_change":"2023-07-05T23:32:53.348210+0000","last_active":"2023-07-05T23:35:20.631412+0000","last_peered":"2023-07-05T23:35:20.631412+0000","last_clean":"2023-07-05T23:35:20.631412+0000","last_became_active":"2023-07-05T23:32:53.346652+0000","last_became_peered":"2023-07-05T23:32:53.346652+0000","last_unstale":"2023-07-05T23:35:20.631412+0000","last_undegraded":"2023-07-05T23:35:20.631412+0000","last_fullsized":"2023-07-05T23:35:20.631412+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"30'495","reported_seq":514,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:21.661520+0000","last_change":"2023-07-05T23:32:57.357185+0000","last_active":"2023-07-05T23:35:21.661520+0000","last_peered":"2023-07-05T23:35:21.661520+0000","last_clean":"2023-07-05T23:35:21.661520+0000","last_became_active":"2023-07-05T23:32:57.356637+0000","last_became_peered":"2023-07-05T23:32:57.356637+0000","last_unstale":"2023-07-05T23:35:21.661520+0000","last_undegraded":"2023-07-05T23:35:21.661520+0000","last_fullsized":"2023-07-05T23:35:21.661520+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"30'7","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:33.566089+0000","last_change":"2023-07-05T23:35:33.566152+0000","last_active":"2023-07-05T23:35:33.566089+0000","last_peered":"2023-07-05T23:35:33.566089+0000","last_clean":"2023-07-05T23:35:33.566089+0000","last_became_active":"2023-07-05T23:32:52.903823+0000","last_became_peered":"2023-07-05T23:32:52.903823+0000","last_unstale":"2023-07-05T23:35:33.566089+0000","last_undegraded":"2023-07-05T23:35:33.566089+0000","last_fullsized":"2023-07-05T23:35:33.566089+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'7","last_scrub_stamp":"2023-07-05T23:35:33.566002+0000","last_deep_scrub":"30'7","last_deep_scrub_stamp":"2023-07-05T23:35:33.566002+0000","last_clean_scrub_stamp":"2023-07-05T23:35:33.566002+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:27:40.581236+0000","scrub_duration":0.0037408099999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"30'42","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:20.624055+0000","last_change":"2023-07-05T23:32:53.342800+0000","last_active":"2023-07-05T23:35:20.624055+0000","last_peered":"2023-07-05T23:35:20.624055+0000","last_clean":"2023-07-05T23:35:20.624055+0000","last_became_active":"2023-07-05T23:32:53.339863+0000","last_became_peered":"2023-07-05T23:32:53.339863+0000","last_unstale":"2023-07-05T23:35:20.624055+0000","last_undegraded":"2023-07-05T23:35:20.624055+0000","last_fullsized":"2023-07-05T23:35:20.624055+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"30'50","reported_seq":83,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:37.493267+0000","last_change":"2023-07-05T23:35:37.493321+0000","last_active":"2023-07-05T23:35:37.493267+0000","last_peered":"2023-07-05T23:35:37.493267+0000","last_clean":"2023-07-05T23:35:37.493267+0000","last_became_active":"2023-07-05T23:32:53.336759+0000","last_became_peered":"2023-07-05T23:32:53.336759+0000","last_unstale":"2023-07-05T23:35:37.493267+0000","last_undegraded":"2023-07-05T23:35:37.493267+0000","last_fullsized":"2023-07-05T23:35:37.493267+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'50","last_scrub_stamp":"2023-07-05T23:35:37.493181+0000","last_deep_scrub":"30'50","last_deep_scrub_stamp":"2023-07-05T23:35:37.493181+0000","last_clean_scrub_stamp":"2023-07-05T23:35:37.493181+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:01:21.748318+0000","scrub_duration":0.001613509,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"30'46","reported_seq":71,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.298958+0000","last_change":"2023-07-05T23:32:53.346160+0000","last_active":"2023-07-05T23:35:17.298958+0000","last_peered":"2023-07-05T23:35:17.298958+0000","last_clean":"2023-07-05T23:35:17.298958+0000","last_became_active":"2023-07-05T23:32:53.345711+0000","last_became_peered":"2023-07-05T23:32:53.345711+0000","last_unstale":"2023-07-05T23:35:17.298958+0000","last_undegraded":"2023-07-05T23:35:17.298958+0000","last_fullsized":"2023-07-05T23:35:17.298958+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"30'34","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:31.415358+0000","last_change":"2023-07-05T23:35:31.415413+0000","last_active":"2023-07-05T23:35:31.415358+0000","last_peered":"2023-07-05T23:35:31.415358+0000","last_clean":"2023-07-05T23:35:31.415358+0000","last_became_active":"2023-07-05T23:32:53.339431+0000","last_became_peered":"2023-07-05T23:32:53.339431+0000","last_unstale":"2023-07-05T23:35:31.415358+0000","last_undegraded":"2023-07-05T23:35:31.415358+0000","last_fullsized":"2023-07-05T23:35:31.415358+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'34","last_scrub_stamp":"2023-07-05T23:35:31.415263+0000","last_deep_scrub":"30'34","last_deep_scrub_stamp":"2023-07-05T23:35:31.415263+0000","last_clean_scrub_stamp":"2023-07-05T23:35:31.415263+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:58:25.030438+0000","scrub_duration":0.0015583839999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"30'31","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:38.732951+0000","last_change":"2023-07-05T23:35:38.733005+0000","last_active":"2023-07-05T23:35:38.732951+0000","last_peered":"2023-07-05T23:35:38.732951+0000","last_clean":"2023-07-05T23:35:38.732951+0000","last_became_active":"2023-07-05T23:32:53.335181+0000","last_became_peered":"2023-07-05T23:32:53.335181+0000","last_unstale":"2023-07-05T23:35:38.732951+0000","last_undegraded":"2023-07-05T23:35:38.732951+0000","last_fullsized":"2023-07-05T23:35:38.732951+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'31","last_scrub_stamp":"2023-07-05T23:35:38.732855+0000","last_deep_scrub":"30'31","last_deep_scrub_stamp":"2023-07-05T23:35:38.732855+0000","last_clean_scrub_stamp":"2023-07-05T23:35:38.732855+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:47:39.820920+0000","scrub_duration":0.0020207810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"30'32","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.295495+0000","last_change":"2023-07-05T23:32:53.338171+0000","last_active":"2023-07-05T23:35:17.295495+0000","last_peered":"2023-07-05T23:35:17.295495+0000","last_clean":"2023-07-05T23:35:17.295495+0000","last_became_active":"2023-07-05T23:32:53.337835+0000","last_became_peered":"2023-07-05T23:32:53.337835+0000","last_unstale":"2023-07-05T23:35:17.295495+0000","last_undegraded":"2023-07-05T23:35:17.295495+0000","last_fullsized":"2023-07-05T23:35:17.295495+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":614,"num_write_kb":1286144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":201326592,"data_stored":201326592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15089,"ondisk_log_size":15089,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2060,"ondisk_log_size":2060,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1537265,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":15,"num_read_kb":17,"num_write":488,"num_write_kb":1816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3137536,"data_stored":3074530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":496,"ondisk_log_size":496,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574888,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68284,"kb_used_data":33140,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94303556,"statfs":{"total":96636764160,"available":96566841344,"internally_reserved":0,"allocated":33935360,"data_stored":33715425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 5 23:34:44 2023","interfaces":[{"interface":"back","average":{"1min":3.7120000000000002,"5min":1.2150000000000001,"15min":0.79900000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":12.042,"5min":12.042,"15min":12.042},"last":0.55100000000000005},{"interface":"front","average":{"1min":6.5010000000000003,"5min":2.4590000000000001,"15min":1.7849999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":26.367999999999999,"5min":26.367999999999999,"15min":26.367999999999999},"last":0.60099999999999998}]},{"osd":1,"last update":"Wed Jul 5 23:34:44 2023","interfaces":[{"interface":"back","average":{"1min":3.536,"5min":1.2789999999999999,"15min":0.90300000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":11.948,"5min":11.948,"15min":11.948},"last":0.68300000000000005},{"interface":"front","average":{"1min":4.0110000000000001,"5min":1.2789999999999999,"15min":0.82399999999999995},"min":{"1min":0.318,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":11.952,"5min":11.952,"15min":11.952},"last":0.62}]},{"osd":2,"last update":"Wed Jul 5 23:34:44 2023","interfaces":[{"interface":"back","average":{"1min":4.0209999999999999,"5min":1.675,"15min":1.284},"min":{"1min":0.38500000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":11.997,"5min":11.997,"15min":11.997},"last":0.59099999999999997},{"interface":"front","average":{"1min":6.1189999999999998,"5min":1.7829999999999999,"15min":1.0600000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":26.419,"5min":26.419,"15min":26.419},"last":3.1219999999999999}]},{"osd":3,"last update":"Wed Jul 5 23:34:44 2023","interfaces":[{"interface":"back","average":{"1min":4.9889999999999999,"5min":1.51,"15min":0.93000000000000005},"min":{"1min":0.43099999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":24.094000000000001,"5min":24.094000000000001,"15min":24.094000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":5.3719999999999999,"5min":1.5780000000000001,"15min":0.94599999999999995},"min":{"1min":0.44700000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":22.588000000000001,"5min":22.588000000000001,"15min":22.588000000000001},"last":0.65800000000000003}]},{"osd":4,"last update":"Wed Jul 5 23:34:44 2023","interfaces":[{"interface":"back","average":{"1min":3.4390000000000001,"5min":1.111,"15min":0.72299999999999998},"min":{"1min":0.32500000000000001,"5min":0.318,"15min":0.318},"max":{"1min":12.173999999999999,"5min":12.173999999999999,"15min":12.173999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":3.4780000000000002,"5min":1.147,"15min":0.75900000000000001},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":12.151,"5min":12.151,"15min":12.151},"last":0.46800000000000003}]},{"osd":5,"last update":"Wed Jul 5 23:34:44 2023","interfaces":[{"interface":"back","average":{"1min":3.8519999999999999,"5min":1.222,"15min":0.78400000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":19.954999999999998,"5min":19.954999999999998,"15min":19.954999999999998},"last":0.52900000000000003},{"interface":"front","average":{"1min":3.6509999999999998,"5min":1.2150000000000001,"15min":0.80900000000000005},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":21.870999999999999,"5min":21.870999999999999,"15min":21.870999999999999},"last":0.63}]},{"osd":6,"last update":"Wed Jul 5 23:34:44 2023","interfaces":[{"interface":"back","average":{"1min":5.4880000000000004,"5min":1.6060000000000001,"15min":0.95899999999999996},"min":{"1min":0.436,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":20.212,"5min":20.212,"15min":20.212},"last":0.64700000000000002},{"interface":"front","average":{"1min":2.4449999999999998,"5min":0.98399999999999999,"15min":0.73999999999999999},"min":{"1min":0.45700000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":12.010999999999999,"5min":12.010999999999999,"15min":12.010999999999999},"last":0.71599999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574888,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57992,"kb_used_data":26944,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94313848,"statfs":{"total":96636764160,"available":96577380352,"internally_reserved":0,"allocated":27590656,"data_stored":27401822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 5 23:34:42 2023","interfaces":[{"interface":"back","average":{"1min":7.4859999999999998,"5min":1.9059999999999999,"15min":0.97599999999999998},"min":{"1min":0.39800000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":24.012,"5min":24.012,"15min":24.012},"last":0.51000000000000001},{"interface":"front","average":{"1min":7.5389999999999997,"5min":1.909,"15min":0.97099999999999997},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":27.036000000000001,"5min":27.036000000000001,"15min":27.036000000000001},"last":0.69099999999999995}]},{"osd":1,"last update":"Wed Jul 5 23:34:42 2023","interfaces":[{"interface":"back","average":{"1min":7.0979999999999999,"5min":1.8220000000000001,"15min":0.94199999999999995},"min":{"1min":0.34499999999999997,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":20.021999999999998,"5min":20.021999999999998,"15min":20.021999999999998},"last":0.65500000000000003},{"interface":"front","average":{"1min":7.7549999999999999,"5min":1.9970000000000001,"15min":1.0369999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":23.943000000000001,"5min":23.943000000000001,"15min":23.943000000000001},"last":0.63500000000000001}]},{"osd":2,"last update":"Wed Jul 5 23:34:42 2023","interfaces":[{"interface":"back","average":{"1min":7.1660000000000004,"5min":1.871,"15min":0.98899999999999999},"min":{"1min":0.36699999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":25.658000000000001,"5min":25.658000000000001,"15min":25.658000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":5.9139999999999997,"5min":1.647,"15min":0.93600000000000005},"min":{"1min":0.40000000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":27.062000000000001,"5min":27.062000000000001,"15min":27.062000000000001},"last":0.66900000000000004}]},{"osd":3,"last update":"Wed Jul 5 23:34:42 2023","interfaces":[{"interface":"back","average":{"1min":6.657,"5min":1.7889999999999999,"15min":0.97699999999999998},"min":{"1min":0.443,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":27.108000000000001,"5min":27.108000000000001,"15min":27.108000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":7.6630000000000003,"5min":1.976,"15min":1.028},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":19.940000000000001,"5min":19.940000000000001,"15min":19.940000000000001},"last":0.57699999999999996}]},{"osd":4,"last update":"Wed Jul 5 23:34:42 2023","interfaces":[{"interface":"back","average":{"1min":8.0489999999999995,"5min":2.0430000000000001,"15min":1.042},"min":{"1min":0.34899999999999998,"5min":0.308,"15min":0.308},"max":{"1min":26,"5min":26,"15min":26},"last":0.46999999999999997},{"interface":"front","average":{"1min":5.0650000000000004,"5min":1.482,"15min":0.88500000000000001},"min":{"1min":0.376,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":27.085000000000001,"5min":27.085000000000001,"15min":27.085000000000001},"last":0.51800000000000002}]},{"osd":5,"last update":"Wed Jul 5 23:34:42 2023","interfaces":[{"interface":"back","average":{"1min":5.5750000000000002,"5min":1.5549999999999999,"15min":0.88500000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":19.975000000000001,"5min":19.975000000000001,"15min":19.975000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":6.4349999999999996,"5min":1.7789999999999999,"15min":1.0029999999999999},"min":{"1min":0.41999999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":17.126999999999999,"5min":17.126999999999999,"15min":17.126999999999999},"last":0.59099999999999997}]},{"osd":7,"last update":"Wed Jul 5 23:34:42 2023","interfaces":[{"interface":"back","average":{"1min":5.7000000000000002,"5min":1.6240000000000001,"15min":0.94499999999999995},"min":{"1min":0.438,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":26.992000000000001,"5min":26.992000000000001,"15min":26.992000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":6.1929999999999996,"5min":1.7250000000000001,"15min":0.98099999999999998},"min":{"1min":0.44700000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":19.998999999999999,"5min":19.998999999999999,"15min":19.998999999999999},"last":0.62}]}]},{"osd":1,"up_from":13,"seq":55834574888,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53896,"kb_used_data":22848,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94317944,"statfs":{"total":96636764160,"available":96581574656,"internally_reserved":0,"allocated":23396352,"data_stored":23207518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 5 23:34:46 2023","interfaces":[{"interface":"back","average":{"1min":3.9239999999999999,"5min":1.0700000000000001,"15min":0.59399999999999997},"min":{"1min":0.29799999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":14.039999999999999,"5min":14.039999999999999,"15min":14.039999999999999},"last":0.32600000000000001},{"interface":"front","average":{"1min":3.871,"5min":1.0669999999999999,"15min":0.59899999999999998},"min":{"1min":0.27400000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":18.006,"5min":18.006,"15min":18.006},"last":0.58099999999999996}]},{"osd":2,"last update":"Wed Jul 5 23:34:46 2023","interfaces":[{"interface":"back","average":{"1min":4.3860000000000001,"5min":1.1839999999999999,"15min":0.65000000000000002},"min":{"1min":0.32200000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":14.092000000000001,"5min":14.092000000000001,"15min":14.092000000000001},"last":0.38400000000000001},{"interface":"front","average":{"1min":4.3929999999999998,"5min":1.173,"15min":0.63600000000000001},"min":{"1min":0.33500000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":17.994,"5min":17.994,"15min":17.994},"last":0.443}]},{"osd":3,"last update":"Wed Jul 5 23:34:46 2023","interfaces":[{"interface":"back","average":{"1min":4.9980000000000002,"5min":1.3180000000000001,"15min":0.70399999999999996},"min":{"1min":0.29999999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":17.949999999999999,"5min":17.949999999999999,"15min":17.949999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":3.2240000000000002,"5min":0.96999999999999997,"15min":0.59399999999999997},"min":{"1min":0.38800000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":14.377000000000001,"5min":14.377000000000001,"15min":14.377000000000001},"last":0.42499999999999999}]},{"osd":4,"last update":"Wed Jul 5 23:34:46 2023","interfaces":[{"interface":"back","average":{"1min":5.0419999999999998,"5min":1.4790000000000001,"15min":0.88500000000000001},"min":{"1min":0.436,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":14.004,"5min":14.004,"15min":14.004},"last":0.52200000000000002},{"interface":"front","average":{"1min":5.75,"5min":1.6100000000000001,"15min":0.92000000000000004},"min":{"1min":0.49399999999999999,"5min":0.371,"15min":0.371},"max":{"1min":20.943999999999999,"5min":20.943999999999999,"15min":20.943999999999999},"last":0.59499999999999997}]},{"osd":5,"last update":"Wed Jul 5 23:34:46 2023","interfaces":[{"interface":"back","average":{"1min":5.2549999999999999,"5min":1.5509999999999999,"15min":0.93400000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":24.949999999999999,"5min":24.949999999999999,"15min":24.949999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":5.9710000000000001,"5min":1.7190000000000001,"15min":1.0109999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":21.945,"5min":21.945,"15min":21.945},"last":0.56999999999999995}]},{"osd":6,"last update":"Wed Jul 5 23:34:46 2023","interfaces":[{"interface":"back","average":{"1min":4.2859999999999996,"5min":1.3420000000000001,"15min":0.85099999999999998},"min":{"1min":0.42799999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":17.981999999999999,"5min":17.981999999999999,"15min":17.981999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":6.0060000000000002,"5min":1.714,"15min":0.998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":24.943000000000001,"5min":24.943000000000001,"15min":24.943000000000001},"last":0.46500000000000002}]},{"osd":7,"last update":"Wed Jul 5 23:34:46 2023","interfaces":[{"interface":"back","average":{"1min":5.6079999999999997,"5min":1.621,"15min":0.95699999999999996},"min":{"1min":0.52700000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":18.045000000000002,"5min":18.045000000000002,"15min":18.045000000000002},"last":0.55500000000000005},{"interface":"front","average":{"1min":3.9289999999999998,"5min":1.2769999999999999,"15min":0.83499999999999996},"min":{"1min":0.46000000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":14.352,"5min":14.352,"15min":14.352},"last":0.63400000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574888,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54488,"kb_used_data":23440,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94317352,"statfs":{"total":96636764160,"available":96580968448,"internally_reserved":0,"allocated":24002560,"data_stored":23806220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Jul 5 23:34:41 2023","interfaces":[{"interface":"back","average":{"1min":4.0949999999999998,"5min":1.081,"15min":0.57899999999999996},"min":{"1min":0.254,"5min":0.185,"15min":0.185},"max":{"1min":23.974,"5min":23.974,"15min":23.974},"last":0.32000000000000001},{"interface":"front","average":{"1min":5.0419999999999998,"5min":1.282,"15min":0.65500000000000003},"min":{"1min":0.28999999999999998,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":32.256999999999998,"5min":32.256999999999998,"15min":32.256999999999998},"last":0.377}]},{"osd":2,"last update":"Wed Jul 5 23:34:41 2023","interfaces":[{"interface":"back","average":{"1min":3.4060000000000001,"5min":0.97899999999999998,"15min":0.57499999999999996},"min":{"1min":0.31,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":16.157,"5min":16.157,"15min":16.157},"last":0.432},{"interface":"front","average":{"1min":3.6739999999999999,"5min":1.0269999999999999,"15min":0.58599999999999997},"min":{"1min":0.28899999999999998,"5min":0.254,"15min":0.254},"max":{"1min":14.91,"5min":14.91,"15min":14.91},"last":0.44500000000000001}]},{"osd":3,"last update":"Wed Jul 5 23:34:41 2023","interfaces":[{"interface":"back","average":{"1min":6.1820000000000004,"5min":1.534,"15min":0.75900000000000001},"min":{"1min":0.35299999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":16.928999999999998,"5min":16.928999999999998,"15min":16.928999999999998},"last":0.46600000000000003},{"interface":"front","average":{"1min":2.4399999999999999,"5min":0.83199999999999996,"15min":0.56399999999999995},"min":{"1min":0.38500000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":11.923999999999999,"5min":11.923999999999999,"15min":11.923999999999999},"last":0.54200000000000004}]},{"osd":4,"last update":"Wed Jul 5 23:34:41 2023","interfaces":[{"interface":"back","average":{"1min":4.6520000000000001,"5min":1.3899999999999999,"15min":0.84599999999999997},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":16.838000000000001,"5min":16.838000000000001,"15min":16.838000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":5.7990000000000004,"5min":1.633,"15min":0.93899999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":23.905999999999999,"5min":23.905999999999999,"15min":23.905999999999999},"last":0.48599999999999999}]},{"osd":5,"last update":"Wed Jul 5 23:34:41 2023","interfaces":[{"interface":"back","average":{"1min":4.7140000000000004,"5min":1.4299999999999999,"15min":0.88200000000000001},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":17.824000000000002,"5min":17.824000000000002,"15min":17.824000000000002},"last":0.51100000000000001},{"interface":"front","average":{"1min":5.0519999999999996,"5min":1.5,"15min":0.90800000000000003},"min":{"1min":0.498,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":16.905000000000001,"5min":16.905000000000001,"15min":16.905000000000001},"last":0.60599999999999998}]},{"osd":6,"last update":"Wed Jul 5 23:34:41 2023","interfaces":[{"interface":"back","average":{"1min":2.7469999999999999,"5min":1.0389999999999999,"15min":0.754},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":10.102,"5min":10.102,"15min":10.102},"last":0.59099999999999997},{"interface":"front","average":{"1min":5.2690000000000001,"5min":1.5529999999999999,"15min":0.93300000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":32.298999999999999,"5min":32.298999999999999,"15min":32.298999999999999},"last":0.55600000000000005}]},{"osd":7,"last update":"Wed Jul 5 23:34:41 2023","interfaces":[{"interface":"back","average":{"1min":4.7759999999999998,"5min":1.464,"15min":0.91200000000000003},"min":{"1min":0.51000000000000001,"5min":0.503,"15min":0.503},"max":{"1min":14.946,"5min":14.946,"15min":14.946},"last":0.63900000000000001},{"interface":"front","average":{"1min":5.8360000000000003,"5min":1.657,"15min":0.96099999999999997},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":16.878,"5min":16.878,"15min":16.878},"last":0.56799999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574889,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55944,"kb_used_data":24896,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94315896,"statfs":{"total":96636764160,"available":96579477504,"internally_reserved":0,"allocated":25493504,"data_stored":25304670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 5 23:34:45 2023","interfaces":[{"interface":"back","average":{"1min":6.4109999999999996,"5min":1.728,"15min":0.94799999999999995},"min":{"1min":0.27600000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":29.716000000000001,"5min":29.716000000000001,"15min":29.716000000000001},"last":0.29999999999999999},{"interface":"front","average":{"1min":6.1890000000000001,"5min":1.7290000000000001,"15min":0.98599999999999999},"min":{"1min":0.26800000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":21.699000000000002,"5min":21.699000000000002,"15min":21.699000000000002},"last":0.38300000000000001}]},{"osd":1,"last update":"Wed Jul 5 23:34:45 2023","interfaces":[{"interface":"back","average":{"1min":6.0640000000000001,"5min":1.718,"15min":0.99399999999999999},"min":{"1min":0.35999999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":23.053000000000001,"5min":23.053000000000001,"15min":23.053000000000001},"last":0.35099999999999998},{"interface":"front","average":{"1min":5.3579999999999997,"5min":1.5720000000000001,"15min":0.94099999999999995},"min":{"1min":0.32800000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":29.632999999999999,"5min":29.632999999999999,"15min":29.632999999999999},"last":0.42199999999999999}]},{"osd":3,"last update":"Wed Jul 5 23:34:45 2023","interfaces":[{"interface":"back","average":{"1min":3.52,"5min":1.1559999999999999,"15min":0.76200000000000001},"min":{"1min":0.29799999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":22.018000000000001,"5min":22.018000000000001,"15min":22.018000000000001},"last":0.36699999999999999},{"interface":"front","average":{"1min":4.9390000000000001,"5min":1.5429999999999999,"15min":0.97699999999999998},"min":{"1min":0.41399999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":29.686,"5min":29.686,"15min":29.686},"last":0.46700000000000003}]},{"osd":4,"last update":"Wed Jul 5 23:34:45 2023","interfaces":[{"interface":"back","average":{"1min":6.9909999999999997,"5min":2.0550000000000002,"15min":1.2330000000000001},"min":{"1min":0.46200000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":29.768999999999998,"5min":29.768999999999998,"15min":29.768999999999998},"last":0.65800000000000003},{"interface":"front","average":{"1min":7.3170000000000002,"5min":2.141,"15min":1.278},"min":{"1min":0.44600000000000001,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":21.16,"5min":21.16,"15min":21.16},"last":0.59299999999999997}]},{"osd":5,"last update":"Wed Jul 5 23:34:45 2023","interfaces":[{"interface":"back","average":{"1min":8.359,"5min":2.331,"15min":1.3260000000000001},"min":{"1min":0.502,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":22.927,"5min":22.927,"15min":22.927},"last":0.621},{"interface":"front","average":{"1min":5.6970000000000001,"5min":1.8140000000000001,"15min":1.167},"min":{"1min":0.52400000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":23.120000000000001,"5min":23.120000000000001,"15min":23.120000000000001},"last":0.69299999999999995}]},{"osd":6,"last update":"Wed Jul 5 23:34:45 2023","interfaces":[{"interface":"back","average":{"1min":6.0430000000000001,"5min":1.889,"15min":1.1970000000000001},"min":{"1min":0.54200000000000004,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":23.173999999999999,"5min":23.173999999999999,"15min":23.173999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":8.3699999999999992,"5min":2.3570000000000002,"15min":1.355},"min":{"1min":0.59599999999999997,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":29.742999999999999,"5min":29.742999999999999,"15min":29.742999999999999},"last":0.71299999999999997}]},{"osd":7,"last update":"Wed Jul 5 23:34:45 2023","interfaces":[{"interface":"back","average":{"1min":8.6240000000000006,"5min":2.4140000000000001,"15min":1.379},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":32.924999999999997,"5min":32.924999999999997,"15min":32.924999999999997},"last":0.67300000000000004},{"interface":"front","average":{"1min":7.1630000000000003,"5min":2.1419999999999999,"15min":1.3049999999999999},"min":{"1min":0.53000000000000003,"5min":0.436,"15min":0.436},"max":{"1min":30.594999999999999,"5min":30.594999999999999,"15min":30.594999999999999},"last":0.64100000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574888,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51852,"kb_used_data":20804,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94319988,"statfs":{"total":96636764160,"available":96583667712,"internally_reserved":0,"allocated":21303296,"data_stored":21110456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 5 23:34:48 2023","interfaces":[{"interface":"back","average":{"1min":4.9059999999999997,"5min":1.333,"15min":0.73699999999999999},"min":{"1min":0.33100000000000002,"5min":0.25,"15min":0.25},"max":{"1min":22.948,"5min":22.948,"15min":22.948},"last":0.374},{"interface":"front","average":{"1min":4.9850000000000003,"5min":1.3799999999999999,"15min":0.77900000000000003},"min":{"1min":0.34699999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":23.036000000000001,"5min":23.036000000000001,"15min":23.036000000000001},"last":0.40699999999999997}]},{"osd":1,"last update":"Wed Jul 5 23:34:48 2023","interfaces":[{"interface":"back","average":{"1min":4.1429999999999998,"5min":1.405,"15min":0.94899999999999995},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":18.981999999999999,"5min":18.981999999999999,"15min":18.981999999999999},"last":0.34799999999999998},{"interface":"front","average":{"1min":4.5170000000000003,"5min":1.512,"15min":1.0109999999999999},"min":{"1min":0.38300000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":25.253,"5min":25.253,"15min":25.253},"last":0.436}]},{"osd":2,"last update":"Wed Jul 5 23:34:48 2023","interfaces":[{"interface":"back","average":{"1min":4.101,"5min":1.234,"15min":0.75600000000000001},"min":{"1min":0.30499999999999999,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":25.32,"5min":25.32,"15min":25.32},"last":0.32400000000000001},{"interface":"front","average":{"1min":4.048,"5min":1.2010000000000001,"15min":0.72699999999999998},"min":{"1min":0.42499999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":12.010999999999999,"5min":12.010999999999999,"15min":12.010999999999999},"last":0.51700000000000002}]},{"osd":4,"last update":"Wed Jul 5 23:34:48 2023","interfaces":[{"interface":"back","average":{"1min":4.343,"5min":1.379,"15min":0.88500000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":19.007999999999999,"5min":19.007999999999999,"15min":19.007999999999999},"last":0.496},{"interface":"front","average":{"1min":5.3330000000000002,"5min":1.6080000000000001,"15min":0.98699999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":22.882000000000001,"5min":22.882000000000001,"15min":22.882000000000001},"last":0.48099999999999998}]},{"osd":5,"last update":"Wed Jul 5 23:34:48 2023","interfaces":[{"interface":"back","average":{"1min":6.7869999999999999,"5min":1.919,"15min":1.1080000000000001},"min":{"1min":0.46600000000000003,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":23.004999999999999,"5min":23.004999999999999,"15min":23.004999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":5.7699999999999996,"5min":1.7330000000000001,"15min":1.0600000000000001},"min":{"1min":0.61499999999999999,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":18.959,"5min":18.959,"15min":18.959},"last":0.61399999999999999}]},{"osd":6,"last update":"Wed Jul 5 23:34:48 2023","interfaces":[{"interface":"back","average":{"1min":4.2370000000000001,"5min":1.429,"15min":0.96099999999999997},"min":{"1min":0.60699999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":18.923999999999999,"5min":18.923999999999999,"15min":18.923999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":5.5460000000000003,"5min":1.6539999999999999,"15min":1.006},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":18.978000000000002,"5min":18.978000000000002,"15min":18.978000000000002},"last":0.58599999999999997}]},{"osd":7,"last update":"Wed Jul 5 23:34:48 2023","interfaces":[{"interface":"back","average":{"1min":5.2569999999999997,"5min":1.585,"15min":0.97299999999999998},"min":{"1min":0.47499999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":19.937999999999999,"5min":19.937999999999999,"15min":19.937999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":5.9630000000000001,"5min":1.7749999999999999,"15min":1.077},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":22.974,"5min":22.974,"15min":22.974},"last":0.60199999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574889,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61560,"kb_used_data":26416,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94310280,"statfs":{"total":96636764160,"available":96573726720,"internally_reserved":0,"allocated":27049984,"data_stored":26841193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 5 23:34:44 2023","interfaces":[{"interface":"back","average":{"1min":5.1120000000000001,"5min":1.4319999999999999,"15min":0.81799999999999995},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":16.655999999999999,"5min":16.655999999999999,"15min":16.655999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":5.5030000000000001,"5min":1.5149999999999999,"15min":0.85099999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":18.661999999999999,"5min":18.661999999999999,"15min":18.661999999999999},"last":0.53500000000000003}]},{"osd":1,"last update":"Wed Jul 5 23:34:44 2023","interfaces":[{"interface":"back","average":{"1min":5.3860000000000001,"5min":1.47,"15min":0.81799999999999995},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":18.991,"5min":18.991,"15min":18.991},"last":0.52200000000000002},{"interface":"front","average":{"1min":7.1799999999999997,"5min":1.8400000000000001,"15min":0.94999999999999996},"min":{"1min":0.371,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":23.879000000000001,"5min":23.879000000000001,"15min":23.879000000000001},"last":0.54900000000000004}]},{"osd":2,"last update":"Wed Jul 5 23:34:44 2023","interfaces":[{"interface":"back","average":{"1min":6.8799999999999999,"5min":1.8320000000000001,"15min":0.98999999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":23.805,"5min":23.805,"15min":23.805},"last":0.57199999999999995},{"interface":"front","average":{"1min":6.1379999999999999,"5min":1.6659999999999999,"15min":0.92100000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":18.707000000000001,"5min":18.707000000000001,"15min":18.707000000000001},"last":0.622}]},{"osd":3,"last update":"Wed Jul 5 23:34:44 2023","interfaces":[{"interface":"back","average":{"1min":6.0090000000000003,"5min":1.6220000000000001,"15min":0.89100000000000001},"min":{"1min":0.373,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":22.966999999999999,"5min":22.966999999999999,"15min":22.966999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":6.0899999999999999,"5min":1.6799999999999999,"15min":0.94499999999999995},"min":{"1min":0.33800000000000002,"5min":0.314,"15min":0.314},"max":{"1min":23.843,"5min":23.843,"15min":23.843},"last":0.64300000000000002}]},{"osd":5,"last update":"Wed Jul 5 23:34:44 2023","interfaces":[{"interface":"back","average":{"1min":4.7779999999999996,"5min":1.3280000000000001,"15min":0.753},"min":{"1min":0.39500000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":16.574999999999999,"5min":16.574999999999999,"15min":16.574999999999999},"last":0.36399999999999999},{"interface":"front","average":{"1min":3.8380000000000001,"5min":1.1870000000000001,"15min":0.745},"min":{"1min":0.40100000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":18.693999999999999,"5min":18.693999999999999,"15min":18.693999999999999},"last":0.41199999999999998}]},{"osd":6,"last update":"Wed Jul 5 23:34:44 2023","interfaces":[{"interface":"back","average":{"1min":5.016,"5min":1.425,"15min":0.82699999999999996},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":17.983000000000001,"5min":17.983000000000001,"15min":17.983000000000001},"last":0.46200000000000002},{"interface":"front","average":{"1min":4.4509999999999996,"5min":1.3300000000000001,"15min":0.81000000000000005},"min":{"1min":0.44500000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":16.622,"5min":16.622,"15min":16.622},"last":0.58599999999999997}]},{"osd":7,"last update":"Wed Jul 5 23:34:44 2023","interfaces":[{"interface":"back","average":{"1min":3.9460000000000002,"5min":1.226,"15min":0.77300000000000002},"min":{"1min":0.46500000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":22.931000000000001,"5min":22.931000000000001,"15min":22.931000000000001},"last":0.497},{"interface":"front","average":{"1min":4.2030000000000003,"5min":1.3069999999999999,"15min":0.82499999999999996},"min":{"1min":0.40400000000000003,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":18.966000000000001,"5min":18.966000000000001,"15min":18.966000000000001},"last":0.60399999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574888,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60048,"kb_used_data":24904,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94311792,"statfs":{"total":96636764160,"available":96575275008,"internally_reserved":0,"allocated":25501696,"data_stored":25305322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 5 23:34:40 2023","interfaces":[{"interface":"back","average":{"1min":5.9340000000000002,"5min":1.5860000000000001,"15min":0.86099999999999999},"min":{"1min":0.42999999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":18.867999999999999,"5min":18.867999999999999,"15min":18.867999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":4.109,"5min":1.3380000000000001,"15min":0.876},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":18.099,"5min":18.099,"15min":18.099},"last":0.52700000000000002}]},{"osd":1,"last update":"Wed Jul 5 23:34:40 2023","interfaces":[{"interface":"back","average":{"1min":3.8809999999999998,"5min":1.244,"15min":0.80400000000000005},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":18.071999999999999,"5min":18.071999999999999,"15min":18.071999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":4.7530000000000001,"5min":1.444,"15min":0.89200000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":16.869,"5min":16.869,"15min":16.869},"last":0.51800000000000002}]},{"osd":2,"last update":"Wed Jul 5 23:34:40 2023","interfaces":[{"interface":"back","average":{"1min":5.4950000000000001,"5min":1.556,"15min":0.90000000000000002},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":22.177,"5min":22.177,"15min":22.177},"last":0.71899999999999997},{"interface":"front","average":{"1min":5.4589999999999996,"5min":1.5589999999999999,"15min":0.90900000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":18.902999999999999,"5min":18.902999999999999,"15min":18.902999999999999},"last":0.73899999999999999}]},{"osd":3,"last update":"Wed Jul 5 23:34:40 2023","interfaces":[{"interface":"back","average":{"1min":4.3230000000000004,"5min":1.333,"15min":0.83499999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":18.032,"5min":18.032,"15min":18.032},"last":0.495},{"interface":"front","average":{"1min":4.2400000000000002,"5min":1.399,"15min":0.92500000000000004},"min":{"1min":0.46700000000000003,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":16.905000000000001,"5min":16.905000000000001,"15min":16.905000000000001},"last":0.67400000000000004}]},{"osd":4,"last update":"Wed Jul 5 23:34:40 2023","interfaces":[{"interface":"back","average":{"1min":5.4420000000000002,"5min":1.51,"15min":0.85499999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":18.957000000000001,"5min":18.957000000000001,"15min":18.957000000000001},"last":0.38500000000000001},{"interface":"front","average":{"1min":3.6560000000000001,"5min":1.2,"15min":0.79100000000000004},"min":{"1min":0.38400000000000001,"5min":0.377,"15min":0.377},"max":{"1min":18.123999999999999,"5min":18.123999999999999,"15min":18.123999999999999},"last":0.40100000000000002}]},{"osd":6,"last update":"Wed Jul 5 23:34:40 2023","interfaces":[{"interface":"back","average":{"1min":4.1299999999999999,"5min":1.29,"15min":0.81599999999999995},"min":{"1min":0.41999999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":16.952000000000002,"5min":16.952000000000002,"15min":16.952000000000002},"last":0.42599999999999999},{"interface":"front","average":{"1min":5.1159999999999997,"5min":1.488,"15min":0.88300000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":18.928000000000001,"5min":18.928000000000001,"15min":18.928000000000001},"last":0.47099999999999997}]},{"osd":7,"last update":"Wed Jul 5 23:34:40 2023","interfaces":[{"interface":"back","average":{"1min":2.4380000000000002,"5min":0.96299999999999997,"15min":0.71699999999999997},"min":{"1min":0.40899999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":10.324999999999999,"5min":10.324999999999999,"15min":10.324999999999999},"last":0.45700000000000002},{"interface":"front","average":{"1min":2.8799999999999999,"5min":1.077,"15min":0.77700000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":13.013,"5min":13.013,"15min":13.013},"last":0.58599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":8334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1556480,"data_stored":1536523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1556480,"data_stored":1528931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":23068672,"data_stored":23068672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23068672,"data_stored":23068672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":25165824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":25165824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":25165824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":27262976,"data_stored":27262976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":31457280,"data_stored":31457280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-05T23:35:45.637 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.638 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.638 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.639 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.639 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.639 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.640 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.640 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.640 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.641 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.641 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.641 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.641 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.642 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.642 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.642 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.643 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.643 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.643 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-07-05T23:32:51.877945+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=51, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.644 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.644 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.644 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.644 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.645 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.645 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.645 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.646 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-07-05T23:32:51.877945+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=51, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.646 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.646 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.647 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-07-05T23:32:51.877945+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=51, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.647 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.647 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-07-05T23:32:51.877945+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=51, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.647 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.648 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.648 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.649 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-07-05T23:32:51.877945+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=51, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.649 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.649 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.649 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.650 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.650 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-07-05T23:32:51.877945+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=51, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.650 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.651 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.651 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-07-05T23:32:51.877945+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=51, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.651 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.652 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.652 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.652 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.653 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-07-05T23:32:51.877945+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=51, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.653 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.653 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.653 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.654 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.654 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-07-05T23:32:51.877945+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=51, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.654 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.655 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.655 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.655 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.656 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.656 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.656 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.657 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.657 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.657 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.657 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.658 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.658 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.658 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.659 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.659 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.659 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.660 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.660 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.660 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.661 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:35:45.661 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-07-05T23:35:52.840 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:35:52.843 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:36:05.662 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-05T23:36:05.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.799+0000 7f9fdfd33700 1 Processor -- start 2023-07-05T23:36:05.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.799+0000 7f9fdfd33700 1 -- start start 2023-07-05T23:36:05.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.800+0000 7f9fdfd33700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9fd8156880 0x7f9fd8069ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:05.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.800+0000 7f9fdfd33700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9fd80cc1d0 0x7f9fd80cc650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:05.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.800+0000 7f9fdfd33700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fd80cee80 con 0x7f9fd80aed30 2023-07-05T23:36:05.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.800+0000 7f9fdfd33700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fd80ccb90 con 0x7f9fd80cc1d0 2023-07-05T23:36:05.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.800+0000 7f9fdfd33700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd80cf100 con 0x7f9fd8156880 2023-07-05T23:36:05.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.800+0000 7f9fdd2ce700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f9fd80aed30 0x7f9fd8160580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:53928/0 (socket says 172.21.15.27:53928) 2023-07-05T23:36:05.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.800+0000 7f9fdd2ce700 1 -- 172.21.15.27:0/2650232351 learned_addr learned my addr 172.21.15.27:0/2650232351 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-07-05T23:36:05.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.801+0000 7f9fddacf700 1 --2- 172.21.15.27:0/2650232351 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9fd8156880 0x7f9fd8069ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:05.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.801+0000 7f9fde2d0700 1 --2- 172.21.15.27:0/2650232351 >> v2:172.21.15.162:3300/0 conn(0x7f9fd80cc1d0 0x7f9fd80cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:05.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.801+0000 7f9fdcacd700 1 -- 172.21.15.27:0/2650232351 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 750122695 0 0) 0x7f9fd80cee80 con 0x7f9fd80aed30 2023-07-05T23:36:05.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.801+0000 7f9fdcacd700 1 -- 172.21.15.27:0/2650232351 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fc40035b0 con 0x7f9fd80aed30 2023-07-05T23:36:05.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.801+0000 7f9fdcacd700 1 -- 172.21.15.27:0/2650232351 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2517298654 0 0) 0x7f9fc40035b0 con 0x7f9fd80aed30 2023-07-05T23:36:05.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.801+0000 7f9fdcacd700 1 -- 172.21.15.27:0/2650232351 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9fd8156880 msgr2=0x7f9fd8069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:36:05.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.801+0000 7f9fdcacd700 1 --2- 172.21.15.27:0/2650232351 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9fd8156880 0x7f9fd8069ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:05.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.801+0000 7f9fdcacd700 1 -- 172.21.15.27:0/2650232351 >> v2:172.21.15.162:3300/0 conn(0x7f9fd80cc1d0 msgr2=0x7f9fd80cc650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:36:05.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.801+0000 7f9fdcacd700 1 --2- 172.21.15.27:0/2650232351 >> v2:172.21.15.162:3300/0 conn(0x7f9fd80cc1d0 0x7f9fd80cc650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:05.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.801+0000 7f9fdcacd700 1 -- 172.21.15.27:0/2650232351 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fd80cf3e0 con 0x7f9fd80aed30 2023-07-05T23:36:05.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.801+0000 7f9fdcacd700 1 -- 172.21.15.27:0/2650232351 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1246168953 0 0) 0x7f9fd4001670 con 0x7f9fd80aed30 2023-07-05T23:36:05.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.801+0000 7f9fdcacd700 1 -- 172.21.15.27:0/2650232351 >> v1:172.21.15.27:6789/0 conn(0x7f9fd80aed30 legacy=0x7f9fd8160580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:05.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.801+0000 7f9fdcacd700 1 --2- 172.21.15.27:0/2650232351 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9fc4003a00 0x7f9fc4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:05.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.801+0000 7f9fdcacd700 1 --2- 172.21.15.27:0/2650232351 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9fd8156880 0x7f9fc4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:05.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.801+0000 7f9fdcacd700 1 --2- 172.21.15.27:0/2650232351 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9fc4004d90 0x7f9fc4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:05.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.801+0000 7f9fdcacd700 1 -- 172.21.15.27:0/2650232351 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd80ccb90 con 0x7f9fc4004d90 2023-07-05T23:36:05.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.801+0000 7f9fdcacd700 1 -- 172.21.15.27:0/2650232351 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd80cf100 con 0x7f9fc4003a00 2023-07-05T23:36:05.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.801+0000 7f9fdcacd700 1 -- 172.21.15.27:0/2650232351 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc400ba10 con 0x7f9fd8156880 2023-07-05T23:36:05.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.801+0000 7f9fde2d0700 1 --2- 172.21.15.27:0/2650232351 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9fc4004d90 0x7f9fc4005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:05.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.801+0000 7f9fddacf700 1 --2- 172.21.15.27:0/2650232351 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9fc4003a00 0x7f9fc4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:05.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.801+0000 7f9fdd2ce700 1 --2- 172.21.15.27:0/2650232351 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9fd8156880 0x7f9fc4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:05.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.801+0000 7f9fde2d0700 1 -- 172.21.15.27:0/2650232351 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9fd8156880 msgr2=0x7f9fc4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:36:05.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.801+0000 7f9fde2d0700 1 --2- 172.21.15.27:0/2650232351 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9fd8156880 0x7f9fc4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:05.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.801+0000 7f9fde2d0700 1 -- 172.21.15.27:0/2650232351 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9fc4003a00 msgr2=0x7f9fc4003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:36:05.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.801+0000 7f9fde2d0700 1 --2- 172.21.15.27:0/2650232351 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9fc4003a00 0x7f9fc4003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:05.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.801+0000 7f9fde2d0700 1 -- 172.21.15.27:0/2650232351 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fc40035b0 con 0x7f9fc4004d90 2023-07-05T23:36:05.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.802+0000 7f9fde2d0700 1 --2- 172.21.15.27:0/2650232351 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9fc4004d90 0x7f9fc4005200 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f9fd0009fc0 tx=0x7f9fc4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81d13b7017e7cf14 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:36:05.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.802+0000 7f9fdcacd700 1 -- 172.21.15.27:0/2650232351 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd000ebd0 con 0x7f9fc4004d90 2023-07-05T23:36:05.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.802+0000 7f9fdcacd700 1 -- 172.21.15.27:0/2650232351 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fd000f040 con 0x7f9fc4004d90 2023-07-05T23:36:05.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.802+0000 7f9fdcacd700 1 -- 172.21.15.27:0/2650232351 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd0014480 con 0x7f9fc4004d90 2023-07-05T23:36:05.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.802+0000 7f9fdfd33700 1 -- 172.21.15.27:0/2650232351 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9fc4004d90 msgr2=0x7f9fc4005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:05.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.802+0000 7f9fdfd33700 1 --2- 172.21.15.27:0/2650232351 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9fc4004d90 0x7f9fc4005200 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f9fd0009fc0 tx=0x7f9fc4005880 comp rx=0 tx=0).stop 2023-07-05T23:36:05.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.802+0000 7f9fde2d0700 1 -- 172.21.15.27:0/2650232351 reap_dead start 2023-07-05T23:36:05.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.802+0000 7f9fdfd33700 1 -- 172.21.15.27:0/2650232351 shutdown_connections 2023-07-05T23:36:05.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.802+0000 7f9fdfd33700 1 -- 172.21.15.27:0/2650232351 >> 172.21.15.27:0/2650232351 conn(0x7f9fd806d4a0 msgr2=0x7f9fd806d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:36:05.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.802+0000 7f9fdfd33700 1 -- 172.21.15.27:0/2650232351 shutdown_connections 2023-07-05T23:36:05.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.802+0000 7f9fdfd33700 1 -- 172.21.15.27:0/2650232351 wait complete. 2023-07-05T23:36:05.820 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.804+0000 7f9fdfd33700 1 Processor -- start 2023-07-05T23:36:05.821 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.804+0000 7f9fdfd33700 1 -- start start 2023-07-05T23:36:05.821 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.804+0000 7f9fdfd33700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9fc4004d90 0x7f9fd8150080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:05.821 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.804+0000 7f9fdfd33700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9fd80b4dd0 0x7f9fd80c5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:05.821 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.804+0000 7f9fdfd33700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9fd80adee0 0x7f9fd806a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:05.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.804+0000 7f9fdfd33700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd80b52d0 con 0x7f9fd80adee0 2023-07-05T23:36:05.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.804+0000 7f9fdfd33700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd80c4740 con 0x7f9fc4004d90 2023-07-05T23:36:05.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.804+0000 7f9fdfd33700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd80c4a20 con 0x7f9fd80b4dd0 2023-07-05T23:36:05.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.804+0000 7f9fde2d0700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9fd80adee0 0x7f9fd806a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:05.823 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.805+0000 7f9fde2d0700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9fd80adee0 0x7f9fd806a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46778/0 (socket says 172.21.15.27:46778) 2023-07-05T23:36:05.823 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.805+0000 7f9fde2d0700 1 -- 172.21.15.27:0/434305856 learned_addr learned my addr 172.21.15.27:0/434305856 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:36:05.823 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.805+0000 7f9fddacf700 1 --2- 172.21.15.27:0/434305856 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9fc4004d90 0x7f9fd8150080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:05.823 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.805+0000 7f9fdd2ce700 1 --2- 172.21.15.27:0/434305856 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9fd80b4dd0 0x7f9fd80c5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:05.823 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.805+0000 7f9fde2d0700 1 -- 172.21.15.27:0/434305856 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9fd80b4dd0 msgr2=0x7f9fd80c5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:05.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.805+0000 7f9fde2d0700 1 --2- 172.21.15.27:0/434305856 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9fd80b4dd0 0x7f9fd80c5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:05.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.805+0000 7f9fde2d0700 1 -- 172.21.15.27:0/434305856 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9fc4004d90 msgr2=0x7f9fd8150080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:05.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.805+0000 7f9fde2d0700 1 --2- 172.21.15.27:0/434305856 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9fc4004d90 0x7f9fd8150080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:05.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.805+0000 7f9fde2d0700 1 -- 172.21.15.27:0/434305856 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fd80c4d00 con 0x7f9fd80adee0 2023-07-05T23:36:05.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.805+0000 7f9fdd2ce700 1 --2- 172.21.15.27:0/434305856 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9fd80b4dd0 0x7f9fd80c5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T23:36:05.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.805+0000 7f9fde2d0700 1 --2- 172.21.15.27:0/434305856 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9fd80adee0 0x7f9fd806a490 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f9fd0016000 tx=0x7f9fd0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:36:05.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.805+0000 7f9fce7fc700 1 -- 172.21.15.27:0/434305856 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd0007000 con 0x7f9fd80adee0 2023-07-05T23:36:05.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.805+0000 7f9fce7fc700 1 -- 172.21.15.27:0/434305856 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fd0004470 con 0x7f9fd80adee0 2023-07-05T23:36:05.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.805+0000 7f9fce7fc700 1 -- 172.21.15.27:0/434305856 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd0004820 con 0x7f9fd80adee0 2023-07-05T23:36:05.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.805+0000 7f9fdfd33700 1 -- 172.21.15.27:0/434305856 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fd80c5760 con 0x7f9fd80adee0 2023-07-05T23:36:05.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.805+0000 7f9fdfd33700 1 -- 172.21.15.27:0/434305856 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fd80ae350 con 0x7f9fd80adee0 2023-07-05T23:36:05.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.806+0000 7f9fdfd33700 1 -- 172.21.15.27:0/434305856 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fd80ae570 con 0x7f9fd80adee0 2023-07-05T23:36:05.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.807+0000 7f9fce7fc700 1 -- 172.21.15.27:0/434305856 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9fd0014480 con 0x7f9fd80adee0 2023-07-05T23:36:05.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.807+0000 7f9fce7fc700 1 --2- 172.21.15.27:0/434305856 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f9fbc06ace0 0x7f9fbc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:05.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.807+0000 7f9fce7fc700 1 -- 172.21.15.27:0/434305856 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9fd008b1e0 con 0x7f9fd80adee0 2023-07-05T23:36:05.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.807+0000 7f9fddacf700 1 --2- 172.21.15.27:0/434305856 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f9fbc06ace0 0x7f9fbc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:05.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.808+0000 7f9fddacf700 1 --2- 172.21.15.27:0/434305856 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f9fbc06ace0 0x7f9fbc06d190 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9fc8009aa0 tx=0x7f9fc8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:36:05.828 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:05.811+0000 7f9fce7fc700 1 -- 172.21.15.27:0/434305856 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9fd0056090 con 0x7f9fd80adee0 2023-07-05T23:36:06.008 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:06.006+0000 7f9fdfd33700 1 -- 172.21.15.27:0/434305856 --> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9fd80c45d0 con 0x7f9fbc06ace0 2023-07-05T23:36:06.019 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:06.017+0000 7f9fce7fc700 1 -- 172.21.15.27:0/434305856 <== mgr.4105 v2:172.21.15.162:6832/3790028097 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+393803 (secure 0 0 0) 0x7f9fd80c45d0 con 0x7f9fbc06ace0 2023-07-05T23:36:06.024 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:36:06.027 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:06.021+0000 7f9fdfd33700 1 -- 172.21.15.27:0/434305856 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f9fbc06ace0 msgr2=0x7f9fbc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:06.027 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:06.021+0000 7f9fdfd33700 1 --2- 172.21.15.27:0/434305856 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f9fbc06ace0 0x7f9fbc06d190 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9fc8009aa0 tx=0x7f9fc8008040 comp rx=0 tx=0).stop 2023-07-05T23:36:06.028 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:06.021+0000 7f9fdfd33700 1 -- 172.21.15.27:0/434305856 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9fd80adee0 msgr2=0x7f9fd806a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:06.028 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:06.021+0000 7f9fdfd33700 1 --2- 172.21.15.27:0/434305856 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9fd80adee0 0x7f9fd806a490 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f9fd0016000 tx=0x7f9fd0009750 comp rx=0 tx=0).stop 2023-07-05T23:36:06.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:06.021+0000 7f9fdfd33700 1 -- 172.21.15.27:0/434305856 shutdown_connections 2023-07-05T23:36:06.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:06.021+0000 7f9fdfd33700 1 --2- 172.21.15.27:0/434305856 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9fc4004d90 0x7f9fd8150080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:06.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:06.021+0000 7f9fdfd33700 1 --2- 172.21.15.27:0/434305856 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f9fbc06ace0 0x7f9fbc06d190 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:06.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:06.021+0000 7f9fdfd33700 1 --2- 172.21.15.27:0/434305856 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9fd80adee0 0x7f9fd806a490 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:06.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:06.021+0000 7f9fdfd33700 1 --2- 172.21.15.27:0/434305856 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9fd80b4dd0 0x7f9fd80c5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:06.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:06.021+0000 7f9fdfd33700 1 -- 172.21.15.27:0/434305856 >> 172.21.15.27:0/434305856 conn(0x7f9fd806d4a0 msgr2=0x7f9fd80b0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:36:06.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:06.021+0000 7f9fdfd33700 1 -- 172.21.15.27:0/434305856 shutdown_connections 2023-07-05T23:36:06.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:06.021+0000 7f9fdfd33700 1 -- 172.21.15.27:0/434305856 wait complete. 2023-07-05T23:36:06.032 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2023-07-05T23:36:06.035 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":126,"stamp":"2023-07-05T23:36:05.689955+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":102790929,"num_objects":49,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":131,"num_read_kb":117,"num_write":1261,"num_write_kb":1290376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17771,"ondisk_log_size":17771,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":464064,"kb_used_data":203392,"kb_used_omap":0,"kb_used_meta":260608,"kb_avail":754510656,"statfs":{"total":773094113280,"available":772618911744,"internally_reserved":0,"allocated":208273408,"data_stored":206692626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":266862592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003636"},"pg_stats":[{"pgid":"4.3f","version":"30'28","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:28.077809+0000","last_change":"2023-07-05T23:35:28.077860+0000","last_active":"2023-07-05T23:35:28.077809+0000","last_peered":"2023-07-05T23:35:28.077809+0000","last_clean":"2023-07-05T23:35:28.077809+0000","last_became_active":"2023-07-05T23:32:53.342061+0000","last_became_peered":"2023-07-05T23:32:53.342061+0000","last_unstale":"2023-07-05T23:35:28.077809+0000","last_undegraded":"2023-07-05T23:35:28.077809+0000","last_fullsized":"2023-07-05T23:35:28.077809+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'28","last_scrub_stamp":"2023-07-05T23:35:28.077703+0000","last_deep_scrub":"30'28","last_deep_scrub_stamp":"2023-07-05T23:35:28.077703+0000","last_clean_scrub_stamp":"2023-07-05T23:35:28.077703+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:53:22.483440+0000","scrub_duration":0.0019331699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"30'27","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:26.826504+0000","last_change":"2023-07-05T23:35:26.826592+0000","last_active":"2023-07-05T23:35:26.826504+0000","last_peered":"2023-07-05T23:35:26.826504+0000","last_clean":"2023-07-05T23:35:26.826504+0000","last_became_active":"2023-07-05T23:32:53.342843+0000","last_became_peered":"2023-07-05T23:32:53.342843+0000","last_unstale":"2023-07-05T23:35:26.826504+0000","last_undegraded":"2023-07-05T23:35:26.826504+0000","last_fullsized":"2023-07-05T23:35:26.826504+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'27","last_scrub_stamp":"2023-07-05T23:35:26.826382+0000","last_deep_scrub":"30'27","last_deep_scrub_stamp":"2023-07-05T23:35:26.826382+0000","last_clean_scrub_stamp":"2023-07-05T23:35:26.826382+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:27:33.841616+0000","scrub_duration":0.002058448,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"30'43","reported_seq":68,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.285039+0000","last_change":"2023-07-05T23:32:53.339304+0000","last_active":"2023-07-05T23:35:17.285039+0000","last_peered":"2023-07-05T23:35:17.285039+0000","last_clean":"2023-07-05T23:35:17.285039+0000","last_became_active":"2023-07-05T23:32:53.338973+0000","last_became_peered":"2023-07-05T23:32:53.338973+0000","last_unstale":"2023-07-05T23:35:17.285039+0000","last_undegraded":"2023-07-05T23:35:17.285039+0000","last_fullsized":"2023-07-05T23:35:17.285039+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"30'24","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:33.415555+0000","last_change":"2023-07-05T23:35:33.415615+0000","last_active":"2023-07-05T23:35:33.415555+0000","last_peered":"2023-07-05T23:35:33.415555+0000","last_clean":"2023-07-05T23:35:33.415555+0000","last_became_active":"2023-07-05T23:32:53.334473+0000","last_became_peered":"2023-07-05T23:32:53.334473+0000","last_unstale":"2023-07-05T23:35:33.415555+0000","last_undegraded":"2023-07-05T23:35:33.415555+0000","last_fullsized":"2023-07-05T23:35:33.415555+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'24","last_scrub_stamp":"2023-07-05T23:35:33.415463+0000","last_deep_scrub":"30'24","last_deep_scrub_stamp":"2023-07-05T23:35:33.415463+0000","last_clean_scrub_stamp":"2023-07-05T23:35:33.415463+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:35:57.145092+0000","scrub_duration":0.0017828779999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"30'34","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:51.557867+0000","last_change":"2023-07-05T23:35:51.557916+0000","last_active":"2023-07-05T23:35:51.557867+0000","last_peered":"2023-07-05T23:35:51.557867+0000","last_clean":"2023-07-05T23:35:51.557867+0000","last_became_active":"2023-07-05T23:32:53.345743+0000","last_became_peered":"2023-07-05T23:32:53.345743+0000","last_unstale":"2023-07-05T23:35:51.557867+0000","last_undegraded":"2023-07-05T23:35:51.557867+0000","last_fullsized":"2023-07-05T23:35:51.557867+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'34","last_scrub_stamp":"2023-07-05T23:35:51.557768+0000","last_deep_scrub":"30'34","last_deep_scrub_stamp":"2023-07-05T23:35:51.557768+0000","last_clean_scrub_stamp":"2023-07-05T23:35:51.557768+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:22:28.327810+0000","scrub_duration":0.00171462,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"30'39","reported_seq":72,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:36:05.569982+0000","last_change":"2023-07-05T23:36:05.570030+0000","last_active":"2023-07-05T23:36:05.569982+0000","last_peered":"2023-07-05T23:36:05.569982+0000","last_clean":"2023-07-05T23:36:05.569982+0000","last_became_active":"2023-07-05T23:32:53.335456+0000","last_became_peered":"2023-07-05T23:32:53.335456+0000","last_unstale":"2023-07-05T23:36:05.569982+0000","last_undegraded":"2023-07-05T23:36:05.569982+0000","last_fullsized":"2023-07-05T23:36:05.569982+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'39","last_scrub_stamp":"2023-07-05T23:36:05.569878+0000","last_deep_scrub":"30'39","last_deep_scrub_stamp":"2023-07-05T23:36:05.569878+0000","last_clean_scrub_stamp":"2023-07-05T23:36:05.569878+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:58:20.957985+0000","scrub_duration":0.001660908,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"30'27","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:49.364981+0000","last_change":"2023-07-05T23:35:49.365055+0000","last_active":"2023-07-05T23:35:49.364981+0000","last_peered":"2023-07-05T23:35:49.364981+0000","last_clean":"2023-07-05T23:35:49.364981+0000","last_became_active":"2023-07-05T23:32:53.340639+0000","last_became_peered":"2023-07-05T23:32:53.340639+0000","last_unstale":"2023-07-05T23:35:49.364981+0000","last_undegraded":"2023-07-05T23:35:49.364981+0000","last_fullsized":"2023-07-05T23:35:49.364981+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'27","last_scrub_stamp":"2023-07-05T23:35:49.364872+0000","last_deep_scrub":"30'27","last_deep_scrub_stamp":"2023-07-05T23:35:49.364872+0000","last_clean_scrub_stamp":"2023-07-05T23:35:49.364872+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:47:50.452938+0000","scrub_duration":0.0017485770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"30'31","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:29.789118+0000","last_change":"2023-07-05T23:35:29.789172+0000","last_active":"2023-07-05T23:35:29.789118+0000","last_peered":"2023-07-05T23:35:29.789118+0000","last_clean":"2023-07-05T23:35:29.789118+0000","last_became_active":"2023-07-05T23:32:53.336216+0000","last_became_peered":"2023-07-05T23:32:53.336216+0000","last_unstale":"2023-07-05T23:35:29.789118+0000","last_undegraded":"2023-07-05T23:35:29.789118+0000","last_fullsized":"2023-07-05T23:35:29.789118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'31","last_scrub_stamp":"2023-07-05T23:35:29.789015+0000","last_deep_scrub":"30'31","last_deep_scrub_stamp":"2023-07-05T23:35:29.789015+0000","last_clean_scrub_stamp":"2023-07-05T23:35:29.789015+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:06:48.212448+0000","scrub_duration":0.001571259,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"30'38","reported_seq":71,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:44.530028+0000","last_change":"2023-07-05T23:35:44.530111+0000","last_active":"2023-07-05T23:35:44.530028+0000","last_peered":"2023-07-05T23:35:44.530028+0000","last_clean":"2023-07-05T23:35:44.530028+0000","last_became_active":"2023-07-05T23:32:53.347948+0000","last_became_peered":"2023-07-05T23:32:53.347948+0000","last_unstale":"2023-07-05T23:35:44.530028+0000","last_undegraded":"2023-07-05T23:35:44.530028+0000","last_fullsized":"2023-07-05T23:35:44.530028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'38","last_scrub_stamp":"2023-07-05T23:35:44.529912+0000","last_deep_scrub":"30'38","last_deep_scrub_stamp":"2023-07-05T23:35:44.529912+0000","last_clean_scrub_stamp":"2023-07-05T23:35:44.529912+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:47:45.617977+0000","scrub_duration":0.001908533,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"30'44","reported_seq":77,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:46.800220+0000","last_change":"2023-07-05T23:35:46.800291+0000","last_active":"2023-07-05T23:35:46.800220+0000","last_peered":"2023-07-05T23:35:46.800220+0000","last_clean":"2023-07-05T23:35:46.800220+0000","last_became_active":"2023-07-05T23:32:53.330135+0000","last_became_peered":"2023-07-05T23:32:53.330135+0000","last_unstale":"2023-07-05T23:35:46.800220+0000","last_undegraded":"2023-07-05T23:35:46.800220+0000","last_fullsized":"2023-07-05T23:35:46.800220+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'44","last_scrub_stamp":"2023-07-05T23:35:46.800082+0000","last_deep_scrub":"30'44","last_deep_scrub_stamp":"2023-07-05T23:35:46.800082+0000","last_clean_scrub_stamp":"2023-07-05T23:35:46.800082+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:58:40.415256+0000","scrub_duration":0.001981516,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"30'25","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:36:03.568650+0000","last_change":"2023-07-05T23:36:03.568698+0000","last_active":"2023-07-05T23:36:03.568650+0000","last_peered":"2023-07-05T23:36:03.568650+0000","last_clean":"2023-07-05T23:36:03.568650+0000","last_became_active":"2023-07-05T23:32:53.341526+0000","last_became_peered":"2023-07-05T23:32:53.341526+0000","last_unstale":"2023-07-05T23:36:03.568650+0000","last_undegraded":"2023-07-05T23:36:03.568650+0000","last_fullsized":"2023-07-05T23:36:03.568650+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'25","last_scrub_stamp":"2023-07-05T23:36:03.568545+0000","last_deep_scrub":"30'25","last_deep_scrub_stamp":"2023-07-05T23:36:03.568545+0000","last_clean_scrub_stamp":"2023-07-05T23:36:03.568545+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:19:51.173415+0000","scrub_duration":0.0021177969999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"30'30","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:39.129286+0000","last_change":"2023-07-05T23:35:39.129369+0000","last_active":"2023-07-05T23:35:39.129286+0000","last_peered":"2023-07-05T23:35:39.129286+0000","last_clean":"2023-07-05T23:35:39.129286+0000","last_became_active":"2023-07-05T23:32:53.337279+0000","last_became_peered":"2023-07-05T23:32:53.337279+0000","last_unstale":"2023-07-05T23:35:39.129286+0000","last_undegraded":"2023-07-05T23:35:39.129286+0000","last_fullsized":"2023-07-05T23:35:39.129286+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'30","last_scrub_stamp":"2023-07-05T23:35:39.129160+0000","last_deep_scrub":"30'30","last_deep_scrub_stamp":"2023-07-05T23:35:39.129160+0000","last_clean_scrub_stamp":"2023-07-05T23:35:39.129160+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:01:23.384296+0000","scrub_duration":0.0019447869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"30'30","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:31.043742+0000","last_change":"2023-07-05T23:35:31.043789+0000","last_active":"2023-07-05T23:35:31.043742+0000","last_peered":"2023-07-05T23:35:31.043742+0000","last_clean":"2023-07-05T23:35:31.043742+0000","last_became_active":"2023-07-05T23:32:53.336083+0000","last_became_peered":"2023-07-05T23:32:53.336083+0000","last_unstale":"2023-07-05T23:35:31.043742+0000","last_undegraded":"2023-07-05T23:35:31.043742+0000","last_fullsized":"2023-07-05T23:35:31.043742+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'30","last_scrub_stamp":"2023-07-05T23:35:31.043651+0000","last_deep_scrub":"30'30","last_deep_scrub_stamp":"2023-07-05T23:35:31.043651+0000","last_clean_scrub_stamp":"2023-07-05T23:35:31.043651+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:00:14.136508+0000","scrub_duration":0.001589949,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"30'32","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:47.783303+0000","last_change":"2023-07-05T23:35:47.783348+0000","last_active":"2023-07-05T23:35:47.783303+0000","last_peered":"2023-07-05T23:35:47.783303+0000","last_clean":"2023-07-05T23:35:47.783303+0000","last_became_active":"2023-07-05T23:32:53.327918+0000","last_became_peered":"2023-07-05T23:32:53.327918+0000","last_unstale":"2023-07-05T23:35:47.783303+0000","last_undegraded":"2023-07-05T23:35:47.783303+0000","last_fullsized":"2023-07-05T23:35:47.783303+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-07-05T23:35:47.783224+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-07-05T23:35:47.783224+0000","last_clean_scrub_stamp":"2023-07-05T23:35:47.783224+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:37:51.419002+0000","scrub_duration":0.0020096649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"30'31","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:36:00.352406+0000","last_change":"2023-07-05T23:36:00.352452+0000","last_active":"2023-07-05T23:36:00.352406+0000","last_peered":"2023-07-05T23:36:00.352406+0000","last_clean":"2023-07-05T23:36:00.352406+0000","last_became_active":"2023-07-05T23:32:53.340246+0000","last_became_peered":"2023-07-05T23:32:53.340246+0000","last_unstale":"2023-07-05T23:36:00.352406+0000","last_undegraded":"2023-07-05T23:36:00.352406+0000","last_fullsized":"2023-07-05T23:36:00.352406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'31","last_scrub_stamp":"2023-07-05T23:36:00.352316+0000","last_deep_scrub":"30'31","last_deep_scrub_stamp":"2023-07-05T23:36:00.352316+0000","last_clean_scrub_stamp":"2023-07-05T23:36:00.352316+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:01:31.956213+0000","scrub_duration":0.0019103480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"30'39","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.293979+0000","last_change":"2023-07-05T23:32:53.336278+0000","last_active":"2023-07-05T23:35:17.293979+0000","last_peered":"2023-07-05T23:35:17.293979+0000","last_clean":"2023-07-05T23:35:17.293979+0000","last_became_active":"2023-07-05T23:32:53.336006+0000","last_became_peered":"2023-07-05T23:32:53.336006+0000","last_unstale":"2023-07-05T23:35:17.293979+0000","last_undegraded":"2023-07-05T23:35:17.293979+0000","last_fullsized":"2023-07-05T23:35:17.293979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:52.882283+0000","last_clean_scrub_stamp":"2023-07-05T23:32:52.882283+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"30'34","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:41.603516+0000","last_change":"2023-07-05T23:35:41.603564+0000","last_active":"2023-07-05T23:35:41.603516+0000","last_peered":"2023-07-05T23:35:41.603516+0000","last_clean":"2023-07-05T23:35:41.603516+0000","last_became_active":"2023-07-05T23:32:53.345848+0000","last_became_peered":"2023-07-05T23:32:53.345848+0000","last_unstale":"2023-07-05T23:35:41.603516+0000","last_undegraded":"2023-07-05T23:35:41.603516+0000","last_fullsized":"2023-07-05T23:35:41.603516+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'34","last_scrub_stamp":"2023-07-05T23:35:41.603416+0000","last_deep_scrub":"30'34","last_deep_scrub_stamp":"2023-07-05T23:35:41.603416+0000","last_clean_scrub_stamp":"2023-07-05T23:35:41.603416+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:47:37.532728+0000","scrub_duration":0.00170199,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"30'29","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:36:04.597927+0000","last_change":"2023-07-05T23:36:04.597980+0000","last_active":"2023-07-05T23:36:04.597927+0000","last_peered":"2023-07-05T23:36:04.597927+0000","last_clean":"2023-07-05T23:36:04.597927+0000","last_became_active":"2023-07-05T23:32:53.335535+0000","last_became_peered":"2023-07-05T23:32:53.335535+0000","last_unstale":"2023-07-05T23:36:04.597927+0000","last_undegraded":"2023-07-05T23:36:04.597927+0000","last_fullsized":"2023-07-05T23:36:04.597927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'29","last_scrub_stamp":"2023-07-05T23:36:04.597831+0000","last_deep_scrub":"30'29","last_deep_scrub_stamp":"2023-07-05T23:36:04.597831+0000","last_clean_scrub_stamp":"2023-07-05T23:36:04.597831+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:05:21.515109+0000","scrub_duration":0.0019810919999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"30'31","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:27.082265+0000","last_change":"2023-07-05T23:35:27.082315+0000","last_active":"2023-07-05T23:35:27.082265+0000","last_peered":"2023-07-05T23:35:27.082265+0000","last_clean":"2023-07-05T23:35:27.082265+0000","last_became_active":"2023-07-05T23:32:53.338095+0000","last_became_peered":"2023-07-05T23:32:53.338095+0000","last_unstale":"2023-07-05T23:35:27.082265+0000","last_undegraded":"2023-07-05T23:35:27.082265+0000","last_fullsized":"2023-07-05T23:35:27.082265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'31","last_scrub_stamp":"2023-07-05T23:35:27.082179+0000","last_deep_scrub":"30'31","last_deep_scrub_stamp":"2023-07-05T23:35:27.082179+0000","last_clean_scrub_stamp":"2023-07-05T23:35:27.082179+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:05:57.887925+0000","scrub_duration":0.0021665159999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"30'34","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:32.375023+0000","last_change":"2023-07-05T23:35:32.375073+0000","last_active":"2023-07-05T23:35:32.375023+0000","last_peered":"2023-07-05T23:35:32.375023+0000","last_clean":"2023-07-05T23:35:32.375023+0000","last_became_active":"2023-07-05T23:32:53.341783+0000","last_became_peered":"2023-07-05T23:32:53.341783+0000","last_unstale":"2023-07-05T23:35:32.375023+0000","last_undegraded":"2023-07-05T23:35:32.375023+0000","last_fullsized":"2023-07-05T23:35:32.375023+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'34","last_scrub_stamp":"2023-07-05T23:35:32.374915+0000","last_deep_scrub":"30'34","last_deep_scrub_stamp":"2023-07-05T23:35:32.374915+0000","last_clean_scrub_stamp":"2023-07-05T23:35:32.374915+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:37:36.010693+0000","scrub_duration":0.0016638619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"30'40","reported_seq":73,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:36:04.360787+0000","last_change":"2023-07-05T23:36:04.360837+0000","last_active":"2023-07-05T23:36:04.360787+0000","last_peered":"2023-07-05T23:36:04.360787+0000","last_clean":"2023-07-05T23:36:04.360787+0000","last_became_active":"2023-07-05T23:32:53.348108+0000","last_became_peered":"2023-07-05T23:32:53.348108+0000","last_unstale":"2023-07-05T23:36:04.360787+0000","last_undegraded":"2023-07-05T23:36:04.360787+0000","last_fullsized":"2023-07-05T23:36:04.360787+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'40","last_scrub_stamp":"2023-07-05T23:36:04.360681+0000","last_deep_scrub":"30'40","last_deep_scrub_stamp":"2023-07-05T23:36:04.360681+0000","last_clean_scrub_stamp":"2023-07-05T23:36:04.360681+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:48:44.777245+0000","scrub_duration":0.0022089200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"30'32","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:39.617241+0000","last_change":"2023-07-05T23:35:39.617299+0000","last_active":"2023-07-05T23:35:39.617241+0000","last_peered":"2023-07-05T23:35:39.617241+0000","last_clean":"2023-07-05T23:35:39.617241+0000","last_became_active":"2023-07-05T23:32:53.340698+0000","last_became_peered":"2023-07-05T23:32:53.340698+0000","last_unstale":"2023-07-05T23:35:39.617241+0000","last_undegraded":"2023-07-05T23:35:39.617241+0000","last_fullsized":"2023-07-05T23:35:39.617241+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-07-05T23:35:39.617135+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-07-05T23:35:39.617135+0000","last_clean_scrub_stamp":"2023-07-05T23:35:39.617135+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:23:59.478196+0000","scrub_duration":0.001562581,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"30'36","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:45.686994+0000","last_change":"2023-07-05T23:35:45.687058+0000","last_active":"2023-07-05T23:35:45.686994+0000","last_peered":"2023-07-05T23:35:45.686994+0000","last_clean":"2023-07-05T23:35:45.686994+0000","last_became_active":"2023-07-05T23:32:53.345403+0000","last_became_peered":"2023-07-05T23:32:53.345403+0000","last_unstale":"2023-07-05T23:35:45.686994+0000","last_undegraded":"2023-07-05T23:35:45.686994+0000","last_fullsized":"2023-07-05T23:35:45.686994+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'36","last_scrub_stamp":"2023-07-05T23:35:45.686913+0000","last_deep_scrub":"30'36","last_deep_scrub_stamp":"2023-07-05T23:35:45.686913+0000","last_clean_scrub_stamp":"2023-07-05T23:35:45.686913+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:22:22.456955+0000","scrub_duration":0.0012798390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"30'31","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:56.381912+0000","last_change":"2023-07-05T23:35:56.381959+0000","last_active":"2023-07-05T23:35:56.381912+0000","last_peered":"2023-07-05T23:35:56.381912+0000","last_clean":"2023-07-05T23:35:56.381912+0000","last_became_active":"2023-07-05T23:32:53.348053+0000","last_became_peered":"2023-07-05T23:32:53.348053+0000","last_unstale":"2023-07-05T23:35:56.381912+0000","last_undegraded":"2023-07-05T23:35:56.381912+0000","last_fullsized":"2023-07-05T23:35:56.381912+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'31","last_scrub_stamp":"2023-07-05T23:35:56.381814+0000","last_deep_scrub":"30'31","last_deep_scrub_stamp":"2023-07-05T23:35:56.381814+0000","last_clean_scrub_stamp":"2023-07-05T23:35:56.381814+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:22:33.151856+0000","scrub_duration":0.0019954069999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"30'25","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:45.605594+0000","last_change":"2023-07-05T23:35:45.605631+0000","last_active":"2023-07-05T23:35:45.605594+0000","last_peered":"2023-07-05T23:35:45.605594+0000","last_clean":"2023-07-05T23:35:45.605594+0000","last_became_active":"2023-07-05T23:32:53.338935+0000","last_became_peered":"2023-07-05T23:32:53.338935+0000","last_unstale":"2023-07-05T23:35:45.605594+0000","last_undegraded":"2023-07-05T23:35:45.605594+0000","last_fullsized":"2023-07-05T23:35:45.605594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'25","last_scrub_stamp":"2023-07-05T23:35:45.605527+0000","last_deep_scrub":"30'25","last_deep_scrub_stamp":"2023-07-05T23:35:45.605527+0000","last_clean_scrub_stamp":"2023-07-05T23:35:45.605527+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:25:57.165990+0000","scrub_duration":0.001695216,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"30'38","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:58.767545+0000","last_change":"2023-07-05T23:35:58.767634+0000","last_active":"2023-07-05T23:35:58.767545+0000","last_peered":"2023-07-05T23:35:58.767545+0000","last_clean":"2023-07-05T23:35:58.767545+0000","last_became_active":"2023-07-05T23:33:34.898383+0000","last_became_peered":"2023-07-05T23:33:34.898383+0000","last_unstale":"2023-07-05T23:35:58.767545+0000","last_undegraded":"2023-07-05T23:35:58.767545+0000","last_fullsized":"2023-07-05T23:35:58.767545+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'38","last_scrub_stamp":"2023-07-05T23:35:58.767437+0000","last_deep_scrub":"30'38","last_deep_scrub_stamp":"2023-07-05T23:35:58.767437+0000","last_clean_scrub_stamp":"2023-07-05T23:35:58.767437+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:30:54.182990+0000","scrub_duration":0.0021658070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.25","version":"30'26","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:23.832669+0000","last_change":"2023-07-05T23:35:23.832721+0000","last_active":"2023-07-05T23:35:23.832669+0000","last_peered":"2023-07-05T23:35:23.832669+0000","last_clean":"2023-07-05T23:35:23.832669+0000","last_became_active":"2023-07-05T23:32:53.335857+0000","last_became_peered":"2023-07-05T23:32:53.335857+0000","last_unstale":"2023-07-05T23:35:23.832669+0000","last_undegraded":"2023-07-05T23:35:23.832669+0000","last_fullsized":"2023-07-05T23:35:23.832669+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'26","last_scrub_stamp":"2023-07-05T23:35:23.832558+0000","last_deep_scrub":"30'26","last_deep_scrub_stamp":"2023-07-05T23:35:23.832558+0000","last_clean_scrub_stamp":"2023-07-05T23:35:23.832558+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:24:02.493000+0000","scrub_duration":0.001482206,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"30'479","reported_seq":498,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:23.256642+0000","last_change":"2023-07-05T23:32:57.365825+0000","last_active":"2023-07-05T23:35:23.256642+0000","last_peered":"2023-07-05T23:35:23.256642+0000","last_clean":"2023-07-05T23:35:23.256642+0000","last_became_active":"2023-07-05T23:32:57.365409+0000","last_became_peered":"2023-07-05T23:32:57.365409+0000","last_unstale":"2023-07-05T23:35:23.256642+0000","last_undegraded":"2023-07-05T23:35:23.256642+0000","last_fullsized":"2023-07-05T23:35:23.256642+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:41.313810+0000","last_change":"2023-07-05T23:35:41.313864+0000","last_active":"2023-07-05T23:35:41.313810+0000","last_peered":"2023-07-05T23:35:41.313810+0000","last_clean":"2023-07-05T23:35:41.313810+0000","last_became_active":"2023-07-05T23:32:52.901080+0000","last_became_peered":"2023-07-05T23:32:52.901080+0000","last_unstale":"2023-07-05T23:35:41.313810+0000","last_undegraded":"2023-07-05T23:35:41.313810+0000","last_fullsized":"2023-07-05T23:35:41.313810+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2023-07-05T23:35:41.313704+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2023-07-05T23:35:41.313704+0000","last_clean_scrub_stamp":"2023-07-05T23:35:41.313704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:14:58.964233+0000","scrub_duration":0.002060026,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'39","reported_seq":72,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:22.793480+0000","last_change":"2023-07-05T23:35:22.793480+0000","last_active":"2023-07-05T23:35:22.793480+0000","last_peered":"2023-07-05T23:35:22.793480+0000","last_clean":"2023-07-05T23:35:22.793480+0000","last_became_active":"2023-07-05T23:32:53.339464+0000","last_became_peered":"2023-07-05T23:32:53.339464+0000","last_unstale":"2023-07-05T23:35:22.793480+0000","last_undegraded":"2023-07-05T23:35:22.793480+0000","last_fullsized":"2023-07-05T23:35:22.793480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'39","last_scrub_stamp":"2023-07-05T23:35:22.793364+0000","last_deep_scrub":"30'39","last_deep_scrub_stamp":"2023-07-05T23:35:22.793364+0000","last_clean_scrub_stamp":"2023-07-05T23:35:22.793364+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:46:08.645177+0000","scrub_duration":0.0015116330000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"30'446","reported_seq":473,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:52.332953+0000","last_change":"2023-07-05T23:35:52.333015+0000","last_active":"2023-07-05T23:35:52.332953+0000","last_peered":"2023-07-05T23:35:52.332953+0000","last_clean":"2023-07-05T23:35:52.332953+0000","last_became_active":"2023-07-05T23:32:57.353465+0000","last_became_peered":"2023-07-05T23:32:57.353465+0000","last_unstale":"2023-07-05T23:35:52.332953+0000","last_undegraded":"2023-07-05T23:35:52.332953+0000","last_fullsized":"2023-07-05T23:35:52.332953+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'446","last_scrub_stamp":"2023-07-05T23:35:52.332863+0000","last_deep_scrub":"30'446","last_deep_scrub_stamp":"2023-07-05T23:35:52.332863+0000","last_clean_scrub_stamp":"2023-07-05T23:35:52.332863+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:59:24.781573+0000","scrub_duration":0.002013571,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:33.568592+0000","last_change":"2023-07-05T23:35:33.568640+0000","last_active":"2023-07-05T23:35:33.568592+0000","last_peered":"2023-07-05T23:35:33.568592+0000","last_clean":"2023-07-05T23:35:33.568592+0000","last_became_active":"2023-07-05T23:32:52.909347+0000","last_became_peered":"2023-07-05T23:32:52.909347+0000","last_unstale":"2023-07-05T23:35:33.568592+0000","last_undegraded":"2023-07-05T23:35:33.568592+0000","last_fullsized":"2023-07-05T23:35:33.568592+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:35:33.568495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:35:33.568495+0000","last_clean_scrub_stamp":"2023-07-05T23:35:33.568495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:02:17.042409+0000","scrub_duration":0.001426716,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"30'31","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:21.633620+0000","last_change":"2023-07-05T23:35:21.633689+0000","last_active":"2023-07-05T23:35:21.633620+0000","last_peered":"2023-07-05T23:35:21.633620+0000","last_clean":"2023-07-05T23:35:21.633620+0000","last_became_active":"2023-07-05T23:32:53.338825+0000","last_became_peered":"2023-07-05T23:32:53.338825+0000","last_unstale":"2023-07-05T23:35:21.633620+0000","last_undegraded":"2023-07-05T23:35:21.633620+0000","last_fullsized":"2023-07-05T23:35:21.633620+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'31","last_scrub_stamp":"2023-07-05T23:35:21.633532+0000","last_deep_scrub":"30'31","last_deep_scrub_stamp":"2023-07-05T23:35:21.633532+0000","last_clean_scrub_stamp":"2023-07-05T23:35:21.633532+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:17:27.662797+0000","scrub_duration":0.001837602,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"30'462","reported_seq":489,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:57.755099+0000","last_change":"2023-07-05T23:35:57.755228+0000","last_active":"2023-07-05T23:35:57.755099+0000","last_peered":"2023-07-05T23:35:57.755099+0000","last_clean":"2023-07-05T23:35:57.755099+0000","last_became_active":"2023-07-05T23:32:57.358965+0000","last_became_peered":"2023-07-05T23:32:57.358965+0000","last_unstale":"2023-07-05T23:35:57.755099+0000","last_undegraded":"2023-07-05T23:35:57.755099+0000","last_fullsized":"2023-07-05T23:35:57.755099+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'462","last_scrub_stamp":"2023-07-05T23:35:57.754987+0000","last_deep_scrub":"30'462","last_deep_scrub_stamp":"2023-07-05T23:35:57.754987+0000","last_clean_scrub_stamp":"2023-07-05T23:35:57.754987+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:58:26.611108+0000","scrub_duration":0.0021636189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"30'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:33.640451+0000","last_change":"2023-07-05T23:35:33.640503+0000","last_active":"2023-07-05T23:35:33.640451+0000","last_peered":"2023-07-05T23:35:33.640451+0000","last_clean":"2023-07-05T23:35:33.640451+0000","last_became_active":"2023-07-05T23:32:52.908756+0000","last_became_peered":"2023-07-05T23:32:52.908756+0000","last_unstale":"2023-07-05T23:35:33.640451+0000","last_undegraded":"2023-07-05T23:35:33.640451+0000","last_fullsized":"2023-07-05T23:35:33.640451+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2023-07-05T23:35:33.640351+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2023-07-05T23:35:33.640351+0000","last_clean_scrub_stamp":"2023-07-05T23:35:33.640351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:23:53.501412+0000","scrub_duration":0.001423014,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"30'30","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:43.356371+0000","last_change":"2023-07-05T23:35:43.356419+0000","last_active":"2023-07-05T23:35:43.356371+0000","last_peered":"2023-07-05T23:35:43.356371+0000","last_clean":"2023-07-05T23:35:43.356371+0000","last_became_active":"2023-07-05T23:32:53.337480+0000","last_became_peered":"2023-07-05T23:32:53.337480+0000","last_unstale":"2023-07-05T23:35:43.356371+0000","last_undegraded":"2023-07-05T23:35:43.356371+0000","last_fullsized":"2023-07-05T23:35:43.356371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'30","last_scrub_stamp":"2023-07-05T23:35:43.356270+0000","last_deep_scrub":"30'30","last_deep_scrub_stamp":"2023-07-05T23:35:43.356270+0000","last_clean_scrub_stamp":"2023-07-05T23:35:43.356270+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:45:04.042706+0000","scrub_duration":0.001661778,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"30'473","reported_seq":500,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:48.410604+0000","last_change":"2023-07-05T23:35:48.410698+0000","last_active":"2023-07-05T23:35:48.410604+0000","last_peered":"2023-07-05T23:35:48.410604+0000","last_clean":"2023-07-05T23:35:48.410604+0000","last_became_active":"2023-07-05T23:32:57.355940+0000","last_became_peered":"2023-07-05T23:32:57.355940+0000","last_unstale":"2023-07-05T23:35:48.410604+0000","last_undegraded":"2023-07-05T23:35:48.410604+0000","last_fullsized":"2023-07-05T23:35:48.410604+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'473","last_scrub_stamp":"2023-07-05T23:35:48.410456+0000","last_deep_scrub":"30'473","last_deep_scrub_stamp":"2023-07-05T23:35:48.410456+0000","last_clean_scrub_stamp":"2023-07-05T23:35:48.410456+0000","objects_scrubbed":1,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:47:15.076777+0000","scrub_duration":0.0067811599999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"30'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:36.599539+0000","last_change":"2023-07-05T23:35:36.599624+0000","last_active":"2023-07-05T23:35:36.599539+0000","last_peered":"2023-07-05T23:35:36.599539+0000","last_clean":"2023-07-05T23:35:36.599539+0000","last_became_active":"2023-07-05T23:32:52.904140+0000","last_became_peered":"2023-07-05T23:32:52.904140+0000","last_unstale":"2023-07-05T23:35:36.599539+0000","last_undegraded":"2023-07-05T23:35:36.599539+0000","last_fullsized":"2023-07-05T23:35:36.599539+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2023-07-05T23:35:36.599420+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2023-07-05T23:35:36.599420+0000","last_clean_scrub_stamp":"2023-07-05T23:35:36.599420+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:06:55.022852+0000","scrub_duration":0.0020385260000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"30'27","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:37.731303+0000","last_change":"2023-07-05T23:35:37.731363+0000","last_active":"2023-07-05T23:35:37.731303+0000","last_peered":"2023-07-05T23:35:37.731303+0000","last_clean":"2023-07-05T23:35:37.731303+0000","last_became_active":"2023-07-05T23:32:53.338248+0000","last_became_peered":"2023-07-05T23:32:53.338248+0000","last_unstale":"2023-07-05T23:35:37.731303+0000","last_undegraded":"2023-07-05T23:35:37.731303+0000","last_fullsized":"2023-07-05T23:35:37.731303+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'27","last_scrub_stamp":"2023-07-05T23:35:37.731211+0000","last_deep_scrub":"30'27","last_deep_scrub_stamp":"2023-07-05T23:35:37.731211+0000","last_clean_scrub_stamp":"2023-07-05T23:35:37.731211+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:55:31.804023+0000","scrub_duration":0.001714728,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"30'457","reported_seq":476,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:20.630970+0000","last_change":"2023-07-05T23:32:57.357483+0000","last_active":"2023-07-05T23:35:20.630970+0000","last_peered":"2023-07-05T23:35:20.630970+0000","last_clean":"2023-07-05T23:35:20.630970+0000","last_became_active":"2023-07-05T23:32:57.357039+0000","last_became_peered":"2023-07-05T23:32:57.357039+0000","last_unstale":"2023-07-05T23:35:20.630970+0000","last_undegraded":"2023-07-05T23:35:20.630970+0000","last_fullsized":"2023-07-05T23:35:20.630970+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:37.856933+0000","last_change":"2023-07-05T23:35:37.857007+0000","last_active":"2023-07-05T23:35:37.856933+0000","last_peered":"2023-07-05T23:35:37.856933+0000","last_clean":"2023-07-05T23:35:37.856933+0000","last_became_active":"2023-07-05T23:32:52.900352+0000","last_became_peered":"2023-07-05T23:32:52.900352+0000","last_unstale":"2023-07-05T23:35:37.856933+0000","last_undegraded":"2023-07-05T23:35:37.856933+0000","last_fullsized":"2023-07-05T23:35:37.856933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:35:37.856826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:35:37.856826+0000","last_clean_scrub_stamp":"2023-07-05T23:35:37.856826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:47:38.944891+0000","scrub_duration":0.001391553,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"30'36","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:51.627133+0000","last_change":"2023-07-05T23:35:51.627180+0000","last_active":"2023-07-05T23:35:51.627133+0000","last_peered":"2023-07-05T23:35:51.627133+0000","last_clean":"2023-07-05T23:35:51.627133+0000","last_became_active":"2023-07-05T23:32:53.346373+0000","last_became_peered":"2023-07-05T23:32:53.346373+0000","last_unstale":"2023-07-05T23:35:51.627133+0000","last_undegraded":"2023-07-05T23:35:51.627133+0000","last_fullsized":"2023-07-05T23:35:51.627133+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'36","last_scrub_stamp":"2023-07-05T23:35:51.627048+0000","last_deep_scrub":"30'36","last_deep_scrub_stamp":"2023-07-05T23:35:51.627048+0000","last_clean_scrub_stamp":"2023-07-05T23:35:51.627048+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:58:20.483169+0000","scrub_duration":0.0018575690000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"30'483","reported_seq":510,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:53.603528+0000","last_change":"2023-07-05T23:35:53.603599+0000","last_active":"2023-07-05T23:35:53.603528+0000","last_peered":"2023-07-05T23:35:53.603528+0000","last_clean":"2023-07-05T23:35:53.603528+0000","last_became_active":"2023-07-05T23:32:57.365200+0000","last_became_peered":"2023-07-05T23:32:57.365200+0000","last_unstale":"2023-07-05T23:35:53.603528+0000","last_undegraded":"2023-07-05T23:35:53.603528+0000","last_fullsized":"2023-07-05T23:35:53.603528+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'483","last_scrub_stamp":"2023-07-05T23:35:53.603424+0000","last_deep_scrub":"30'483","last_deep_scrub_stamp":"2023-07-05T23:35:53.603424+0000","last_clean_scrub_stamp":"2023-07-05T23:35:53.603424+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:49:51.973696+0000","scrub_duration":0.002277004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"30'14","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:43.257611+0000","last_change":"2023-07-05T23:35:43.257685+0000","last_active":"2023-07-05T23:35:43.257611+0000","last_peered":"2023-07-05T23:35:43.257611+0000","last_clean":"2023-07-05T23:35:43.257611+0000","last_became_active":"2023-07-05T23:32:52.912749+0000","last_became_peered":"2023-07-05T23:32:52.912749+0000","last_unstale":"2023-07-05T23:35:43.257611+0000","last_undegraded":"2023-07-05T23:35:43.257611+0000","last_fullsized":"2023-07-05T23:35:43.257611+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'14","last_scrub_stamp":"2023-07-05T23:35:43.257470+0000","last_deep_scrub":"30'14","last_deep_scrub_stamp":"2023-07-05T23:35:43.257470+0000","last_clean_scrub_stamp":"2023-07-05T23:35:43.257470+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:13:19.970455+0000","scrub_duration":0.0041172719999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"30'42","reported_seq":75,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:41.629692+0000","last_change":"2023-07-05T23:35:41.629741+0000","last_active":"2023-07-05T23:35:41.629692+0000","last_peered":"2023-07-05T23:35:41.629692+0000","last_clean":"2023-07-05T23:35:41.629692+0000","last_became_active":"2023-07-05T23:32:53.339001+0000","last_became_peered":"2023-07-05T23:32:53.339001+0000","last_unstale":"2023-07-05T23:35:41.629692+0000","last_undegraded":"2023-07-05T23:35:41.629692+0000","last_fullsized":"2023-07-05T23:35:41.629692+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'42","last_scrub_stamp":"2023-07-05T23:35:41.629594+0000","last_deep_scrub":"30'42","last_deep_scrub_stamp":"2023-07-05T23:35:41.629594+0000","last_clean_scrub_stamp":"2023-07-05T23:35:41.629594+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:24:01.490655+0000","scrub_duration":0.0017554409999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"30'476","reported_seq":503,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:50.657476+0000","last_change":"2023-07-05T23:35:50.657546+0000","last_active":"2023-07-05T23:35:50.657476+0000","last_peered":"2023-07-05T23:35:50.657476+0000","last_clean":"2023-07-05T23:35:50.657476+0000","last_became_active":"2023-07-05T23:32:57.353848+0000","last_became_peered":"2023-07-05T23:32:57.353848+0000","last_unstale":"2023-07-05T23:35:50.657476+0000","last_undegraded":"2023-07-05T23:35:50.657476+0000","last_fullsized":"2023-07-05T23:35:50.657476+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'476","last_scrub_stamp":"2023-07-05T23:35:50.657366+0000","last_deep_scrub":"30'476","last_deep_scrub_stamp":"2023-07-05T23:35:50.657366+0000","last_clean_scrub_stamp":"2023-07-05T23:35:50.657366+0000","objects_scrubbed":0,"log_size":476,"log_dups_size":0,"ondisk_log_size":476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:59:33.017524+0000","scrub_duration":0.00215351,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"30'402","reported_seq":437,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:43.308198+0000","last_change":"2023-07-05T23:35:43.308282+0000","last_active":"2023-07-05T23:35:43.308198+0000","last_peered":"2023-07-05T23:35:43.308198+0000","last_clean":"2023-07-05T23:35:43.308198+0000","last_became_active":"2023-07-05T23:32:52.904318+0000","last_became_peered":"2023-07-05T23:32:52.904318+0000","last_unstale":"2023-07-05T23:35:43.308198+0000","last_undegraded":"2023-07-05T23:35:43.308198+0000","last_fullsized":"2023-07-05T23:35:43.308198+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'402","last_scrub_stamp":"2023-07-05T23:35:43.308095+0000","last_deep_scrub":"30'402","last_deep_scrub_stamp":"2023-07-05T23:35:43.308095+0000","last_clean_scrub_stamp":"2023-07-05T23:35:43.308095+0000","objects_scrubbed":4,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:30:38.723647+0000","scrub_duration":0.0079608939999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1528715,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":399,"num_write_kb":1765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"30'41","reported_seq":74,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:38.344828+0000","last_change":"2023-07-05T23:35:38.344911+0000","last_active":"2023-07-05T23:35:38.344828+0000","last_peered":"2023-07-05T23:35:38.344828+0000","last_clean":"2023-07-05T23:35:38.344828+0000","last_became_active":"2023-07-05T23:32:53.339583+0000","last_became_peered":"2023-07-05T23:32:53.339583+0000","last_unstale":"2023-07-05T23:35:38.344828+0000","last_undegraded":"2023-07-05T23:35:38.344828+0000","last_fullsized":"2023-07-05T23:35:38.344828+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'41","last_scrub_stamp":"2023-07-05T23:35:38.344698+0000","last_deep_scrub":"30'41","last_deep_scrub_stamp":"2023-07-05T23:35:38.344698+0000","last_clean_scrub_stamp":"2023-07-05T23:35:38.344698+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:55:53.973802+0000","scrub_duration":0.001677949,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"30'441","reported_seq":468,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:50.781752+0000","last_change":"2023-07-05T23:35:50.781816+0000","last_active":"2023-07-05T23:35:50.781752+0000","last_peered":"2023-07-05T23:35:50.781752+0000","last_clean":"2023-07-05T23:35:50.781752+0000","last_became_active":"2023-07-05T23:32:57.365204+0000","last_became_peered":"2023-07-05T23:32:57.365204+0000","last_unstale":"2023-07-05T23:35:50.781752+0000","last_undegraded":"2023-07-05T23:35:50.781752+0000","last_fullsized":"2023-07-05T23:35:50.781752+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'441","last_scrub_stamp":"2023-07-05T23:35:50.781660+0000","last_deep_scrub":"30'441","last_deep_scrub_stamp":"2023-07-05T23:35:50.781660+0000","last_clean_scrub_stamp":"2023-07-05T23:35:50.781660+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:58:19.637781+0000","scrub_duration":0.0024078680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"30'5","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:45.290604+0000","last_change":"2023-07-05T23:35:45.290655+0000","last_active":"2023-07-05T23:35:45.290604+0000","last_peered":"2023-07-05T23:35:45.290604+0000","last_clean":"2023-07-05T23:35:45.290604+0000","last_became_active":"2023-07-05T23:32:52.907970+0000","last_became_peered":"2023-07-05T23:32:52.907970+0000","last_unstale":"2023-07-05T23:35:45.290604+0000","last_undegraded":"2023-07-05T23:35:45.290604+0000","last_fullsized":"2023-07-05T23:35:45.290604+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'5","last_scrub_stamp":"2023-07-05T23:35:45.290514+0000","last_deep_scrub":"30'5","last_deep_scrub_stamp":"2023-07-05T23:35:45.290514+0000","last_clean_scrub_stamp":"2023-07-05T23:35:45.290514+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:14:55.311137+0000","scrub_duration":0.003099306,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"30'29","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:27.578398+0000","last_change":"2023-07-05T23:35:27.578448+0000","last_active":"2023-07-05T23:35:27.578398+0000","last_peered":"2023-07-05T23:35:27.578398+0000","last_clean":"2023-07-05T23:35:27.578398+0000","last_became_active":"2023-07-05T23:32:53.339827+0000","last_became_peered":"2023-07-05T23:32:53.339827+0000","last_unstale":"2023-07-05T23:35:27.578398+0000","last_undegraded":"2023-07-05T23:35:27.578398+0000","last_fullsized":"2023-07-05T23:35:27.578398+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'29","last_scrub_stamp":"2023-07-05T23:35:27.578299+0000","last_deep_scrub":"30'29","last_deep_scrub_stamp":"2023-07-05T23:35:27.578299+0000","last_clean_scrub_stamp":"2023-07-05T23:35:27.578299+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:27:34.593533+0000","scrub_duration":0.0015027510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"30'475","reported_seq":502,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:57.600364+0000","last_change":"2023-07-05T23:35:57.600491+0000","last_active":"2023-07-05T23:35:57.600364+0000","last_peered":"2023-07-05T23:35:57.600364+0000","last_clean":"2023-07-05T23:35:57.600364+0000","last_became_active":"2023-07-05T23:32:57.354235+0000","last_became_peered":"2023-07-05T23:32:57.354235+0000","last_unstale":"2023-07-05T23:35:57.600364+0000","last_undegraded":"2023-07-05T23:35:57.600364+0000","last_fullsized":"2023-07-05T23:35:57.600364+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'475","last_scrub_stamp":"2023-07-05T23:35:57.600234+0000","last_deep_scrub":"30'475","last_deep_scrub_stamp":"2023-07-05T23:35:57.600234+0000","last_clean_scrub_stamp":"2023-07-05T23:35:57.600234+0000","objects_scrubbed":1,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:15:15.250763+0000","scrub_duration":0.0074268889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:31.639525+0000","last_change":"2023-07-05T23:35:31.639611+0000","last_active":"2023-07-05T23:35:31.639525+0000","last_peered":"2023-07-05T23:35:31.639525+0000","last_clean":"2023-07-05T23:35:31.639525+0000","last_became_active":"2023-07-05T23:32:52.900387+0000","last_became_peered":"2023-07-05T23:32:52.900387+0000","last_unstale":"2023-07-05T23:35:31.639525+0000","last_undegraded":"2023-07-05T23:35:31.639525+0000","last_fullsized":"2023-07-05T23:35:31.639525+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:35:31.639414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:35:31.639414+0000","last_clean_scrub_stamp":"2023-07-05T23:35:31.639414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:02:15.113328+0000","scrub_duration":0.0019919690000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"30'33","reported_seq":66,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:44.792740+0000","last_change":"2023-07-05T23:35:44.792823+0000","last_active":"2023-07-05T23:35:44.792740+0000","last_peered":"2023-07-05T23:35:44.792740+0000","last_clean":"2023-07-05T23:35:44.792740+0000","last_became_active":"2023-07-05T23:32:53.335513+0000","last_became_peered":"2023-07-05T23:32:53.335513+0000","last_unstale":"2023-07-05T23:35:44.792740+0000","last_undegraded":"2023-07-05T23:35:44.792740+0000","last_fullsized":"2023-07-05T23:35:44.792740+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'33","last_scrub_stamp":"2023-07-05T23:35:44.792639+0000","last_deep_scrub":"30'33","last_deep_scrub_stamp":"2023-07-05T23:35:44.792639+0000","last_clean_scrub_stamp":"2023-07-05T23:35:44.792639+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:22:21.562681+0000","scrub_duration":0.0015213340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"30'450","reported_seq":477,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:52.614119+0000","last_change":"2023-07-05T23:35:52.614243+0000","last_active":"2023-07-05T23:35:52.614119+0000","last_peered":"2023-07-05T23:35:52.614119+0000","last_clean":"2023-07-05T23:35:52.614119+0000","last_became_active":"2023-07-05T23:32:57.362407+0000","last_became_peered":"2023-07-05T23:32:57.362407+0000","last_unstale":"2023-07-05T23:35:52.614119+0000","last_undegraded":"2023-07-05T23:35:52.614119+0000","last_fullsized":"2023-07-05T23:35:52.614119+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'450","last_scrub_stamp":"2023-07-05T23:35:52.614000+0000","last_deep_scrub":"30'450","last_deep_scrub_stamp":"2023-07-05T23:35:52.614000+0000","last_clean_scrub_stamp":"2023-07-05T23:35:52.614000+0000","objects_scrubbed":1,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:48:33.030564+0000","scrub_duration":0.0068755639999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"30'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:42.252627+0000","last_change":"2023-07-05T23:35:42.252721+0000","last_active":"2023-07-05T23:35:42.252627+0000","last_peered":"2023-07-05T23:35:42.252627+0000","last_clean":"2023-07-05T23:35:42.252627+0000","last_became_active":"2023-07-05T23:32:52.905595+0000","last_became_peered":"2023-07-05T23:32:52.905595+0000","last_unstale":"2023-07-05T23:35:42.252627+0000","last_undegraded":"2023-07-05T23:35:42.252627+0000","last_fullsized":"2023-07-05T23:35:42.252627+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2023-07-05T23:35:42.252504+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2023-07-05T23:35:42.252504+0000","last_clean_scrub_stamp":"2023-07-05T23:35:42.252504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:58:36.662409+0000","scrub_duration":0.0015537260000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"30'40","reported_seq":73,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:53.637883+0000","last_change":"2023-07-05T23:35:53.637930+0000","last_active":"2023-07-05T23:35:53.637883+0000","last_peered":"2023-07-05T23:35:53.637883+0000","last_clean":"2023-07-05T23:35:53.637883+0000","last_became_active":"2023-07-05T23:32:53.342033+0000","last_became_peered":"2023-07-05T23:32:53.342033+0000","last_unstale":"2023-07-05T23:35:53.637883+0000","last_undegraded":"2023-07-05T23:35:53.637883+0000","last_fullsized":"2023-07-05T23:35:53.637883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'40","last_scrub_stamp":"2023-07-05T23:35:53.637796+0000","last_deep_scrub":"30'40","last_deep_scrub_stamp":"2023-07-05T23:35:53.637796+0000","last_clean_scrub_stamp":"2023-07-05T23:35:53.637796+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:58:47.252971+0000","scrub_duration":0.001377063,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"30'495","reported_seq":522,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:56.801854+0000","last_change":"2023-07-05T23:35:56.801956+0000","last_active":"2023-07-05T23:35:56.801854+0000","last_peered":"2023-07-05T23:35:56.801854+0000","last_clean":"2023-07-05T23:35:56.801854+0000","last_became_active":"2023-07-05T23:32:57.359532+0000","last_became_peered":"2023-07-05T23:32:57.359532+0000","last_unstale":"2023-07-05T23:35:56.801854+0000","last_undegraded":"2023-07-05T23:35:56.801854+0000","last_fullsized":"2023-07-05T23:35:56.801854+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'495","last_scrub_stamp":"2023-07-05T23:35:56.801731+0000","last_deep_scrub":"30'495","last_deep_scrub_stamp":"2023-07-05T23:35:56.801731+0000","last_clean_scrub_stamp":"2023-07-05T23:35:56.801731+0000","objects_scrubbed":1,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:15:14.452259+0000","scrub_duration":0.0064926660000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":46080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"30'12","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:27.409720+0000","last_change":"2023-07-05T23:35:27.409779+0000","last_active":"2023-07-05T23:35:27.409720+0000","last_peered":"2023-07-05T23:35:27.409720+0000","last_clean":"2023-07-05T23:35:27.409720+0000","last_became_active":"2023-07-05T23:32:52.903419+0000","last_became_peered":"2023-07-05T23:32:52.903419+0000","last_unstale":"2023-07-05T23:35:27.409720+0000","last_undegraded":"2023-07-05T23:35:27.409720+0000","last_fullsized":"2023-07-05T23:35:27.409720+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'12","last_scrub_stamp":"2023-07-05T23:35:27.409640+0000","last_deep_scrub":"30'12","last_deep_scrub_stamp":"2023-07-05T23:35:27.409640+0000","last_clean_scrub_stamp":"2023-07-05T23:35:27.409640+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:48:23.989282+0000","scrub_duration":0.0045973059999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"30'32","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:25.668033+0000","last_change":"2023-07-05T23:35:25.668080+0000","last_active":"2023-07-05T23:35:25.668033+0000","last_peered":"2023-07-05T23:35:25.668033+0000","last_clean":"2023-07-05T23:35:25.668033+0000","last_became_active":"2023-07-05T23:32:53.341162+0000","last_became_peered":"2023-07-05T23:32:53.341162+0000","last_unstale":"2023-07-05T23:35:25.668033+0000","last_undegraded":"2023-07-05T23:35:25.668033+0000","last_fullsized":"2023-07-05T23:35:25.668033+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-07-05T23:35:25.667940+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-07-05T23:35:25.667940+0000","last_clean_scrub_stamp":"2023-07-05T23:35:25.667940+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:02:09.141854+0000","scrub_duration":0.0023076949999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"30'445","reported_seq":464,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.508452+0000","last_change":"2023-07-05T23:32:57.358009+0000","last_active":"2023-07-05T23:35:17.508452+0000","last_peered":"2023-07-05T23:35:17.508452+0000","last_clean":"2023-07-05T23:35:17.508452+0000","last_became_active":"2023-07-05T23:32:57.357082+0000","last_became_peered":"2023-07-05T23:32:57.357082+0000","last_unstale":"2023-07-05T23:35:17.508452+0000","last_undegraded":"2023-07-05T23:35:17.508452+0000","last_fullsized":"2023-07-05T23:35:17.508452+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"30'2","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:27.155588+0000","last_change":"2023-07-05T23:35:27.155648+0000","last_active":"2023-07-05T23:35:27.155588+0000","last_peered":"2023-07-05T23:35:27.155588+0000","last_clean":"2023-07-05T23:35:27.155588+0000","last_became_active":"2023-07-05T23:32:52.907397+0000","last_became_peered":"2023-07-05T23:32:52.907397+0000","last_unstale":"2023-07-05T23:35:27.155588+0000","last_undegraded":"2023-07-05T23:35:27.155588+0000","last_fullsized":"2023-07-05T23:35:27.155588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2023-07-05T23:35:27.155474+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2023-07-05T23:35:27.155474+0000","last_clean_scrub_stamp":"2023-07-05T23:35:27.155474+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:58:59.604184+0000","scrub_duration":0.00301433,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"30'29","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:24.804906+0000","last_change":"2023-07-05T23:35:24.804959+0000","last_active":"2023-07-05T23:35:24.804906+0000","last_peered":"2023-07-05T23:35:24.804906+0000","last_clean":"2023-07-05T23:35:24.804906+0000","last_became_active":"2023-07-05T23:32:53.333978+0000","last_became_peered":"2023-07-05T23:32:53.333978+0000","last_unstale":"2023-07-05T23:35:24.804906+0000","last_undegraded":"2023-07-05T23:35:24.804906+0000","last_fullsized":"2023-07-05T23:35:24.804906+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'29","last_scrub_stamp":"2023-07-05T23:35:24.804794+0000","last_deep_scrub":"30'29","last_deep_scrub_stamp":"2023-07-05T23:35:24.804794+0000","last_clean_scrub_stamp":"2023-07-05T23:35:24.804794+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:02:08.278708+0000","scrub_duration":0.001601922,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"30'423","reported_seq":450,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:50.138538+0000","last_change":"2023-07-05T23:35:50.138658+0000","last_active":"2023-07-05T23:35:50.138538+0000","last_peered":"2023-07-05T23:35:50.138538+0000","last_clean":"2023-07-05T23:35:50.138538+0000","last_became_active":"2023-07-05T23:32:57.361892+0000","last_became_peered":"2023-07-05T23:32:57.361892+0000","last_unstale":"2023-07-05T23:35:50.138538+0000","last_undegraded":"2023-07-05T23:35:50.138538+0000","last_fullsized":"2023-07-05T23:35:50.138538+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'423","last_scrub_stamp":"2023-07-05T23:35:50.138422+0000","last_deep_scrub":"30'423","last_deep_scrub_stamp":"2023-07-05T23:35:50.138422+0000","last_clean_scrub_stamp":"2023-07-05T23:35:50.138422+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:11:32.924812+0000","scrub_duration":0.0023489349999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"30'3","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:48.318102+0000","last_change":"2023-07-05T23:35:48.318154+0000","last_active":"2023-07-05T23:35:48.318102+0000","last_peered":"2023-07-05T23:35:48.318102+0000","last_clean":"2023-07-05T23:35:48.318102+0000","last_became_active":"2023-07-05T23:32:52.907975+0000","last_became_peered":"2023-07-05T23:32:52.907975+0000","last_unstale":"2023-07-05T23:35:48.318102+0000","last_undegraded":"2023-07-05T23:35:48.318102+0000","last_fullsized":"2023-07-05T23:35:48.318102+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2023-07-05T23:35:48.318009+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2023-07-05T23:35:48.318009+0000","last_clean_scrub_stamp":"2023-07-05T23:35:48.318009+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:55:42.390822+0000","scrub_duration":0.0027735860000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"30'32","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:36:02.525961+0000","last_change":"2023-07-05T23:36:02.526009+0000","last_active":"2023-07-05T23:36:02.525961+0000","last_peered":"2023-07-05T23:36:02.525961+0000","last_clean":"2023-07-05T23:36:02.525961+0000","last_became_active":"2023-07-05T23:32:53.339543+0000","last_became_peered":"2023-07-05T23:32:53.339543+0000","last_unstale":"2023-07-05T23:36:02.525961+0000","last_undegraded":"2023-07-05T23:36:02.525961+0000","last_fullsized":"2023-07-05T23:36:02.525961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-07-05T23:36:02.525863+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-07-05T23:36:02.525863+0000","last_clean_scrub_stamp":"2023-07-05T23:36:02.525863+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:11:35.060811+0000","scrub_duration":0.0021218999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"30'472","reported_seq":499,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:54.120168+0000","last_change":"2023-07-05T23:35:54.120297+0000","last_active":"2023-07-05T23:35:54.120168+0000","last_peered":"2023-07-05T23:35:54.120168+0000","last_clean":"2023-07-05T23:35:54.120168+0000","last_became_active":"2023-07-05T23:32:57.360614+0000","last_became_peered":"2023-07-05T23:32:57.360614+0000","last_unstale":"2023-07-05T23:35:54.120168+0000","last_undegraded":"2023-07-05T23:35:54.120168+0000","last_fullsized":"2023-07-05T23:35:54.120168+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'472","last_scrub_stamp":"2023-07-05T23:35:54.119957+0000","last_deep_scrub":"30'472","last_deep_scrub_stamp":"2023-07-05T23:35:54.119957+0000","last_clean_scrub_stamp":"2023-07-05T23:35:54.119957+0000","objects_scrubbed":2,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:25:06.383829+0000","scrub_duration":0.01146981,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"30'2","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:47.312152+0000","last_change":"2023-07-05T23:35:47.312205+0000","last_active":"2023-07-05T23:35:47.312152+0000","last_peered":"2023-07-05T23:35:47.312152+0000","last_clean":"2023-07-05T23:35:47.312152+0000","last_became_active":"2023-07-05T23:32:52.907441+0000","last_became_peered":"2023-07-05T23:32:52.907441+0000","last_unstale":"2023-07-05T23:35:47.312152+0000","last_undegraded":"2023-07-05T23:35:47.312152+0000","last_fullsized":"2023-07-05T23:35:47.312152+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2023-07-05T23:35:47.312050+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2023-07-05T23:35:47.312050+0000","last_clean_scrub_stamp":"2023-07-05T23:35:47.312050+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:44:29.196719+0000","scrub_duration":0.0028692190000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"30'32","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:38.470273+0000","last_change":"2023-07-05T23:35:38.470324+0000","last_active":"2023-07-05T23:35:38.470273+0000","last_peered":"2023-07-05T23:35:38.470273+0000","last_clean":"2023-07-05T23:35:38.470273+0000","last_became_active":"2023-07-05T23:32:53.343566+0000","last_became_peered":"2023-07-05T23:32:53.343566+0000","last_unstale":"2023-07-05T23:35:38.470273+0000","last_undegraded":"2023-07-05T23:35:38.470273+0000","last_fullsized":"2023-07-05T23:35:38.470273+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-07-05T23:35:38.470192+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-07-05T23:35:38.470192+0000","last_clean_scrub_stamp":"2023-07-05T23:35:38.470192+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:00:40.790153+0000","scrub_duration":0.0021110870000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"30'486","reported_seq":513,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:41.144469+0000","last_change":"2023-07-05T23:35:41.144576+0000","last_active":"2023-07-05T23:35:41.144469+0000","last_peered":"2023-07-05T23:35:41.144469+0000","last_clean":"2023-07-05T23:35:41.144469+0000","last_became_active":"2023-07-05T23:32:57.356091+0000","last_became_peered":"2023-07-05T23:32:57.356091+0000","last_unstale":"2023-07-05T23:35:41.144469+0000","last_undegraded":"2023-07-05T23:35:41.144469+0000","last_fullsized":"2023-07-05T23:35:41.144469+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'486","last_scrub_stamp":"2023-07-05T23:35:41.144349+0000","last_deep_scrub":"30'486","last_deep_scrub_stamp":"2023-07-05T23:35:41.144349+0000","last_clean_scrub_stamp":"2023-07-05T23:35:41.144349+0000","objects_scrubbed":0,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:00:43.464311+0000","scrub_duration":0.0026373849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"30'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:32.851440+0000","last_change":"2023-07-05T23:35:32.851538+0000","last_active":"2023-07-05T23:35:32.851440+0000","last_peered":"2023-07-05T23:35:32.851440+0000","last_clean":"2023-07-05T23:35:32.851440+0000","last_became_active":"2023-07-05T23:32:52.905988+0000","last_became_peered":"2023-07-05T23:32:52.905988+0000","last_unstale":"2023-07-05T23:35:32.851440+0000","last_undegraded":"2023-07-05T23:35:32.851440+0000","last_fullsized":"2023-07-05T23:35:32.851440+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2023-07-05T23:35:32.851307+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2023-07-05T23:35:32.851307+0000","last_clean_scrub_stamp":"2023-07-05T23:35:32.851307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:23:52.712368+0000","scrub_duration":0.00186185,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"30'32","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:24.662045+0000","last_change":"2023-07-05T23:35:24.662084+0000","last_active":"2023-07-05T23:35:24.662045+0000","last_peered":"2023-07-05T23:35:24.662045+0000","last_clean":"2023-07-05T23:35:24.662045+0000","last_became_active":"2023-07-05T23:32:53.339382+0000","last_became_peered":"2023-07-05T23:32:53.339382+0000","last_unstale":"2023-07-05T23:35:24.662045+0000","last_undegraded":"2023-07-05T23:35:24.662045+0000","last_fullsized":"2023-07-05T23:35:24.662045+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-07-05T23:35:24.661961+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-07-05T23:35:24.661961+0000","last_clean_scrub_stamp":"2023-07-05T23:35:24.661961+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:58:57.110671+0000","scrub_duration":0.0012445749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"30'472","reported_seq":499,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:45.141454+0000","last_change":"2023-07-05T23:35:45.141553+0000","last_active":"2023-07-05T23:35:45.141454+0000","last_peered":"2023-07-05T23:35:45.141454+0000","last_clean":"2023-07-05T23:35:45.141454+0000","last_became_active":"2023-07-05T23:32:57.354576+0000","last_became_peered":"2023-07-05T23:32:57.354576+0000","last_unstale":"2023-07-05T23:35:45.141454+0000","last_undegraded":"2023-07-05T23:35:45.141454+0000","last_fullsized":"2023-07-05T23:35:45.141454+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'472","last_scrub_stamp":"2023-07-05T23:35:45.141356+0000","last_deep_scrub":"30'472","last_deep_scrub_stamp":"2023-07-05T23:35:45.141356+0000","last_clean_scrub_stamp":"2023-07-05T23:35:45.141356+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:45:05.827792+0000","scrub_duration":0.002439751,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":27648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"30'5","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:30.548358+0000","last_change":"2023-07-05T23:35:30.548410+0000","last_active":"2023-07-05T23:35:30.548358+0000","last_peered":"2023-07-05T23:35:30.548358+0000","last_clean":"2023-07-05T23:35:30.548358+0000","last_became_active":"2023-07-05T23:32:52.906187+0000","last_became_peered":"2023-07-05T23:32:52.906187+0000","last_unstale":"2023-07-05T23:35:30.548358+0000","last_undegraded":"2023-07-05T23:35:30.548358+0000","last_fullsized":"2023-07-05T23:35:30.548358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'5","last_scrub_stamp":"2023-07-05T23:35:30.548235+0000","last_deep_scrub":"30'5","last_deep_scrub_stamp":"2023-07-05T23:35:30.548235+0000","last_clean_scrub_stamp":"2023-07-05T23:35:30.548235+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:06:48.971667+0000","scrub_duration":0.0031165590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"30'27","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:36.389104+0000","last_change":"2023-07-05T23:35:36.389175+0000","last_active":"2023-07-05T23:35:36.389104+0000","last_peered":"2023-07-05T23:35:36.389104+0000","last_clean":"2023-07-05T23:35:36.389104+0000","last_became_active":"2023-07-05T23:32:53.343393+0000","last_became_peered":"2023-07-05T23:32:53.343393+0000","last_unstale":"2023-07-05T23:35:36.389104+0000","last_undegraded":"2023-07-05T23:35:36.389104+0000","last_fullsized":"2023-07-05T23:35:36.389104+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'27","last_scrub_stamp":"2023-07-05T23:35:36.388980+0000","last_deep_scrub":"30'27","last_deep_scrub_stamp":"2023-07-05T23:35:36.388980+0000","last_clean_scrub_stamp":"2023-07-05T23:35:36.388980+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:48:16.805544+0000","scrub_duration":0.0021672190000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"30'457","reported_seq":484,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:51.707975+0000","last_change":"2023-07-05T23:35:51.708100+0000","last_active":"2023-07-05T23:35:51.707975+0000","last_peered":"2023-07-05T23:35:51.707975+0000","last_clean":"2023-07-05T23:35:51.707975+0000","last_became_active":"2023-07-05T23:32:57.362431+0000","last_became_peered":"2023-07-05T23:32:57.362431+0000","last_unstale":"2023-07-05T23:35:51.707975+0000","last_undegraded":"2023-07-05T23:35:51.707975+0000","last_fullsized":"2023-07-05T23:35:51.707975+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'457","last_scrub_stamp":"2023-07-05T23:35:51.707863+0000","last_deep_scrub":"30'457","last_deep_scrub_stamp":"2023-07-05T23:35:51.707863+0000","last_clean_scrub_stamp":"2023-07-05T23:35:51.707863+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:22:28.477905+0000","scrub_duration":0.0021919309999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"30'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:28.449465+0000","last_change":"2023-07-05T23:35:28.449517+0000","last_active":"2023-07-05T23:35:28.449465+0000","last_peered":"2023-07-05T23:35:28.449465+0000","last_clean":"2023-07-05T23:35:28.449465+0000","last_became_active":"2023-07-05T23:32:52.907983+0000","last_became_peered":"2023-07-05T23:32:52.907983+0000","last_unstale":"2023-07-05T23:35:28.449465+0000","last_undegraded":"2023-07-05T23:35:28.449465+0000","last_fullsized":"2023-07-05T23:35:28.449465+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2023-07-05T23:35:28.449359+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2023-07-05T23:35:28.449359+0000","last_clean_scrub_stamp":"2023-07-05T23:35:28.449359+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:35:25.750621+0000","scrub_duration":0.001700666,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"30'30","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:35.360758+0000","last_change":"2023-07-05T23:35:35.360814+0000","last_active":"2023-07-05T23:35:35.360758+0000","last_peered":"2023-07-05T23:35:35.360758+0000","last_clean":"2023-07-05T23:35:35.360758+0000","last_became_active":"2023-07-05T23:32:53.338903+0000","last_became_peered":"2023-07-05T23:32:53.338903+0000","last_unstale":"2023-07-05T23:35:35.360758+0000","last_undegraded":"2023-07-05T23:35:35.360758+0000","last_fullsized":"2023-07-05T23:35:35.360758+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'30","last_scrub_stamp":"2023-07-05T23:35:35.360651+0000","last_deep_scrub":"30'30","last_deep_scrub_stamp":"2023-07-05T23:35:35.360651+0000","last_clean_scrub_stamp":"2023-07-05T23:35:35.360651+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:58:04.216771+0000","scrub_duration":0.001803224,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'492","reported_seq":519,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:52.842638+0000","last_change":"2023-07-05T23:35:52.842710+0000","last_active":"2023-07-05T23:35:52.842638+0000","last_peered":"2023-07-05T23:35:52.842638+0000","last_clean":"2023-07-05T23:35:52.842638+0000","last_became_active":"2023-07-05T23:32:57.356611+0000","last_became_peered":"2023-07-05T23:32:57.356611+0000","last_unstale":"2023-07-05T23:35:52.842638+0000","last_undegraded":"2023-07-05T23:35:52.842638+0000","last_fullsized":"2023-07-05T23:35:52.842638+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'492","last_scrub_stamp":"2023-07-05T23:35:52.842519+0000","last_deep_scrub":"30'492","last_deep_scrub_stamp":"2023-07-05T23:35:52.842519+0000","last_clean_scrub_stamp":"2023-07-05T23:35:52.842519+0000","objects_scrubbed":1,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:49:51.212791+0000","scrub_duration":0.0070507490000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":51200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:45.280959+0000","last_change":"2023-07-05T23:35:45.281054+0000","last_active":"2023-07-05T23:35:45.280959+0000","last_peered":"2023-07-05T23:35:45.280959+0000","last_clean":"2023-07-05T23:35:45.280959+0000","last_became_active":"2023-07-05T23:32:52.906779+0000","last_became_peered":"2023-07-05T23:32:52.906779+0000","last_unstale":"2023-07-05T23:35:45.280959+0000","last_undegraded":"2023-07-05T23:35:45.280959+0000","last_fullsized":"2023-07-05T23:35:45.280959+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:35:45.280812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:35:45.280812+0000","last_clean_scrub_stamp":"2023-07-05T23:35:45.280812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:51:49.240572+0000","scrub_duration":0.0016633380000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"30'17","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:23.577489+0000","last_change":"2023-07-05T23:35:23.577540+0000","last_active":"2023-07-05T23:35:23.577489+0000","last_peered":"2023-07-05T23:35:23.577489+0000","last_clean":"2023-07-05T23:35:23.577489+0000","last_became_active":"2023-07-05T23:32:53.339869+0000","last_became_peered":"2023-07-05T23:32:53.339869+0000","last_unstale":"2023-07-05T23:35:23.577489+0000","last_undegraded":"2023-07-05T23:35:23.577489+0000","last_fullsized":"2023-07-05T23:35:23.577489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'17","last_scrub_stamp":"2023-07-05T23:35:23.577389+0000","last_deep_scrub":"30'17","last_deep_scrub_stamp":"2023-07-05T23:35:23.577389+0000","last_clean_scrub_stamp":"2023-07-05T23:35:23.577389+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:47:24.665455+0000","scrub_duration":0.0013589629999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"30'497","reported_seq":516,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.516208+0000","last_change":"2023-07-05T23:32:57.363813+0000","last_active":"2023-07-05T23:35:17.516208+0000","last_peered":"2023-07-05T23:35:17.516208+0000","last_clean":"2023-07-05T23:35:17.516208+0000","last_became_active":"2023-07-05T23:32:57.363409+0000","last_became_peered":"2023-07-05T23:32:57.363409+0000","last_unstale":"2023-07-05T23:35:17.516208+0000","last_undegraded":"2023-07-05T23:35:17.516208+0000","last_fullsized":"2023-07-05T23:35:17.516208+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":497,"log_dups_size":0,"ondisk_log_size":497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:35.704543+0000","last_change":"2023-07-05T23:35:35.704595+0000","last_active":"2023-07-05T23:35:35.704543+0000","last_peered":"2023-07-05T23:35:35.704543+0000","last_clean":"2023-07-05T23:35:35.704543+0000","last_became_active":"2023-07-05T23:32:52.909169+0000","last_became_peered":"2023-07-05T23:32:52.909169+0000","last_unstale":"2023-07-05T23:35:35.704543+0000","last_undegraded":"2023-07-05T23:35:35.704543+0000","last_fullsized":"2023-07-05T23:35:35.704543+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:35:35.704430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:35:35.704430+0000","last_clean_scrub_stamp":"2023-07-05T23:35:35.704430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:47:31.633741+0000","scrub_duration":0.0014660249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"30'28","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:46.648910+0000","last_change":"2023-07-05T23:35:46.648958+0000","last_active":"2023-07-05T23:35:46.648910+0000","last_peered":"2023-07-05T23:35:46.648910+0000","last_clean":"2023-07-05T23:35:46.648910+0000","last_became_active":"2023-07-05T23:32:53.342420+0000","last_became_peered":"2023-07-05T23:32:53.342420+0000","last_unstale":"2023-07-05T23:35:46.648910+0000","last_undegraded":"2023-07-05T23:35:46.648910+0000","last_fullsized":"2023-07-05T23:35:46.648910+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'28","last_scrub_stamp":"2023-07-05T23:35:46.648809+0000","last_deep_scrub":"30'28","last_deep_scrub_stamp":"2023-07-05T23:35:46.648809+0000","last_clean_scrub_stamp":"2023-07-05T23:35:46.648809+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:34:43.580605+0000","scrub_duration":0.001639901,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"30'504","reported_seq":531,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:54.645376+0000","last_change":"2023-07-05T23:35:54.645456+0000","last_active":"2023-07-05T23:35:54.645376+0000","last_peered":"2023-07-05T23:35:54.645376+0000","last_clean":"2023-07-05T23:35:54.645376+0000","last_became_active":"2023-07-05T23:32:57.358647+0000","last_became_peered":"2023-07-05T23:32:57.358647+0000","last_unstale":"2023-07-05T23:35:54.645376+0000","last_undegraded":"2023-07-05T23:35:54.645376+0000","last_fullsized":"2023-07-05T23:35:54.645376+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'504","last_scrub_stamp":"2023-07-05T23:35:54.645268+0000","last_deep_scrub":"30'504","last_deep_scrub_stamp":"2023-07-05T23:35:54.645268+0000","last_clean_scrub_stamp":"2023-07-05T23:35:54.645268+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:37:58.281046+0000","scrub_duration":0.0024869089999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:26.562376+0000","last_change":"2023-07-05T23:35:26.562422+0000","last_active":"2023-07-05T23:35:26.562376+0000","last_peered":"2023-07-05T23:35:26.562376+0000","last_clean":"2023-07-05T23:35:26.562376+0000","last_became_active":"2023-07-05T23:32:47.790546+0000","last_became_peered":"2023-07-05T23:32:47.790546+0000","last_unstale":"2023-07-05T23:35:26.562376+0000","last_undegraded":"2023-07-05T23:35:26.562376+0000","last_fullsized":"2023-07-05T23:35:26.562376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:35:26.562263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:35:26.562263+0000","last_clean_scrub_stamp":"2023-07-05T23:35:26.562263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:58:59.010972+0000","scrub_duration":0.0014801910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"30'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:35.839097+0000","last_change":"2023-07-05T23:35:35.839146+0000","last_active":"2023-07-05T23:35:35.839097+0000","last_peered":"2023-07-05T23:35:35.839097+0000","last_clean":"2023-07-05T23:35:35.839097+0000","last_became_active":"2023-07-05T23:32:52.912682+0000","last_became_peered":"2023-07-05T23:32:52.912682+0000","last_unstale":"2023-07-05T23:35:35.839097+0000","last_undegraded":"2023-07-05T23:35:35.839097+0000","last_fullsized":"2023-07-05T23:35:35.839097+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2023-07-05T23:35:35.838992+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2023-07-05T23:35:35.838992+0000","last_clean_scrub_stamp":"2023-07-05T23:35:35.838992+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:44:17.723660+0000","scrub_duration":0.001818807,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"30'30","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:39.577561+0000","last_change":"2023-07-05T23:35:39.577622+0000","last_active":"2023-07-05T23:35:39.577561+0000","last_peered":"2023-07-05T23:35:39.577561+0000","last_clean":"2023-07-05T23:35:39.577561+0000","last_became_active":"2023-07-05T23:32:53.335073+0000","last_became_peered":"2023-07-05T23:32:53.335073+0000","last_unstale":"2023-07-05T23:35:39.577561+0000","last_undegraded":"2023-07-05T23:35:39.577561+0000","last_fullsized":"2023-07-05T23:35:39.577561+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'30","last_scrub_stamp":"2023-07-05T23:35:39.577456+0000","last_deep_scrub":"30'30","last_deep_scrub_stamp":"2023-07-05T23:35:39.577456+0000","last_clean_scrub_stamp":"2023-07-05T23:35:39.577456+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:58:33.987361+0000","scrub_duration":0.002451389,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"30'450","reported_seq":477,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:58.780923+0000","last_change":"2023-07-05T23:35:58.781006+0000","last_active":"2023-07-05T23:35:58.780923+0000","last_peered":"2023-07-05T23:35:58.780923+0000","last_clean":"2023-07-05T23:35:58.780923+0000","last_became_active":"2023-07-05T23:32:57.368030+0000","last_became_peered":"2023-07-05T23:32:57.368030+0000","last_unstale":"2023-07-05T23:35:58.780923+0000","last_undegraded":"2023-07-05T23:35:58.780923+0000","last_fullsized":"2023-07-05T23:35:58.780923+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'450","last_scrub_stamp":"2023-07-05T23:35:58.780819+0000","last_deep_scrub":"30'450","last_deep_scrub_stamp":"2023-07-05T23:35:58.780819+0000","last_clean_scrub_stamp":"2023-07-05T23:35:58.780819+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:48:39.197384+0000","scrub_duration":0.0023398440000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:31.801037+0000","last_change":"2023-07-05T23:35:31.801102+0000","last_active":"2023-07-05T23:35:31.801037+0000","last_peered":"2023-07-05T23:35:31.801037+0000","last_clean":"2023-07-05T23:35:31.801037+0000","last_became_active":"2023-07-05T23:32:47.761996+0000","last_became_peered":"2023-07-05T23:32:47.761996+0000","last_unstale":"2023-07-05T23:35:31.801037+0000","last_undegraded":"2023-07-05T23:35:31.801037+0000","last_fullsized":"2023-07-05T23:35:31.801037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:35:31.800926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:35:31.800926+0000","last_clean_scrub_stamp":"2023-07-05T23:35:31.800926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:13:08.513911+0000","scrub_duration":0.0015452980000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:44.271904+0000","last_change":"2023-07-05T23:35:44.271952+0000","last_active":"2023-07-05T23:35:44.271904+0000","last_peered":"2023-07-05T23:35:44.271904+0000","last_clean":"2023-07-05T23:35:44.271904+0000","last_became_active":"2023-07-05T23:32:52.904202+0000","last_became_peered":"2023-07-05T23:32:52.904202+0000","last_unstale":"2023-07-05T23:35:44.271904+0000","last_undegraded":"2023-07-05T23:35:44.271904+0000","last_fullsized":"2023-07-05T23:35:44.271904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:35:44.271815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:35:44.271815+0000","last_clean_scrub_stamp":"2023-07-05T23:35:44.271815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:29:53.965209+0000","scrub_duration":0.0020349460000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"30'30","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:38.621680+0000","last_change":"2023-07-05T23:35:38.621729+0000","last_active":"2023-07-05T23:35:38.621680+0000","last_peered":"2023-07-05T23:35:38.621680+0000","last_clean":"2023-07-05T23:35:38.621680+0000","last_became_active":"2023-07-05T23:32:53.338626+0000","last_became_peered":"2023-07-05T23:32:53.338626+0000","last_unstale":"2023-07-05T23:35:38.621680+0000","last_undegraded":"2023-07-05T23:35:38.621680+0000","last_fullsized":"2023-07-05T23:35:38.621680+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'30","last_scrub_stamp":"2023-07-05T23:35:38.621586+0000","last_deep_scrub":"30'30","last_deep_scrub_stamp":"2023-07-05T23:35:38.621586+0000","last_clean_scrub_stamp":"2023-07-05T23:35:38.621586+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:06:57.045018+0000","scrub_duration":0.001417272,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"30'489","reported_seq":516,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:52.150975+0000","last_change":"2023-07-05T23:35:52.151097+0000","last_active":"2023-07-05T23:35:52.150975+0000","last_peered":"2023-07-05T23:35:52.150975+0000","last_clean":"2023-07-05T23:35:52.150975+0000","last_became_active":"2023-07-05T23:32:57.355882+0000","last_became_peered":"2023-07-05T23:32:57.355882+0000","last_unstale":"2023-07-05T23:35:52.150975+0000","last_undegraded":"2023-07-05T23:35:52.150975+0000","last_fullsized":"2023-07-05T23:35:52.150975+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'489","last_scrub_stamp":"2023-07-05T23:35:52.150821+0000","last_deep_scrub":"30'489","last_deep_scrub_stamp":"2023-07-05T23:35:52.150821+0000","last_clean_scrub_stamp":"2023-07-05T23:35:52.150821+0000","objects_scrubbed":2,"log_size":489,"log_dups_size":0,"ondisk_log_size":489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:47:18.817141+0000","scrub_duration":0.010813102,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":55296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:22.970005+0000","last_change":"2023-07-05T23:35:22.970044+0000","last_active":"2023-07-05T23:35:22.970005+0000","last_peered":"2023-07-05T23:35:22.970005+0000","last_clean":"2023-07-05T23:35:22.970005+0000","last_became_active":"2023-07-05T23:32:47.979348+0000","last_became_peered":"2023-07-05T23:32:47.979348+0000","last_unstale":"2023-07-05T23:35:22.970005+0000","last_undegraded":"2023-07-05T23:35:22.970005+0000","last_fullsized":"2023-07-05T23:35:22.970005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:35:22.969930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:35:22.969930+0000","last_clean_scrub_stamp":"2023-07-05T23:35:22.969930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:04:30.215991+0000","scrub_duration":0.0013098879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:30.605928+0000","last_change":"2023-07-05T23:35:30.605974+0000","last_active":"2023-07-05T23:35:30.605928+0000","last_peered":"2023-07-05T23:35:30.605928+0000","last_clean":"2023-07-05T23:35:30.605928+0000","last_became_active":"2023-07-05T23:32:52.907307+0000","last_became_peered":"2023-07-05T23:32:52.907307+0000","last_unstale":"2023-07-05T23:35:30.605928+0000","last_undegraded":"2023-07-05T23:35:30.605928+0000","last_fullsized":"2023-07-05T23:35:30.605928+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:35:30.605843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:35:30.605843+0000","last_clean_scrub_stamp":"2023-07-05T23:35:30.605843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:46:16.457656+0000","scrub_duration":0.0017402780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"30'29","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:43.580664+0000","last_change":"2023-07-05T23:35:43.580744+0000","last_active":"2023-07-05T23:35:43.580664+0000","last_peered":"2023-07-05T23:35:43.580664+0000","last_clean":"2023-07-05T23:35:43.580664+0000","last_became_active":"2023-07-05T23:32:53.337896+0000","last_became_peered":"2023-07-05T23:32:53.337896+0000","last_unstale":"2023-07-05T23:35:43.580664+0000","last_undegraded":"2023-07-05T23:35:43.580664+0000","last_fullsized":"2023-07-05T23:35:43.580664+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'29","last_scrub_stamp":"2023-07-05T23:35:43.580552+0000","last_deep_scrub":"30'29","last_deep_scrub_stamp":"2023-07-05T23:35:43.580552+0000","last_clean_scrub_stamp":"2023-07-05T23:35:43.580552+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:47:39.509863+0000","scrub_duration":0.001819665,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"30'478","reported_seq":497,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.515981+0000","last_change":"2023-07-05T23:32:57.355885+0000","last_active":"2023-07-05T23:35:17.515981+0000","last_peered":"2023-07-05T23:35:17.515981+0000","last_clean":"2023-07-05T23:35:17.515981+0000","last_became_active":"2023-07-05T23:32:57.355475+0000","last_became_peered":"2023-07-05T23:32:57.355475+0000","last_unstale":"2023-07-05T23:35:17.515981+0000","last_undegraded":"2023-07-05T23:35:17.515981+0000","last_fullsized":"2023-07-05T23:35:17.515981+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:30.765164+0000","last_change":"2023-07-05T23:35:30.765209+0000","last_active":"2023-07-05T23:35:30.765164+0000","last_peered":"2023-07-05T23:35:30.765164+0000","last_clean":"2023-07-05T23:35:30.765164+0000","last_became_active":"2023-07-05T23:32:47.761392+0000","last_became_peered":"2023-07-05T23:32:47.761392+0000","last_unstale":"2023-07-05T23:35:30.765164+0000","last_undegraded":"2023-07-05T23:35:30.765164+0000","last_fullsized":"2023-07-05T23:35:30.765164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:35:30.765068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:35:30.765068+0000","last_clean_scrub_stamp":"2023-07-05T23:35:30.765068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:58:25.174973+0000","scrub_duration":0.0016083200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"30'119","reported_seq":199,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:31.132448+0000","last_change":"2023-07-05T23:35:31.132526+0000","last_active":"2023-07-05T23:35:31.132448+0000","last_peered":"2023-07-05T23:35:31.132448+0000","last_clean":"2023-07-05T23:35:31.132448+0000","last_became_active":"2023-07-05T23:32:42.736736+0000","last_became_peered":"2023-07-05T23:32:42.736736+0000","last_unstale":"2023-07-05T23:35:31.132448+0000","last_undegraded":"2023-07-05T23:35:31.132448+0000","last_fullsized":"2023-07-05T23:35:31.132448+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'119","last_scrub_stamp":"2023-07-05T23:35:31.132330+0000","last_deep_scrub":"30'119","last_deep_scrub_stamp":"2023-07-05T23:35:31.132330+0000","last_clean_scrub_stamp":"2023-07-05T23:35:31.132330+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:46:16.984143+0000","scrub_duration":0.00536033,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:36.754162+0000","last_change":"2023-07-05T23:35:36.754217+0000","last_active":"2023-07-05T23:35:36.754162+0000","last_peered":"2023-07-05T23:35:36.754162+0000","last_clean":"2023-07-05T23:35:36.754162+0000","last_became_active":"2023-07-05T23:32:52.912684+0000","last_became_peered":"2023-07-05T23:32:52.912684+0000","last_unstale":"2023-07-05T23:35:36.754162+0000","last_undegraded":"2023-07-05T23:35:36.754162+0000","last_fullsized":"2023-07-05T23:35:36.754162+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:35:36.754056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:35:36.754056+0000","last_clean_scrub_stamp":"2023-07-05T23:35:36.754056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:44:18.638725+0000","scrub_duration":0.0017168890000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"30'32","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:47.404403+0000","last_change":"2023-07-05T23:35:47.404459+0000","last_active":"2023-07-05T23:35:47.404403+0000","last_peered":"2023-07-05T23:35:47.404403+0000","last_clean":"2023-07-05T23:35:47.404403+0000","last_became_active":"2023-07-05T23:32:53.343848+0000","last_became_peered":"2023-07-05T23:32:53.343848+0000","last_unstale":"2023-07-05T23:35:47.404403+0000","last_undegraded":"2023-07-05T23:35:47.404403+0000","last_fullsized":"2023-07-05T23:35:47.404403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-07-05T23:35:47.404309+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-07-05T23:35:47.404309+0000","last_clean_scrub_stamp":"2023-07-05T23:35:47.404309+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:46:50.341000+0000","scrub_duration":0.0015473119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"30'453","reported_seq":480,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:53.846180+0000","last_change":"2023-07-05T23:35:53.846247+0000","last_active":"2023-07-05T23:35:53.846180+0000","last_peered":"2023-07-05T23:35:53.846180+0000","last_clean":"2023-07-05T23:35:53.846180+0000","last_became_active":"2023-07-05T23:32:57.365013+0000","last_became_peered":"2023-07-05T23:32:57.365013+0000","last_unstale":"2023-07-05T23:35:53.846180+0000","last_undegraded":"2023-07-05T23:35:53.846180+0000","last_fullsized":"2023-07-05T23:35:53.846180+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'453","last_scrub_stamp":"2023-07-05T23:35:53.846088+0000","last_deep_scrub":"30'453","last_deep_scrub_stamp":"2023-07-05T23:35:53.846088+0000","last_clean_scrub_stamp":"2023-07-05T23:35:53.846088+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:56:09.475192+0000","scrub_duration":0.0022154990000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:34.134050+0000","last_change":"2023-07-05T23:35:34.134097+0000","last_active":"2023-07-05T23:35:34.134050+0000","last_peered":"2023-07-05T23:35:34.134050+0000","last_clean":"2023-07-05T23:35:34.134050+0000","last_became_active":"2023-07-05T23:32:47.767297+0000","last_became_peered":"2023-07-05T23:32:47.767297+0000","last_unstale":"2023-07-05T23:35:34.134050+0000","last_undegraded":"2023-07-05T23:35:34.134050+0000","last_fullsized":"2023-07-05T23:35:34.134050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:35:34.133947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:35:34.133947+0000","last_clean_scrub_stamp":"2023-07-05T23:35:34.133947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:00:27.997249+0000","scrub_duration":0.0020560800000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"30'16","reported_seq":66,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:28.696907+0000","last_change":"2023-07-05T23:35:28.696959+0000","last_active":"2023-07-05T23:35:28.696907+0000","last_peered":"2023-07-05T23:35:28.696907+0000","last_clean":"2023-07-05T23:35:28.696907+0000","last_became_active":"2023-07-05T23:32:52.906204+0000","last_became_peered":"2023-07-05T23:32:52.906204+0000","last_unstale":"2023-07-05T23:35:28.696907+0000","last_undegraded":"2023-07-05T23:35:28.696907+0000","last_fullsized":"2023-07-05T23:35:28.696907+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'16","last_scrub_stamp":"2023-07-05T23:35:28.696811+0000","last_deep_scrub":"30'16","last_deep_scrub_stamp":"2023-07-05T23:35:28.696811+0000","last_clean_scrub_stamp":"2023-07-05T23:35:28.696811+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:46:14.548624+0000","scrub_duration":0.0020850030000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7752,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":17,"num_write":15,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"30'28","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:42.625154+0000","last_change":"2023-07-05T23:35:42.625231+0000","last_active":"2023-07-05T23:35:42.625154+0000","last_peered":"2023-07-05T23:35:42.625154+0000","last_clean":"2023-07-05T23:35:42.625154+0000","last_became_active":"2023-07-05T23:32:53.340061+0000","last_became_peered":"2023-07-05T23:32:53.340061+0000","last_unstale":"2023-07-05T23:35:42.625154+0000","last_undegraded":"2023-07-05T23:35:42.625154+0000","last_fullsized":"2023-07-05T23:35:42.625154+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'28","last_scrub_stamp":"2023-07-05T23:35:42.624996+0000","last_deep_scrub":"30'28","last_deep_scrub_stamp":"2023-07-05T23:35:42.624996+0000","last_clean_scrub_stamp":"2023-07-05T23:35:42.624996+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:44:24.509665+0000","scrub_duration":0.001641656,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"30'503","reported_seq":530,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:49.385259+0000","last_change":"2023-07-05T23:35:49.385368+0000","last_active":"2023-07-05T23:35:49.385259+0000","last_peered":"2023-07-05T23:35:49.385259+0000","last_clean":"2023-07-05T23:35:49.385259+0000","last_became_active":"2023-07-05T23:32:57.361941+0000","last_became_peered":"2023-07-05T23:32:57.361941+0000","last_unstale":"2023-07-05T23:35:49.385259+0000","last_undegraded":"2023-07-05T23:35:49.385259+0000","last_fullsized":"2023-07-05T23:35:49.385259+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'503","last_scrub_stamp":"2023-07-05T23:35:49.385143+0000","last_deep_scrub":"30'503","last_deep_scrub_stamp":"2023-07-05T23:35:49.385143+0000","last_clean_scrub_stamp":"2023-07-05T23:35:49.385143+0000","objects_scrubbed":2,"log_size":503,"log_dups_size":0,"ondisk_log_size":503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:17:55.414408+0000","scrub_duration":0.010069819000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:35.179206+0000","last_change":"2023-07-05T23:35:35.179285+0000","last_active":"2023-07-05T23:35:35.179206+0000","last_peered":"2023-07-05T23:35:35.179206+0000","last_clean":"2023-07-05T23:35:35.179206+0000","last_became_active":"2023-07-05T23:32:47.790408+0000","last_became_peered":"2023-07-05T23:32:47.790408+0000","last_unstale":"2023-07-05T23:35:35.179206+0000","last_undegraded":"2023-07-05T23:35:35.179206+0000","last_fullsized":"2023-07-05T23:35:35.179206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:35:35.179072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:35:35.179072+0000","last_clean_scrub_stamp":"2023-07-05T23:35:35.179072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:27:42.194306+0000","scrub_duration":0.001815529,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"30'2","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:35.571238+0000","last_change":"2023-07-05T23:35:35.571330+0000","last_active":"2023-07-05T23:35:35.571238+0000","last_peered":"2023-07-05T23:35:35.571238+0000","last_clean":"2023-07-05T23:35:35.571238+0000","last_became_active":"2023-07-05T23:32:52.908379+0000","last_became_peered":"2023-07-05T23:32:52.908379+0000","last_unstale":"2023-07-05T23:35:35.571238+0000","last_undegraded":"2023-07-05T23:35:35.571238+0000","last_fullsized":"2023-07-05T23:35:35.571238+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2023-07-05T23:35:35.571122+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2023-07-05T23:35:35.571122+0000","last_clean_scrub_stamp":"2023-07-05T23:35:35.571122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:27:42.586356+0000","scrub_duration":0.0016887200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"30'34","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:43.575930+0000","last_change":"2023-07-05T23:35:43.575987+0000","last_active":"2023-07-05T23:35:43.575930+0000","last_peered":"2023-07-05T23:35:43.575930+0000","last_clean":"2023-07-05T23:35:43.575930+0000","last_became_active":"2023-07-05T23:32:53.330771+0000","last_became_peered":"2023-07-05T23:32:53.330771+0000","last_unstale":"2023-07-05T23:35:43.575930+0000","last_undegraded":"2023-07-05T23:35:43.575930+0000","last_fullsized":"2023-07-05T23:35:43.575930+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'34","last_scrub_stamp":"2023-07-05T23:35:43.575837+0000","last_deep_scrub":"30'34","last_deep_scrub_stamp":"2023-07-05T23:35:43.575837+0000","last_clean_scrub_stamp":"2023-07-05T23:35:43.575837+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:55:37.648649+0000","scrub_duration":0.00188262,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"30'487","reported_seq":506,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.514556+0000","last_change":"2023-07-05T23:32:57.357223+0000","last_active":"2023-07-05T23:35:17.514556+0000","last_peered":"2023-07-05T23:35:17.514556+0000","last_clean":"2023-07-05T23:35:17.514556+0000","last_became_active":"2023-07-05T23:32:57.356797+0000","last_became_peered":"2023-07-05T23:32:57.356797+0000","last_unstale":"2023-07-05T23:35:17.514556+0000","last_undegraded":"2023-07-05T23:35:17.514556+0000","last_fullsized":"2023-07-05T23:35:17.514556+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"30'4","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:32.616690+0000","last_change":"2023-07-05T23:35:32.616740+0000","last_active":"2023-07-05T23:35:32.616690+0000","last_peered":"2023-07-05T23:35:32.616690+0000","last_clean":"2023-07-05T23:35:32.616690+0000","last_became_active":"2023-07-05T23:32:52.905704+0000","last_became_peered":"2023-07-05T23:32:52.905704+0000","last_unstale":"2023-07-05T23:35:32.616690+0000","last_undegraded":"2023-07-05T23:35:32.616690+0000","last_fullsized":"2023-07-05T23:35:32.616690+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2023-07-05T23:35:32.616594+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2023-07-05T23:35:32.616594+0000","last_clean_scrub_stamp":"2023-07-05T23:35:32.616594+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:13:09.329579+0000","scrub_duration":0.0031987550000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:23.554123+0000","last_change":"2023-07-05T23:35:23.554182+0000","last_active":"2023-07-05T23:35:23.554123+0000","last_peered":"2023-07-05T23:35:23.554123+0000","last_clean":"2023-07-05T23:35:23.554123+0000","last_became_active":"2023-07-05T23:32:47.768844+0000","last_became_peered":"2023-07-05T23:32:47.768844+0000","last_unstale":"2023-07-05T23:35:23.554123+0000","last_undegraded":"2023-07-05T23:35:23.554123+0000","last_fullsized":"2023-07-05T23:35:23.554123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:35:23.554014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:35:23.554014+0000","last_clean_scrub_stamp":"2023-07-05T23:35:23.554014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:17:29.583280+0000","scrub_duration":0.0020942920000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"30'25","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:56.137007+0000","last_change":"2023-07-05T23:35:56.137087+0000","last_active":"2023-07-05T23:35:56.137007+0000","last_peered":"2023-07-05T23:35:56.137007+0000","last_clean":"2023-07-05T23:35:56.137007+0000","last_became_active":"2023-07-05T23:33:35.012290+0000","last_became_peered":"2023-07-05T23:33:35.012290+0000","last_unstale":"2023-07-05T23:35:56.137007+0000","last_undegraded":"2023-07-05T23:35:56.137007+0000","last_fullsized":"2023-07-05T23:35:56.137007+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'25","last_scrub_stamp":"2023-07-05T23:35:56.136865+0000","last_deep_scrub":"30'25","last_deep_scrub_stamp":"2023-07-05T23:35:56.136865+0000","last_clean_scrub_stamp":"2023-07-05T23:35:56.136865+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:59:28.585575+0000","scrub_duration":0.0022280490000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"30'449","reported_seq":476,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:54.599522+0000","last_change":"2023-07-05T23:35:54.599625+0000","last_active":"2023-07-05T23:35:54.599522+0000","last_peered":"2023-07-05T23:35:54.599522+0000","last_clean":"2023-07-05T23:35:54.599522+0000","last_became_active":"2023-07-05T23:32:57.362112+0000","last_became_peered":"2023-07-05T23:32:57.362112+0000","last_unstale":"2023-07-05T23:35:54.599522+0000","last_undegraded":"2023-07-05T23:35:54.599522+0000","last_fullsized":"2023-07-05T23:35:54.599522+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'449","last_scrub_stamp":"2023-07-05T23:35:54.599336+0000","last_deep_scrub":"30'449","last_deep_scrub_stamp":"2023-07-05T23:35:54.599336+0000","last_clean_scrub_stamp":"2023-07-05T23:35:54.599336+0000","objects_scrubbed":2,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:56:10.228440+0000","scrub_duration":0.011051040999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":46080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:25.353416+0000","last_change":"2023-07-05T23:35:25.353461+0000","last_active":"2023-07-05T23:35:25.353416+0000","last_peered":"2023-07-05T23:35:25.353416+0000","last_clean":"2023-07-05T23:35:25.353416+0000","last_became_active":"2023-07-05T23:32:47.769141+0000","last_became_peered":"2023-07-05T23:32:47.769141+0000","last_unstale":"2023-07-05T23:35:25.353416+0000","last_undegraded":"2023-07-05T23:35:25.353416+0000","last_fullsized":"2023-07-05T23:35:25.353416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:35:25.353313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:35:25.353313+0000","last_clean_scrub_stamp":"2023-07-05T23:35:25.353313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:53:19.759050+0000","scrub_duration":0.0014175699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"30'13","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:38.600293+0000","last_change":"2023-07-05T23:35:38.600354+0000","last_active":"2023-07-05T23:35:38.600293+0000","last_peered":"2023-07-05T23:35:38.600293+0000","last_clean":"2023-07-05T23:35:38.600293+0000","last_became_active":"2023-07-05T23:32:52.905451+0000","last_became_peered":"2023-07-05T23:32:52.905451+0000","last_unstale":"2023-07-05T23:35:38.600293+0000","last_undegraded":"2023-07-05T23:35:38.600293+0000","last_fullsized":"2023-07-05T23:35:38.600293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'13","last_scrub_stamp":"2023-07-05T23:35:38.600196+0000","last_deep_scrub":"30'13","last_deep_scrub_stamp":"2023-07-05T23:35:38.600196+0000","last_clean_scrub_stamp":"2023-07-05T23:35:38.600196+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:13:15.313181+0000","scrub_duration":0.0019374049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"30'21","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:51.362930+0000","last_change":"2023-07-05T23:35:51.362986+0000","last_active":"2023-07-05T23:35:51.362930+0000","last_peered":"2023-07-05T23:35:51.362930+0000","last_clean":"2023-07-05T23:35:51.362930+0000","last_became_active":"2023-07-05T23:32:53.332159+0000","last_became_peered":"2023-07-05T23:32:53.332159+0000","last_unstale":"2023-07-05T23:35:51.362930+0000","last_undegraded":"2023-07-05T23:35:51.362930+0000","last_fullsized":"2023-07-05T23:35:51.362930+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'21","last_scrub_stamp":"2023-07-05T23:35:51.362824+0000","last_deep_scrub":"30'21","last_deep_scrub_stamp":"2023-07-05T23:35:51.362824+0000","last_clean_scrub_stamp":"2023-07-05T23:35:51.362824+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:38:41.943629+0000","scrub_duration":0.0015691850000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"30'470","reported_seq":497,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:53.770574+0000","last_change":"2023-07-05T23:35:53.770643+0000","last_active":"2023-07-05T23:35:53.770574+0000","last_peered":"2023-07-05T23:35:53.770574+0000","last_clean":"2023-07-05T23:35:53.770574+0000","last_became_active":"2023-07-05T23:32:57.363620+0000","last_became_peered":"2023-07-05T23:32:57.363620+0000","last_unstale":"2023-07-05T23:35:53.770574+0000","last_undegraded":"2023-07-05T23:35:53.770574+0000","last_fullsized":"2023-07-05T23:35:53.770574+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'470","last_scrub_stamp":"2023-07-05T23:35:53.770477+0000","last_deep_scrub":"30'470","last_deep_scrub_stamp":"2023-07-05T23:35:53.770477+0000","last_clean_scrub_stamp":"2023-07-05T23:35:53.770477+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:58:47.385652+0000","scrub_duration":0.001943052,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:37.555778+0000","last_change":"2023-07-05T23:35:37.555838+0000","last_active":"2023-07-05T23:35:37.555778+0000","last_peered":"2023-07-05T23:35:37.555778+0000","last_clean":"2023-07-05T23:35:37.555778+0000","last_became_active":"2023-07-05T23:32:52.908111+0000","last_became_peered":"2023-07-05T23:32:52.908111+0000","last_unstale":"2023-07-05T23:35:37.555778+0000","last_undegraded":"2023-07-05T23:35:37.555778+0000","last_fullsized":"2023-07-05T23:35:37.555778+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2023-07-05T23:35:37.555686+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2023-07-05T23:35:37.555686+0000","last_clean_scrub_stamp":"2023-07-05T23:35:37.555686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:58:31.965591+0000","scrub_duration":0.0016203809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"30'32","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:32.063729+0000","last_change":"2023-07-05T23:35:32.063812+0000","last_active":"2023-07-05T23:35:32.063729+0000","last_peered":"2023-07-05T23:35:32.063729+0000","last_clean":"2023-07-05T23:35:32.063729+0000","last_became_active":"2023-07-05T23:32:53.339686+0000","last_became_peered":"2023-07-05T23:32:53.339686+0000","last_unstale":"2023-07-05T23:35:32.063729+0000","last_undegraded":"2023-07-05T23:35:32.063729+0000","last_fullsized":"2023-07-05T23:35:32.063729+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-07-05T23:35:32.063608+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-07-05T23:35:32.063608+0000","last_clean_scrub_stamp":"2023-07-05T23:35:32.063608+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:53:42.153964+0000","scrub_duration":0.0016321899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"30'478","reported_seq":497,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:24.813485+0000","last_change":"2023-07-05T23:32:57.356309+0000","last_active":"2023-07-05T23:35:24.813485+0000","last_peered":"2023-07-05T23:35:24.813485+0000","last_clean":"2023-07-05T23:35:24.813485+0000","last_became_active":"2023-07-05T23:32:57.355910+0000","last_became_peered":"2023-07-05T23:32:57.355910+0000","last_unstale":"2023-07-05T23:35:24.813485+0000","last_undegraded":"2023-07-05T23:35:24.813485+0000","last_fullsized":"2023-07-05T23:35:24.813485+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"30'3","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:34.865970+0000","last_change":"2023-07-05T23:35:34.866032+0000","last_active":"2023-07-05T23:35:34.865970+0000","last_peered":"2023-07-05T23:35:34.865970+0000","last_clean":"2023-07-05T23:35:34.865970+0000","last_became_active":"2023-07-05T23:32:52.899159+0000","last_became_peered":"2023-07-05T23:32:52.899159+0000","last_unstale":"2023-07-05T23:35:34.865970+0000","last_undegraded":"2023-07-05T23:35:34.865970+0000","last_fullsized":"2023-07-05T23:35:34.865970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2023-07-05T23:35:34.865874+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2023-07-05T23:35:34.865874+0000","last_clean_scrub_stamp":"2023-07-05T23:35:34.865874+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:47:30.795186+0000","scrub_duration":0.0029783230000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"30'24","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:37.340324+0000","last_change":"2023-07-05T23:35:37.340375+0000","last_active":"2023-07-05T23:35:37.340324+0000","last_peered":"2023-07-05T23:35:37.340324+0000","last_clean":"2023-07-05T23:35:37.340324+0000","last_became_active":"2023-07-05T23:32:53.343262+0000","last_became_peered":"2023-07-05T23:32:53.343262+0000","last_unstale":"2023-07-05T23:35:37.340324+0000","last_undegraded":"2023-07-05T23:35:37.340324+0000","last_fullsized":"2023-07-05T23:35:37.340324+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'24","last_scrub_stamp":"2023-07-05T23:35:37.340221+0000","last_deep_scrub":"30'24","last_deep_scrub_stamp":"2023-07-05T23:35:37.340221+0000","last_clean_scrub_stamp":"2023-07-05T23:35:37.340221+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:49:35.710493+0000","scrub_duration":0.0018883940000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"30'465","reported_seq":492,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:51.796756+0000","last_change":"2023-07-05T23:35:51.796846+0000","last_active":"2023-07-05T23:35:51.796756+0000","last_peered":"2023-07-05T23:35:51.796756+0000","last_clean":"2023-07-05T23:35:51.796756+0000","last_became_active":"2023-07-05T23:32:57.365087+0000","last_became_peered":"2023-07-05T23:32:57.365087+0000","last_unstale":"2023-07-05T23:35:51.796756+0000","last_undegraded":"2023-07-05T23:35:51.796756+0000","last_fullsized":"2023-07-05T23:35:51.796756+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'465","last_scrub_stamp":"2023-07-05T23:35:51.796641+0000","last_deep_scrub":"30'465","last_deep_scrub_stamp":"2023-07-05T23:35:51.796641+0000","last_clean_scrub_stamp":"2023-07-05T23:35:51.796641+0000","objects_scrubbed":1,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:48:32.213205+0000","scrub_duration":0.0070808599999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"30'4","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:36.815441+0000","last_change":"2023-07-05T23:35:36.815520+0000","last_active":"2023-07-05T23:35:36.815441+0000","last_peered":"2023-07-05T23:35:36.815441+0000","last_clean":"2023-07-05T23:35:36.815441+0000","last_became_active":"2023-07-05T23:32:52.901689+0000","last_became_peered":"2023-07-05T23:32:52.901689+0000","last_unstale":"2023-07-05T23:35:36.815441+0000","last_undegraded":"2023-07-05T23:35:36.815441+0000","last_fullsized":"2023-07-05T23:35:36.815441+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2023-07-05T23:35:36.815346+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2023-07-05T23:35:36.815346+0000","last_clean_scrub_stamp":"2023-07-05T23:35:36.815346+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:55:30.888158+0000","scrub_duration":0.00274881,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'23","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:27.474074+0000","last_change":"2023-07-05T23:35:27.474123+0000","last_active":"2023-07-05T23:35:27.474074+0000","last_peered":"2023-07-05T23:35:27.474074+0000","last_clean":"2023-07-05T23:35:27.474074+0000","last_became_active":"2023-07-05T23:32:53.346553+0000","last_became_peered":"2023-07-05T23:32:53.346553+0000","last_unstale":"2023-07-05T23:35:27.474074+0000","last_undegraded":"2023-07-05T23:35:27.474074+0000","last_fullsized":"2023-07-05T23:35:27.474074+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'23","last_scrub_stamp":"2023-07-05T23:35:27.473982+0000","last_deep_scrub":"30'23","last_deep_scrub_stamp":"2023-07-05T23:35:27.473982+0000","last_clean_scrub_stamp":"2023-07-05T23:35:27.473982+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:59:09.834139+0000","scrub_duration":0.00189398,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"30'487","reported_seq":506,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:23.256652+0000","last_change":"2023-07-05T23:32:57.353173+0000","last_active":"2023-07-05T23:35:23.256652+0000","last_peered":"2023-07-05T23:35:23.256652+0000","last_clean":"2023-07-05T23:35:23.256652+0000","last_became_active":"2023-07-05T23:32:57.352716+0000","last_became_peered":"2023-07-05T23:32:57.352716+0000","last_unstale":"2023-07-05T23:35:23.256652+0000","last_undegraded":"2023-07-05T23:35:23.256652+0000","last_fullsized":"2023-07-05T23:35:23.256652+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:31.581893+0000","last_change":"2023-07-05T23:35:31.581975+0000","last_active":"2023-07-05T23:35:31.581893+0000","last_peered":"2023-07-05T23:35:31.581893+0000","last_clean":"2023-07-05T23:35:31.581893+0000","last_became_active":"2023-07-05T23:32:52.906688+0000","last_became_peered":"2023-07-05T23:32:52.906688+0000","last_unstale":"2023-07-05T23:35:31.581893+0000","last_undegraded":"2023-07-05T23:35:31.581893+0000","last_fullsized":"2023-07-05T23:35:31.581893+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2023-07-05T23:35:31.581776+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2023-07-05T23:35:31.581776+0000","last_clean_scrub_stamp":"2023-07-05T23:35:31.581776+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:58:25.991680+0000","scrub_duration":0.001758639,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"30'32","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:47.672594+0000","last_change":"2023-07-05T23:35:47.672645+0000","last_active":"2023-07-05T23:35:47.672594+0000","last_peered":"2023-07-05T23:35:47.672594+0000","last_clean":"2023-07-05T23:35:47.672594+0000","last_became_active":"2023-07-05T23:32:53.346652+0000","last_became_peered":"2023-07-05T23:32:53.346652+0000","last_unstale":"2023-07-05T23:35:47.672594+0000","last_undegraded":"2023-07-05T23:35:47.672594+0000","last_fullsized":"2023-07-05T23:35:47.672594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-07-05T23:35:47.672502+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-07-05T23:35:47.672502+0000","last_clean_scrub_stamp":"2023-07-05T23:35:47.672502+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:58:41.287677+0000","scrub_duration":0.001513707,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"30'495","reported_seq":522,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:47.653110+0000","last_change":"2023-07-05T23:35:47.653219+0000","last_active":"2023-07-05T23:35:47.653110+0000","last_peered":"2023-07-05T23:35:47.653110+0000","last_clean":"2023-07-05T23:35:47.653110+0000","last_became_active":"2023-07-05T23:32:57.356637+0000","last_became_peered":"2023-07-05T23:32:57.356637+0000","last_unstale":"2023-07-05T23:35:47.653110+0000","last_undegraded":"2023-07-05T23:35:47.653110+0000","last_fullsized":"2023-07-05T23:35:47.653110+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'495","last_scrub_stamp":"2023-07-05T23:35:47.653002+0000","last_deep_scrub":"30'495","last_deep_scrub_stamp":"2023-07-05T23:35:47.653002+0000","last_clean_scrub_stamp":"2023-07-05T23:35:47.653002+0000","objects_scrubbed":2,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:54:32.892802+0000","scrub_duration":0.011149088999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"30'7","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:33.566089+0000","last_change":"2023-07-05T23:35:33.566152+0000","last_active":"2023-07-05T23:35:33.566089+0000","last_peered":"2023-07-05T23:35:33.566089+0000","last_clean":"2023-07-05T23:35:33.566089+0000","last_became_active":"2023-07-05T23:32:52.903823+0000","last_became_peered":"2023-07-05T23:32:52.903823+0000","last_unstale":"2023-07-05T23:35:33.566089+0000","last_undegraded":"2023-07-05T23:35:33.566089+0000","last_fullsized":"2023-07-05T23:35:33.566089+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'7","last_scrub_stamp":"2023-07-05T23:35:33.566002+0000","last_deep_scrub":"30'7","last_deep_scrub_stamp":"2023-07-05T23:35:33.566002+0000","last_clean_scrub_stamp":"2023-07-05T23:35:33.566002+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:27:40.581236+0000","scrub_duration":0.0037408099999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"30'42","reported_seq":75,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:36:00.478716+0000","last_change":"2023-07-05T23:36:00.478767+0000","last_active":"2023-07-05T23:36:00.478716+0000","last_peered":"2023-07-05T23:36:00.478716+0000","last_clean":"2023-07-05T23:36:00.478716+0000","last_became_active":"2023-07-05T23:32:53.339863+0000","last_became_peered":"2023-07-05T23:32:53.339863+0000","last_unstale":"2023-07-05T23:36:00.478716+0000","last_undegraded":"2023-07-05T23:36:00.478716+0000","last_fullsized":"2023-07-05T23:36:00.478716+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'42","last_scrub_stamp":"2023-07-05T23:36:00.478608+0000","last_deep_scrub":"30'42","last_deep_scrub_stamp":"2023-07-05T23:36:00.478608+0000","last_clean_scrub_stamp":"2023-07-05T23:36:00.478608+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:32:36.569699+0000","scrub_duration":0.0015116839999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"30'50","reported_seq":83,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:37.493267+0000","last_change":"2023-07-05T23:35:37.493321+0000","last_active":"2023-07-05T23:35:37.493267+0000","last_peered":"2023-07-05T23:35:37.493267+0000","last_clean":"2023-07-05T23:35:37.493267+0000","last_became_active":"2023-07-05T23:32:53.336759+0000","last_became_peered":"2023-07-05T23:32:53.336759+0000","last_unstale":"2023-07-05T23:35:37.493267+0000","last_undegraded":"2023-07-05T23:35:37.493267+0000","last_fullsized":"2023-07-05T23:35:37.493267+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'50","last_scrub_stamp":"2023-07-05T23:35:37.493181+0000","last_deep_scrub":"30'50","last_deep_scrub_stamp":"2023-07-05T23:35:37.493181+0000","last_clean_scrub_stamp":"2023-07-05T23:35:37.493181+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:01:21.748318+0000","scrub_duration":0.001613509,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"30'46","reported_seq":79,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:48.678427+0000","last_change":"2023-07-05T23:35:48.678473+0000","last_active":"2023-07-05T23:35:48.678427+0000","last_peered":"2023-07-05T23:35:48.678427+0000","last_clean":"2023-07-05T23:35:48.678427+0000","last_became_active":"2023-07-05T23:32:53.345711+0000","last_became_peered":"2023-07-05T23:32:53.345711+0000","last_unstale":"2023-07-05T23:35:48.678427+0000","last_undegraded":"2023-07-05T23:35:48.678427+0000","last_fullsized":"2023-07-05T23:35:48.678427+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'46","last_scrub_stamp":"2023-07-05T23:35:48.678317+0000","last_deep_scrub":"30'46","last_deep_scrub_stamp":"2023-07-05T23:35:48.678317+0000","last_clean_scrub_stamp":"2023-07-05T23:35:48.678317+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:37:52.314095+0000","scrub_duration":0.001454442,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"30'34","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:31.415358+0000","last_change":"2023-07-05T23:35:31.415413+0000","last_active":"2023-07-05T23:35:31.415358+0000","last_peered":"2023-07-05T23:35:31.415358+0000","last_clean":"2023-07-05T23:35:31.415358+0000","last_became_active":"2023-07-05T23:32:53.339431+0000","last_became_peered":"2023-07-05T23:32:53.339431+0000","last_unstale":"2023-07-05T23:35:31.415358+0000","last_undegraded":"2023-07-05T23:35:31.415358+0000","last_fullsized":"2023-07-05T23:35:31.415358+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'34","last_scrub_stamp":"2023-07-05T23:35:31.415263+0000","last_deep_scrub":"30'34","last_deep_scrub_stamp":"2023-07-05T23:35:31.415263+0000","last_clean_scrub_stamp":"2023-07-05T23:35:31.415263+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:58:25.030438+0000","scrub_duration":0.0015583839999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"30'31","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:38.732951+0000","last_change":"2023-07-05T23:35:38.733005+0000","last_active":"2023-07-05T23:35:38.732951+0000","last_peered":"2023-07-05T23:35:38.732951+0000","last_clean":"2023-07-05T23:35:38.732951+0000","last_became_active":"2023-07-05T23:32:53.335181+0000","last_became_peered":"2023-07-05T23:32:53.335181+0000","last_unstale":"2023-07-05T23:35:38.732951+0000","last_undegraded":"2023-07-05T23:35:38.732951+0000","last_fullsized":"2023-07-05T23:35:38.732951+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'31","last_scrub_stamp":"2023-07-05T23:35:38.732855+0000","last_deep_scrub":"30'31","last_deep_scrub_stamp":"2023-07-05T23:35:38.732855+0000","last_clean_scrub_stamp":"2023-07-05T23:35:38.732855+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:47:39.820920+0000","scrub_duration":0.0020207810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"30'32","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:40.615959+0000","last_change":"2023-07-05T23:35:40.616010+0000","last_active":"2023-07-05T23:35:40.615959+0000","last_peered":"2023-07-05T23:35:40.615959+0000","last_clean":"2023-07-05T23:35:40.615959+0000","last_became_active":"2023-07-05T23:32:53.337835+0000","last_became_peered":"2023-07-05T23:32:53.337835+0000","last_unstale":"2023-07-05T23:35:40.615959+0000","last_undegraded":"2023-07-05T23:35:40.615959+0000","last_fullsized":"2023-07-05T23:35:40.615959+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-07-05T23:35:40.615858+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-07-05T23:35:40.615858+0000","last_clean_scrub_stamp":"2023-07-05T23:35:40.615858+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:13:17.328843+0000","scrub_duration":0.0021545140000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":614,"num_write_kb":1286144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":201326592,"data_stored":201326592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15089,"ondisk_log_size":15089,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2060,"ondisk_log_size":2060,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1537265,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":15,"num_read_kb":17,"num_write":488,"num_write_kb":1816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3137536,"data_stored":3074530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":503,"ondisk_log_size":503,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574893,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68284,"kb_used_data":33140,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94303556,"statfs":{"total":96636764160,"available":96566841344,"internally_reserved":0,"allocated":33935360,"data_stored":33715425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 5 23:35:45 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":1.1919999999999999,"15min":0.79100000000000004},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.65900000000000003,"5min":12.042,"15min":12.042},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":2.2799999999999998,"15min":1.726},"min":{"1min":0.32900000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.82999999999999996,"5min":26.367999999999999,"15min":26.367999999999999},"last":0.56599999999999995}]},{"osd":1,"last update":"Wed Jul 5 23:35:45 2023","interfaces":[{"interface":"back","average":{"1min":2.6160000000000001,"5min":1.659,"15min":1.0289999999999999},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":28.850000000000001,"5min":28.850000000000001,"15min":28.850000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":2.1789999999999998,"5min":1.5960000000000001,"15min":0.93000000000000005},"min":{"1min":0.30199999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":28.797999999999998,"5min":28.797999999999998,"15min":28.797999999999998},"last":0.54200000000000004}]},{"osd":2,"last update":"Wed Jul 5 23:35:45 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":1.5629999999999999,"15min":1.2470000000000001},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.88900000000000001,"5min":11.997,"15min":11.997},"last":0.629},{"interface":"front","average":{"1min":0.67800000000000005,"5min":1.778,"15min":1.0580000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":3.1219999999999999,"5min":26.419,"15min":26.419},"last":0.63800000000000001}]},{"osd":3,"last update":"Wed Jul 5 23:35:45 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":1.54,"15min":0.93999999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":4.9480000000000004,"5min":24.094000000000001,"15min":24.094000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.55400000000000005,"5min":1.5629999999999999,"15min":0.94099999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.79300000000000004,"5min":22.588000000000001,"15min":22.588000000000001},"last":0.65300000000000002}]},{"osd":4,"last update":"Wed Jul 5 23:35:45 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":1.0940000000000001,"15min":0.71699999999999997},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.73199999999999998,"5min":12.173999999999999,"15min":12.173999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.44700000000000001,"5min":1.1240000000000001,"15min":0.751},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.66000000000000003,"5min":12.151,"15min":12.151},"last":0.39400000000000002}]},{"osd":5,"last update":"Wed Jul 5 23:35:45 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":1.206,"15min":0.77800000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.76400000000000001,"5min":19.954999999999998,"15min":19.954999999999998},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.52300000000000002,"5min":1.1990000000000001,"15min":0.80400000000000005},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.70599999999999996,"5min":21.870999999999999,"15min":21.870999999999999},"last":0.46800000000000003}]},{"osd":6,"last update":"Wed Jul 5 23:35:45 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":1.585,"15min":0.95199999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.68600000000000005,"5min":20.212,"15min":20.212},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.97099999999999997,"15min":0.73599999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77700000000000002,"5min":12.010999999999999,"15min":12.010999999999999},"last":0.435}]}]},{"osd":6,"up_from":13,"seq":55834574893,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57992,"kb_used_data":26944,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94313848,"statfs":{"total":96636764160,"available":96577380352,"internally_reserved":0,"allocated":27590656,"data_stored":27401822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 5 23:35:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":2.0630000000000002,"15min":1.028},"min":{"1min":0.39700000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":9.9100000000000001,"5min":24.012,"15min":24.012},"last":0.57599999999999996},{"interface":"front","average":{"1min":1.2689999999999999,"5min":2.0619999999999998,"15min":1.022},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":10.098000000000001,"5min":27.036000000000001,"15min":27.036000000000001},"last":0.67400000000000004}]},{"osd":1,"last update":"Wed Jul 5 23:35:44 2023","interfaces":[{"interface":"back","average":{"1min":2.3399999999999999,"5min":2.1890000000000001,"15min":1.0649999999999999},"min":{"1min":0.42199999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":24.684000000000001,"5min":24.684000000000001,"15min":24.684000000000001},"last":0.56299999999999994},{"interface":"front","average":{"1min":1.28,"5min":2.141,"15min":1.085},"min":{"1min":0.35599999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":9.9730000000000008,"5min":23.943000000000001,"15min":23.943000000000001},"last":0.54100000000000004}]},{"osd":2,"last update":"Wed Jul 5 23:35:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":2.0270000000000001,"15min":1.0409999999999999},"min":{"1min":0.45600000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":9.9440000000000008,"5min":25.658000000000001,"15min":25.658000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":1.7549999999999999,"5min":1.8819999999999999,"15min":1.014},"min":{"1min":0.38600000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":10.135,"5min":27.062000000000001,"15min":27.062000000000001},"last":0.61699999999999999}]},{"osd":3,"last update":"Wed Jul 5 23:35:44 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":1.821,"15min":0.98799999999999999},"min":{"1min":0.41299999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":2.0030000000000001,"5min":27.108000000000001,"15min":27.108000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":1.4099999999999999,"5min":2.1469999999999998,"15min":1.085},"min":{"1min":0.39500000000000002,"5min":0.377,"15min":0.377},"max":{"1min":10.047000000000001,"5min":19.940000000000001,"15min":19.940000000000001},"last":0.64900000000000002}]},{"osd":4,"last update":"Wed Jul 5 23:35:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":2.0489999999999999,"15min":1.044},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.087,"5min":26,"15min":26},"last":0.374},{"interface":"front","average":{"1min":1.96,"5min":1.7569999999999999,"15min":0.97699999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":20.593,"5min":27.085000000000001,"15min":27.085000000000001},"last":0.40400000000000003}]},{"osd":5,"last update":"Wed Jul 5 23:35:44 2023","interfaces":[{"interface":"back","average":{"1min":1.9359999999999999,"5min":1.8320000000000001,"15min":0.97799999999999998},"min":{"1min":0.32500000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":20.643000000000001,"5min":20.643000000000001,"15min":20.643000000000001},"last":0.47399999999999998},{"interface":"front","average":{"1min":1.998,"5min":2.056,"15min":1.0960000000000001},"min":{"1min":0.37,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":20.353999999999999,"5min":20.353999999999999,"15min":20.353999999999999},"last":0.437}]},{"osd":7,"last update":"Wed Jul 5 23:35:44 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":1.6279999999999999,"15min":0.94599999999999995},"min":{"1min":0.42699999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.0149999999999999,"5min":26.992000000000001,"15min":26.992000000000001},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.61599999999999999,"5min":1.7270000000000001,"15min":0.98099999999999998},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.1100000000000001,"5min":19.998999999999999,"15min":19.998999999999999},"last":0.52300000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574893,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53896,"kb_used_data":22848,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94317944,"statfs":{"total":96636764160,"available":96581574656,"internally_reserved":0,"allocated":23396352,"data_stored":23207518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 5 23:35:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.2,"15min":0.63800000000000001},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":10.971,"5min":14.039999999999999,"15min":14.039999999999999},"last":0.48199999999999998},{"interface":"front","average":{"1min":1.681,"5min":1.3300000000000001,"15min":0.68700000000000006},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":13.132,"5min":18.006,"15min":18.006},"last":0.45500000000000002}]},{"osd":2,"last update":"Wed Jul 5 23:35:49 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.3140000000000001,"15min":0.69399999999999995},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":11.026999999999999,"5min":14.092000000000001,"15min":14.092000000000001},"last":0.60499999999999998},{"interface":"front","average":{"1min":2.4039999999999999,"5min":1.5800000000000001,"15min":0.77200000000000002},"min":{"1min":0.26500000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":22.966999999999999,"5min":22.966999999999999,"15min":22.966999999999999},"last":0.63700000000000001}]},{"osd":3,"last update":"Wed Jul 5 23:35:49 2023","interfaces":[{"interface":"back","average":{"1min":1.8759999999999999,"5min":1.613,"15min":0.80300000000000005},"min":{"1min":0.27200000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":22.885000000000002,"5min":22.885000000000002,"15min":22.885000000000002},"last":0.57799999999999996},{"interface":"front","average":{"1min":1.101,"5min":1.109,"15min":0.64100000000000001},"min":{"1min":0.28499999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":13.103,"5min":14.377000000000001,"15min":14.377000000000001},"last":0.56200000000000006}]},{"osd":4,"last update":"Wed Jul 5 23:35:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.603,"15min":0.92700000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":11.003,"5min":14.004,"15min":14.004},"last":0.85099999999999998},{"interface":"front","average":{"1min":2.0369999999999999,"5min":1.903,"15min":1.018},"min":{"1min":0.42299999999999999,"5min":0.371,"15min":0.371},"max":{"1min":22.995999999999999,"5min":22.995999999999999,"15min":22.995999999999999},"last":0.83499999999999996}]},{"osd":5,"last update":"Wed Jul 5 23:35:49 2023","interfaces":[{"interface":"back","average":{"1min":1.8899999999999999,"5min":1.804,"15min":1.018},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":13.053000000000001,"5min":24.949999999999999,"15min":24.949999999999999},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.254,"5min":1.839,"15min":1.0509999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":11.08,"5min":21.945,"15min":21.945},"last":0.94799999999999995}]},{"osd":6,"last update":"Wed Jul 5 23:35:49 2023","interfaces":[{"interface":"back","average":{"1min":1.6719999999999999,"5min":1.5549999999999999,"15min":0.92200000000000004},"min":{"1min":0.40799999999999997,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":13.016999999999999,"5min":17.981999999999999,"15min":17.981999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":1.236,"5min":1.833,"15min":1.038},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":11.050000000000001,"5min":24.943000000000001,"15min":24.943000000000001},"last":0.90800000000000003}]},{"osd":7,"last update":"Wed Jul 5 23:35:49 2023","interfaces":[{"interface":"back","average":{"1min":2.6440000000000001,"5min":2.0249999999999999,"15min":1.091},"min":{"1min":0.46200000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":23.021999999999998,"5min":23.021999999999998,"15min":23.021999999999998},"last":0.77400000000000002},{"interface":"front","average":{"1min":1.9019999999999999,"5min":1.5349999999999999,"15min":0.92100000000000004},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":13.077999999999999,"5min":14.352,"15min":14.352},"last":0.88800000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574893,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54488,"kb_used_data":23440,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94317352,"statfs":{"total":96636764160,"available":96580968448,"internally_reserved":0,"allocated":24002560,"data_stored":23806220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Jul 5 23:35:42 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":1.202,"15min":0.61899999999999999},"min":{"1min":0.22800000000000001,"5min":0.185,"15min":0.185},"max":{"1min":6.1029999999999998,"5min":23.974,"15min":23.974},"last":0.29199999999999998},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.476,"15min":0.71999999999999997},"min":{"1min":0.28699999999999998,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":16.966000000000001,"5min":32.256999999999998,"15min":32.256999999999998},"last":0.50800000000000001}]},{"osd":2,"last update":"Wed Jul 5 23:35:42 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":1.0549999999999999,"15min":0.59999999999999998},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":5.9699999999999998,"5min":16.157,"15min":16.157},"last":0.433},{"interface":"front","average":{"1min":0.80100000000000005,"5min":1.1140000000000001,"15min":0.61499999999999999},"min":{"1min":0.25900000000000001,"5min":0.254,"15min":0.254},"max":{"1min":6.0620000000000003,"5min":14.91,"15min":14.91},"last":0.44800000000000001}]},{"osd":3,"last update":"Wed Jul 5 23:35:42 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.667,"15min":0.80300000000000005},"min":{"1min":0.27600000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":6.133,"5min":16.928999999999998,"15min":16.928999999999998},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.872,"5min":0.92100000000000004,"15min":0.59399999999999997},"min":{"1min":0.34799999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":6.0039999999999996,"5min":11.923999999999999,"15min":11.923999999999999},"last":0.47199999999999998}]},{"osd":4,"last update":"Wed Jul 5 23:35:42 2023","interfaces":[{"interface":"back","average":{"1min":1.403,"5min":1.556,"15min":0.90200000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":12.066000000000001,"5min":16.838000000000001,"15min":16.838000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.98899999999999999,"5min":1.712,"15min":0.96499999999999997},"min":{"1min":0.40000000000000002,"5min":0.374,"15min":0.374},"max":{"1min":5.9320000000000004,"5min":23.905999999999999,"15min":23.905999999999999},"last":0.74199999999999999}]},{"osd":5,"last update":"Wed Jul 5 23:35:42 2023","interfaces":[{"interface":"back","average":{"1min":2.073,"5min":1.722,"15min":0.97999999999999998},"min":{"1min":0.41299999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":16.928999999999998,"5min":17.824000000000002,"15min":17.824000000000002},"last":0.57599999999999996},{"interface":"front","average":{"1min":1.423,"5min":1.6619999999999999,"15min":0.96199999999999997},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":12.034000000000001,"5min":16.905000000000001,"15min":16.905000000000001},"last":0.755}]},{"osd":6,"last update":"Wed Jul 5 23:35:42 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":1.113,"15min":0.77900000000000003},"min":{"1min":0.47099999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":6.0369999999999999,"5min":10.102,"15min":10.102},"last":0.55900000000000005},{"interface":"front","average":{"1min":1.29,"5min":1.6859999999999999,"15min":0.97799999999999998},"min":{"1min":0.45800000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":11.994999999999999,"5min":32.298999999999999,"15min":32.298999999999999},"last":0.76600000000000001}]},{"osd":7,"last update":"Wed Jul 5 23:35:42 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.599,"15min":0.95699999999999996},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":11.933,"5min":14.946,"15min":14.946},"last":0.61899999999999999},{"interface":"front","average":{"1min":2.016,"5min":1.9379999999999999,"15min":1.054},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":15.031000000000001,"5min":16.878,"15min":16.878},"last":0.67400000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574894,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55944,"kb_used_data":24896,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94315896,"statfs":{"total":96636764160,"available":96579477504,"internally_reserved":0,"allocated":25493504,"data_stored":25304670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 5 23:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":1.7529999999999999,"15min":0.95599999999999996},"min":{"1min":0.24399999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":6.3879999999999999,"5min":29.716000000000001,"15min":29.716000000000001},"last":0.438},{"interface":"front","average":{"1min":1.409,"5min":1.8879999999999999,"15min":1.0389999999999999},"min":{"1min":0.29399999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":17.940000000000001,"5min":21.699000000000002,"15min":21.699000000000002},"last":0.372}]},{"osd":1,"last update":"Wed Jul 5 23:35:49 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.7949999999999999,"15min":1.0189999999999999},"min":{"1min":0.309,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":11.032,"5min":23.053000000000001,"15min":23.053000000000001},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.71099999999999997,"5min":1.589,"15min":0.94699999999999995},"min":{"1min":0.311,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":5.1820000000000004,"5min":29.632999999999999,"15min":29.632999999999999},"last":0.46600000000000003}]},{"osd":3,"last update":"Wed Jul 5 23:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":1.1279999999999999,"15min":0.753},"min":{"1min":0.28599999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.0920000000000001,"5min":22.018000000000001,"15min":22.018000000000001},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.78900000000000003,"5min":1.5620000000000001,"15min":0.98399999999999999},"min":{"1min":0.34899999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":6.468,"5min":29.686,"15min":29.686},"last":0.497}]},{"osd":4,"last update":"Wed Jul 5 23:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":2.0800000000000001,"15min":1.2410000000000001},"min":{"1min":0.443,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":6.4180000000000001,"5min":29.768999999999998,"15min":29.768999999999998},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.98199999999999998,"5min":2.1680000000000001,"15min":1.2869999999999999},"min":{"1min":0.45100000000000001,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":7,"5min":21.16,"15min":21.16},"last":0.60799999999999998}]},{"osd":5,"last update":"Wed Jul 5 23:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":2.3650000000000002,"15min":1.337},"min":{"1min":0.505,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":6.9400000000000004,"5min":22.927,"15min":22.927},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.61199999999999999,"5min":1.768,"15min":1.1519999999999999},"min":{"1min":0.42399999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.755,"5min":23.120000000000001,"15min":23.120000000000001},"last":0.67400000000000004}]},{"osd":6,"last update":"Wed Jul 5 23:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":1.8400000000000001,"15min":1.1799999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.83399999999999996,"5min":23.173999999999999,"15min":23.173999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.95299999999999996,"5min":2.3769999999999998,"15min":1.361},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":6.4400000000000004,"5min":29.742999999999999,"15min":29.742999999999999},"last":0.61799999999999999}]},{"osd":7,"last update":"Wed Jul 5 23:35:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":2.4510000000000001,"15min":1.391},"min":{"1min":0.47399999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":6.9749999999999996,"5min":32.924999999999997,"15min":32.924999999999997},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.63600000000000001,"5min":2.0920000000000001,"15min":1.288},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.88900000000000001,"5min":30.594999999999999,"15min":30.594999999999999},"last":0.73699999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574893,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51852,"kb_used_data":20804,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94319988,"statfs":{"total":96636764160,"available":96583667712,"internally_reserved":0,"allocated":21303296,"data_stored":21110456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 5 23:35:53 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":1.4199999999999999,"15min":0.76600000000000001},"min":{"1min":0.26000000000000001,"5min":0.25,"15min":0.25},"max":{"1min":8.032,"5min":22.948,"15min":22.948},"last":0.40600000000000003},{"interface":"front","average":{"1min":3.8399999999999999,"5min":2.052,"15min":1.0029999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":61.006999999999998,"5min":61.006999999999998,"15min":61.006999999999998},"last":0.42299999999999999}]},{"osd":1,"last update":"Wed Jul 5 23:35:53 2023","interfaces":[{"interface":"back","average":{"1min":3.5840000000000001,"5min":1.978,"15min":1.1399999999999999},"min":{"1min":0.247,"5min":0.246,"15min":0.246},"max":{"1min":58.177999999999997,"5min":58.177999999999997,"15min":58.177999999999997},"last":0.36299999999999999},{"interface":"front","average":{"1min":3.4969999999999999,"5min":2.0590000000000002,"15min":1.1930000000000001},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":54.911000000000001,"5min":54.911000000000001,"15min":54.911000000000001},"last":0.30099999999999999}]},{"osd":2,"last update":"Wed Jul 5 23:35:53 2023","interfaces":[{"interface":"back","average":{"1min":2.4980000000000002,"5min":1.6299999999999999,"15min":0.88800000000000001},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":37.674999999999997,"5min":37.674999999999997,"15min":37.674999999999997},"last":0.34000000000000002},{"interface":"front","average":{"1min":1.286,"5min":1.3600000000000001,"15min":0.78000000000000003},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":14.624000000000001,"5min":14.624000000000001,"15min":14.624000000000001},"last":0.44500000000000001}]},{"osd":4,"last update":"Wed Jul 5 23:35:53 2023","interfaces":[{"interface":"back","average":{"1min":2.7309999999999999,"5min":1.798,"15min":1.0249999999999999},"min":{"1min":0.39300000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":37.648000000000003,"5min":37.648000000000003,"15min":37.648000000000003},"last":0.63500000000000001},{"interface":"front","average":{"1min":1.373,"5min":1.7470000000000001,"15min":1.0329999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":14.361000000000001,"5min":22.882000000000001,"15min":22.882000000000001},"last":0.749}]},{"osd":5,"last update":"Wed Jul 5 23:35:53 2023","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":2.0609999999999999,"15min":1.155},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":14.435,"5min":23.004999999999999,"15min":23.004999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.92300000000000004,"5min":1.7729999999999999,"15min":1.073},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":4.4329999999999998,"5min":18.959,"15min":18.959},"last":0.75900000000000001}]},{"osd":6,"last update":"Wed Jul 5 23:35:53 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":1.47,"15min":0.97499999999999998},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":4.6879999999999997,"5min":18.923999999999999,"15min":18.923999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":2.734,"5min":2.0649999999999999,"15min":1.143},"min":{"1min":0.44500000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":37.619,"5min":37.619,"15min":37.619},"last":0.69399999999999995}]},{"osd":7,"last update":"Wed Jul 5 23:35:53 2023","interfaces":[{"interface":"back","average":{"1min":2.75,"5min":2.0019999999999998,"15min":1.1120000000000001},"min":{"1min":0.47699999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":37.555999999999997,"5min":37.555999999999997,"15min":37.555999999999997},"last":0.73099999999999998},{"interface":"front","average":{"1min":1.462,"5min":1.9219999999999999,"15min":1.1259999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":14.747999999999999,"5min":22.974,"15min":22.974},"last":0.80100000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574894,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61560,"kb_used_data":26416,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94310280,"statfs":{"total":96636764160,"available":96573726720,"internally_reserved":0,"allocated":27049984,"data_stored":26841193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 5 23:35:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":1.4610000000000001,"15min":0.82799999999999996},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":3.3119999999999998,"5min":16.655999999999999,"15min":16.655999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":1.5189999999999999,"15min":0.85199999999999998},"min":{"1min":0.32300000000000001,"5min":0.307,"15min":0.307},"max":{"1min":1.1140000000000001,"5min":18.661999999999999,"15min":18.661999999999999},"last":0.66300000000000003}]},{"osd":1,"last update":"Wed Jul 5 23:35:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":1.4770000000000001,"15min":0.81999999999999995},"min":{"1min":0.33000000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.77400000000000002,"5min":18.991,"15min":18.991},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":1.8420000000000001,"15min":0.94999999999999996},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71199999999999997,"5min":23.879000000000001,"15min":23.879000000000001},"last":0.67300000000000004}]},{"osd":2,"last update":"Wed Jul 5 23:35:48 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":1.907,"15min":1.0149999999999999},"min":{"1min":0.36799999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":8.7750000000000004,"5min":23.805,"15min":23.805},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":1.6639999999999999,"15min":0.92000000000000004},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.1839999999999999,"5min":18.707000000000001,"15min":18.707000000000001},"last":0.70999999999999996}]},{"osd":3,"last update":"Wed Jul 5 23:35:48 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":1.6259999999999999,"15min":0.89200000000000002},"min":{"1min":0.38200000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.0229999999999999,"5min":22.966999999999999,"15min":22.966999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.77600000000000002,"5min":1.72,"15min":0.95799999999999996},"min":{"1min":0.36499999999999999,"5min":0.314,"15min":0.314},"max":{"1min":5.391,"5min":23.843,"15min":23.843},"last":0.59899999999999998}]},{"osd":5,"last update":"Wed Jul 5 23:35:48 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":1.327,"15min":0.753},"min":{"1min":0.315,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.70099999999999996,"5min":16.574999999999999,"15min":16.574999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.45000000000000001,"5min":1.1719999999999999,"15min":0.73999999999999999},"min":{"1min":0.34100000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.624,"5min":18.693999999999999,"15min":18.693999999999999},"last":0.505}]},{"osd":6,"last update":"Wed Jul 5 23:35:48 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":1.4139999999999999,"15min":0.82299999999999995},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.80200000000000005,"5min":17.983000000000001,"15min":17.983000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":1.3220000000000001,"15min":0.80700000000000005},"min":{"1min":0.375,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.79400000000000004,"5min":16.622,"15min":16.622},"last":0.61799999999999999}]},{"osd":7,"last update":"Wed Jul 5 23:35:48 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":1.2130000000000001,"15min":0.76900000000000002},"min":{"1min":0.35799999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.82899999999999996,"5min":22.931000000000001,"15min":22.931000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":1.3,"15min":0.82199999999999995},"min":{"1min":0.39900000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.90200000000000002,"5min":18.966000000000001,"15min":18.966000000000001},"last":0.68700000000000006}]}]},{"osd":5,"up_from":13,"seq":55834574893,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60048,"kb_used_data":24904,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94311792,"statfs":{"total":96636764160,"available":96575275008,"internally_reserved":0,"allocated":25501696,"data_stored":25305322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 5 23:35:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.722,"15min":0.90600000000000003},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":10.981,"5min":18.867999999999999,"15min":18.867999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":1.7290000000000001,"5min":1.5549999999999999,"15min":0.94899999999999995},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":12.927,"5min":18.099,"15min":18.099},"last":0.63700000000000001}]},{"osd":1,"last update":"Wed Jul 5 23:35:41 2023","interfaces":[{"interface":"back","average":{"1min":1.7569999999999999,"5min":1.478,"15min":0.88200000000000001},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":13.012,"5min":18.071999999999999,"15min":18.071999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":2.2109999999999999,"5min":1.7629999999999999,"15min":0.999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":17.004999999999999,"5min":17.004999999999999,"15min":17.004999999999999},"last":0.44600000000000001}]},{"osd":2,"last update":"Wed Jul 5 23:35:41 2023","interfaces":[{"interface":"back","average":{"1min":2.222,"5min":1.8859999999999999,"15min":1.01},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":16.920999999999999,"5min":22.177,"15min":22.177},"last":0.58199999999999996},{"interface":"front","average":{"1min":1.9410000000000001,"5min":1.831,"15min":1},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":17.369,"5min":18.902999999999999,"15min":18.902999999999999},"last":0.45800000000000002}]},{"osd":3,"last update":"Wed Jul 5 23:35:41 2023","interfaces":[{"interface":"back","average":{"1min":1.7709999999999999,"5min":1.5700000000000001,"15min":0.91400000000000003},"min":{"1min":0.39300000000000002,"5min":0.376,"15min":0.376},"max":{"1min":12.965999999999999,"5min":18.032,"15min":18.032},"last":0.54900000000000004},{"interface":"front","average":{"1min":2.258,"5min":1.7130000000000001,"15min":1.03},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":17.029,"5min":17.029,"15min":17.029},"last":0.50900000000000001}]},{"osd":4,"last update":"Wed Jul 5 23:35:41 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":1.599,"15min":0.88500000000000001},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":10.957000000000001,"5min":18.957000000000001,"15min":18.957000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":1.131,"5min":1.3089999999999999,"15min":0.82699999999999996},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":13.032999999999999,"5min":18.123999999999999,"15min":18.123999999999999},"last":0.41799999999999998}]},{"osd":6,"last update":"Wed Jul 5 23:35:41 2023","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.4530000000000001,"15min":0.871},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":16.954000000000001,"5min":16.954000000000001,"15min":16.954000000000001},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.58799999999999997,"5min":1.4890000000000001,"15min":0.88300000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":2.0600000000000001,"5min":18.928000000000001,"15min":18.928000000000001},"last":0.60899999999999999}]},{"osd":7,"last update":"Wed Jul 5 23:35:41 2023","interfaces":[{"interface":"back","average":{"1min":1.7549999999999999,"5min":1.1950000000000001,"15min":0.79500000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":12.991,"5min":12.991,"15min":12.991},"last":0.59399999999999997},{"interface":"front","average":{"1min":1.5129999999999999,"5min":1.254,"15min":0.83599999999999997},"min":{"1min":0.39800000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":16.98,"5min":16.98,"15min":16.98},"last":0.54200000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":8334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1556480,"data_stored":1536523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1556480,"data_stored":1528931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":23068672,"data_stored":23068672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23068672,"data_stored":23068672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":25165824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":25165824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":25165824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":27262976,"data_stored":27262976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":31457280,"data_stored":31457280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-05T23:36:06.048 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:36:06.048 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-07-05T23:32:52.882283+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=52, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:36:06.049 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:36:06.049 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:36:06.050 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:36:06.050 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:36:06.051 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:36:06.051 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:36:06.052 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:36:06.052 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:36:06.053 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-07-05T23:36:22.907 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:36:22.909 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:36:26.054 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-05T23:36:26.195 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.192+0000 7f7a992f9700 1 Processor -- start 2023-07-05T23:36:26.195 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.192+0000 7f7a992f9700 1 -- start start 2023-07-05T23:36:26.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.193+0000 7f7a992f9700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7a9415c570 0x7f7a940cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:26.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.193+0000 7f7a992f9700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a94160e70 con 0x7f7a94160a50 2023-07-05T23:36:26.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.193+0000 7f7a992f9700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a941610a0 con 0x7f7a940cd660 2023-07-05T23:36:26.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.193+0000 7f7a992f9700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a9415d670 con 0x7f7a9415c570 2023-07-05T23:36:26.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.193+0000 7f7a937fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f7a94160a50 0x7f7a940d0bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:53950/0 (socket says 172.21.15.27:53950) 2023-07-05T23:36:26.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.193+0000 7f7a937fe700 1 -- 172.21.15.27:0/4042164442 learned_addr learned my addr 172.21.15.27:0/4042164442 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-07-05T23:36:26.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.193+0000 7f7a92ffd700 1 --2- 172.21.15.27:0/4042164442 >> v2:172.21.15.162:3300/0 conn(0x7f7a9415c570 0x7f7a940cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:26.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.193+0000 7f7a91ffb700 1 -- 172.21.15.27:0/4042164442 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2694544761 0 0) 0x7f7a94160e70 con 0x7f7a94160a50 2023-07-05T23:36:26.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.193+0000 7f7a91ffb700 1 -- 172.21.15.27:0/4042164442 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a7c0035b0 con 0x7f7a94160a50 2023-07-05T23:36:26.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.193+0000 7f7a91ffb700 1 -- 172.21.15.27:0/4042164442 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 171829886 0 0) 0x7f7a7c0035b0 con 0x7f7a94160a50 2023-07-05T23:36:26.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.193+0000 7f7a91ffb700 1 -- 172.21.15.27:0/4042164442 >> v2:172.21.15.162:3300/0 conn(0x7f7a9415c570 msgr2=0x7f7a940cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:36:26.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.193+0000 7f7a91ffb700 1 --2- 172.21.15.27:0/4042164442 >> v2:172.21.15.162:3300/0 conn(0x7f7a9415c570 0x7f7a940cd120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:26.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.193+0000 7f7a91ffb700 1 -- 172.21.15.27:0/4042164442 >> v1:172.21.15.162:6789/0 conn(0x7f7a940cd660 legacy=0x7f7a94160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:26.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.193+0000 7f7a91ffb700 1 -- 172.21.15.27:0/4042164442 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a9415da90 con 0x7f7a94160a50 2023-07-05T23:36:26.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.193+0000 7f7a91ffb700 1 -- 172.21.15.27:0/4042164442 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1246168953 0 0) 0x7f7a8c0019f0 con 0x7f7a94160a50 2023-07-05T23:36:26.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.193+0000 7f7a91ffb700 1 -- 172.21.15.27:0/4042164442 >> v1:172.21.15.27:6789/0 conn(0x7f7a94160a50 legacy=0x7f7a940d0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:26.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.193+0000 7f7a91ffb700 1 --2- 172.21.15.27:0/4042164442 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7a7c003a00 0x7f7a7c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:26.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.194+0000 7f7a91ffb700 1 --2- 172.21.15.27:0/4042164442 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a7c004850 0x7f7a7c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:26.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.194+0000 7f7a91ffb700 1 --2- 172.21.15.27:0/4042164442 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a7c005200 0x7f7a7c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:26.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.194+0000 7f7a91ffb700 1 -- 172.21.15.27:0/4042164442 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a9415d670 con 0x7f7a7c003a00 2023-07-05T23:36:26.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.194+0000 7f7a91ffb700 1 -- 172.21.15.27:0/4042164442 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7c00c080 con 0x7f7a7c005200 2023-07-05T23:36:26.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.194+0000 7f7a91ffb700 1 -- 172.21.15.27:0/4042164442 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7c00c240 con 0x7f7a7c004850 2023-07-05T23:36:26.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.194+0000 7f7a92ffd700 1 --2- 172.21.15.27:0/4042164442 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7a7c003a00 0x7f7a7c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:26.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.194+0000 7f7a937fe700 1 --2- 172.21.15.27:0/4042164442 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a7c005200 0x7f7a7c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:26.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.194+0000 7f7a927fc700 1 --2- 172.21.15.27:0/4042164442 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a7c004850 0x7f7a7c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:26.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.194+0000 7f7a92ffd700 1 -- 172.21.15.27:0/4042164442 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a7c004850 msgr2=0x7f7a7c004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:36:26.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.194+0000 7f7a92ffd700 1 --2- 172.21.15.27:0/4042164442 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a7c004850 0x7f7a7c004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:26.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.194+0000 7f7a92ffd700 1 -- 172.21.15.27:0/4042164442 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a7c005200 msgr2=0x7f7a7c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:36:26.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.194+0000 7f7a92ffd700 1 --2- 172.21.15.27:0/4042164442 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a7c005200 0x7f7a7c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:26.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.194+0000 7f7a937fe700 1 -- 172.21.15.27:0/4042164442 reap_dead start 2023-07-05T23:36:26.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.194+0000 7f7a92ffd700 1 -- 172.21.15.27:0/4042164442 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a7c0035b0 con 0x7f7a7c003a00 2023-07-05T23:36:26.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.194+0000 7f7a927fc700 1 --2- 172.21.15.27:0/4042164442 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a7c004850 0x7f7a7c004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T23:36:26.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.194+0000 7f7a92ffd700 1 --2- 172.21.15.27:0/4042164442 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7a7c003a00 0x7f7a7c003e10 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f7a84009b60 tx=0x7f7a7c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b65999a50f88a0ee server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:36:26.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.194+0000 7f7a91ffb700 1 -- 172.21.15.27:0/4042164442 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8400e6c0 con 0x7f7a7c003a00 2023-07-05T23:36:26.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.194+0000 7f7a91ffb700 1 -- 172.21.15.27:0/4042164442 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a8400e820 con 0x7f7a7c003a00 2023-07-05T23:36:26.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.194+0000 7f7a91ffb700 1 -- 172.21.15.27:0/4042164442 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8400eb90 con 0x7f7a7c003a00 2023-07-05T23:36:26.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.195+0000 7f7a992f9700 1 -- 172.21.15.27:0/4042164442 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7a7c003a00 msgr2=0x7f7a7c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:26.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.195+0000 7f7a992f9700 1 --2- 172.21.15.27:0/4042164442 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7a7c003a00 0x7f7a7c003e10 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f7a84009b60 tx=0x7f7a7c005880 comp rx=0 tx=0).stop 2023-07-05T23:36:26.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.195+0000 7f7a992f9700 1 -- 172.21.15.27:0/4042164442 shutdown_connections 2023-07-05T23:36:26.213 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.195+0000 7f7a992f9700 1 --2- 172.21.15.27:0/4042164442 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7a7c003a00 0x7f7a7c003e10 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:26.213 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.195+0000 7f7a992f9700 1 -- 172.21.15.27:0/4042164442 >> 172.21.15.27:0/4042164442 conn(0x7f7a94071620 msgr2=0x7f7a940719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:36:26.213 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.195+0000 7f7a992f9700 1 -- 172.21.15.27:0/4042164442 shutdown_connections 2023-07-05T23:36:26.214 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.195+0000 7f7a992f9700 1 -- 172.21.15.27:0/4042164442 wait complete. 2023-07-05T23:36:26.214 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.196+0000 7f7a992f9700 1 Processor -- start 2023-07-05T23:36:26.214 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.196+0000 7f7a992f9700 1 -- start start 2023-07-05T23:36:26.218 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.197+0000 7f7a992f9700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a7c003a00 0x7f7a940c8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:26.218 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.197+0000 7f7a992f9700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a94156350 0x7f7a941e7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:26.218 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.197+0000 7f7a992f9700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7a941e8040 0x7f7a940b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:26.219 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.197+0000 7f7a992f9700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a940c7010 con 0x7f7a941e8040 2023-07-05T23:36:26.219 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.197+0000 7f7a992f9700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a940c7e70 con 0x7f7a7c003a00 2023-07-05T23:36:26.219 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.197+0000 7f7a992f9700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a94157250 con 0x7f7a94156350 2023-07-05T23:36:26.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.197+0000 7f7a937fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7a941e8040 0x7f7a940b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:26.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.197+0000 7f7a937fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7a941e8040 0x7f7a940b39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46796/0 (socket says 172.21.15.27:46796) 2023-07-05T23:36:26.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.197+0000 7f7a937fe700 1 -- 172.21.15.27:0/1160275563 learned_addr learned my addr 172.21.15.27:0/1160275563 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:36:26.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.197+0000 7f7a92ffd700 1 --2- 172.21.15.27:0/1160275563 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a7c003a00 0x7f7a940c8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:26.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.197+0000 7f7a927fc700 1 --2- 172.21.15.27:0/1160275563 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a94156350 0x7f7a941e7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:26.222 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.198+0000 7f7a937fe700 1 -- 172.21.15.27:0/1160275563 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a94156350 msgr2=0x7f7a941e7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:26.222 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.198+0000 7f7a937fe700 1 --2- 172.21.15.27:0/1160275563 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a94156350 0x7f7a941e7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:26.222 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.198+0000 7f7a937fe700 1 -- 172.21.15.27:0/1160275563 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a7c003a00 msgr2=0x7f7a940c8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:26.223 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.198+0000 7f7a937fe700 1 --2- 172.21.15.27:0/1160275563 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a7c003a00 0x7f7a940c8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:26.223 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.198+0000 7f7a937fe700 1 -- 172.21.15.27:0/1160275563 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a941567c0 con 0x7f7a941e8040 2023-07-05T23:36:26.224 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.198+0000 7f7a937fe700 1 --2- 172.21.15.27:0/1160275563 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7a941e8040 0x7f7a940b39e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f7a940d00e0 tx=0x7f7a8c00a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:36:26.224 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.198+0000 7f7a7b7fe700 1 -- 172.21.15.27:0/1160275563 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8c00ada0 con 0x7f7a941e8040 2023-07-05T23:36:26.224 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.198+0000 7f7a7b7fe700 1 -- 172.21.15.27:0/1160275563 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a8c0133f0 con 0x7f7a941e8040 2023-07-05T23:36:26.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.198+0000 7f7a7b7fe700 1 -- 172.21.15.27:0/1160275563 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8c0137a0 con 0x7f7a941e8040 2023-07-05T23:36:26.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.198+0000 7f7a992f9700 1 -- 172.21.15.27:0/1160275563 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a940c7260 con 0x7f7a941e8040 2023-07-05T23:36:26.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.198+0000 7f7a992f9700 1 -- 172.21.15.27:0/1160275563 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a940c7820 con 0x7f7a941e8040 2023-07-05T23:36:26.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.199+0000 7f7a992f9700 1 -- 172.21.15.27:0/1160275563 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a94073910 con 0x7f7a941e8040 2023-07-05T23:36:26.226 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.199+0000 7f7a7b7fe700 1 -- 172.21.15.27:0/1160275563 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7a8c013900 con 0x7f7a941e8040 2023-07-05T23:36:26.226 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.200+0000 7f7a7b7fe700 1 --2- 172.21.15.27:0/1160275563 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f7a8006ace0 0x7f7a8006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:26.226 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.200+0000 7f7a7b7fe700 1 -- 172.21.15.27:0/1160275563 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7a8c08a250 con 0x7f7a941e8040 2023-07-05T23:36:26.226 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.200+0000 7f7a92ffd700 1 --2- 172.21.15.27:0/1160275563 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f7a8006ace0 0x7f7a8006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:26.227 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.201+0000 7f7a92ffd700 1 --2- 172.21.15.27:0/1160275563 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f7a8006ace0 0x7f7a8006d190 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7a840090b0 tx=0x7f7a8401e040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:36:26.227 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.204+0000 7f7a7b7fe700 1 -- 172.21.15.27:0/1160275563 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7a8c054ff0 con 0x7f7a941e8040 2023-07-05T23:36:26.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.398+0000 7f7a992f9700 1 -- 172.21.15.27:0/1160275563 --> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7a9415cfb0 con 0x7f7a8006ace0 2023-07-05T23:36:26.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.410+0000 7f7a7b7fe700 1 -- 172.21.15.27:0/1160275563 <== mgr.4105 v2:172.21.15.162:6832/3790028097 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+394192 (secure 0 0 0) 0x7f7a84006c60 con 0x7f7a8006ace0 2023-07-05T23:36:26.417 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:36:26.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.414+0000 7f7a992f9700 1 -- 172.21.15.27:0/1160275563 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f7a8006ace0 msgr2=0x7f7a8006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:26.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.414+0000 7f7a992f9700 1 --2- 172.21.15.27:0/1160275563 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f7a8006ace0 0x7f7a8006d190 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7a840090b0 tx=0x7f7a8401e040 comp rx=0 tx=0).stop 2023-07-05T23:36:26.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.414+0000 7f7a992f9700 1 -- 172.21.15.27:0/1160275563 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7a941e8040 msgr2=0x7f7a940b39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:26.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.414+0000 7f7a992f9700 1 --2- 172.21.15.27:0/1160275563 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7a941e8040 0x7f7a940b39e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f7a940d00e0 tx=0x7f7a8c00a5f0 comp rx=0 tx=0).stop 2023-07-05T23:36:26.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.414+0000 7f7a992f9700 1 -- 172.21.15.27:0/1160275563 shutdown_connections 2023-07-05T23:36:26.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.414+0000 7f7a992f9700 1 --2- 172.21.15.27:0/1160275563 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a7c003a00 0x7f7a940c8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:26.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.414+0000 7f7a992f9700 1 --2- 172.21.15.27:0/1160275563 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f7a8006ace0 0x7f7a8006d190 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:26.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.414+0000 7f7a992f9700 1 --2- 172.21.15.27:0/1160275563 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7a941e8040 0x7f7a940b39e0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:26.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.414+0000 7f7a992f9700 1 --2- 172.21.15.27:0/1160275563 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a94156350 0x7f7a941e7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:26.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.414+0000 7f7a992f9700 1 -- 172.21.15.27:0/1160275563 >> 172.21.15.27:0/1160275563 conn(0x7f7a94071620 msgr2=0x7f7a940d2080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:36:26.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.414+0000 7f7a992f9700 1 -- 172.21.15.27:0/1160275563 shutdown_connections 2023-07-05T23:36:26.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:26.414+0000 7f7a992f9700 1 -- 172.21.15.27:0/1160275563 wait complete. 2023-07-05T23:36:26.422 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2023-07-05T23:36:26.429 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":136,"stamp":"2023-07-05T23:36:25.696100+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":102790929,"num_objects":49,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":131,"num_read_kb":117,"num_write":1261,"num_write_kb":1290376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17771,"ondisk_log_size":17771,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":464064,"kb_used_data":203392,"kb_used_omap":0,"kb_used_meta":260608,"kb_avail":754510656,"statfs":{"total":773094113280,"available":772618911744,"internally_reserved":0,"allocated":208273408,"data_stored":206692626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":266862592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003494"},"pg_stats":[{"pgid":"4.3f","version":"30'28","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:28.077809+0000","last_change":"2023-07-05T23:35:28.077860+0000","last_active":"2023-07-05T23:35:28.077809+0000","last_peered":"2023-07-05T23:35:28.077809+0000","last_clean":"2023-07-05T23:35:28.077809+0000","last_became_active":"2023-07-05T23:32:53.342061+0000","last_became_peered":"2023-07-05T23:32:53.342061+0000","last_unstale":"2023-07-05T23:35:28.077809+0000","last_undegraded":"2023-07-05T23:35:28.077809+0000","last_fullsized":"2023-07-05T23:35:28.077809+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'28","last_scrub_stamp":"2023-07-05T23:35:28.077703+0000","last_deep_scrub":"30'28","last_deep_scrub_stamp":"2023-07-05T23:35:28.077703+0000","last_clean_scrub_stamp":"2023-07-05T23:35:28.077703+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:53:22.483440+0000","scrub_duration":0.0019331699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"30'27","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:26.826504+0000","last_change":"2023-07-05T23:35:26.826592+0000","last_active":"2023-07-05T23:35:26.826504+0000","last_peered":"2023-07-05T23:35:26.826504+0000","last_clean":"2023-07-05T23:35:26.826504+0000","last_became_active":"2023-07-05T23:32:53.342843+0000","last_became_peered":"2023-07-05T23:32:53.342843+0000","last_unstale":"2023-07-05T23:35:26.826504+0000","last_undegraded":"2023-07-05T23:35:26.826504+0000","last_fullsized":"2023-07-05T23:35:26.826504+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'27","last_scrub_stamp":"2023-07-05T23:35:26.826382+0000","last_deep_scrub":"30'27","last_deep_scrub_stamp":"2023-07-05T23:35:26.826382+0000","last_clean_scrub_stamp":"2023-07-05T23:35:26.826382+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:27:33.841616+0000","scrub_duration":0.002058448,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"30'43","reported_seq":76,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:36:13.646035+0000","last_change":"2023-07-05T23:36:13.646095+0000","last_active":"2023-07-05T23:36:13.646035+0000","last_peered":"2023-07-05T23:36:13.646035+0000","last_clean":"2023-07-05T23:36:13.646035+0000","last_became_active":"2023-07-05T23:32:53.338973+0000","last_became_peered":"2023-07-05T23:32:53.338973+0000","last_unstale":"2023-07-05T23:36:13.646035+0000","last_undegraded":"2023-07-05T23:36:13.646035+0000","last_fullsized":"2023-07-05T23:36:13.646035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'43","last_scrub_stamp":"2023-07-05T23:36:13.645903+0000","last_deep_scrub":"30'43","last_deep_scrub_stamp":"2023-07-05T23:36:13.645903+0000","last_clean_scrub_stamp":"2023-07-05T23:36:13.645903+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:22:46.066144+0000","scrub_duration":0.0021327379999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"30'24","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:33.415555+0000","last_change":"2023-07-05T23:35:33.415615+0000","last_active":"2023-07-05T23:35:33.415555+0000","last_peered":"2023-07-05T23:35:33.415555+0000","last_clean":"2023-07-05T23:35:33.415555+0000","last_became_active":"2023-07-05T23:32:53.334473+0000","last_became_peered":"2023-07-05T23:32:53.334473+0000","last_unstale":"2023-07-05T23:35:33.415555+0000","last_undegraded":"2023-07-05T23:35:33.415555+0000","last_fullsized":"2023-07-05T23:35:33.415555+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'24","last_scrub_stamp":"2023-07-05T23:35:33.415463+0000","last_deep_scrub":"30'24","last_deep_scrub_stamp":"2023-07-05T23:35:33.415463+0000","last_clean_scrub_stamp":"2023-07-05T23:35:33.415463+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:35:57.145092+0000","scrub_duration":0.0017828779999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"30'34","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:51.557867+0000","last_change":"2023-07-05T23:35:51.557916+0000","last_active":"2023-07-05T23:35:51.557867+0000","last_peered":"2023-07-05T23:35:51.557867+0000","last_clean":"2023-07-05T23:35:51.557867+0000","last_became_active":"2023-07-05T23:32:53.345743+0000","last_became_peered":"2023-07-05T23:32:53.345743+0000","last_unstale":"2023-07-05T23:35:51.557867+0000","last_undegraded":"2023-07-05T23:35:51.557867+0000","last_fullsized":"2023-07-05T23:35:51.557867+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'34","last_scrub_stamp":"2023-07-05T23:35:51.557768+0000","last_deep_scrub":"30'34","last_deep_scrub_stamp":"2023-07-05T23:35:51.557768+0000","last_clean_scrub_stamp":"2023-07-05T23:35:51.557768+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:22:28.327810+0000","scrub_duration":0.00171462,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"30'39","reported_seq":72,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:36:05.569982+0000","last_change":"2023-07-05T23:36:05.570030+0000","last_active":"2023-07-05T23:36:05.569982+0000","last_peered":"2023-07-05T23:36:05.569982+0000","last_clean":"2023-07-05T23:36:05.569982+0000","last_became_active":"2023-07-05T23:32:53.335456+0000","last_became_peered":"2023-07-05T23:32:53.335456+0000","last_unstale":"2023-07-05T23:36:05.569982+0000","last_undegraded":"2023-07-05T23:36:05.569982+0000","last_fullsized":"2023-07-05T23:36:05.569982+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'39","last_scrub_stamp":"2023-07-05T23:36:05.569878+0000","last_deep_scrub":"30'39","last_deep_scrub_stamp":"2023-07-05T23:36:05.569878+0000","last_clean_scrub_stamp":"2023-07-05T23:36:05.569878+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:58:20.957985+0000","scrub_duration":0.001660908,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"30'27","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:49.364981+0000","last_change":"2023-07-05T23:35:49.365055+0000","last_active":"2023-07-05T23:35:49.364981+0000","last_peered":"2023-07-05T23:35:49.364981+0000","last_clean":"2023-07-05T23:35:49.364981+0000","last_became_active":"2023-07-05T23:32:53.340639+0000","last_became_peered":"2023-07-05T23:32:53.340639+0000","last_unstale":"2023-07-05T23:35:49.364981+0000","last_undegraded":"2023-07-05T23:35:49.364981+0000","last_fullsized":"2023-07-05T23:35:49.364981+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'27","last_scrub_stamp":"2023-07-05T23:35:49.364872+0000","last_deep_scrub":"30'27","last_deep_scrub_stamp":"2023-07-05T23:35:49.364872+0000","last_clean_scrub_stamp":"2023-07-05T23:35:49.364872+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:47:50.452938+0000","scrub_duration":0.0017485770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"30'31","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:29.789118+0000","last_change":"2023-07-05T23:35:29.789172+0000","last_active":"2023-07-05T23:35:29.789118+0000","last_peered":"2023-07-05T23:35:29.789118+0000","last_clean":"2023-07-05T23:35:29.789118+0000","last_became_active":"2023-07-05T23:32:53.336216+0000","last_became_peered":"2023-07-05T23:32:53.336216+0000","last_unstale":"2023-07-05T23:35:29.789118+0000","last_undegraded":"2023-07-05T23:35:29.789118+0000","last_fullsized":"2023-07-05T23:35:29.789118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'31","last_scrub_stamp":"2023-07-05T23:35:29.789015+0000","last_deep_scrub":"30'31","last_deep_scrub_stamp":"2023-07-05T23:35:29.789015+0000","last_clean_scrub_stamp":"2023-07-05T23:35:29.789015+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:06:48.212448+0000","scrub_duration":0.001571259,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"30'38","reported_seq":71,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:44.530028+0000","last_change":"2023-07-05T23:35:44.530111+0000","last_active":"2023-07-05T23:35:44.530028+0000","last_peered":"2023-07-05T23:35:44.530028+0000","last_clean":"2023-07-05T23:35:44.530028+0000","last_became_active":"2023-07-05T23:32:53.347948+0000","last_became_peered":"2023-07-05T23:32:53.347948+0000","last_unstale":"2023-07-05T23:35:44.530028+0000","last_undegraded":"2023-07-05T23:35:44.530028+0000","last_fullsized":"2023-07-05T23:35:44.530028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'38","last_scrub_stamp":"2023-07-05T23:35:44.529912+0000","last_deep_scrub":"30'38","last_deep_scrub_stamp":"2023-07-05T23:35:44.529912+0000","last_clean_scrub_stamp":"2023-07-05T23:35:44.529912+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:47:45.617977+0000","scrub_duration":0.001908533,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"30'44","reported_seq":77,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:46.800220+0000","last_change":"2023-07-05T23:35:46.800291+0000","last_active":"2023-07-05T23:35:46.800220+0000","last_peered":"2023-07-05T23:35:46.800220+0000","last_clean":"2023-07-05T23:35:46.800220+0000","last_became_active":"2023-07-05T23:32:53.330135+0000","last_became_peered":"2023-07-05T23:32:53.330135+0000","last_unstale":"2023-07-05T23:35:46.800220+0000","last_undegraded":"2023-07-05T23:35:46.800220+0000","last_fullsized":"2023-07-05T23:35:46.800220+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'44","last_scrub_stamp":"2023-07-05T23:35:46.800082+0000","last_deep_scrub":"30'44","last_deep_scrub_stamp":"2023-07-05T23:35:46.800082+0000","last_clean_scrub_stamp":"2023-07-05T23:35:46.800082+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:58:40.415256+0000","scrub_duration":0.001981516,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"30'25","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:36:03.568650+0000","last_change":"2023-07-05T23:36:03.568698+0000","last_active":"2023-07-05T23:36:03.568650+0000","last_peered":"2023-07-05T23:36:03.568650+0000","last_clean":"2023-07-05T23:36:03.568650+0000","last_became_active":"2023-07-05T23:32:53.341526+0000","last_became_peered":"2023-07-05T23:32:53.341526+0000","last_unstale":"2023-07-05T23:36:03.568650+0000","last_undegraded":"2023-07-05T23:36:03.568650+0000","last_fullsized":"2023-07-05T23:36:03.568650+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'25","last_scrub_stamp":"2023-07-05T23:36:03.568545+0000","last_deep_scrub":"30'25","last_deep_scrub_stamp":"2023-07-05T23:36:03.568545+0000","last_clean_scrub_stamp":"2023-07-05T23:36:03.568545+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:19:51.173415+0000","scrub_duration":0.0021177969999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"30'30","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:39.129286+0000","last_change":"2023-07-05T23:35:39.129369+0000","last_active":"2023-07-05T23:35:39.129286+0000","last_peered":"2023-07-05T23:35:39.129286+0000","last_clean":"2023-07-05T23:35:39.129286+0000","last_became_active":"2023-07-05T23:32:53.337279+0000","last_became_peered":"2023-07-05T23:32:53.337279+0000","last_unstale":"2023-07-05T23:35:39.129286+0000","last_undegraded":"2023-07-05T23:35:39.129286+0000","last_fullsized":"2023-07-05T23:35:39.129286+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'30","last_scrub_stamp":"2023-07-05T23:35:39.129160+0000","last_deep_scrub":"30'30","last_deep_scrub_stamp":"2023-07-05T23:35:39.129160+0000","last_clean_scrub_stamp":"2023-07-05T23:35:39.129160+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:01:23.384296+0000","scrub_duration":0.0019447869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"30'30","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:31.043742+0000","last_change":"2023-07-05T23:35:31.043789+0000","last_active":"2023-07-05T23:35:31.043742+0000","last_peered":"2023-07-05T23:35:31.043742+0000","last_clean":"2023-07-05T23:35:31.043742+0000","last_became_active":"2023-07-05T23:32:53.336083+0000","last_became_peered":"2023-07-05T23:32:53.336083+0000","last_unstale":"2023-07-05T23:35:31.043742+0000","last_undegraded":"2023-07-05T23:35:31.043742+0000","last_fullsized":"2023-07-05T23:35:31.043742+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'30","last_scrub_stamp":"2023-07-05T23:35:31.043651+0000","last_deep_scrub":"30'30","last_deep_scrub_stamp":"2023-07-05T23:35:31.043651+0000","last_clean_scrub_stamp":"2023-07-05T23:35:31.043651+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:00:14.136508+0000","scrub_duration":0.001589949,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"30'32","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:47.783303+0000","last_change":"2023-07-05T23:35:47.783348+0000","last_active":"2023-07-05T23:35:47.783303+0000","last_peered":"2023-07-05T23:35:47.783303+0000","last_clean":"2023-07-05T23:35:47.783303+0000","last_became_active":"2023-07-05T23:32:53.327918+0000","last_became_peered":"2023-07-05T23:32:53.327918+0000","last_unstale":"2023-07-05T23:35:47.783303+0000","last_undegraded":"2023-07-05T23:35:47.783303+0000","last_fullsized":"2023-07-05T23:35:47.783303+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-07-05T23:35:47.783224+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-07-05T23:35:47.783224+0000","last_clean_scrub_stamp":"2023-07-05T23:35:47.783224+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:37:51.419002+0000","scrub_duration":0.0020096649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"30'31","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:36:00.352406+0000","last_change":"2023-07-05T23:36:00.352452+0000","last_active":"2023-07-05T23:36:00.352406+0000","last_peered":"2023-07-05T23:36:00.352406+0000","last_clean":"2023-07-05T23:36:00.352406+0000","last_became_active":"2023-07-05T23:32:53.340246+0000","last_became_peered":"2023-07-05T23:32:53.340246+0000","last_unstale":"2023-07-05T23:36:00.352406+0000","last_undegraded":"2023-07-05T23:36:00.352406+0000","last_fullsized":"2023-07-05T23:36:00.352406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'31","last_scrub_stamp":"2023-07-05T23:36:00.352316+0000","last_deep_scrub":"30'31","last_deep_scrub_stamp":"2023-07-05T23:36:00.352316+0000","last_clean_scrub_stamp":"2023-07-05T23:36:00.352316+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:01:31.956213+0000","scrub_duration":0.0019103480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"30'39","reported_seq":72,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:36:06.559205+0000","last_change":"2023-07-05T23:36:06.559269+0000","last_active":"2023-07-05T23:36:06.559205+0000","last_peered":"2023-07-05T23:36:06.559205+0000","last_clean":"2023-07-05T23:36:06.559205+0000","last_became_active":"2023-07-05T23:32:53.336006+0000","last_became_peered":"2023-07-05T23:32:53.336006+0000","last_unstale":"2023-07-05T23:36:06.559205+0000","last_undegraded":"2023-07-05T23:36:06.559205+0000","last_fullsized":"2023-07-05T23:36:06.559205+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'39","last_scrub_stamp":"2023-07-05T23:36:06.559117+0000","last_deep_scrub":"30'39","last_deep_scrub_stamp":"2023-07-05T23:36:06.559117+0000","last_clean_scrub_stamp":"2023-07-05T23:36:06.559117+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:18:43.649326+0000","scrub_duration":0.00178312,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"30'34","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:41.603516+0000","last_change":"2023-07-05T23:35:41.603564+0000","last_active":"2023-07-05T23:35:41.603516+0000","last_peered":"2023-07-05T23:35:41.603516+0000","last_clean":"2023-07-05T23:35:41.603516+0000","last_became_active":"2023-07-05T23:32:53.345848+0000","last_became_peered":"2023-07-05T23:32:53.345848+0000","last_unstale":"2023-07-05T23:35:41.603516+0000","last_undegraded":"2023-07-05T23:35:41.603516+0000","last_fullsized":"2023-07-05T23:35:41.603516+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'34","last_scrub_stamp":"2023-07-05T23:35:41.603416+0000","last_deep_scrub":"30'34","last_deep_scrub_stamp":"2023-07-05T23:35:41.603416+0000","last_clean_scrub_stamp":"2023-07-05T23:35:41.603416+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:47:37.532728+0000","scrub_duration":0.00170199,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"30'29","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:36:04.597927+0000","last_change":"2023-07-05T23:36:04.597980+0000","last_active":"2023-07-05T23:36:04.597927+0000","last_peered":"2023-07-05T23:36:04.597927+0000","last_clean":"2023-07-05T23:36:04.597927+0000","last_became_active":"2023-07-05T23:32:53.335535+0000","last_became_peered":"2023-07-05T23:32:53.335535+0000","last_unstale":"2023-07-05T23:36:04.597927+0000","last_undegraded":"2023-07-05T23:36:04.597927+0000","last_fullsized":"2023-07-05T23:36:04.597927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'29","last_scrub_stamp":"2023-07-05T23:36:04.597831+0000","last_deep_scrub":"30'29","last_deep_scrub_stamp":"2023-07-05T23:36:04.597831+0000","last_clean_scrub_stamp":"2023-07-05T23:36:04.597831+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:05:21.515109+0000","scrub_duration":0.0019810919999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"30'31","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:27.082265+0000","last_change":"2023-07-05T23:35:27.082315+0000","last_active":"2023-07-05T23:35:27.082265+0000","last_peered":"2023-07-05T23:35:27.082265+0000","last_clean":"2023-07-05T23:35:27.082265+0000","last_became_active":"2023-07-05T23:32:53.338095+0000","last_became_peered":"2023-07-05T23:32:53.338095+0000","last_unstale":"2023-07-05T23:35:27.082265+0000","last_undegraded":"2023-07-05T23:35:27.082265+0000","last_fullsized":"2023-07-05T23:35:27.082265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'31","last_scrub_stamp":"2023-07-05T23:35:27.082179+0000","last_deep_scrub":"30'31","last_deep_scrub_stamp":"2023-07-05T23:35:27.082179+0000","last_clean_scrub_stamp":"2023-07-05T23:35:27.082179+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:05:57.887925+0000","scrub_duration":0.0021665159999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"30'34","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:32.375023+0000","last_change":"2023-07-05T23:35:32.375073+0000","last_active":"2023-07-05T23:35:32.375023+0000","last_peered":"2023-07-05T23:35:32.375023+0000","last_clean":"2023-07-05T23:35:32.375023+0000","last_became_active":"2023-07-05T23:32:53.341783+0000","last_became_peered":"2023-07-05T23:32:53.341783+0000","last_unstale":"2023-07-05T23:35:32.375023+0000","last_undegraded":"2023-07-05T23:35:32.375023+0000","last_fullsized":"2023-07-05T23:35:32.375023+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'34","last_scrub_stamp":"2023-07-05T23:35:32.374915+0000","last_deep_scrub":"30'34","last_deep_scrub_stamp":"2023-07-05T23:35:32.374915+0000","last_clean_scrub_stamp":"2023-07-05T23:35:32.374915+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:37:36.010693+0000","scrub_duration":0.0016638619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"30'40","reported_seq":73,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:36:04.360787+0000","last_change":"2023-07-05T23:36:04.360837+0000","last_active":"2023-07-05T23:36:04.360787+0000","last_peered":"2023-07-05T23:36:04.360787+0000","last_clean":"2023-07-05T23:36:04.360787+0000","last_became_active":"2023-07-05T23:32:53.348108+0000","last_became_peered":"2023-07-05T23:32:53.348108+0000","last_unstale":"2023-07-05T23:36:04.360787+0000","last_undegraded":"2023-07-05T23:36:04.360787+0000","last_fullsized":"2023-07-05T23:36:04.360787+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'40","last_scrub_stamp":"2023-07-05T23:36:04.360681+0000","last_deep_scrub":"30'40","last_deep_scrub_stamp":"2023-07-05T23:36:04.360681+0000","last_clean_scrub_stamp":"2023-07-05T23:36:04.360681+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:48:44.777245+0000","scrub_duration":0.0022089200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"30'32","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:39.617241+0000","last_change":"2023-07-05T23:35:39.617299+0000","last_active":"2023-07-05T23:35:39.617241+0000","last_peered":"2023-07-05T23:35:39.617241+0000","last_clean":"2023-07-05T23:35:39.617241+0000","last_became_active":"2023-07-05T23:32:53.340698+0000","last_became_peered":"2023-07-05T23:32:53.340698+0000","last_unstale":"2023-07-05T23:35:39.617241+0000","last_undegraded":"2023-07-05T23:35:39.617241+0000","last_fullsized":"2023-07-05T23:35:39.617241+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-07-05T23:35:39.617135+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-07-05T23:35:39.617135+0000","last_clean_scrub_stamp":"2023-07-05T23:35:39.617135+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:23:59.478196+0000","scrub_duration":0.001562581,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"30'36","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:45.686994+0000","last_change":"2023-07-05T23:35:45.687058+0000","last_active":"2023-07-05T23:35:45.686994+0000","last_peered":"2023-07-05T23:35:45.686994+0000","last_clean":"2023-07-05T23:35:45.686994+0000","last_became_active":"2023-07-05T23:32:53.345403+0000","last_became_peered":"2023-07-05T23:32:53.345403+0000","last_unstale":"2023-07-05T23:35:45.686994+0000","last_undegraded":"2023-07-05T23:35:45.686994+0000","last_fullsized":"2023-07-05T23:35:45.686994+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'36","last_scrub_stamp":"2023-07-05T23:35:45.686913+0000","last_deep_scrub":"30'36","last_deep_scrub_stamp":"2023-07-05T23:35:45.686913+0000","last_clean_scrub_stamp":"2023-07-05T23:35:45.686913+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:22:22.456955+0000","scrub_duration":0.0012798390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"30'31","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:56.381912+0000","last_change":"2023-07-05T23:35:56.381959+0000","last_active":"2023-07-05T23:35:56.381912+0000","last_peered":"2023-07-05T23:35:56.381912+0000","last_clean":"2023-07-05T23:35:56.381912+0000","last_became_active":"2023-07-05T23:32:53.348053+0000","last_became_peered":"2023-07-05T23:32:53.348053+0000","last_unstale":"2023-07-05T23:35:56.381912+0000","last_undegraded":"2023-07-05T23:35:56.381912+0000","last_fullsized":"2023-07-05T23:35:56.381912+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'31","last_scrub_stamp":"2023-07-05T23:35:56.381814+0000","last_deep_scrub":"30'31","last_deep_scrub_stamp":"2023-07-05T23:35:56.381814+0000","last_clean_scrub_stamp":"2023-07-05T23:35:56.381814+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:22:33.151856+0000","scrub_duration":0.0019954069999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"30'25","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:45.605594+0000","last_change":"2023-07-05T23:35:45.605631+0000","last_active":"2023-07-05T23:35:45.605594+0000","last_peered":"2023-07-05T23:35:45.605594+0000","last_clean":"2023-07-05T23:35:45.605594+0000","last_became_active":"2023-07-05T23:32:53.338935+0000","last_became_peered":"2023-07-05T23:32:53.338935+0000","last_unstale":"2023-07-05T23:35:45.605594+0000","last_undegraded":"2023-07-05T23:35:45.605594+0000","last_fullsized":"2023-07-05T23:35:45.605594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'25","last_scrub_stamp":"2023-07-05T23:35:45.605527+0000","last_deep_scrub":"30'25","last_deep_scrub_stamp":"2023-07-05T23:35:45.605527+0000","last_clean_scrub_stamp":"2023-07-05T23:35:45.605527+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:25:57.165990+0000","scrub_duration":0.001695216,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"30'38","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:58.767545+0000","last_change":"2023-07-05T23:35:58.767634+0000","last_active":"2023-07-05T23:35:58.767545+0000","last_peered":"2023-07-05T23:35:58.767545+0000","last_clean":"2023-07-05T23:35:58.767545+0000","last_became_active":"2023-07-05T23:33:34.898383+0000","last_became_peered":"2023-07-05T23:33:34.898383+0000","last_unstale":"2023-07-05T23:35:58.767545+0000","last_undegraded":"2023-07-05T23:35:58.767545+0000","last_fullsized":"2023-07-05T23:35:58.767545+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'38","last_scrub_stamp":"2023-07-05T23:35:58.767437+0000","last_deep_scrub":"30'38","last_deep_scrub_stamp":"2023-07-05T23:35:58.767437+0000","last_clean_scrub_stamp":"2023-07-05T23:35:58.767437+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:30:54.182990+0000","scrub_duration":0.0021658070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.25","version":"30'26","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:23.832669+0000","last_change":"2023-07-05T23:35:23.832721+0000","last_active":"2023-07-05T23:35:23.832669+0000","last_peered":"2023-07-05T23:35:23.832669+0000","last_clean":"2023-07-05T23:35:23.832669+0000","last_became_active":"2023-07-05T23:32:53.335857+0000","last_became_peered":"2023-07-05T23:32:53.335857+0000","last_unstale":"2023-07-05T23:35:23.832669+0000","last_undegraded":"2023-07-05T23:35:23.832669+0000","last_fullsized":"2023-07-05T23:35:23.832669+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'26","last_scrub_stamp":"2023-07-05T23:35:23.832558+0000","last_deep_scrub":"30'26","last_deep_scrub_stamp":"2023-07-05T23:35:23.832558+0000","last_clean_scrub_stamp":"2023-07-05T23:35:23.832558+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:24:02.493000+0000","scrub_duration":0.001482206,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"30'479","reported_seq":498,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:23.256642+0000","last_change":"2023-07-05T23:32:57.365825+0000","last_active":"2023-07-05T23:35:23.256642+0000","last_peered":"2023-07-05T23:35:23.256642+0000","last_clean":"2023-07-05T23:35:23.256642+0000","last_became_active":"2023-07-05T23:32:57.365409+0000","last_became_peered":"2023-07-05T23:32:57.365409+0000","last_unstale":"2023-07-05T23:35:23.256642+0000","last_undegraded":"2023-07-05T23:35:23.256642+0000","last_fullsized":"2023-07-05T23:35:23.256642+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:41.313810+0000","last_change":"2023-07-05T23:35:41.313864+0000","last_active":"2023-07-05T23:35:41.313810+0000","last_peered":"2023-07-05T23:35:41.313810+0000","last_clean":"2023-07-05T23:35:41.313810+0000","last_became_active":"2023-07-05T23:32:52.901080+0000","last_became_peered":"2023-07-05T23:32:52.901080+0000","last_unstale":"2023-07-05T23:35:41.313810+0000","last_undegraded":"2023-07-05T23:35:41.313810+0000","last_fullsized":"2023-07-05T23:35:41.313810+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2023-07-05T23:35:41.313704+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2023-07-05T23:35:41.313704+0000","last_clean_scrub_stamp":"2023-07-05T23:35:41.313704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:14:58.964233+0000","scrub_duration":0.002060026,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'39","reported_seq":72,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:22.793480+0000","last_change":"2023-07-05T23:35:22.793480+0000","last_active":"2023-07-05T23:35:22.793480+0000","last_peered":"2023-07-05T23:35:22.793480+0000","last_clean":"2023-07-05T23:35:22.793480+0000","last_became_active":"2023-07-05T23:32:53.339464+0000","last_became_peered":"2023-07-05T23:32:53.339464+0000","last_unstale":"2023-07-05T23:35:22.793480+0000","last_undegraded":"2023-07-05T23:35:22.793480+0000","last_fullsized":"2023-07-05T23:35:22.793480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'39","last_scrub_stamp":"2023-07-05T23:35:22.793364+0000","last_deep_scrub":"30'39","last_deep_scrub_stamp":"2023-07-05T23:35:22.793364+0000","last_clean_scrub_stamp":"2023-07-05T23:35:22.793364+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:46:08.645177+0000","scrub_duration":0.0015116330000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"30'446","reported_seq":473,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:52.332953+0000","last_change":"2023-07-05T23:35:52.333015+0000","last_active":"2023-07-05T23:35:52.332953+0000","last_peered":"2023-07-05T23:35:52.332953+0000","last_clean":"2023-07-05T23:35:52.332953+0000","last_became_active":"2023-07-05T23:32:57.353465+0000","last_became_peered":"2023-07-05T23:32:57.353465+0000","last_unstale":"2023-07-05T23:35:52.332953+0000","last_undegraded":"2023-07-05T23:35:52.332953+0000","last_fullsized":"2023-07-05T23:35:52.332953+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'446","last_scrub_stamp":"2023-07-05T23:35:52.332863+0000","last_deep_scrub":"30'446","last_deep_scrub_stamp":"2023-07-05T23:35:52.332863+0000","last_clean_scrub_stamp":"2023-07-05T23:35:52.332863+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:59:24.781573+0000","scrub_duration":0.002013571,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:33.568592+0000","last_change":"2023-07-05T23:35:33.568640+0000","last_active":"2023-07-05T23:35:33.568592+0000","last_peered":"2023-07-05T23:35:33.568592+0000","last_clean":"2023-07-05T23:35:33.568592+0000","last_became_active":"2023-07-05T23:32:52.909347+0000","last_became_peered":"2023-07-05T23:32:52.909347+0000","last_unstale":"2023-07-05T23:35:33.568592+0000","last_undegraded":"2023-07-05T23:35:33.568592+0000","last_fullsized":"2023-07-05T23:35:33.568592+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:35:33.568495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:35:33.568495+0000","last_clean_scrub_stamp":"2023-07-05T23:35:33.568495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:02:17.042409+0000","scrub_duration":0.001426716,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"30'31","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:21.633620+0000","last_change":"2023-07-05T23:35:21.633689+0000","last_active":"2023-07-05T23:35:21.633620+0000","last_peered":"2023-07-05T23:35:21.633620+0000","last_clean":"2023-07-05T23:35:21.633620+0000","last_became_active":"2023-07-05T23:32:53.338825+0000","last_became_peered":"2023-07-05T23:32:53.338825+0000","last_unstale":"2023-07-05T23:35:21.633620+0000","last_undegraded":"2023-07-05T23:35:21.633620+0000","last_fullsized":"2023-07-05T23:35:21.633620+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'31","last_scrub_stamp":"2023-07-05T23:35:21.633532+0000","last_deep_scrub":"30'31","last_deep_scrub_stamp":"2023-07-05T23:35:21.633532+0000","last_clean_scrub_stamp":"2023-07-05T23:35:21.633532+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:17:27.662797+0000","scrub_duration":0.001837602,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"30'462","reported_seq":489,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:57.755099+0000","last_change":"2023-07-05T23:35:57.755228+0000","last_active":"2023-07-05T23:35:57.755099+0000","last_peered":"2023-07-05T23:35:57.755099+0000","last_clean":"2023-07-05T23:35:57.755099+0000","last_became_active":"2023-07-05T23:32:57.358965+0000","last_became_peered":"2023-07-05T23:32:57.358965+0000","last_unstale":"2023-07-05T23:35:57.755099+0000","last_undegraded":"2023-07-05T23:35:57.755099+0000","last_fullsized":"2023-07-05T23:35:57.755099+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'462","last_scrub_stamp":"2023-07-05T23:35:57.754987+0000","last_deep_scrub":"30'462","last_deep_scrub_stamp":"2023-07-05T23:35:57.754987+0000","last_clean_scrub_stamp":"2023-07-05T23:35:57.754987+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:58:26.611108+0000","scrub_duration":0.0021636189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"30'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:33.640451+0000","last_change":"2023-07-05T23:35:33.640503+0000","last_active":"2023-07-05T23:35:33.640451+0000","last_peered":"2023-07-05T23:35:33.640451+0000","last_clean":"2023-07-05T23:35:33.640451+0000","last_became_active":"2023-07-05T23:32:52.908756+0000","last_became_peered":"2023-07-05T23:32:52.908756+0000","last_unstale":"2023-07-05T23:35:33.640451+0000","last_undegraded":"2023-07-05T23:35:33.640451+0000","last_fullsized":"2023-07-05T23:35:33.640451+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2023-07-05T23:35:33.640351+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2023-07-05T23:35:33.640351+0000","last_clean_scrub_stamp":"2023-07-05T23:35:33.640351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:23:53.501412+0000","scrub_duration":0.001423014,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"30'30","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:43.356371+0000","last_change":"2023-07-05T23:35:43.356419+0000","last_active":"2023-07-05T23:35:43.356371+0000","last_peered":"2023-07-05T23:35:43.356371+0000","last_clean":"2023-07-05T23:35:43.356371+0000","last_became_active":"2023-07-05T23:32:53.337480+0000","last_became_peered":"2023-07-05T23:32:53.337480+0000","last_unstale":"2023-07-05T23:35:43.356371+0000","last_undegraded":"2023-07-05T23:35:43.356371+0000","last_fullsized":"2023-07-05T23:35:43.356371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'30","last_scrub_stamp":"2023-07-05T23:35:43.356270+0000","last_deep_scrub":"30'30","last_deep_scrub_stamp":"2023-07-05T23:35:43.356270+0000","last_clean_scrub_stamp":"2023-07-05T23:35:43.356270+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:45:04.042706+0000","scrub_duration":0.001661778,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"30'473","reported_seq":500,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:48.410604+0000","last_change":"2023-07-05T23:35:48.410698+0000","last_active":"2023-07-05T23:35:48.410604+0000","last_peered":"2023-07-05T23:35:48.410604+0000","last_clean":"2023-07-05T23:35:48.410604+0000","last_became_active":"2023-07-05T23:32:57.355940+0000","last_became_peered":"2023-07-05T23:32:57.355940+0000","last_unstale":"2023-07-05T23:35:48.410604+0000","last_undegraded":"2023-07-05T23:35:48.410604+0000","last_fullsized":"2023-07-05T23:35:48.410604+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'473","last_scrub_stamp":"2023-07-05T23:35:48.410456+0000","last_deep_scrub":"30'473","last_deep_scrub_stamp":"2023-07-05T23:35:48.410456+0000","last_clean_scrub_stamp":"2023-07-05T23:35:48.410456+0000","objects_scrubbed":1,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:47:15.076777+0000","scrub_duration":0.0067811599999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"30'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:36.599539+0000","last_change":"2023-07-05T23:35:36.599624+0000","last_active":"2023-07-05T23:35:36.599539+0000","last_peered":"2023-07-05T23:35:36.599539+0000","last_clean":"2023-07-05T23:35:36.599539+0000","last_became_active":"2023-07-05T23:32:52.904140+0000","last_became_peered":"2023-07-05T23:32:52.904140+0000","last_unstale":"2023-07-05T23:35:36.599539+0000","last_undegraded":"2023-07-05T23:35:36.599539+0000","last_fullsized":"2023-07-05T23:35:36.599539+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2023-07-05T23:35:36.599420+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2023-07-05T23:35:36.599420+0000","last_clean_scrub_stamp":"2023-07-05T23:35:36.599420+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:06:55.022852+0000","scrub_duration":0.0020385260000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"30'27","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:37.731303+0000","last_change":"2023-07-05T23:35:37.731363+0000","last_active":"2023-07-05T23:35:37.731303+0000","last_peered":"2023-07-05T23:35:37.731303+0000","last_clean":"2023-07-05T23:35:37.731303+0000","last_became_active":"2023-07-05T23:32:53.338248+0000","last_became_peered":"2023-07-05T23:32:53.338248+0000","last_unstale":"2023-07-05T23:35:37.731303+0000","last_undegraded":"2023-07-05T23:35:37.731303+0000","last_fullsized":"2023-07-05T23:35:37.731303+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'27","last_scrub_stamp":"2023-07-05T23:35:37.731211+0000","last_deep_scrub":"30'27","last_deep_scrub_stamp":"2023-07-05T23:35:37.731211+0000","last_clean_scrub_stamp":"2023-07-05T23:35:37.731211+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:55:31.804023+0000","scrub_duration":0.001714728,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"30'457","reported_seq":484,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:36:06.361694+0000","last_change":"2023-07-05T23:36:06.361807+0000","last_active":"2023-07-05T23:36:06.361694+0000","last_peered":"2023-07-05T23:36:06.361694+0000","last_clean":"2023-07-05T23:36:06.361694+0000","last_became_active":"2023-07-05T23:32:57.357039+0000","last_became_peered":"2023-07-05T23:32:57.357039+0000","last_unstale":"2023-07-05T23:36:06.361694+0000","last_undegraded":"2023-07-05T23:36:06.361694+0000","last_fullsized":"2023-07-05T23:36:06.361694+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'457","last_scrub_stamp":"2023-07-05T23:36:06.361543+0000","last_deep_scrub":"30'457","last_deep_scrub_stamp":"2023-07-05T23:36:06.361543+0000","last_clean_scrub_stamp":"2023-07-05T23:36:06.361543+0000","objects_scrubbed":2,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:50:04.731815+0000","scrub_duration":0.01125281,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:37.856933+0000","last_change":"2023-07-05T23:35:37.857007+0000","last_active":"2023-07-05T23:35:37.856933+0000","last_peered":"2023-07-05T23:35:37.856933+0000","last_clean":"2023-07-05T23:35:37.856933+0000","last_became_active":"2023-07-05T23:32:52.900352+0000","last_became_peered":"2023-07-05T23:32:52.900352+0000","last_unstale":"2023-07-05T23:35:37.856933+0000","last_undegraded":"2023-07-05T23:35:37.856933+0000","last_fullsized":"2023-07-05T23:35:37.856933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:35:37.856826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:35:37.856826+0000","last_clean_scrub_stamp":"2023-07-05T23:35:37.856826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:47:38.944891+0000","scrub_duration":0.001391553,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"30'36","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:51.627133+0000","last_change":"2023-07-05T23:35:51.627180+0000","last_active":"2023-07-05T23:35:51.627133+0000","last_peered":"2023-07-05T23:35:51.627133+0000","last_clean":"2023-07-05T23:35:51.627133+0000","last_became_active":"2023-07-05T23:32:53.346373+0000","last_became_peered":"2023-07-05T23:32:53.346373+0000","last_unstale":"2023-07-05T23:35:51.627133+0000","last_undegraded":"2023-07-05T23:35:51.627133+0000","last_fullsized":"2023-07-05T23:35:51.627133+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'36","last_scrub_stamp":"2023-07-05T23:35:51.627048+0000","last_deep_scrub":"30'36","last_deep_scrub_stamp":"2023-07-05T23:35:51.627048+0000","last_clean_scrub_stamp":"2023-07-05T23:35:51.627048+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:58:20.483169+0000","scrub_duration":0.0018575690000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"30'483","reported_seq":510,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:53.603528+0000","last_change":"2023-07-05T23:35:53.603599+0000","last_active":"2023-07-05T23:35:53.603528+0000","last_peered":"2023-07-05T23:35:53.603528+0000","last_clean":"2023-07-05T23:35:53.603528+0000","last_became_active":"2023-07-05T23:32:57.365200+0000","last_became_peered":"2023-07-05T23:32:57.365200+0000","last_unstale":"2023-07-05T23:35:53.603528+0000","last_undegraded":"2023-07-05T23:35:53.603528+0000","last_fullsized":"2023-07-05T23:35:53.603528+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'483","last_scrub_stamp":"2023-07-05T23:35:53.603424+0000","last_deep_scrub":"30'483","last_deep_scrub_stamp":"2023-07-05T23:35:53.603424+0000","last_clean_scrub_stamp":"2023-07-05T23:35:53.603424+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:49:51.973696+0000","scrub_duration":0.002277004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"30'14","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:43.257611+0000","last_change":"2023-07-05T23:35:43.257685+0000","last_active":"2023-07-05T23:35:43.257611+0000","last_peered":"2023-07-05T23:35:43.257611+0000","last_clean":"2023-07-05T23:35:43.257611+0000","last_became_active":"2023-07-05T23:32:52.912749+0000","last_became_peered":"2023-07-05T23:32:52.912749+0000","last_unstale":"2023-07-05T23:35:43.257611+0000","last_undegraded":"2023-07-05T23:35:43.257611+0000","last_fullsized":"2023-07-05T23:35:43.257611+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'14","last_scrub_stamp":"2023-07-05T23:35:43.257470+0000","last_deep_scrub":"30'14","last_deep_scrub_stamp":"2023-07-05T23:35:43.257470+0000","last_clean_scrub_stamp":"2023-07-05T23:35:43.257470+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:13:19.970455+0000","scrub_duration":0.0041172719999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"30'42","reported_seq":75,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:41.629692+0000","last_change":"2023-07-05T23:35:41.629741+0000","last_active":"2023-07-05T23:35:41.629692+0000","last_peered":"2023-07-05T23:35:41.629692+0000","last_clean":"2023-07-05T23:35:41.629692+0000","last_became_active":"2023-07-05T23:32:53.339001+0000","last_became_peered":"2023-07-05T23:32:53.339001+0000","last_unstale":"2023-07-05T23:35:41.629692+0000","last_undegraded":"2023-07-05T23:35:41.629692+0000","last_fullsized":"2023-07-05T23:35:41.629692+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'42","last_scrub_stamp":"2023-07-05T23:35:41.629594+0000","last_deep_scrub":"30'42","last_deep_scrub_stamp":"2023-07-05T23:35:41.629594+0000","last_clean_scrub_stamp":"2023-07-05T23:35:41.629594+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:24:01.490655+0000","scrub_duration":0.0017554409999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"30'476","reported_seq":503,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:50.657476+0000","last_change":"2023-07-05T23:35:50.657546+0000","last_active":"2023-07-05T23:35:50.657476+0000","last_peered":"2023-07-05T23:35:50.657476+0000","last_clean":"2023-07-05T23:35:50.657476+0000","last_became_active":"2023-07-05T23:32:57.353848+0000","last_became_peered":"2023-07-05T23:32:57.353848+0000","last_unstale":"2023-07-05T23:35:50.657476+0000","last_undegraded":"2023-07-05T23:35:50.657476+0000","last_fullsized":"2023-07-05T23:35:50.657476+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'476","last_scrub_stamp":"2023-07-05T23:35:50.657366+0000","last_deep_scrub":"30'476","last_deep_scrub_stamp":"2023-07-05T23:35:50.657366+0000","last_clean_scrub_stamp":"2023-07-05T23:35:50.657366+0000","objects_scrubbed":0,"log_size":476,"log_dups_size":0,"ondisk_log_size":476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:59:33.017524+0000","scrub_duration":0.00215351,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"30'402","reported_seq":437,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:43.308198+0000","last_change":"2023-07-05T23:35:43.308282+0000","last_active":"2023-07-05T23:35:43.308198+0000","last_peered":"2023-07-05T23:35:43.308198+0000","last_clean":"2023-07-05T23:35:43.308198+0000","last_became_active":"2023-07-05T23:32:52.904318+0000","last_became_peered":"2023-07-05T23:32:52.904318+0000","last_unstale":"2023-07-05T23:35:43.308198+0000","last_undegraded":"2023-07-05T23:35:43.308198+0000","last_fullsized":"2023-07-05T23:35:43.308198+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'402","last_scrub_stamp":"2023-07-05T23:35:43.308095+0000","last_deep_scrub":"30'402","last_deep_scrub_stamp":"2023-07-05T23:35:43.308095+0000","last_clean_scrub_stamp":"2023-07-05T23:35:43.308095+0000","objects_scrubbed":4,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:30:38.723647+0000","scrub_duration":0.0079608939999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1528715,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":399,"num_write_kb":1765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"30'41","reported_seq":74,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:38.344828+0000","last_change":"2023-07-05T23:35:38.344911+0000","last_active":"2023-07-05T23:35:38.344828+0000","last_peered":"2023-07-05T23:35:38.344828+0000","last_clean":"2023-07-05T23:35:38.344828+0000","last_became_active":"2023-07-05T23:32:53.339583+0000","last_became_peered":"2023-07-05T23:32:53.339583+0000","last_unstale":"2023-07-05T23:35:38.344828+0000","last_undegraded":"2023-07-05T23:35:38.344828+0000","last_fullsized":"2023-07-05T23:35:38.344828+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'41","last_scrub_stamp":"2023-07-05T23:35:38.344698+0000","last_deep_scrub":"30'41","last_deep_scrub_stamp":"2023-07-05T23:35:38.344698+0000","last_clean_scrub_stamp":"2023-07-05T23:35:38.344698+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:55:53.973802+0000","scrub_duration":0.001677949,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"30'441","reported_seq":468,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:50.781752+0000","last_change":"2023-07-05T23:35:50.781816+0000","last_active":"2023-07-05T23:35:50.781752+0000","last_peered":"2023-07-05T23:35:50.781752+0000","last_clean":"2023-07-05T23:35:50.781752+0000","last_became_active":"2023-07-05T23:32:57.365204+0000","last_became_peered":"2023-07-05T23:32:57.365204+0000","last_unstale":"2023-07-05T23:35:50.781752+0000","last_undegraded":"2023-07-05T23:35:50.781752+0000","last_fullsized":"2023-07-05T23:35:50.781752+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'441","last_scrub_stamp":"2023-07-05T23:35:50.781660+0000","last_deep_scrub":"30'441","last_deep_scrub_stamp":"2023-07-05T23:35:50.781660+0000","last_clean_scrub_stamp":"2023-07-05T23:35:50.781660+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:58:19.637781+0000","scrub_duration":0.0024078680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"30'5","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:45.290604+0000","last_change":"2023-07-05T23:35:45.290655+0000","last_active":"2023-07-05T23:35:45.290604+0000","last_peered":"2023-07-05T23:35:45.290604+0000","last_clean":"2023-07-05T23:35:45.290604+0000","last_became_active":"2023-07-05T23:32:52.907970+0000","last_became_peered":"2023-07-05T23:32:52.907970+0000","last_unstale":"2023-07-05T23:35:45.290604+0000","last_undegraded":"2023-07-05T23:35:45.290604+0000","last_fullsized":"2023-07-05T23:35:45.290604+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'5","last_scrub_stamp":"2023-07-05T23:35:45.290514+0000","last_deep_scrub":"30'5","last_deep_scrub_stamp":"2023-07-05T23:35:45.290514+0000","last_clean_scrub_stamp":"2023-07-05T23:35:45.290514+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:14:55.311137+0000","scrub_duration":0.003099306,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"30'29","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:27.578398+0000","last_change":"2023-07-05T23:35:27.578448+0000","last_active":"2023-07-05T23:35:27.578398+0000","last_peered":"2023-07-05T23:35:27.578398+0000","last_clean":"2023-07-05T23:35:27.578398+0000","last_became_active":"2023-07-05T23:32:53.339827+0000","last_became_peered":"2023-07-05T23:32:53.339827+0000","last_unstale":"2023-07-05T23:35:27.578398+0000","last_undegraded":"2023-07-05T23:35:27.578398+0000","last_fullsized":"2023-07-05T23:35:27.578398+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'29","last_scrub_stamp":"2023-07-05T23:35:27.578299+0000","last_deep_scrub":"30'29","last_deep_scrub_stamp":"2023-07-05T23:35:27.578299+0000","last_clean_scrub_stamp":"2023-07-05T23:35:27.578299+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:27:34.593533+0000","scrub_duration":0.0015027510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"30'475","reported_seq":502,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:57.600364+0000","last_change":"2023-07-05T23:35:57.600491+0000","last_active":"2023-07-05T23:35:57.600364+0000","last_peered":"2023-07-05T23:35:57.600364+0000","last_clean":"2023-07-05T23:35:57.600364+0000","last_became_active":"2023-07-05T23:32:57.354235+0000","last_became_peered":"2023-07-05T23:32:57.354235+0000","last_unstale":"2023-07-05T23:35:57.600364+0000","last_undegraded":"2023-07-05T23:35:57.600364+0000","last_fullsized":"2023-07-05T23:35:57.600364+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'475","last_scrub_stamp":"2023-07-05T23:35:57.600234+0000","last_deep_scrub":"30'475","last_deep_scrub_stamp":"2023-07-05T23:35:57.600234+0000","last_clean_scrub_stamp":"2023-07-05T23:35:57.600234+0000","objects_scrubbed":1,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:15:15.250763+0000","scrub_duration":0.0074268889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:31.639525+0000","last_change":"2023-07-05T23:35:31.639611+0000","last_active":"2023-07-05T23:35:31.639525+0000","last_peered":"2023-07-05T23:35:31.639525+0000","last_clean":"2023-07-05T23:35:31.639525+0000","last_became_active":"2023-07-05T23:32:52.900387+0000","last_became_peered":"2023-07-05T23:32:52.900387+0000","last_unstale":"2023-07-05T23:35:31.639525+0000","last_undegraded":"2023-07-05T23:35:31.639525+0000","last_fullsized":"2023-07-05T23:35:31.639525+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:35:31.639414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:35:31.639414+0000","last_clean_scrub_stamp":"2023-07-05T23:35:31.639414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:02:15.113328+0000","scrub_duration":0.0019919690000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"30'33","reported_seq":66,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:44.792740+0000","last_change":"2023-07-05T23:35:44.792823+0000","last_active":"2023-07-05T23:35:44.792740+0000","last_peered":"2023-07-05T23:35:44.792740+0000","last_clean":"2023-07-05T23:35:44.792740+0000","last_became_active":"2023-07-05T23:32:53.335513+0000","last_became_peered":"2023-07-05T23:32:53.335513+0000","last_unstale":"2023-07-05T23:35:44.792740+0000","last_undegraded":"2023-07-05T23:35:44.792740+0000","last_fullsized":"2023-07-05T23:35:44.792740+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'33","last_scrub_stamp":"2023-07-05T23:35:44.792639+0000","last_deep_scrub":"30'33","last_deep_scrub_stamp":"2023-07-05T23:35:44.792639+0000","last_clean_scrub_stamp":"2023-07-05T23:35:44.792639+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:22:21.562681+0000","scrub_duration":0.0015213340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"30'450","reported_seq":477,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:52.614119+0000","last_change":"2023-07-05T23:35:52.614243+0000","last_active":"2023-07-05T23:35:52.614119+0000","last_peered":"2023-07-05T23:35:52.614119+0000","last_clean":"2023-07-05T23:35:52.614119+0000","last_became_active":"2023-07-05T23:32:57.362407+0000","last_became_peered":"2023-07-05T23:32:57.362407+0000","last_unstale":"2023-07-05T23:35:52.614119+0000","last_undegraded":"2023-07-05T23:35:52.614119+0000","last_fullsized":"2023-07-05T23:35:52.614119+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'450","last_scrub_stamp":"2023-07-05T23:35:52.614000+0000","last_deep_scrub":"30'450","last_deep_scrub_stamp":"2023-07-05T23:35:52.614000+0000","last_clean_scrub_stamp":"2023-07-05T23:35:52.614000+0000","objects_scrubbed":1,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:48:33.030564+0000","scrub_duration":0.0068755639999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"30'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:42.252627+0000","last_change":"2023-07-05T23:35:42.252721+0000","last_active":"2023-07-05T23:35:42.252627+0000","last_peered":"2023-07-05T23:35:42.252627+0000","last_clean":"2023-07-05T23:35:42.252627+0000","last_became_active":"2023-07-05T23:32:52.905595+0000","last_became_peered":"2023-07-05T23:32:52.905595+0000","last_unstale":"2023-07-05T23:35:42.252627+0000","last_undegraded":"2023-07-05T23:35:42.252627+0000","last_fullsized":"2023-07-05T23:35:42.252627+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2023-07-05T23:35:42.252504+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2023-07-05T23:35:42.252504+0000","last_clean_scrub_stamp":"2023-07-05T23:35:42.252504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:58:36.662409+0000","scrub_duration":0.0015537260000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"30'40","reported_seq":73,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:53.637883+0000","last_change":"2023-07-05T23:35:53.637930+0000","last_active":"2023-07-05T23:35:53.637883+0000","last_peered":"2023-07-05T23:35:53.637883+0000","last_clean":"2023-07-05T23:35:53.637883+0000","last_became_active":"2023-07-05T23:32:53.342033+0000","last_became_peered":"2023-07-05T23:32:53.342033+0000","last_unstale":"2023-07-05T23:35:53.637883+0000","last_undegraded":"2023-07-05T23:35:53.637883+0000","last_fullsized":"2023-07-05T23:35:53.637883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'40","last_scrub_stamp":"2023-07-05T23:35:53.637796+0000","last_deep_scrub":"30'40","last_deep_scrub_stamp":"2023-07-05T23:35:53.637796+0000","last_clean_scrub_stamp":"2023-07-05T23:35:53.637796+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:58:47.252971+0000","scrub_duration":0.001377063,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"30'495","reported_seq":522,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:56.801854+0000","last_change":"2023-07-05T23:35:56.801956+0000","last_active":"2023-07-05T23:35:56.801854+0000","last_peered":"2023-07-05T23:35:56.801854+0000","last_clean":"2023-07-05T23:35:56.801854+0000","last_became_active":"2023-07-05T23:32:57.359532+0000","last_became_peered":"2023-07-05T23:32:57.359532+0000","last_unstale":"2023-07-05T23:35:56.801854+0000","last_undegraded":"2023-07-05T23:35:56.801854+0000","last_fullsized":"2023-07-05T23:35:56.801854+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'495","last_scrub_stamp":"2023-07-05T23:35:56.801731+0000","last_deep_scrub":"30'495","last_deep_scrub_stamp":"2023-07-05T23:35:56.801731+0000","last_clean_scrub_stamp":"2023-07-05T23:35:56.801731+0000","objects_scrubbed":1,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:15:14.452259+0000","scrub_duration":0.0064926660000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":46080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"30'12","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:27.409720+0000","last_change":"2023-07-05T23:35:27.409779+0000","last_active":"2023-07-05T23:35:27.409720+0000","last_peered":"2023-07-05T23:35:27.409720+0000","last_clean":"2023-07-05T23:35:27.409720+0000","last_became_active":"2023-07-05T23:32:52.903419+0000","last_became_peered":"2023-07-05T23:32:52.903419+0000","last_unstale":"2023-07-05T23:35:27.409720+0000","last_undegraded":"2023-07-05T23:35:27.409720+0000","last_fullsized":"2023-07-05T23:35:27.409720+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'12","last_scrub_stamp":"2023-07-05T23:35:27.409640+0000","last_deep_scrub":"30'12","last_deep_scrub_stamp":"2023-07-05T23:35:27.409640+0000","last_clean_scrub_stamp":"2023-07-05T23:35:27.409640+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:48:23.989282+0000","scrub_duration":0.0045973059999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"30'32","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:25.668033+0000","last_change":"2023-07-05T23:35:25.668080+0000","last_active":"2023-07-05T23:35:25.668033+0000","last_peered":"2023-07-05T23:35:25.668033+0000","last_clean":"2023-07-05T23:35:25.668033+0000","last_became_active":"2023-07-05T23:32:53.341162+0000","last_became_peered":"2023-07-05T23:32:53.341162+0000","last_unstale":"2023-07-05T23:35:25.668033+0000","last_undegraded":"2023-07-05T23:35:25.668033+0000","last_fullsized":"2023-07-05T23:35:25.668033+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-07-05T23:35:25.667940+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-07-05T23:35:25.667940+0000","last_clean_scrub_stamp":"2023-07-05T23:35:25.667940+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:02:09.141854+0000","scrub_duration":0.0023076949999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"30'445","reported_seq":472,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:36:07.409609+0000","last_change":"2023-07-05T23:36:07.409742+0000","last_active":"2023-07-05T23:36:07.409609+0000","last_peered":"2023-07-05T23:36:07.409609+0000","last_clean":"2023-07-05T23:36:07.409609+0000","last_became_active":"2023-07-05T23:32:57.357082+0000","last_became_peered":"2023-07-05T23:32:57.357082+0000","last_unstale":"2023-07-05T23:36:07.409609+0000","last_undegraded":"2023-07-05T23:36:07.409609+0000","last_fullsized":"2023-07-05T23:36:07.409609+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'445","last_scrub_stamp":"2023-07-05T23:36:07.409487+0000","last_deep_scrub":"30'445","last_deep_scrub_stamp":"2023-07-05T23:36:07.409487+0000","last_clean_scrub_stamp":"2023-07-05T23:36:07.409487+0000","objects_scrubbed":3,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:56:23.038591+0000","scrub_duration":0.014890028,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"30'2","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:27.155588+0000","last_change":"2023-07-05T23:35:27.155648+0000","last_active":"2023-07-05T23:35:27.155588+0000","last_peered":"2023-07-05T23:35:27.155588+0000","last_clean":"2023-07-05T23:35:27.155588+0000","last_became_active":"2023-07-05T23:32:52.907397+0000","last_became_peered":"2023-07-05T23:32:52.907397+0000","last_unstale":"2023-07-05T23:35:27.155588+0000","last_undegraded":"2023-07-05T23:35:27.155588+0000","last_fullsized":"2023-07-05T23:35:27.155588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2023-07-05T23:35:27.155474+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2023-07-05T23:35:27.155474+0000","last_clean_scrub_stamp":"2023-07-05T23:35:27.155474+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:58:59.604184+0000","scrub_duration":0.00301433,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"30'29","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:24.804906+0000","last_change":"2023-07-05T23:35:24.804959+0000","last_active":"2023-07-05T23:35:24.804906+0000","last_peered":"2023-07-05T23:35:24.804906+0000","last_clean":"2023-07-05T23:35:24.804906+0000","last_became_active":"2023-07-05T23:32:53.333978+0000","last_became_peered":"2023-07-05T23:32:53.333978+0000","last_unstale":"2023-07-05T23:35:24.804906+0000","last_undegraded":"2023-07-05T23:35:24.804906+0000","last_fullsized":"2023-07-05T23:35:24.804906+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'29","last_scrub_stamp":"2023-07-05T23:35:24.804794+0000","last_deep_scrub":"30'29","last_deep_scrub_stamp":"2023-07-05T23:35:24.804794+0000","last_clean_scrub_stamp":"2023-07-05T23:35:24.804794+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:02:08.278708+0000","scrub_duration":0.001601922,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"30'423","reported_seq":450,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:50.138538+0000","last_change":"2023-07-05T23:35:50.138658+0000","last_active":"2023-07-05T23:35:50.138538+0000","last_peered":"2023-07-05T23:35:50.138538+0000","last_clean":"2023-07-05T23:35:50.138538+0000","last_became_active":"2023-07-05T23:32:57.361892+0000","last_became_peered":"2023-07-05T23:32:57.361892+0000","last_unstale":"2023-07-05T23:35:50.138538+0000","last_undegraded":"2023-07-05T23:35:50.138538+0000","last_fullsized":"2023-07-05T23:35:50.138538+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'423","last_scrub_stamp":"2023-07-05T23:35:50.138422+0000","last_deep_scrub":"30'423","last_deep_scrub_stamp":"2023-07-05T23:35:50.138422+0000","last_clean_scrub_stamp":"2023-07-05T23:35:50.138422+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:11:32.924812+0000","scrub_duration":0.0023489349999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"30'3","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:48.318102+0000","last_change":"2023-07-05T23:35:48.318154+0000","last_active":"2023-07-05T23:35:48.318102+0000","last_peered":"2023-07-05T23:35:48.318102+0000","last_clean":"2023-07-05T23:35:48.318102+0000","last_became_active":"2023-07-05T23:32:52.907975+0000","last_became_peered":"2023-07-05T23:32:52.907975+0000","last_unstale":"2023-07-05T23:35:48.318102+0000","last_undegraded":"2023-07-05T23:35:48.318102+0000","last_fullsized":"2023-07-05T23:35:48.318102+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2023-07-05T23:35:48.318009+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2023-07-05T23:35:48.318009+0000","last_clean_scrub_stamp":"2023-07-05T23:35:48.318009+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:55:42.390822+0000","scrub_duration":0.0027735860000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"30'32","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:36:02.525961+0000","last_change":"2023-07-05T23:36:02.526009+0000","last_active":"2023-07-05T23:36:02.525961+0000","last_peered":"2023-07-05T23:36:02.525961+0000","last_clean":"2023-07-05T23:36:02.525961+0000","last_became_active":"2023-07-05T23:32:53.339543+0000","last_became_peered":"2023-07-05T23:32:53.339543+0000","last_unstale":"2023-07-05T23:36:02.525961+0000","last_undegraded":"2023-07-05T23:36:02.525961+0000","last_fullsized":"2023-07-05T23:36:02.525961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-07-05T23:36:02.525863+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-07-05T23:36:02.525863+0000","last_clean_scrub_stamp":"2023-07-05T23:36:02.525863+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:11:35.060811+0000","scrub_duration":0.0021218999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"30'472","reported_seq":499,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:54.120168+0000","last_change":"2023-07-05T23:35:54.120297+0000","last_active":"2023-07-05T23:35:54.120168+0000","last_peered":"2023-07-05T23:35:54.120168+0000","last_clean":"2023-07-05T23:35:54.120168+0000","last_became_active":"2023-07-05T23:32:57.360614+0000","last_became_peered":"2023-07-05T23:32:57.360614+0000","last_unstale":"2023-07-05T23:35:54.120168+0000","last_undegraded":"2023-07-05T23:35:54.120168+0000","last_fullsized":"2023-07-05T23:35:54.120168+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'472","last_scrub_stamp":"2023-07-05T23:35:54.119957+0000","last_deep_scrub":"30'472","last_deep_scrub_stamp":"2023-07-05T23:35:54.119957+0000","last_clean_scrub_stamp":"2023-07-05T23:35:54.119957+0000","objects_scrubbed":2,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:25:06.383829+0000","scrub_duration":0.01146981,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"30'2","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:47.312152+0000","last_change":"2023-07-05T23:35:47.312205+0000","last_active":"2023-07-05T23:35:47.312152+0000","last_peered":"2023-07-05T23:35:47.312152+0000","last_clean":"2023-07-05T23:35:47.312152+0000","last_became_active":"2023-07-05T23:32:52.907441+0000","last_became_peered":"2023-07-05T23:32:52.907441+0000","last_unstale":"2023-07-05T23:35:47.312152+0000","last_undegraded":"2023-07-05T23:35:47.312152+0000","last_fullsized":"2023-07-05T23:35:47.312152+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2023-07-05T23:35:47.312050+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2023-07-05T23:35:47.312050+0000","last_clean_scrub_stamp":"2023-07-05T23:35:47.312050+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:44:29.196719+0000","scrub_duration":0.0028692190000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"30'32","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:38.470273+0000","last_change":"2023-07-05T23:35:38.470324+0000","last_active":"2023-07-05T23:35:38.470273+0000","last_peered":"2023-07-05T23:35:38.470273+0000","last_clean":"2023-07-05T23:35:38.470273+0000","last_became_active":"2023-07-05T23:32:53.343566+0000","last_became_peered":"2023-07-05T23:32:53.343566+0000","last_unstale":"2023-07-05T23:35:38.470273+0000","last_undegraded":"2023-07-05T23:35:38.470273+0000","last_fullsized":"2023-07-05T23:35:38.470273+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-07-05T23:35:38.470192+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-07-05T23:35:38.470192+0000","last_clean_scrub_stamp":"2023-07-05T23:35:38.470192+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:00:40.790153+0000","scrub_duration":0.0021110870000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"30'486","reported_seq":513,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:41.144469+0000","last_change":"2023-07-05T23:35:41.144576+0000","last_active":"2023-07-05T23:35:41.144469+0000","last_peered":"2023-07-05T23:35:41.144469+0000","last_clean":"2023-07-05T23:35:41.144469+0000","last_became_active":"2023-07-05T23:32:57.356091+0000","last_became_peered":"2023-07-05T23:32:57.356091+0000","last_unstale":"2023-07-05T23:35:41.144469+0000","last_undegraded":"2023-07-05T23:35:41.144469+0000","last_fullsized":"2023-07-05T23:35:41.144469+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'486","last_scrub_stamp":"2023-07-05T23:35:41.144349+0000","last_deep_scrub":"30'486","last_deep_scrub_stamp":"2023-07-05T23:35:41.144349+0000","last_clean_scrub_stamp":"2023-07-05T23:35:41.144349+0000","objects_scrubbed":0,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:00:43.464311+0000","scrub_duration":0.0026373849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"30'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:32.851440+0000","last_change":"2023-07-05T23:35:32.851538+0000","last_active":"2023-07-05T23:35:32.851440+0000","last_peered":"2023-07-05T23:35:32.851440+0000","last_clean":"2023-07-05T23:35:32.851440+0000","last_became_active":"2023-07-05T23:32:52.905988+0000","last_became_peered":"2023-07-05T23:32:52.905988+0000","last_unstale":"2023-07-05T23:35:32.851440+0000","last_undegraded":"2023-07-05T23:35:32.851440+0000","last_fullsized":"2023-07-05T23:35:32.851440+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2023-07-05T23:35:32.851307+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2023-07-05T23:35:32.851307+0000","last_clean_scrub_stamp":"2023-07-05T23:35:32.851307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:23:52.712368+0000","scrub_duration":0.00186185,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"30'32","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:24.662045+0000","last_change":"2023-07-05T23:35:24.662084+0000","last_active":"2023-07-05T23:35:24.662045+0000","last_peered":"2023-07-05T23:35:24.662045+0000","last_clean":"2023-07-05T23:35:24.662045+0000","last_became_active":"2023-07-05T23:32:53.339382+0000","last_became_peered":"2023-07-05T23:32:53.339382+0000","last_unstale":"2023-07-05T23:35:24.662045+0000","last_undegraded":"2023-07-05T23:35:24.662045+0000","last_fullsized":"2023-07-05T23:35:24.662045+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-07-05T23:35:24.661961+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-07-05T23:35:24.661961+0000","last_clean_scrub_stamp":"2023-07-05T23:35:24.661961+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:58:57.110671+0000","scrub_duration":0.0012445749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"30'472","reported_seq":499,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:45.141454+0000","last_change":"2023-07-05T23:35:45.141553+0000","last_active":"2023-07-05T23:35:45.141454+0000","last_peered":"2023-07-05T23:35:45.141454+0000","last_clean":"2023-07-05T23:35:45.141454+0000","last_became_active":"2023-07-05T23:32:57.354576+0000","last_became_peered":"2023-07-05T23:32:57.354576+0000","last_unstale":"2023-07-05T23:35:45.141454+0000","last_undegraded":"2023-07-05T23:35:45.141454+0000","last_fullsized":"2023-07-05T23:35:45.141454+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'472","last_scrub_stamp":"2023-07-05T23:35:45.141356+0000","last_deep_scrub":"30'472","last_deep_scrub_stamp":"2023-07-05T23:35:45.141356+0000","last_clean_scrub_stamp":"2023-07-05T23:35:45.141356+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:45:05.827792+0000","scrub_duration":0.002439751,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":27648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"30'5","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:30.548358+0000","last_change":"2023-07-05T23:35:30.548410+0000","last_active":"2023-07-05T23:35:30.548358+0000","last_peered":"2023-07-05T23:35:30.548358+0000","last_clean":"2023-07-05T23:35:30.548358+0000","last_became_active":"2023-07-05T23:32:52.906187+0000","last_became_peered":"2023-07-05T23:32:52.906187+0000","last_unstale":"2023-07-05T23:35:30.548358+0000","last_undegraded":"2023-07-05T23:35:30.548358+0000","last_fullsized":"2023-07-05T23:35:30.548358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'5","last_scrub_stamp":"2023-07-05T23:35:30.548235+0000","last_deep_scrub":"30'5","last_deep_scrub_stamp":"2023-07-05T23:35:30.548235+0000","last_clean_scrub_stamp":"2023-07-05T23:35:30.548235+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:06:48.971667+0000","scrub_duration":0.0031165590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"30'27","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:36.389104+0000","last_change":"2023-07-05T23:35:36.389175+0000","last_active":"2023-07-05T23:35:36.389104+0000","last_peered":"2023-07-05T23:35:36.389104+0000","last_clean":"2023-07-05T23:35:36.389104+0000","last_became_active":"2023-07-05T23:32:53.343393+0000","last_became_peered":"2023-07-05T23:32:53.343393+0000","last_unstale":"2023-07-05T23:35:36.389104+0000","last_undegraded":"2023-07-05T23:35:36.389104+0000","last_fullsized":"2023-07-05T23:35:36.389104+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'27","last_scrub_stamp":"2023-07-05T23:35:36.388980+0000","last_deep_scrub":"30'27","last_deep_scrub_stamp":"2023-07-05T23:35:36.388980+0000","last_clean_scrub_stamp":"2023-07-05T23:35:36.388980+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:48:16.805544+0000","scrub_duration":0.0021672190000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"30'457","reported_seq":484,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:51.707975+0000","last_change":"2023-07-05T23:35:51.708100+0000","last_active":"2023-07-05T23:35:51.707975+0000","last_peered":"2023-07-05T23:35:51.707975+0000","last_clean":"2023-07-05T23:35:51.707975+0000","last_became_active":"2023-07-05T23:32:57.362431+0000","last_became_peered":"2023-07-05T23:32:57.362431+0000","last_unstale":"2023-07-05T23:35:51.707975+0000","last_undegraded":"2023-07-05T23:35:51.707975+0000","last_fullsized":"2023-07-05T23:35:51.707975+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'457","last_scrub_stamp":"2023-07-05T23:35:51.707863+0000","last_deep_scrub":"30'457","last_deep_scrub_stamp":"2023-07-05T23:35:51.707863+0000","last_clean_scrub_stamp":"2023-07-05T23:35:51.707863+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:22:28.477905+0000","scrub_duration":0.0021919309999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"30'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:28.449465+0000","last_change":"2023-07-05T23:35:28.449517+0000","last_active":"2023-07-05T23:35:28.449465+0000","last_peered":"2023-07-05T23:35:28.449465+0000","last_clean":"2023-07-05T23:35:28.449465+0000","last_became_active":"2023-07-05T23:32:52.907983+0000","last_became_peered":"2023-07-05T23:32:52.907983+0000","last_unstale":"2023-07-05T23:35:28.449465+0000","last_undegraded":"2023-07-05T23:35:28.449465+0000","last_fullsized":"2023-07-05T23:35:28.449465+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2023-07-05T23:35:28.449359+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2023-07-05T23:35:28.449359+0000","last_clean_scrub_stamp":"2023-07-05T23:35:28.449359+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:35:25.750621+0000","scrub_duration":0.001700666,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"30'30","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:35.360758+0000","last_change":"2023-07-05T23:35:35.360814+0000","last_active":"2023-07-05T23:35:35.360758+0000","last_peered":"2023-07-05T23:35:35.360758+0000","last_clean":"2023-07-05T23:35:35.360758+0000","last_became_active":"2023-07-05T23:32:53.338903+0000","last_became_peered":"2023-07-05T23:32:53.338903+0000","last_unstale":"2023-07-05T23:35:35.360758+0000","last_undegraded":"2023-07-05T23:35:35.360758+0000","last_fullsized":"2023-07-05T23:35:35.360758+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'30","last_scrub_stamp":"2023-07-05T23:35:35.360651+0000","last_deep_scrub":"30'30","last_deep_scrub_stamp":"2023-07-05T23:35:35.360651+0000","last_clean_scrub_stamp":"2023-07-05T23:35:35.360651+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:58:04.216771+0000","scrub_duration":0.001803224,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'492","reported_seq":519,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:52.842638+0000","last_change":"2023-07-05T23:35:52.842710+0000","last_active":"2023-07-05T23:35:52.842638+0000","last_peered":"2023-07-05T23:35:52.842638+0000","last_clean":"2023-07-05T23:35:52.842638+0000","last_became_active":"2023-07-05T23:32:57.356611+0000","last_became_peered":"2023-07-05T23:32:57.356611+0000","last_unstale":"2023-07-05T23:35:52.842638+0000","last_undegraded":"2023-07-05T23:35:52.842638+0000","last_fullsized":"2023-07-05T23:35:52.842638+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'492","last_scrub_stamp":"2023-07-05T23:35:52.842519+0000","last_deep_scrub":"30'492","last_deep_scrub_stamp":"2023-07-05T23:35:52.842519+0000","last_clean_scrub_stamp":"2023-07-05T23:35:52.842519+0000","objects_scrubbed":1,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:49:51.212791+0000","scrub_duration":0.0070507490000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":51200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:45.280959+0000","last_change":"2023-07-05T23:35:45.281054+0000","last_active":"2023-07-05T23:35:45.280959+0000","last_peered":"2023-07-05T23:35:45.280959+0000","last_clean":"2023-07-05T23:35:45.280959+0000","last_became_active":"2023-07-05T23:32:52.906779+0000","last_became_peered":"2023-07-05T23:32:52.906779+0000","last_unstale":"2023-07-05T23:35:45.280959+0000","last_undegraded":"2023-07-05T23:35:45.280959+0000","last_fullsized":"2023-07-05T23:35:45.280959+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:35:45.280812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:35:45.280812+0000","last_clean_scrub_stamp":"2023-07-05T23:35:45.280812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:51:49.240572+0000","scrub_duration":0.0016633380000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"30'17","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:23.577489+0000","last_change":"2023-07-05T23:35:23.577540+0000","last_active":"2023-07-05T23:35:23.577489+0000","last_peered":"2023-07-05T23:35:23.577489+0000","last_clean":"2023-07-05T23:35:23.577489+0000","last_became_active":"2023-07-05T23:32:53.339869+0000","last_became_peered":"2023-07-05T23:32:53.339869+0000","last_unstale":"2023-07-05T23:35:23.577489+0000","last_undegraded":"2023-07-05T23:35:23.577489+0000","last_fullsized":"2023-07-05T23:35:23.577489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'17","last_scrub_stamp":"2023-07-05T23:35:23.577389+0000","last_deep_scrub":"30'17","last_deep_scrub_stamp":"2023-07-05T23:35:23.577389+0000","last_clean_scrub_stamp":"2023-07-05T23:35:23.577389+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:47:24.665455+0000","scrub_duration":0.0013589629999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"30'497","reported_seq":524,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:36:19.703789+0000","last_change":"2023-07-05T23:36:19.703858+0000","last_active":"2023-07-05T23:36:19.703789+0000","last_peered":"2023-07-05T23:36:19.703789+0000","last_clean":"2023-07-05T23:36:19.703789+0000","last_became_active":"2023-07-05T23:32:57.363409+0000","last_became_peered":"2023-07-05T23:32:57.363409+0000","last_unstale":"2023-07-05T23:36:19.703789+0000","last_undegraded":"2023-07-05T23:36:19.703789+0000","last_fullsized":"2023-07-05T23:36:19.703789+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'497","last_scrub_stamp":"2023-07-05T23:36:19.703692+0000","last_deep_scrub":"30'497","last_deep_scrub_stamp":"2023-07-05T23:36:19.703692+0000","last_clean_scrub_stamp":"2023-07-05T23:36:19.703692+0000","objects_scrubbed":0,"log_size":497,"log_dups_size":0,"ondisk_log_size":497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:10:44.101467+0000","scrub_duration":0.0024795989999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:35.704543+0000","last_change":"2023-07-05T23:35:35.704595+0000","last_active":"2023-07-05T23:35:35.704543+0000","last_peered":"2023-07-05T23:35:35.704543+0000","last_clean":"2023-07-05T23:35:35.704543+0000","last_became_active":"2023-07-05T23:32:52.909169+0000","last_became_peered":"2023-07-05T23:32:52.909169+0000","last_unstale":"2023-07-05T23:35:35.704543+0000","last_undegraded":"2023-07-05T23:35:35.704543+0000","last_fullsized":"2023-07-05T23:35:35.704543+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:35:35.704430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:35:35.704430+0000","last_clean_scrub_stamp":"2023-07-05T23:35:35.704430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:47:31.633741+0000","scrub_duration":0.0014660249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"30'28","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:46.648910+0000","last_change":"2023-07-05T23:35:46.648958+0000","last_active":"2023-07-05T23:35:46.648910+0000","last_peered":"2023-07-05T23:35:46.648910+0000","last_clean":"2023-07-05T23:35:46.648910+0000","last_became_active":"2023-07-05T23:32:53.342420+0000","last_became_peered":"2023-07-05T23:32:53.342420+0000","last_unstale":"2023-07-05T23:35:46.648910+0000","last_undegraded":"2023-07-05T23:35:46.648910+0000","last_fullsized":"2023-07-05T23:35:46.648910+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'28","last_scrub_stamp":"2023-07-05T23:35:46.648809+0000","last_deep_scrub":"30'28","last_deep_scrub_stamp":"2023-07-05T23:35:46.648809+0000","last_clean_scrub_stamp":"2023-07-05T23:35:46.648809+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:34:43.580605+0000","scrub_duration":0.001639901,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"30'504","reported_seq":531,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:54.645376+0000","last_change":"2023-07-05T23:35:54.645456+0000","last_active":"2023-07-05T23:35:54.645376+0000","last_peered":"2023-07-05T23:35:54.645376+0000","last_clean":"2023-07-05T23:35:54.645376+0000","last_became_active":"2023-07-05T23:32:57.358647+0000","last_became_peered":"2023-07-05T23:32:57.358647+0000","last_unstale":"2023-07-05T23:35:54.645376+0000","last_undegraded":"2023-07-05T23:35:54.645376+0000","last_fullsized":"2023-07-05T23:35:54.645376+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'504","last_scrub_stamp":"2023-07-05T23:35:54.645268+0000","last_deep_scrub":"30'504","last_deep_scrub_stamp":"2023-07-05T23:35:54.645268+0000","last_clean_scrub_stamp":"2023-07-05T23:35:54.645268+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:37:58.281046+0000","scrub_duration":0.0024869089999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:26.562376+0000","last_change":"2023-07-05T23:35:26.562422+0000","last_active":"2023-07-05T23:35:26.562376+0000","last_peered":"2023-07-05T23:35:26.562376+0000","last_clean":"2023-07-05T23:35:26.562376+0000","last_became_active":"2023-07-05T23:32:47.790546+0000","last_became_peered":"2023-07-05T23:32:47.790546+0000","last_unstale":"2023-07-05T23:35:26.562376+0000","last_undegraded":"2023-07-05T23:35:26.562376+0000","last_fullsized":"2023-07-05T23:35:26.562376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:35:26.562263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:35:26.562263+0000","last_clean_scrub_stamp":"2023-07-05T23:35:26.562263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:58:59.010972+0000","scrub_duration":0.0014801910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"30'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:35.839097+0000","last_change":"2023-07-05T23:35:35.839146+0000","last_active":"2023-07-05T23:35:35.839097+0000","last_peered":"2023-07-05T23:35:35.839097+0000","last_clean":"2023-07-05T23:35:35.839097+0000","last_became_active":"2023-07-05T23:32:52.912682+0000","last_became_peered":"2023-07-05T23:32:52.912682+0000","last_unstale":"2023-07-05T23:35:35.839097+0000","last_undegraded":"2023-07-05T23:35:35.839097+0000","last_fullsized":"2023-07-05T23:35:35.839097+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2023-07-05T23:35:35.838992+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2023-07-05T23:35:35.838992+0000","last_clean_scrub_stamp":"2023-07-05T23:35:35.838992+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:44:17.723660+0000","scrub_duration":0.001818807,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"30'30","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:39.577561+0000","last_change":"2023-07-05T23:35:39.577622+0000","last_active":"2023-07-05T23:35:39.577561+0000","last_peered":"2023-07-05T23:35:39.577561+0000","last_clean":"2023-07-05T23:35:39.577561+0000","last_became_active":"2023-07-05T23:32:53.335073+0000","last_became_peered":"2023-07-05T23:32:53.335073+0000","last_unstale":"2023-07-05T23:35:39.577561+0000","last_undegraded":"2023-07-05T23:35:39.577561+0000","last_fullsized":"2023-07-05T23:35:39.577561+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'30","last_scrub_stamp":"2023-07-05T23:35:39.577456+0000","last_deep_scrub":"30'30","last_deep_scrub_stamp":"2023-07-05T23:35:39.577456+0000","last_clean_scrub_stamp":"2023-07-05T23:35:39.577456+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:58:33.987361+0000","scrub_duration":0.002451389,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"30'450","reported_seq":477,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:58.780923+0000","last_change":"2023-07-05T23:35:58.781006+0000","last_active":"2023-07-05T23:35:58.780923+0000","last_peered":"2023-07-05T23:35:58.780923+0000","last_clean":"2023-07-05T23:35:58.780923+0000","last_became_active":"2023-07-05T23:32:57.368030+0000","last_became_peered":"2023-07-05T23:32:57.368030+0000","last_unstale":"2023-07-05T23:35:58.780923+0000","last_undegraded":"2023-07-05T23:35:58.780923+0000","last_fullsized":"2023-07-05T23:35:58.780923+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'450","last_scrub_stamp":"2023-07-05T23:35:58.780819+0000","last_deep_scrub":"30'450","last_deep_scrub_stamp":"2023-07-05T23:35:58.780819+0000","last_clean_scrub_stamp":"2023-07-05T23:35:58.780819+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:48:39.197384+0000","scrub_duration":0.0023398440000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:31.801037+0000","last_change":"2023-07-05T23:35:31.801102+0000","last_active":"2023-07-05T23:35:31.801037+0000","last_peered":"2023-07-05T23:35:31.801037+0000","last_clean":"2023-07-05T23:35:31.801037+0000","last_became_active":"2023-07-05T23:32:47.761996+0000","last_became_peered":"2023-07-05T23:32:47.761996+0000","last_unstale":"2023-07-05T23:35:31.801037+0000","last_undegraded":"2023-07-05T23:35:31.801037+0000","last_fullsized":"2023-07-05T23:35:31.801037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:35:31.800926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:35:31.800926+0000","last_clean_scrub_stamp":"2023-07-05T23:35:31.800926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:13:08.513911+0000","scrub_duration":0.0015452980000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:44.271904+0000","last_change":"2023-07-05T23:35:44.271952+0000","last_active":"2023-07-05T23:35:44.271904+0000","last_peered":"2023-07-05T23:35:44.271904+0000","last_clean":"2023-07-05T23:35:44.271904+0000","last_became_active":"2023-07-05T23:32:52.904202+0000","last_became_peered":"2023-07-05T23:32:52.904202+0000","last_unstale":"2023-07-05T23:35:44.271904+0000","last_undegraded":"2023-07-05T23:35:44.271904+0000","last_fullsized":"2023-07-05T23:35:44.271904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:35:44.271815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:35:44.271815+0000","last_clean_scrub_stamp":"2023-07-05T23:35:44.271815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:29:53.965209+0000","scrub_duration":0.0020349460000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"30'30","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:38.621680+0000","last_change":"2023-07-05T23:35:38.621729+0000","last_active":"2023-07-05T23:35:38.621680+0000","last_peered":"2023-07-05T23:35:38.621680+0000","last_clean":"2023-07-05T23:35:38.621680+0000","last_became_active":"2023-07-05T23:32:53.338626+0000","last_became_peered":"2023-07-05T23:32:53.338626+0000","last_unstale":"2023-07-05T23:35:38.621680+0000","last_undegraded":"2023-07-05T23:35:38.621680+0000","last_fullsized":"2023-07-05T23:35:38.621680+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'30","last_scrub_stamp":"2023-07-05T23:35:38.621586+0000","last_deep_scrub":"30'30","last_deep_scrub_stamp":"2023-07-05T23:35:38.621586+0000","last_clean_scrub_stamp":"2023-07-05T23:35:38.621586+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:06:57.045018+0000","scrub_duration":0.001417272,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"30'489","reported_seq":516,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:52.150975+0000","last_change":"2023-07-05T23:35:52.151097+0000","last_active":"2023-07-05T23:35:52.150975+0000","last_peered":"2023-07-05T23:35:52.150975+0000","last_clean":"2023-07-05T23:35:52.150975+0000","last_became_active":"2023-07-05T23:32:57.355882+0000","last_became_peered":"2023-07-05T23:32:57.355882+0000","last_unstale":"2023-07-05T23:35:52.150975+0000","last_undegraded":"2023-07-05T23:35:52.150975+0000","last_fullsized":"2023-07-05T23:35:52.150975+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'489","last_scrub_stamp":"2023-07-05T23:35:52.150821+0000","last_deep_scrub":"30'489","last_deep_scrub_stamp":"2023-07-05T23:35:52.150821+0000","last_clean_scrub_stamp":"2023-07-05T23:35:52.150821+0000","objects_scrubbed":2,"log_size":489,"log_dups_size":0,"ondisk_log_size":489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:47:18.817141+0000","scrub_duration":0.010813102,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":55296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:22.970005+0000","last_change":"2023-07-05T23:35:22.970044+0000","last_active":"2023-07-05T23:35:22.970005+0000","last_peered":"2023-07-05T23:35:22.970005+0000","last_clean":"2023-07-05T23:35:22.970005+0000","last_became_active":"2023-07-05T23:32:47.979348+0000","last_became_peered":"2023-07-05T23:32:47.979348+0000","last_unstale":"2023-07-05T23:35:22.970005+0000","last_undegraded":"2023-07-05T23:35:22.970005+0000","last_fullsized":"2023-07-05T23:35:22.970005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:35:22.969930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:35:22.969930+0000","last_clean_scrub_stamp":"2023-07-05T23:35:22.969930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:04:30.215991+0000","scrub_duration":0.0013098879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:30.605928+0000","last_change":"2023-07-05T23:35:30.605974+0000","last_active":"2023-07-05T23:35:30.605928+0000","last_peered":"2023-07-05T23:35:30.605928+0000","last_clean":"2023-07-05T23:35:30.605928+0000","last_became_active":"2023-07-05T23:32:52.907307+0000","last_became_peered":"2023-07-05T23:32:52.907307+0000","last_unstale":"2023-07-05T23:35:30.605928+0000","last_undegraded":"2023-07-05T23:35:30.605928+0000","last_fullsized":"2023-07-05T23:35:30.605928+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:35:30.605843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:35:30.605843+0000","last_clean_scrub_stamp":"2023-07-05T23:35:30.605843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:46:16.457656+0000","scrub_duration":0.0017402780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"30'29","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:43.580664+0000","last_change":"2023-07-05T23:35:43.580744+0000","last_active":"2023-07-05T23:35:43.580664+0000","last_peered":"2023-07-05T23:35:43.580664+0000","last_clean":"2023-07-05T23:35:43.580664+0000","last_became_active":"2023-07-05T23:32:53.337896+0000","last_became_peered":"2023-07-05T23:32:53.337896+0000","last_unstale":"2023-07-05T23:35:43.580664+0000","last_undegraded":"2023-07-05T23:35:43.580664+0000","last_fullsized":"2023-07-05T23:35:43.580664+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'29","last_scrub_stamp":"2023-07-05T23:35:43.580552+0000","last_deep_scrub":"30'29","last_deep_scrub_stamp":"2023-07-05T23:35:43.580552+0000","last_clean_scrub_stamp":"2023-07-05T23:35:43.580552+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:47:39.509863+0000","scrub_duration":0.001819665,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"30'478","reported_seq":505,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:36:12.296499+0000","last_change":"2023-07-05T23:36:12.296585+0000","last_active":"2023-07-05T23:36:12.296499+0000","last_peered":"2023-07-05T23:36:12.296499+0000","last_clean":"2023-07-05T23:36:12.296499+0000","last_became_active":"2023-07-05T23:32:57.355475+0000","last_became_peered":"2023-07-05T23:32:57.355475+0000","last_unstale":"2023-07-05T23:36:12.296499+0000","last_undegraded":"2023-07-05T23:36:12.296499+0000","last_fullsized":"2023-07-05T23:36:12.296499+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'478","last_scrub_stamp":"2023-07-05T23:36:12.296398+0000","last_deep_scrub":"30'478","last_deep_scrub_stamp":"2023-07-05T23:36:12.296398+0000","last_clean_scrub_stamp":"2023-07-05T23:36:12.296398+0000","objects_scrubbed":1,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:31:07.711950+0000","scrub_duration":0.0068322039999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:30.765164+0000","last_change":"2023-07-05T23:35:30.765209+0000","last_active":"2023-07-05T23:35:30.765164+0000","last_peered":"2023-07-05T23:35:30.765164+0000","last_clean":"2023-07-05T23:35:30.765164+0000","last_became_active":"2023-07-05T23:32:47.761392+0000","last_became_peered":"2023-07-05T23:32:47.761392+0000","last_unstale":"2023-07-05T23:35:30.765164+0000","last_undegraded":"2023-07-05T23:35:30.765164+0000","last_fullsized":"2023-07-05T23:35:30.765164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:35:30.765068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:35:30.765068+0000","last_clean_scrub_stamp":"2023-07-05T23:35:30.765068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:58:25.174973+0000","scrub_duration":0.0016083200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"30'119","reported_seq":199,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:31.132448+0000","last_change":"2023-07-05T23:35:31.132526+0000","last_active":"2023-07-05T23:35:31.132448+0000","last_peered":"2023-07-05T23:35:31.132448+0000","last_clean":"2023-07-05T23:35:31.132448+0000","last_became_active":"2023-07-05T23:32:42.736736+0000","last_became_peered":"2023-07-05T23:32:42.736736+0000","last_unstale":"2023-07-05T23:35:31.132448+0000","last_undegraded":"2023-07-05T23:35:31.132448+0000","last_fullsized":"2023-07-05T23:35:31.132448+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'119","last_scrub_stamp":"2023-07-05T23:35:31.132330+0000","last_deep_scrub":"30'119","last_deep_scrub_stamp":"2023-07-05T23:35:31.132330+0000","last_clean_scrub_stamp":"2023-07-05T23:35:31.132330+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:46:16.984143+0000","scrub_duration":0.00536033,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:36.754162+0000","last_change":"2023-07-05T23:35:36.754217+0000","last_active":"2023-07-05T23:35:36.754162+0000","last_peered":"2023-07-05T23:35:36.754162+0000","last_clean":"2023-07-05T23:35:36.754162+0000","last_became_active":"2023-07-05T23:32:52.912684+0000","last_became_peered":"2023-07-05T23:32:52.912684+0000","last_unstale":"2023-07-05T23:35:36.754162+0000","last_undegraded":"2023-07-05T23:35:36.754162+0000","last_fullsized":"2023-07-05T23:35:36.754162+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:35:36.754056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:35:36.754056+0000","last_clean_scrub_stamp":"2023-07-05T23:35:36.754056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:44:18.638725+0000","scrub_duration":0.0017168890000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"30'32","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:47.404403+0000","last_change":"2023-07-05T23:35:47.404459+0000","last_active":"2023-07-05T23:35:47.404403+0000","last_peered":"2023-07-05T23:35:47.404403+0000","last_clean":"2023-07-05T23:35:47.404403+0000","last_became_active":"2023-07-05T23:32:53.343848+0000","last_became_peered":"2023-07-05T23:32:53.343848+0000","last_unstale":"2023-07-05T23:35:47.404403+0000","last_undegraded":"2023-07-05T23:35:47.404403+0000","last_fullsized":"2023-07-05T23:35:47.404403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-07-05T23:35:47.404309+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-07-05T23:35:47.404309+0000","last_clean_scrub_stamp":"2023-07-05T23:35:47.404309+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:46:50.341000+0000","scrub_duration":0.0015473119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"30'453","reported_seq":480,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:53.846180+0000","last_change":"2023-07-05T23:35:53.846247+0000","last_active":"2023-07-05T23:35:53.846180+0000","last_peered":"2023-07-05T23:35:53.846180+0000","last_clean":"2023-07-05T23:35:53.846180+0000","last_became_active":"2023-07-05T23:32:57.365013+0000","last_became_peered":"2023-07-05T23:32:57.365013+0000","last_unstale":"2023-07-05T23:35:53.846180+0000","last_undegraded":"2023-07-05T23:35:53.846180+0000","last_fullsized":"2023-07-05T23:35:53.846180+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'453","last_scrub_stamp":"2023-07-05T23:35:53.846088+0000","last_deep_scrub":"30'453","last_deep_scrub_stamp":"2023-07-05T23:35:53.846088+0000","last_clean_scrub_stamp":"2023-07-05T23:35:53.846088+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:56:09.475192+0000","scrub_duration":0.0022154990000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:34.134050+0000","last_change":"2023-07-05T23:35:34.134097+0000","last_active":"2023-07-05T23:35:34.134050+0000","last_peered":"2023-07-05T23:35:34.134050+0000","last_clean":"2023-07-05T23:35:34.134050+0000","last_became_active":"2023-07-05T23:32:47.767297+0000","last_became_peered":"2023-07-05T23:32:47.767297+0000","last_unstale":"2023-07-05T23:35:34.134050+0000","last_undegraded":"2023-07-05T23:35:34.134050+0000","last_fullsized":"2023-07-05T23:35:34.134050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:35:34.133947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:35:34.133947+0000","last_clean_scrub_stamp":"2023-07-05T23:35:34.133947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:00:27.997249+0000","scrub_duration":0.0020560800000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"30'16","reported_seq":66,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:28.696907+0000","last_change":"2023-07-05T23:35:28.696959+0000","last_active":"2023-07-05T23:35:28.696907+0000","last_peered":"2023-07-05T23:35:28.696907+0000","last_clean":"2023-07-05T23:35:28.696907+0000","last_became_active":"2023-07-05T23:32:52.906204+0000","last_became_peered":"2023-07-05T23:32:52.906204+0000","last_unstale":"2023-07-05T23:35:28.696907+0000","last_undegraded":"2023-07-05T23:35:28.696907+0000","last_fullsized":"2023-07-05T23:35:28.696907+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'16","last_scrub_stamp":"2023-07-05T23:35:28.696811+0000","last_deep_scrub":"30'16","last_deep_scrub_stamp":"2023-07-05T23:35:28.696811+0000","last_clean_scrub_stamp":"2023-07-05T23:35:28.696811+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:46:14.548624+0000","scrub_duration":0.0020850030000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7752,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":17,"num_write":15,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"30'28","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:42.625154+0000","last_change":"2023-07-05T23:35:42.625231+0000","last_active":"2023-07-05T23:35:42.625154+0000","last_peered":"2023-07-05T23:35:42.625154+0000","last_clean":"2023-07-05T23:35:42.625154+0000","last_became_active":"2023-07-05T23:32:53.340061+0000","last_became_peered":"2023-07-05T23:32:53.340061+0000","last_unstale":"2023-07-05T23:35:42.625154+0000","last_undegraded":"2023-07-05T23:35:42.625154+0000","last_fullsized":"2023-07-05T23:35:42.625154+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'28","last_scrub_stamp":"2023-07-05T23:35:42.624996+0000","last_deep_scrub":"30'28","last_deep_scrub_stamp":"2023-07-05T23:35:42.624996+0000","last_clean_scrub_stamp":"2023-07-05T23:35:42.624996+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:44:24.509665+0000","scrub_duration":0.001641656,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"30'503","reported_seq":530,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:49.385259+0000","last_change":"2023-07-05T23:35:49.385368+0000","last_active":"2023-07-05T23:35:49.385259+0000","last_peered":"2023-07-05T23:35:49.385259+0000","last_clean":"2023-07-05T23:35:49.385259+0000","last_became_active":"2023-07-05T23:32:57.361941+0000","last_became_peered":"2023-07-05T23:32:57.361941+0000","last_unstale":"2023-07-05T23:35:49.385259+0000","last_undegraded":"2023-07-05T23:35:49.385259+0000","last_fullsized":"2023-07-05T23:35:49.385259+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'503","last_scrub_stamp":"2023-07-05T23:35:49.385143+0000","last_deep_scrub":"30'503","last_deep_scrub_stamp":"2023-07-05T23:35:49.385143+0000","last_clean_scrub_stamp":"2023-07-05T23:35:49.385143+0000","objects_scrubbed":2,"log_size":503,"log_dups_size":0,"ondisk_log_size":503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:17:55.414408+0000","scrub_duration":0.010069819000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:35.179206+0000","last_change":"2023-07-05T23:35:35.179285+0000","last_active":"2023-07-05T23:35:35.179206+0000","last_peered":"2023-07-05T23:35:35.179206+0000","last_clean":"2023-07-05T23:35:35.179206+0000","last_became_active":"2023-07-05T23:32:47.790408+0000","last_became_peered":"2023-07-05T23:32:47.790408+0000","last_unstale":"2023-07-05T23:35:35.179206+0000","last_undegraded":"2023-07-05T23:35:35.179206+0000","last_fullsized":"2023-07-05T23:35:35.179206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:35:35.179072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:35:35.179072+0000","last_clean_scrub_stamp":"2023-07-05T23:35:35.179072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:27:42.194306+0000","scrub_duration":0.001815529,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"30'2","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:35.571238+0000","last_change":"2023-07-05T23:35:35.571330+0000","last_active":"2023-07-05T23:35:35.571238+0000","last_peered":"2023-07-05T23:35:35.571238+0000","last_clean":"2023-07-05T23:35:35.571238+0000","last_became_active":"2023-07-05T23:32:52.908379+0000","last_became_peered":"2023-07-05T23:32:52.908379+0000","last_unstale":"2023-07-05T23:35:35.571238+0000","last_undegraded":"2023-07-05T23:35:35.571238+0000","last_fullsized":"2023-07-05T23:35:35.571238+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2023-07-05T23:35:35.571122+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2023-07-05T23:35:35.571122+0000","last_clean_scrub_stamp":"2023-07-05T23:35:35.571122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:27:42.586356+0000","scrub_duration":0.0016887200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"30'34","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:43.575930+0000","last_change":"2023-07-05T23:35:43.575987+0000","last_active":"2023-07-05T23:35:43.575930+0000","last_peered":"2023-07-05T23:35:43.575930+0000","last_clean":"2023-07-05T23:35:43.575930+0000","last_became_active":"2023-07-05T23:32:53.330771+0000","last_became_peered":"2023-07-05T23:32:53.330771+0000","last_unstale":"2023-07-05T23:35:43.575930+0000","last_undegraded":"2023-07-05T23:35:43.575930+0000","last_fullsized":"2023-07-05T23:35:43.575930+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'34","last_scrub_stamp":"2023-07-05T23:35:43.575837+0000","last_deep_scrub":"30'34","last_deep_scrub_stamp":"2023-07-05T23:35:43.575837+0000","last_clean_scrub_stamp":"2023-07-05T23:35:43.575837+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:55:37.648649+0000","scrub_duration":0.00188262,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"30'487","reported_seq":506,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:17.514556+0000","last_change":"2023-07-05T23:32:57.357223+0000","last_active":"2023-07-05T23:35:17.514556+0000","last_peered":"2023-07-05T23:35:17.514556+0000","last_clean":"2023-07-05T23:35:17.514556+0000","last_became_active":"2023-07-05T23:32:57.356797+0000","last_became_peered":"2023-07-05T23:32:57.356797+0000","last_unstale":"2023-07-05T23:35:17.514556+0000","last_undegraded":"2023-07-05T23:35:17.514556+0000","last_fullsized":"2023-07-05T23:35:17.514556+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"30'4","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:32.616690+0000","last_change":"2023-07-05T23:35:32.616740+0000","last_active":"2023-07-05T23:35:32.616690+0000","last_peered":"2023-07-05T23:35:32.616690+0000","last_clean":"2023-07-05T23:35:32.616690+0000","last_became_active":"2023-07-05T23:32:52.905704+0000","last_became_peered":"2023-07-05T23:32:52.905704+0000","last_unstale":"2023-07-05T23:35:32.616690+0000","last_undegraded":"2023-07-05T23:35:32.616690+0000","last_fullsized":"2023-07-05T23:35:32.616690+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2023-07-05T23:35:32.616594+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2023-07-05T23:35:32.616594+0000","last_clean_scrub_stamp":"2023-07-05T23:35:32.616594+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:13:09.329579+0000","scrub_duration":0.0031987550000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:23.554123+0000","last_change":"2023-07-05T23:35:23.554182+0000","last_active":"2023-07-05T23:35:23.554123+0000","last_peered":"2023-07-05T23:35:23.554123+0000","last_clean":"2023-07-05T23:35:23.554123+0000","last_became_active":"2023-07-05T23:32:47.768844+0000","last_became_peered":"2023-07-05T23:32:47.768844+0000","last_unstale":"2023-07-05T23:35:23.554123+0000","last_undegraded":"2023-07-05T23:35:23.554123+0000","last_fullsized":"2023-07-05T23:35:23.554123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:35:23.554014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:35:23.554014+0000","last_clean_scrub_stamp":"2023-07-05T23:35:23.554014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:17:29.583280+0000","scrub_duration":0.0020942920000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"30'25","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:56.137007+0000","last_change":"2023-07-05T23:35:56.137087+0000","last_active":"2023-07-05T23:35:56.137007+0000","last_peered":"2023-07-05T23:35:56.137007+0000","last_clean":"2023-07-05T23:35:56.137007+0000","last_became_active":"2023-07-05T23:33:35.012290+0000","last_became_peered":"2023-07-05T23:33:35.012290+0000","last_unstale":"2023-07-05T23:35:56.137007+0000","last_undegraded":"2023-07-05T23:35:56.137007+0000","last_fullsized":"2023-07-05T23:35:56.137007+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'25","last_scrub_stamp":"2023-07-05T23:35:56.136865+0000","last_deep_scrub":"30'25","last_deep_scrub_stamp":"2023-07-05T23:35:56.136865+0000","last_clean_scrub_stamp":"2023-07-05T23:35:56.136865+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:59:28.585575+0000","scrub_duration":0.0022280490000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"30'449","reported_seq":476,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:54.599522+0000","last_change":"2023-07-05T23:35:54.599625+0000","last_active":"2023-07-05T23:35:54.599522+0000","last_peered":"2023-07-05T23:35:54.599522+0000","last_clean":"2023-07-05T23:35:54.599522+0000","last_became_active":"2023-07-05T23:32:57.362112+0000","last_became_peered":"2023-07-05T23:32:57.362112+0000","last_unstale":"2023-07-05T23:35:54.599522+0000","last_undegraded":"2023-07-05T23:35:54.599522+0000","last_fullsized":"2023-07-05T23:35:54.599522+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'449","last_scrub_stamp":"2023-07-05T23:35:54.599336+0000","last_deep_scrub":"30'449","last_deep_scrub_stamp":"2023-07-05T23:35:54.599336+0000","last_clean_scrub_stamp":"2023-07-05T23:35:54.599336+0000","objects_scrubbed":2,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:56:10.228440+0000","scrub_duration":0.011051040999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":46080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:25.353416+0000","last_change":"2023-07-05T23:35:25.353461+0000","last_active":"2023-07-05T23:35:25.353416+0000","last_peered":"2023-07-05T23:35:25.353416+0000","last_clean":"2023-07-05T23:35:25.353416+0000","last_became_active":"2023-07-05T23:32:47.769141+0000","last_became_peered":"2023-07-05T23:32:47.769141+0000","last_unstale":"2023-07-05T23:35:25.353416+0000","last_undegraded":"2023-07-05T23:35:25.353416+0000","last_fullsized":"2023-07-05T23:35:25.353416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:35:25.353313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:35:25.353313+0000","last_clean_scrub_stamp":"2023-07-05T23:35:25.353313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:53:19.759050+0000","scrub_duration":0.0014175699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"30'13","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:38.600293+0000","last_change":"2023-07-05T23:35:38.600354+0000","last_active":"2023-07-05T23:35:38.600293+0000","last_peered":"2023-07-05T23:35:38.600293+0000","last_clean":"2023-07-05T23:35:38.600293+0000","last_became_active":"2023-07-05T23:32:52.905451+0000","last_became_peered":"2023-07-05T23:32:52.905451+0000","last_unstale":"2023-07-05T23:35:38.600293+0000","last_undegraded":"2023-07-05T23:35:38.600293+0000","last_fullsized":"2023-07-05T23:35:38.600293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'13","last_scrub_stamp":"2023-07-05T23:35:38.600196+0000","last_deep_scrub":"30'13","last_deep_scrub_stamp":"2023-07-05T23:35:38.600196+0000","last_clean_scrub_stamp":"2023-07-05T23:35:38.600196+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:13:15.313181+0000","scrub_duration":0.0019374049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"30'21","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:51.362930+0000","last_change":"2023-07-05T23:35:51.362986+0000","last_active":"2023-07-05T23:35:51.362930+0000","last_peered":"2023-07-05T23:35:51.362930+0000","last_clean":"2023-07-05T23:35:51.362930+0000","last_became_active":"2023-07-05T23:32:53.332159+0000","last_became_peered":"2023-07-05T23:32:53.332159+0000","last_unstale":"2023-07-05T23:35:51.362930+0000","last_undegraded":"2023-07-05T23:35:51.362930+0000","last_fullsized":"2023-07-05T23:35:51.362930+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'21","last_scrub_stamp":"2023-07-05T23:35:51.362824+0000","last_deep_scrub":"30'21","last_deep_scrub_stamp":"2023-07-05T23:35:51.362824+0000","last_clean_scrub_stamp":"2023-07-05T23:35:51.362824+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:38:41.943629+0000","scrub_duration":0.0015691850000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"30'470","reported_seq":497,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:53.770574+0000","last_change":"2023-07-05T23:35:53.770643+0000","last_active":"2023-07-05T23:35:53.770574+0000","last_peered":"2023-07-05T23:35:53.770574+0000","last_clean":"2023-07-05T23:35:53.770574+0000","last_became_active":"2023-07-05T23:32:57.363620+0000","last_became_peered":"2023-07-05T23:32:57.363620+0000","last_unstale":"2023-07-05T23:35:53.770574+0000","last_undegraded":"2023-07-05T23:35:53.770574+0000","last_fullsized":"2023-07-05T23:35:53.770574+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'470","last_scrub_stamp":"2023-07-05T23:35:53.770477+0000","last_deep_scrub":"30'470","last_deep_scrub_stamp":"2023-07-05T23:35:53.770477+0000","last_clean_scrub_stamp":"2023-07-05T23:35:53.770477+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:58:47.385652+0000","scrub_duration":0.001943052,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:37.555778+0000","last_change":"2023-07-05T23:35:37.555838+0000","last_active":"2023-07-05T23:35:37.555778+0000","last_peered":"2023-07-05T23:35:37.555778+0000","last_clean":"2023-07-05T23:35:37.555778+0000","last_became_active":"2023-07-05T23:32:52.908111+0000","last_became_peered":"2023-07-05T23:32:52.908111+0000","last_unstale":"2023-07-05T23:35:37.555778+0000","last_undegraded":"2023-07-05T23:35:37.555778+0000","last_fullsized":"2023-07-05T23:35:37.555778+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2023-07-05T23:35:37.555686+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2023-07-05T23:35:37.555686+0000","last_clean_scrub_stamp":"2023-07-05T23:35:37.555686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:58:31.965591+0000","scrub_duration":0.0016203809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"30'32","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:32.063729+0000","last_change":"2023-07-05T23:35:32.063812+0000","last_active":"2023-07-05T23:35:32.063729+0000","last_peered":"2023-07-05T23:35:32.063729+0000","last_clean":"2023-07-05T23:35:32.063729+0000","last_became_active":"2023-07-05T23:32:53.339686+0000","last_became_peered":"2023-07-05T23:32:53.339686+0000","last_unstale":"2023-07-05T23:35:32.063729+0000","last_undegraded":"2023-07-05T23:35:32.063729+0000","last_fullsized":"2023-07-05T23:35:32.063729+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-07-05T23:35:32.063608+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-07-05T23:35:32.063608+0000","last_clean_scrub_stamp":"2023-07-05T23:35:32.063608+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:53:42.153964+0000","scrub_duration":0.0016321899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"30'478","reported_seq":505,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:36:10.298535+0000","last_change":"2023-07-05T23:36:10.298624+0000","last_active":"2023-07-05T23:36:10.298535+0000","last_peered":"2023-07-05T23:36:10.298535+0000","last_clean":"2023-07-05T23:36:10.298535+0000","last_became_active":"2023-07-05T23:32:57.355910+0000","last_became_peered":"2023-07-05T23:32:57.355910+0000","last_unstale":"2023-07-05T23:36:10.298535+0000","last_undegraded":"2023-07-05T23:36:10.298535+0000","last_fullsized":"2023-07-05T23:36:10.298535+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'478","last_scrub_stamp":"2023-07-05T23:36:10.298416+0000","last_deep_scrub":"30'478","last_deep_scrub_stamp":"2023-07-05T23:36:10.298416+0000","last_clean_scrub_stamp":"2023-07-05T23:36:10.298416+0000","objects_scrubbed":1,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:15:27.948944+0000","scrub_duration":0.0069478090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"30'3","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:34.865970+0000","last_change":"2023-07-05T23:35:34.866032+0000","last_active":"2023-07-05T23:35:34.865970+0000","last_peered":"2023-07-05T23:35:34.865970+0000","last_clean":"2023-07-05T23:35:34.865970+0000","last_became_active":"2023-07-05T23:32:52.899159+0000","last_became_peered":"2023-07-05T23:32:52.899159+0000","last_unstale":"2023-07-05T23:35:34.865970+0000","last_undegraded":"2023-07-05T23:35:34.865970+0000","last_fullsized":"2023-07-05T23:35:34.865970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2023-07-05T23:35:34.865874+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2023-07-05T23:35:34.865874+0000","last_clean_scrub_stamp":"2023-07-05T23:35:34.865874+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:47:30.795186+0000","scrub_duration":0.0029783230000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"30'24","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:37.340324+0000","last_change":"2023-07-05T23:35:37.340375+0000","last_active":"2023-07-05T23:35:37.340324+0000","last_peered":"2023-07-05T23:35:37.340324+0000","last_clean":"2023-07-05T23:35:37.340324+0000","last_became_active":"2023-07-05T23:32:53.343262+0000","last_became_peered":"2023-07-05T23:32:53.343262+0000","last_unstale":"2023-07-05T23:35:37.340324+0000","last_undegraded":"2023-07-05T23:35:37.340324+0000","last_fullsized":"2023-07-05T23:35:37.340324+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'24","last_scrub_stamp":"2023-07-05T23:35:37.340221+0000","last_deep_scrub":"30'24","last_deep_scrub_stamp":"2023-07-05T23:35:37.340221+0000","last_clean_scrub_stamp":"2023-07-05T23:35:37.340221+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:49:35.710493+0000","scrub_duration":0.0018883940000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"30'465","reported_seq":492,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:51.796756+0000","last_change":"2023-07-05T23:35:51.796846+0000","last_active":"2023-07-05T23:35:51.796756+0000","last_peered":"2023-07-05T23:35:51.796756+0000","last_clean":"2023-07-05T23:35:51.796756+0000","last_became_active":"2023-07-05T23:32:57.365087+0000","last_became_peered":"2023-07-05T23:32:57.365087+0000","last_unstale":"2023-07-05T23:35:51.796756+0000","last_undegraded":"2023-07-05T23:35:51.796756+0000","last_fullsized":"2023-07-05T23:35:51.796756+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'465","last_scrub_stamp":"2023-07-05T23:35:51.796641+0000","last_deep_scrub":"30'465","last_deep_scrub_stamp":"2023-07-05T23:35:51.796641+0000","last_clean_scrub_stamp":"2023-07-05T23:35:51.796641+0000","objects_scrubbed":1,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:48:32.213205+0000","scrub_duration":0.0070808599999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"30'4","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:36.815441+0000","last_change":"2023-07-05T23:35:36.815520+0000","last_active":"2023-07-05T23:35:36.815441+0000","last_peered":"2023-07-05T23:35:36.815441+0000","last_clean":"2023-07-05T23:35:36.815441+0000","last_became_active":"2023-07-05T23:32:52.901689+0000","last_became_peered":"2023-07-05T23:32:52.901689+0000","last_unstale":"2023-07-05T23:35:36.815441+0000","last_undegraded":"2023-07-05T23:35:36.815441+0000","last_fullsized":"2023-07-05T23:35:36.815441+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2023-07-05T23:35:36.815346+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2023-07-05T23:35:36.815346+0000","last_clean_scrub_stamp":"2023-07-05T23:35:36.815346+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:55:30.888158+0000","scrub_duration":0.00274881,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'23","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:27.474074+0000","last_change":"2023-07-05T23:35:27.474123+0000","last_active":"2023-07-05T23:35:27.474074+0000","last_peered":"2023-07-05T23:35:27.474074+0000","last_clean":"2023-07-05T23:35:27.474074+0000","last_became_active":"2023-07-05T23:32:53.346553+0000","last_became_peered":"2023-07-05T23:32:53.346553+0000","last_unstale":"2023-07-05T23:35:27.474074+0000","last_undegraded":"2023-07-05T23:35:27.474074+0000","last_fullsized":"2023-07-05T23:35:27.474074+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'23","last_scrub_stamp":"2023-07-05T23:35:27.473982+0000","last_deep_scrub":"30'23","last_deep_scrub_stamp":"2023-07-05T23:35:27.473982+0000","last_clean_scrub_stamp":"2023-07-05T23:35:27.473982+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:59:09.834139+0000","scrub_duration":0.00189398,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"30'487","reported_seq":506,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:23.256652+0000","last_change":"2023-07-05T23:32:57.353173+0000","last_active":"2023-07-05T23:35:23.256652+0000","last_peered":"2023-07-05T23:35:23.256652+0000","last_clean":"2023-07-05T23:35:23.256652+0000","last_became_active":"2023-07-05T23:32:57.352716+0000","last_became_peered":"2023-07-05T23:32:57.352716+0000","last_unstale":"2023-07-05T23:35:23.256652+0000","last_undegraded":"2023-07-05T23:35:23.256652+0000","last_fullsized":"2023-07-05T23:35:23.256652+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:32:56.321976+0000","last_clean_scrub_stamp":"2023-07-05T23:32:56.321976+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:31.581893+0000","last_change":"2023-07-05T23:35:31.581975+0000","last_active":"2023-07-05T23:35:31.581893+0000","last_peered":"2023-07-05T23:35:31.581893+0000","last_clean":"2023-07-05T23:35:31.581893+0000","last_became_active":"2023-07-05T23:32:52.906688+0000","last_became_peered":"2023-07-05T23:32:52.906688+0000","last_unstale":"2023-07-05T23:35:31.581893+0000","last_undegraded":"2023-07-05T23:35:31.581893+0000","last_fullsized":"2023-07-05T23:35:31.581893+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2023-07-05T23:35:31.581776+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2023-07-05T23:35:31.581776+0000","last_clean_scrub_stamp":"2023-07-05T23:35:31.581776+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:58:25.991680+0000","scrub_duration":0.001758639,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"30'32","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:47.672594+0000","last_change":"2023-07-05T23:35:47.672645+0000","last_active":"2023-07-05T23:35:47.672594+0000","last_peered":"2023-07-05T23:35:47.672594+0000","last_clean":"2023-07-05T23:35:47.672594+0000","last_became_active":"2023-07-05T23:32:53.346652+0000","last_became_peered":"2023-07-05T23:32:53.346652+0000","last_unstale":"2023-07-05T23:35:47.672594+0000","last_undegraded":"2023-07-05T23:35:47.672594+0000","last_fullsized":"2023-07-05T23:35:47.672594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-07-05T23:35:47.672502+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-07-05T23:35:47.672502+0000","last_clean_scrub_stamp":"2023-07-05T23:35:47.672502+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:58:41.287677+0000","scrub_duration":0.001513707,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"30'495","reported_seq":522,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:47.653110+0000","last_change":"2023-07-05T23:35:47.653219+0000","last_active":"2023-07-05T23:35:47.653110+0000","last_peered":"2023-07-05T23:35:47.653110+0000","last_clean":"2023-07-05T23:35:47.653110+0000","last_became_active":"2023-07-05T23:32:57.356637+0000","last_became_peered":"2023-07-05T23:32:57.356637+0000","last_unstale":"2023-07-05T23:35:47.653110+0000","last_undegraded":"2023-07-05T23:35:47.653110+0000","last_fullsized":"2023-07-05T23:35:47.653110+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'495","last_scrub_stamp":"2023-07-05T23:35:47.653002+0000","last_deep_scrub":"30'495","last_deep_scrub_stamp":"2023-07-05T23:35:47.653002+0000","last_clean_scrub_stamp":"2023-07-05T23:35:47.653002+0000","objects_scrubbed":2,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:54:32.892802+0000","scrub_duration":0.011149088999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"30'7","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:33.566089+0000","last_change":"2023-07-05T23:35:33.566152+0000","last_active":"2023-07-05T23:35:33.566089+0000","last_peered":"2023-07-05T23:35:33.566089+0000","last_clean":"2023-07-05T23:35:33.566089+0000","last_became_active":"2023-07-05T23:32:52.903823+0000","last_became_peered":"2023-07-05T23:32:52.903823+0000","last_unstale":"2023-07-05T23:35:33.566089+0000","last_undegraded":"2023-07-05T23:35:33.566089+0000","last_fullsized":"2023-07-05T23:35:33.566089+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'7","last_scrub_stamp":"2023-07-05T23:35:33.566002+0000","last_deep_scrub":"30'7","last_deep_scrub_stamp":"2023-07-05T23:35:33.566002+0000","last_clean_scrub_stamp":"2023-07-05T23:35:33.566002+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:27:40.581236+0000","scrub_duration":0.0037408099999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"30'42","reported_seq":75,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:36:00.478716+0000","last_change":"2023-07-05T23:36:00.478767+0000","last_active":"2023-07-05T23:36:00.478716+0000","last_peered":"2023-07-05T23:36:00.478716+0000","last_clean":"2023-07-05T23:36:00.478716+0000","last_became_active":"2023-07-05T23:32:53.339863+0000","last_became_peered":"2023-07-05T23:32:53.339863+0000","last_unstale":"2023-07-05T23:36:00.478716+0000","last_undegraded":"2023-07-05T23:36:00.478716+0000","last_fullsized":"2023-07-05T23:36:00.478716+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'42","last_scrub_stamp":"2023-07-05T23:36:00.478608+0000","last_deep_scrub":"30'42","last_deep_scrub_stamp":"2023-07-05T23:36:00.478608+0000","last_clean_scrub_stamp":"2023-07-05T23:36:00.478608+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:32:36.569699+0000","scrub_duration":0.0015116839999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"30'50","reported_seq":83,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:37.493267+0000","last_change":"2023-07-05T23:35:37.493321+0000","last_active":"2023-07-05T23:35:37.493267+0000","last_peered":"2023-07-05T23:35:37.493267+0000","last_clean":"2023-07-05T23:35:37.493267+0000","last_became_active":"2023-07-05T23:32:53.336759+0000","last_became_peered":"2023-07-05T23:32:53.336759+0000","last_unstale":"2023-07-05T23:35:37.493267+0000","last_undegraded":"2023-07-05T23:35:37.493267+0000","last_fullsized":"2023-07-05T23:35:37.493267+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'50","last_scrub_stamp":"2023-07-05T23:35:37.493181+0000","last_deep_scrub":"30'50","last_deep_scrub_stamp":"2023-07-05T23:35:37.493181+0000","last_clean_scrub_stamp":"2023-07-05T23:35:37.493181+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:01:21.748318+0000","scrub_duration":0.001613509,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"30'46","reported_seq":79,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:48.678427+0000","last_change":"2023-07-05T23:35:48.678473+0000","last_active":"2023-07-05T23:35:48.678427+0000","last_peered":"2023-07-05T23:35:48.678427+0000","last_clean":"2023-07-05T23:35:48.678427+0000","last_became_active":"2023-07-05T23:32:53.345711+0000","last_became_peered":"2023-07-05T23:32:53.345711+0000","last_unstale":"2023-07-05T23:35:48.678427+0000","last_undegraded":"2023-07-05T23:35:48.678427+0000","last_fullsized":"2023-07-05T23:35:48.678427+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'46","last_scrub_stamp":"2023-07-05T23:35:48.678317+0000","last_deep_scrub":"30'46","last_deep_scrub_stamp":"2023-07-05T23:35:48.678317+0000","last_clean_scrub_stamp":"2023-07-05T23:35:48.678317+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:37:52.314095+0000","scrub_duration":0.001454442,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"30'34","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:31.415358+0000","last_change":"2023-07-05T23:35:31.415413+0000","last_active":"2023-07-05T23:35:31.415358+0000","last_peered":"2023-07-05T23:35:31.415358+0000","last_clean":"2023-07-05T23:35:31.415358+0000","last_became_active":"2023-07-05T23:32:53.339431+0000","last_became_peered":"2023-07-05T23:32:53.339431+0000","last_unstale":"2023-07-05T23:35:31.415358+0000","last_undegraded":"2023-07-05T23:35:31.415358+0000","last_fullsized":"2023-07-05T23:35:31.415358+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'34","last_scrub_stamp":"2023-07-05T23:35:31.415263+0000","last_deep_scrub":"30'34","last_deep_scrub_stamp":"2023-07-05T23:35:31.415263+0000","last_clean_scrub_stamp":"2023-07-05T23:35:31.415263+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:58:25.030438+0000","scrub_duration":0.0015583839999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"30'31","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:38.732951+0000","last_change":"2023-07-05T23:35:38.733005+0000","last_active":"2023-07-05T23:35:38.732951+0000","last_peered":"2023-07-05T23:35:38.732951+0000","last_clean":"2023-07-05T23:35:38.732951+0000","last_became_active":"2023-07-05T23:32:53.335181+0000","last_became_peered":"2023-07-05T23:32:53.335181+0000","last_unstale":"2023-07-05T23:35:38.732951+0000","last_undegraded":"2023-07-05T23:35:38.732951+0000","last_fullsized":"2023-07-05T23:35:38.732951+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'31","last_scrub_stamp":"2023-07-05T23:35:38.732855+0000","last_deep_scrub":"30'31","last_deep_scrub_stamp":"2023-07-05T23:35:38.732855+0000","last_clean_scrub_stamp":"2023-07-05T23:35:38.732855+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:47:39.820920+0000","scrub_duration":0.0020207810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"30'32","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:40.615959+0000","last_change":"2023-07-05T23:35:40.616010+0000","last_active":"2023-07-05T23:35:40.615959+0000","last_peered":"2023-07-05T23:35:40.615959+0000","last_clean":"2023-07-05T23:35:40.615959+0000","last_became_active":"2023-07-05T23:32:53.337835+0000","last_became_peered":"2023-07-05T23:32:53.337835+0000","last_unstale":"2023-07-05T23:35:40.615959+0000","last_undegraded":"2023-07-05T23:35:40.615959+0000","last_fullsized":"2023-07-05T23:35:40.615959+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-07-05T23:35:40.615858+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-07-05T23:35:40.615858+0000","last_clean_scrub_stamp":"2023-07-05T23:35:40.615858+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:13:17.328843+0000","scrub_duration":0.0021545140000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":614,"num_write_kb":1286144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":201326592,"data_stored":201326592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15089,"ondisk_log_size":15089,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2060,"ondisk_log_size":2060,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1537265,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":15,"num_read_kb":17,"num_write":488,"num_write_kb":1816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3137536,"data_stored":3074530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":503,"ondisk_log_size":503,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574897,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68284,"kb_used_data":33140,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94303556,"statfs":{"total":96636764160,"available":96566841344,"internally_reserved":0,"allocated":33935360,"data_stored":33715425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 5 23:35:45 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":1.1919999999999999,"15min":0.79100000000000004},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.65900000000000003,"5min":12.042,"15min":12.042},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":2.2799999999999998,"15min":1.726},"min":{"1min":0.32900000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.82999999999999996,"5min":26.367999999999999,"15min":26.367999999999999},"last":0.55500000000000005}]},{"osd":1,"last update":"Wed Jul 5 23:35:45 2023","interfaces":[{"interface":"back","average":{"1min":2.6160000000000001,"5min":1.659,"15min":1.0289999999999999},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":28.850000000000001,"5min":28.850000000000001,"15min":28.850000000000001},"last":0.46999999999999997},{"interface":"front","average":{"1min":2.1789999999999998,"5min":1.5960000000000001,"15min":0.93000000000000005},"min":{"1min":0.30199999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":28.797999999999998,"5min":28.797999999999998,"15min":28.797999999999998},"last":0.623}]},{"osd":2,"last update":"Wed Jul 5 23:35:45 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":1.5629999999999999,"15min":1.2470000000000001},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.88900000000000001,"5min":11.997,"15min":11.997},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.67800000000000005,"5min":1.778,"15min":1.0580000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":3.1219999999999999,"5min":26.419,"15min":26.419},"last":0.65500000000000003}]},{"osd":3,"last update":"Wed Jul 5 23:35:45 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":1.54,"15min":0.93999999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":4.9480000000000004,"5min":24.094000000000001,"15min":24.094000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":1.5629999999999999,"15min":0.94099999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.79300000000000004,"5min":22.588000000000001,"15min":22.588000000000001},"last":0.59699999999999998}]},{"osd":4,"last update":"Wed Jul 5 23:35:45 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":1.0940000000000001,"15min":0.71699999999999997},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.73199999999999998,"5min":12.173999999999999,"15min":12.173999999999999},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.44700000000000001,"5min":1.1240000000000001,"15min":0.751},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.66000000000000003,"5min":12.151,"15min":12.151},"last":0.40799999999999997}]},{"osd":5,"last update":"Wed Jul 5 23:35:45 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":1.206,"15min":0.77800000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.76400000000000001,"5min":19.954999999999998,"15min":19.954999999999998},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":1.1990000000000001,"15min":0.80400000000000005},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.70599999999999996,"5min":21.870999999999999,"15min":21.870999999999999},"last":0.67700000000000005}]},{"osd":6,"last update":"Wed Jul 5 23:35:45 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":1.585,"15min":0.95199999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.68600000000000005,"5min":20.212,"15min":20.212},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.97099999999999997,"15min":0.73599999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77700000000000002,"5min":12.010999999999999,"15min":12.010999999999999},"last":0.57699999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574897,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57992,"kb_used_data":26944,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94313848,"statfs":{"total":96636764160,"available":96577380352,"internally_reserved":0,"allocated":27590656,"data_stored":27401822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 5 23:35:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":2.0630000000000002,"15min":1.028},"min":{"1min":0.39700000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":9.9100000000000001,"5min":24.012,"15min":24.012},"last":0.629},{"interface":"front","average":{"1min":1.2689999999999999,"5min":2.0619999999999998,"15min":1.022},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":10.098000000000001,"5min":27.036000000000001,"15min":27.036000000000001},"last":0.496}]},{"osd":1,"last update":"Wed Jul 5 23:35:44 2023","interfaces":[{"interface":"back","average":{"1min":2.3399999999999999,"5min":2.1890000000000001,"15min":1.0649999999999999},"min":{"1min":0.42199999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":24.684000000000001,"5min":24.684000000000001,"15min":24.684000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":1.28,"5min":2.141,"15min":1.085},"min":{"1min":0.35599999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":9.9730000000000008,"5min":23.943000000000001,"15min":23.943000000000001},"last":0.59499999999999997}]},{"osd":2,"last update":"Wed Jul 5 23:35:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":2.0270000000000001,"15min":1.0409999999999999},"min":{"1min":0.45600000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":9.9440000000000008,"5min":25.658000000000001,"15min":25.658000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":1.7549999999999999,"5min":1.8819999999999999,"15min":1.014},"min":{"1min":0.38600000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":10.135,"5min":27.062000000000001,"15min":27.062000000000001},"last":0.53400000000000003}]},{"osd":3,"last update":"Wed Jul 5 23:35:44 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":1.821,"15min":0.98799999999999999},"min":{"1min":0.41299999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":2.0030000000000001,"5min":27.108000000000001,"15min":27.108000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":1.4099999999999999,"5min":2.1469999999999998,"15min":1.085},"min":{"1min":0.39500000000000002,"5min":0.377,"15min":0.377},"max":{"1min":10.047000000000001,"5min":19.940000000000001,"15min":19.940000000000001},"last":0.48799999999999999}]},{"osd":4,"last update":"Wed Jul 5 23:35:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":2.0489999999999999,"15min":1.044},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.087,"5min":26,"15min":26},"last":0.45100000000000001},{"interface":"front","average":{"1min":1.96,"5min":1.7569999999999999,"15min":0.97699999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":20.593,"5min":27.085000000000001,"15min":27.085000000000001},"last":0.437}]},{"osd":5,"last update":"Wed Jul 5 23:35:44 2023","interfaces":[{"interface":"back","average":{"1min":1.9359999999999999,"5min":1.8320000000000001,"15min":0.97799999999999998},"min":{"1min":0.32500000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":20.643000000000001,"5min":20.643000000000001,"15min":20.643000000000001},"last":0.35399999999999998},{"interface":"front","average":{"1min":1.998,"5min":2.056,"15min":1.0960000000000001},"min":{"1min":0.37,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":20.353999999999999,"5min":20.353999999999999,"15min":20.353999999999999},"last":0.38700000000000001}]},{"osd":7,"last update":"Wed Jul 5 23:35:44 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":1.6279999999999999,"15min":0.94599999999999995},"min":{"1min":0.42699999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.0149999999999999,"5min":26.992000000000001,"15min":26.992000000000001},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.61599999999999999,"5min":1.7270000000000001,"15min":0.98099999999999998},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.1100000000000001,"5min":19.998999999999999,"15min":19.998999999999999},"last":0.42499999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574897,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53896,"kb_used_data":22848,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94317944,"statfs":{"total":96636764160,"available":96581574656,"internally_reserved":0,"allocated":23396352,"data_stored":23207518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 5 23:35:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.2,"15min":0.63800000000000001},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":10.971,"5min":14.039999999999999,"15min":14.039999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":1.681,"5min":1.3300000000000001,"15min":0.68700000000000006},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":13.132,"5min":18.006,"15min":18.006},"last":0.63100000000000001}]},{"osd":2,"last update":"Wed Jul 5 23:35:49 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.3140000000000001,"15min":0.69399999999999995},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":11.026999999999999,"5min":14.092000000000001,"15min":14.092000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":2.4039999999999999,"5min":1.5800000000000001,"15min":0.77200000000000002},"min":{"1min":0.26500000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":22.966999999999999,"5min":22.966999999999999,"15min":22.966999999999999},"last":0.54100000000000004}]},{"osd":3,"last update":"Wed Jul 5 23:35:49 2023","interfaces":[{"interface":"back","average":{"1min":1.8759999999999999,"5min":1.613,"15min":0.80300000000000005},"min":{"1min":0.27200000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":22.885000000000002,"5min":22.885000000000002,"15min":22.885000000000002},"last":0.65100000000000002},{"interface":"front","average":{"1min":1.101,"5min":1.109,"15min":0.64100000000000001},"min":{"1min":0.28499999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":13.103,"5min":14.377000000000001,"15min":14.377000000000001},"last":0.53000000000000003}]},{"osd":4,"last update":"Wed Jul 5 23:35:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.603,"15min":0.92700000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":11.003,"5min":14.004,"15min":14.004},"last":0.84599999999999997},{"interface":"front","average":{"1min":2.0369999999999999,"5min":1.903,"15min":1.018},"min":{"1min":0.42299999999999999,"5min":0.371,"15min":0.371},"max":{"1min":22.995999999999999,"5min":22.995999999999999,"15min":22.995999999999999},"last":0.82999999999999996}]},{"osd":5,"last update":"Wed Jul 5 23:35:49 2023","interfaces":[{"interface":"back","average":{"1min":1.8899999999999999,"5min":1.804,"15min":1.018},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":13.053000000000001,"5min":24.949999999999999,"15min":24.949999999999999},"last":0.81999999999999995},{"interface":"front","average":{"1min":1.254,"5min":1.839,"15min":1.0509999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":11.08,"5min":21.945,"15min":21.945},"last":0.71799999999999997}]},{"osd":6,"last update":"Wed Jul 5 23:35:49 2023","interfaces":[{"interface":"back","average":{"1min":1.6719999999999999,"5min":1.5549999999999999,"15min":0.92200000000000004},"min":{"1min":0.40799999999999997,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":13.016999999999999,"5min":17.981999999999999,"15min":17.981999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":1.236,"5min":1.833,"15min":1.038},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":11.050000000000001,"5min":24.943000000000001,"15min":24.943000000000001},"last":0.79300000000000004}]},{"osd":7,"last update":"Wed Jul 5 23:35:49 2023","interfaces":[{"interface":"back","average":{"1min":2.6440000000000001,"5min":2.0249999999999999,"15min":1.091},"min":{"1min":0.46200000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":23.021999999999998,"5min":23.021999999999998,"15min":23.021999999999998},"last":0.88},{"interface":"front","average":{"1min":1.9019999999999999,"5min":1.5349999999999999,"15min":0.92100000000000004},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":13.077999999999999,"5min":14.352,"15min":14.352},"last":0.86199999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574897,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54488,"kb_used_data":23440,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94317352,"statfs":{"total":96636764160,"available":96580968448,"internally_reserved":0,"allocated":24002560,"data_stored":23806220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Jul 5 23:35:42 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":1.202,"15min":0.61899999999999999},"min":{"1min":0.22800000000000001,"5min":0.185,"15min":0.185},"max":{"1min":6.1029999999999998,"5min":23.974,"15min":23.974},"last":0.42599999999999999},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.476,"15min":0.71999999999999997},"min":{"1min":0.28699999999999998,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":16.966000000000001,"5min":32.256999999999998,"15min":32.256999999999998},"last":0.39300000000000002}]},{"osd":2,"last update":"Wed Jul 5 23:35:42 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":1.0549999999999999,"15min":0.59999999999999998},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":5.9699999999999998,"5min":16.157,"15min":16.157},"last":0.371},{"interface":"front","average":{"1min":0.80100000000000005,"5min":1.1140000000000001,"15min":0.61499999999999999},"min":{"1min":0.25900000000000001,"5min":0.254,"15min":0.254},"max":{"1min":6.0620000000000003,"5min":14.91,"15min":14.91},"last":0.501}]},{"osd":3,"last update":"Wed Jul 5 23:35:42 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.667,"15min":0.80300000000000005},"min":{"1min":0.27600000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":6.133,"5min":16.928999999999998,"15min":16.928999999999998},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.872,"5min":0.92100000000000004,"15min":0.59399999999999997},"min":{"1min":0.34799999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":6.0039999999999996,"5min":11.923999999999999,"15min":11.923999999999999},"last":0.52000000000000002}]},{"osd":4,"last update":"Wed Jul 5 23:35:42 2023","interfaces":[{"interface":"back","average":{"1min":1.403,"5min":1.556,"15min":0.90200000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":12.066000000000001,"5min":16.838000000000001,"15min":16.838000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.98899999999999999,"5min":1.712,"15min":0.96499999999999997},"min":{"1min":0.40000000000000002,"5min":0.374,"15min":0.374},"max":{"1min":5.9320000000000004,"5min":23.905999999999999,"15min":23.905999999999999},"last":0.57199999999999995}]},{"osd":5,"last update":"Wed Jul 5 23:35:42 2023","interfaces":[{"interface":"back","average":{"1min":2.073,"5min":1.722,"15min":0.97999999999999998},"min":{"1min":0.41299999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":16.928999999999998,"5min":17.824000000000002,"15min":17.824000000000002},"last":0.58199999999999996},{"interface":"front","average":{"1min":1.423,"5min":1.6619999999999999,"15min":0.96199999999999997},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":12.034000000000001,"5min":16.905000000000001,"15min":16.905000000000001},"last":0.60699999999999998}]},{"osd":6,"last update":"Wed Jul 5 23:35:42 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":1.113,"15min":0.77900000000000003},"min":{"1min":0.47099999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":6.0369999999999999,"5min":10.102,"15min":10.102},"last":0.78700000000000003},{"interface":"front","average":{"1min":1.29,"5min":1.6859999999999999,"15min":0.97799999999999998},"min":{"1min":0.45800000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":11.994999999999999,"5min":32.298999999999999,"15min":32.298999999999999},"last":0.75}]},{"osd":7,"last update":"Wed Jul 5 23:35:42 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.599,"15min":0.95699999999999996},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":11.933,"5min":14.946,"15min":14.946},"last":0.69999999999999996},{"interface":"front","average":{"1min":2.016,"5min":1.9379999999999999,"15min":1.054},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":15.031000000000001,"5min":16.878,"15min":16.878},"last":0.68700000000000006}]}]},{"osd":2,"up_from":13,"seq":55834574898,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55944,"kb_used_data":24896,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94315896,"statfs":{"total":96636764160,"available":96579477504,"internally_reserved":0,"allocated":25493504,"data_stored":25304670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 5 23:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":1.7529999999999999,"15min":0.95599999999999996},"min":{"1min":0.24399999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":6.3879999999999999,"5min":29.716000000000001,"15min":29.716000000000001},"last":0.42299999999999999},{"interface":"front","average":{"1min":1.409,"5min":1.8879999999999999,"15min":1.0389999999999999},"min":{"1min":0.29399999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":17.940000000000001,"5min":21.699000000000002,"15min":21.699000000000002},"last":0.51000000000000001}]},{"osd":1,"last update":"Wed Jul 5 23:35:49 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.7949999999999999,"15min":1.0189999999999999},"min":{"1min":0.309,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":11.032,"5min":23.053000000000001,"15min":23.053000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.71099999999999997,"5min":1.589,"15min":0.94699999999999995},"min":{"1min":0.311,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":5.1820000000000004,"5min":29.632999999999999,"15min":29.632999999999999},"last":0.59999999999999998}]},{"osd":3,"last update":"Wed Jul 5 23:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":1.1279999999999999,"15min":0.753},"min":{"1min":0.28599999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.0920000000000001,"5min":22.018000000000001,"15min":22.018000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.78900000000000003,"5min":1.5620000000000001,"15min":0.98399999999999999},"min":{"1min":0.34899999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":6.468,"5min":29.686,"15min":29.686},"last":0.54100000000000004}]},{"osd":4,"last update":"Wed Jul 5 23:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":2.0800000000000001,"15min":1.2410000000000001},"min":{"1min":0.443,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":6.4180000000000001,"5min":29.768999999999998,"15min":29.768999999999998},"last":0.745},{"interface":"front","average":{"1min":0.98199999999999998,"5min":2.1680000000000001,"15min":1.2869999999999999},"min":{"1min":0.45100000000000001,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":7,"5min":21.16,"15min":21.16},"last":0.64100000000000001}]},{"osd":5,"last update":"Wed Jul 5 23:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":2.3650000000000002,"15min":1.337},"min":{"1min":0.505,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":6.9400000000000004,"5min":22.927,"15min":22.927},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":1.768,"15min":1.1519999999999999},"min":{"1min":0.42399999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.755,"5min":23.120000000000001,"15min":23.120000000000001},"last":0.66600000000000004}]},{"osd":6,"last update":"Wed Jul 5 23:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":1.8400000000000001,"15min":1.1799999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.83399999999999996,"5min":23.173999999999999,"15min":23.173999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.95299999999999996,"5min":2.3769999999999998,"15min":1.361},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":6.4400000000000004,"5min":29.742999999999999,"15min":29.742999999999999},"last":0.70399999999999996}]},{"osd":7,"last update":"Wed Jul 5 23:35:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":2.4510000000000001,"15min":1.391},"min":{"1min":0.47399999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":6.9749999999999996,"5min":32.924999999999997,"15min":32.924999999999997},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.63600000000000001,"5min":2.0920000000000001,"15min":1.288},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.88900000000000001,"5min":30.594999999999999,"15min":30.594999999999999},"last":0.63200000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574897,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51852,"kb_used_data":20804,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94319988,"statfs":{"total":96636764160,"available":96583667712,"internally_reserved":0,"allocated":21303296,"data_stored":21110456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 5 23:35:53 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":1.4199999999999999,"15min":0.76600000000000001},"min":{"1min":0.26000000000000001,"5min":0.25,"15min":0.25},"max":{"1min":8.032,"5min":22.948,"15min":22.948},"last":0.39100000000000001},{"interface":"front","average":{"1min":3.8399999999999999,"5min":2.052,"15min":1.0029999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":61.006999999999998,"5min":61.006999999999998,"15min":61.006999999999998},"last":0.40699999999999997}]},{"osd":1,"last update":"Wed Jul 5 23:35:53 2023","interfaces":[{"interface":"back","average":{"1min":3.5840000000000001,"5min":1.978,"15min":1.1399999999999999},"min":{"1min":0.247,"5min":0.246,"15min":0.246},"max":{"1min":58.177999999999997,"5min":58.177999999999997,"15min":58.177999999999997},"last":0.46700000000000003},{"interface":"front","average":{"1min":3.4969999999999999,"5min":2.0590000000000002,"15min":1.1930000000000001},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":54.911000000000001,"5min":54.911000000000001,"15min":54.911000000000001},"last":0.628}]},{"osd":2,"last update":"Wed Jul 5 23:35:53 2023","interfaces":[{"interface":"back","average":{"1min":2.4980000000000002,"5min":1.6299999999999999,"15min":0.88800000000000001},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":37.674999999999997,"5min":37.674999999999997,"15min":37.674999999999997},"last":0.50600000000000001},{"interface":"front","average":{"1min":1.286,"5min":1.3600000000000001,"15min":0.78000000000000003},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":14.624000000000001,"5min":14.624000000000001,"15min":14.624000000000001},"last":0.52800000000000002}]},{"osd":4,"last update":"Wed Jul 5 23:35:53 2023","interfaces":[{"interface":"back","average":{"1min":2.7309999999999999,"5min":1.798,"15min":1.0249999999999999},"min":{"1min":0.39300000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":37.648000000000003,"5min":37.648000000000003,"15min":37.648000000000003},"last":0.61099999999999999},{"interface":"front","average":{"1min":1.373,"5min":1.7470000000000001,"15min":1.0329999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":14.361000000000001,"5min":22.882000000000001,"15min":22.882000000000001},"last":0.59899999999999998}]},{"osd":5,"last update":"Wed Jul 5 23:35:53 2023","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":2.0609999999999999,"15min":1.155},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":14.435,"5min":23.004999999999999,"15min":23.004999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.92300000000000004,"5min":1.7729999999999999,"15min":1.073},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":4.4329999999999998,"5min":18.959,"15min":18.959},"last":0.58299999999999996}]},{"osd":6,"last update":"Wed Jul 5 23:35:53 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":1.47,"15min":0.97499999999999998},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":4.6879999999999997,"5min":18.923999999999999,"15min":18.923999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":2.734,"5min":2.0649999999999999,"15min":1.143},"min":{"1min":0.44500000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":37.619,"5min":37.619,"15min":37.619},"last":0.73499999999999999}]},{"osd":7,"last update":"Wed Jul 5 23:35:53 2023","interfaces":[{"interface":"back","average":{"1min":2.75,"5min":2.0019999999999998,"15min":1.1120000000000001},"min":{"1min":0.47699999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":37.555999999999997,"5min":37.555999999999997,"15min":37.555999999999997},"last":0.76500000000000001},{"interface":"front","average":{"1min":1.462,"5min":1.9219999999999999,"15min":1.1259999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":14.747999999999999,"5min":22.974,"15min":22.974},"last":0.70499999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574898,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61560,"kb_used_data":26416,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94310280,"statfs":{"total":96636764160,"available":96573726720,"internally_reserved":0,"allocated":27049984,"data_stored":26841193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 5 23:35:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":1.4610000000000001,"15min":0.82799999999999996},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":3.3119999999999998,"5min":16.655999999999999,"15min":16.655999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.53500000000000003,"5min":1.5189999999999999,"15min":0.85199999999999998},"min":{"1min":0.32300000000000001,"5min":0.307,"15min":0.307},"max":{"1min":1.1140000000000001,"5min":18.661999999999999,"15min":18.661999999999999},"last":0.59399999999999997}]},{"osd":1,"last update":"Wed Jul 5 23:35:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":1.4770000000000001,"15min":0.81999999999999995},"min":{"1min":0.33000000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.77400000000000002,"5min":18.991,"15min":18.991},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":1.8420000000000001,"15min":0.94999999999999996},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71199999999999997,"5min":23.879000000000001,"15min":23.879000000000001},"last":0.65400000000000003}]},{"osd":2,"last update":"Wed Jul 5 23:35:48 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":1.907,"15min":1.0149999999999999},"min":{"1min":0.36799999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":8.7750000000000004,"5min":23.805,"15min":23.805},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.53800000000000003,"5min":1.6639999999999999,"15min":0.92000000000000004},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.1839999999999999,"5min":18.707000000000001,"15min":18.707000000000001},"last":0.58399999999999996}]},{"osd":3,"last update":"Wed Jul 5 23:35:48 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":1.6259999999999999,"15min":0.89200000000000002},"min":{"1min":0.38200000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.0229999999999999,"5min":22.966999999999999,"15min":22.966999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.77600000000000002,"5min":1.72,"15min":0.95799999999999996},"min":{"1min":0.36499999999999999,"5min":0.314,"15min":0.314},"max":{"1min":5.391,"5min":23.843,"15min":23.843},"last":0.68000000000000005}]},{"osd":5,"last update":"Wed Jul 5 23:35:48 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":1.327,"15min":0.753},"min":{"1min":0.315,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.70099999999999996,"5min":16.574999999999999,"15min":16.574999999999999},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.45000000000000001,"5min":1.1719999999999999,"15min":0.73999999999999999},"min":{"1min":0.34100000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.624,"5min":18.693999999999999,"15min":18.693999999999999},"last":0.51200000000000001}]},{"osd":6,"last update":"Wed Jul 5 23:35:48 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":1.4139999999999999,"15min":0.82299999999999995},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.80200000000000005,"5min":17.983000000000001,"15min":17.983000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.51100000000000001,"5min":1.3220000000000001,"15min":0.80700000000000005},"min":{"1min":0.375,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.79400000000000004,"5min":16.622,"15min":16.622},"last":0.69699999999999995}]},{"osd":7,"last update":"Wed Jul 5 23:35:48 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":1.2130000000000001,"15min":0.76900000000000002},"min":{"1min":0.35799999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.82899999999999996,"5min":22.931000000000001,"15min":22.931000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":1.3,"15min":0.82199999999999995},"min":{"1min":0.39900000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.90200000000000002,"5min":18.966000000000001,"15min":18.966000000000001},"last":0.56799999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574897,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60048,"kb_used_data":24904,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94311792,"statfs":{"total":96636764160,"available":96575275008,"internally_reserved":0,"allocated":25501696,"data_stored":25305322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 5 23:35:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.722,"15min":0.90600000000000003},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":10.981,"5min":18.867999999999999,"15min":18.867999999999999},"last":0.48199999999999998},{"interface":"front","average":{"1min":1.7290000000000001,"5min":1.5549999999999999,"15min":0.94899999999999995},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":12.927,"5min":18.099,"15min":18.099},"last":0.56499999999999995}]},{"osd":1,"last update":"Wed Jul 5 23:35:41 2023","interfaces":[{"interface":"back","average":{"1min":1.7569999999999999,"5min":1.478,"15min":0.88200000000000001},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":13.012,"5min":18.071999999999999,"15min":18.071999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":2.2109999999999999,"5min":1.7629999999999999,"15min":0.999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":17.004999999999999,"5min":17.004999999999999,"15min":17.004999999999999},"last":0.42199999999999999}]},{"osd":2,"last update":"Wed Jul 5 23:35:41 2023","interfaces":[{"interface":"back","average":{"1min":2.222,"5min":1.8859999999999999,"15min":1.01},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":16.920999999999999,"5min":22.177,"15min":22.177},"last":0.60499999999999998},{"interface":"front","average":{"1min":1.9410000000000001,"5min":1.831,"15min":1},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":17.369,"5min":18.902999999999999,"15min":18.902999999999999},"last":0.435}]},{"osd":3,"last update":"Wed Jul 5 23:35:41 2023","interfaces":[{"interface":"back","average":{"1min":1.7709999999999999,"5min":1.5700000000000001,"15min":0.91400000000000003},"min":{"1min":0.39300000000000002,"5min":0.376,"15min":0.376},"max":{"1min":12.965999999999999,"5min":18.032,"15min":18.032},"last":0.38500000000000001},{"interface":"front","average":{"1min":2.258,"5min":1.7130000000000001,"15min":1.03},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":17.029,"5min":17.029,"15min":17.029},"last":0.495}]},{"osd":4,"last update":"Wed Jul 5 23:35:41 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":1.599,"15min":0.88500000000000001},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":10.957000000000001,"5min":18.957000000000001,"15min":18.957000000000001},"last":0.35199999999999998},{"interface":"front","average":{"1min":1.131,"5min":1.3089999999999999,"15min":0.82699999999999996},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":13.032999999999999,"5min":18.123999999999999,"15min":18.123999999999999},"last":0.46200000000000002}]},{"osd":6,"last update":"Wed Jul 5 23:35:41 2023","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.4530000000000001,"15min":0.871},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":16.954000000000001,"5min":16.954000000000001,"15min":16.954000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.58799999999999997,"5min":1.4890000000000001,"15min":0.88300000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":2.0600000000000001,"5min":18.928000000000001,"15min":18.928000000000001},"last":0.52100000000000002}]},{"osd":7,"last update":"Wed Jul 5 23:35:41 2023","interfaces":[{"interface":"back","average":{"1min":1.7549999999999999,"5min":1.1950000000000001,"15min":0.79500000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":12.991,"5min":12.991,"15min":12.991},"last":0.53300000000000003},{"interface":"front","average":{"1min":1.5129999999999999,"5min":1.254,"15min":0.83599999999999997},"min":{"1min":0.39800000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":16.98,"5min":16.98,"15min":16.98},"last":0.57999999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":8334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1556480,"data_stored":1536523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1556480,"data_stored":1528931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":23068672,"data_stored":23068672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23068672,"data_stored":23068672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":25165824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":25165824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":25165824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":27262976,"data_stored":27262976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":31457280,"data_stored":31457280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-05T23:36:26.439 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:36:26.441 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:36:26.441 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2023-07-05T23:32:56.321976+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=32, tm_sec=56, tm_wday=2, tm_yday=186, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=5, tm_hour=23, tm_min=35, tm_sec=19, tm_wday=2, tm_yday=186, tm_isdst=0) 2023-07-05T23:36:26.442 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-07-05T23:36:46.443 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-05T23:36:46.582 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.580+0000 7f4afca87700 1 Processor -- start 2023-07-05T23:36:46.583 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.580+0000 7f4afca87700 1 -- start start 2023-07-05T23:36:46.586 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.581+0000 7f4afca87700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4af806a880 0x7f4af8160830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:46.586 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.581+0000 7f4afca87700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4af80cef00 0x7f4af80cf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:46.586 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.581+0000 7f4afca87700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4af80b1c70 con 0x7f4af815c5a0 2023-07-05T23:36:46.586 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.581+0000 7f4afca87700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4af80b21f0 con 0x7f4af806a880 2023-07-05T23:36:46.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.581+0000 7f4afca87700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4af80b1f10 con 0x7f4af80cef00 2023-07-05T23:36:46.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.581+0000 7f4af659c700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f4af815c5a0 0x7f4af8160120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:53966/0 (socket says 172.21.15.27:53966) 2023-07-05T23:36:46.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.581+0000 7f4af659c700 1 -- 172.21.15.27:0/1084275545 learned_addr learned my addr 172.21.15.27:0/1084275545 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-07-05T23:36:46.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.582+0000 7f4af5d9b700 1 --2- 172.21.15.27:0/1084275545 >> v2:172.21.15.162:3300/0 conn(0x7f4af806a880 0x7f4af8160830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:46.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.582+0000 7f4af6d9d700 1 --2- 172.21.15.27:0/1084275545 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4af80cef00 0x7f4af80cf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:46.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.582+0000 7f4af559a700 1 -- 172.21.15.27:0/1084275545 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3359888798 0 0) 0x7f4af80b1c70 con 0x7f4af815c5a0 2023-07-05T23:36:46.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.582+0000 7f4af559a700 1 -- 172.21.15.27:0/1084275545 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ae00035b0 con 0x7f4af815c5a0 2023-07-05T23:36:46.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.582+0000 7f4af559a700 1 -- 172.21.15.27:0/1084275545 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1111506208 0 0) 0x7f4ae00035b0 con 0x7f4af815c5a0 2023-07-05T23:36:46.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.582+0000 7f4af559a700 1 -- 172.21.15.27:0/1084275545 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4af80cef00 msgr2=0x7f4af80cf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:36:46.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.582+0000 7f4af559a700 1 --2- 172.21.15.27:0/1084275545 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4af80cef00 0x7f4af80cf330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:46.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.582+0000 7f4af559a700 1 -- 172.21.15.27:0/1084275545 >> v2:172.21.15.162:3300/0 conn(0x7f4af806a880 msgr2=0x7f4af8160830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:36:46.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.582+0000 7f4af559a700 1 --2- 172.21.15.27:0/1084275545 >> v2:172.21.15.162:3300/0 conn(0x7f4af806a880 0x7f4af8160830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:46.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.582+0000 7f4af559a700 1 -- 172.21.15.27:0/1084275545 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af8071420 con 0x7f4af815c5a0 2023-07-05T23:36:46.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.582+0000 7f4af559a700 1 -- 172.21.15.27:0/1084275545 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1246168953 0 0) 0x7f4aec001670 con 0x7f4af815c5a0 2023-07-05T23:36:46.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.582+0000 7f4af559a700 1 -- 172.21.15.27:0/1084275545 >> v1:172.21.15.27:6789/0 conn(0x7f4af815c5a0 legacy=0x7f4af8160120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:46.591 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.582+0000 7f4af559a700 1 --2- 172.21.15.27:0/1084275545 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ae0003a00 0x7f4ae0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:46.592 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.582+0000 7f4af559a700 1 --2- 172.21.15.27:0/1084275545 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4af80cef00 0x7f4ae0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:46.592 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.582+0000 7f4af559a700 1 --2- 172.21.15.27:0/1084275545 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4ae0004d90 0x7f4ae0005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:46.592 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.582+0000 7f4af559a700 1 -- 172.21.15.27:0/1084275545 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af80b21f0 con 0x7f4ae0003a00 2023-07-05T23:36:46.592 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.582+0000 7f4af559a700 1 -- 172.21.15.27:0/1084275545 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af80b1f10 con 0x7f4ae0004d90 2023-07-05T23:36:46.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.582+0000 7f4af559a700 1 -- 172.21.15.27:0/1084275545 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae000ba10 con 0x7f4af80cef00 2023-07-05T23:36:46.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.582+0000 7f4af659c700 1 --2- 172.21.15.27:0/1084275545 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ae0003a00 0x7f4ae0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:46.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.582+0000 7f4af6d9d700 1 --2- 172.21.15.27:0/1084275545 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4ae0004d90 0x7f4ae0005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:46.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.582+0000 7f4af5d9b700 1 --2- 172.21.15.27:0/1084275545 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4af80cef00 0x7f4ae0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:46.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.582+0000 7f4af659c700 1 -- 172.21.15.27:0/1084275545 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4af80cef00 msgr2=0x7f4ae0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:36:46.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.582+0000 7f4af659c700 1 --2- 172.21.15.27:0/1084275545 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4af80cef00 0x7f4ae0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:46.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.582+0000 7f4af659c700 1 -- 172.21.15.27:0/1084275545 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4ae0004d90 msgr2=0x7f4ae0005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:36:46.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.582+0000 7f4af659c700 1 --2- 172.21.15.27:0/1084275545 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4ae0004d90 0x7f4ae0005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:46.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.582+0000 7f4af659c700 1 -- 172.21.15.27:0/1084275545 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ae00035b0 con 0x7f4ae0003a00 2023-07-05T23:36:46.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.583+0000 7f4af659c700 1 --2- 172.21.15.27:0/1084275545 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ae0003a00 0x7f4ae0003e10 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f4aec00c2f0 tx=0x7f4ae0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=135cb8f50b732b55 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:36:46.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.583+0000 7f4af559a700 1 -- 172.21.15.27:0/1084275545 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aec00ce30 con 0x7f4ae0003a00 2023-07-05T23:36:46.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.583+0000 7f4af559a700 1 -- 172.21.15.27:0/1084275545 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aec005960 con 0x7f4ae0003a00 2023-07-05T23:36:46.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.583+0000 7f4af559a700 1 -- 172.21.15.27:0/1084275545 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aec005d10 con 0x7f4ae0003a00 2023-07-05T23:36:46.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.583+0000 7f4afca87700 1 -- 172.21.15.27:0/1084275545 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ae0003a00 msgr2=0x7f4ae0003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:46.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.583+0000 7f4afca87700 1 --2- 172.21.15.27:0/1084275545 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ae0003a00 0x7f4ae0003e10 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f4aec00c2f0 tx=0x7f4ae0005880 comp rx=0 tx=0).stop 2023-07-05T23:36:46.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.583+0000 7f4af6d9d700 1 -- 172.21.15.27:0/1084275545 reap_dead start 2023-07-05T23:36:46.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.583+0000 7f4afca87700 1 -- 172.21.15.27:0/1084275545 shutdown_connections 2023-07-05T23:36:46.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.583+0000 7f4afca87700 1 -- 172.21.15.27:0/1084275545 >> 172.21.15.27:0/1084275545 conn(0x7f4af806d450 msgr2=0x7f4af806d820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:36:46.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.583+0000 7f4afca87700 1 -- 172.21.15.27:0/1084275545 shutdown_connections 2023-07-05T23:36:46.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.584+0000 7f4afca87700 1 -- 172.21.15.27:0/1084275545 wait complete. 2023-07-05T23:36:46.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.585+0000 7f4afca87700 1 Processor -- start 2023-07-05T23:36:46.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.585+0000 7f4afca87700 1 -- start start 2023-07-05T23:36:46.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.586+0000 7f4afca87700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ae0003a00 0x7f4af80c6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:46.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.586+0000 7f4afca87700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4af815b910 0x7f4af8157890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:46.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.586+0000 7f4afca87700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4af80c84c0 0x7f4af80c8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:46.601 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.586+0000 7f4afca87700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af81f58b0 con 0x7f4ae0003a00 2023-07-05T23:36:46.601 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.586+0000 7f4afca87700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af80c8e50 con 0x7f4af815b910 2023-07-05T23:36:46.601 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.586+0000 7f4afca87700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4af80b2630 con 0x7f4af80c84c0 2023-07-05T23:36:46.601 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.586+0000 7f4af659c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ae0003a00 0x7f4af80c6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:46.602 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.587+0000 7f4af659c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ae0003a00 0x7f4af80c6820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46812/0 (socket says 172.21.15.27:46812) 2023-07-05T23:36:46.602 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.587+0000 7f4af659c700 1 -- 172.21.15.27:0/35883616 learned_addr learned my addr 172.21.15.27:0/35883616 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:36:46.602 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.587+0000 7f4af5d9b700 1 --2- 172.21.15.27:0/35883616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4af815b910 0x7f4af8157890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:46.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.587+0000 7f4af6d9d700 1 --2- 172.21.15.27:0/35883616 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4af80c84c0 0x7f4af80c8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:46.604 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.587+0000 7f4af659c700 1 -- 172.21.15.27:0/35883616 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4af80c84c0 msgr2=0x7f4af80c8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:46.604 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.587+0000 7f4af659c700 1 --2- 172.21.15.27:0/35883616 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4af80c84c0 0x7f4af80c8910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:46.604 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.587+0000 7f4af659c700 1 -- 172.21.15.27:0/35883616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4af815b910 msgr2=0x7f4af8157890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:46.604 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.587+0000 7f4af659c700 1 --2- 172.21.15.27:0/35883616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4af815b910 0x7f4af8157890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:46.605 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.587+0000 7f4af659c700 1 -- 172.21.15.27:0/35883616 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af80c6ee0 con 0x7f4ae0003a00 2023-07-05T23:36:46.605 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.587+0000 7f4af6d9d700 1 --2- 172.21.15.27:0/35883616 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4af80c84c0 0x7f4af80c8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T23:36:46.605 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.587+0000 7f4af5d9b700 1 --2- 172.21.15.27:0/35883616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4af815b910 0x7f4af8157890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T23:36:46.605 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.587+0000 7f4af659c700 1 --2- 172.21.15.27:0/35883616 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ae0003a00 0x7f4af80c6820 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f4aec008fd0 tx=0x7f4af80b1e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:36:46.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.587+0000 7f4ae6ffd700 1 -- 172.21.15.27:0/35883616 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aec00cea0 con 0x7f4ae0003a00 2023-07-05T23:36:46.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.587+0000 7f4ae6ffd700 1 -- 172.21.15.27:0/35883616 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aec004a80 con 0x7f4ae0003a00 2023-07-05T23:36:46.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.587+0000 7f4afca87700 1 -- 172.21.15.27:0/35883616 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4af80c71c0 con 0x7f4ae0003a00 2023-07-05T23:36:46.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.587+0000 7f4ae6ffd700 1 -- 172.21.15.27:0/35883616 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aec004df0 con 0x7f4ae0003a00 2023-07-05T23:36:46.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.587+0000 7f4afca87700 1 -- 172.21.15.27:0/35883616 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4af80c7780 con 0x7f4ae0003a00 2023-07-05T23:36:46.607 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.588+0000 7f4afca87700 1 -- 172.21.15.27:0/35883616 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4af80b2910 con 0x7f4ae0003a00 2023-07-05T23:36:46.607 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.589+0000 7f4ae6ffd700 1 -- 172.21.15.27:0/35883616 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4aec0070d0 con 0x7f4ae0003a00 2023-07-05T23:36:46.607 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.589+0000 7f4ae6ffd700 1 --2- 172.21.15.27:0/35883616 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f4ad806ace0 0x7f4ad806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:46.607 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.589+0000 7f4ae6ffd700 1 -- 172.21.15.27:0/35883616 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4aec08ab60 con 0x7f4ae0003a00 2023-07-05T23:36:46.607 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.589+0000 7f4af5d9b700 1 --2- 172.21.15.27:0/35883616 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f4ad806ace0 0x7f4ad806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:46.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.590+0000 7f4af5d9b700 1 --2- 172.21.15.27:0/35883616 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f4ad806ace0 0x7f4ad806d190 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4af80c8450 tx=0x7f4ae8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:36:46.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.594+0000 7f4ae6ffd700 1 -- 172.21.15.27:0/35883616 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4aec055a30 con 0x7f4ae0003a00 2023-07-05T23:36:46.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.787+0000 7f4afca87700 1 -- 172.21.15.27:0/35883616 --> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4af8071700 con 0x7f4ad806ace0 2023-07-05T23:36:46.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.799+0000 7f4ae6ffd700 1 -- 172.21.15.27:0/35883616 <== mgr.4105 v2:172.21.15.162:6832/3790028097 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+394445 (secure 0 0 0) 0x7f4ae80097f0 con 0x7f4ad806ace0 2023-07-05T23:36:46.806 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:36:46.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.802+0000 7f4afca87700 1 -- 172.21.15.27:0/35883616 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f4ad806ace0 msgr2=0x7f4ad806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:46.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.802+0000 7f4afca87700 1 --2- 172.21.15.27:0/35883616 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f4ad806ace0 0x7f4ad806d190 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4af80c8450 tx=0x7f4ae8008040 comp rx=0 tx=0).stop 2023-07-05T23:36:46.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.802+0000 7f4afca87700 1 -- 172.21.15.27:0/35883616 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ae0003a00 msgr2=0x7f4af80c6820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:46.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.802+0000 7f4afca87700 1 --2- 172.21.15.27:0/35883616 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ae0003a00 0x7f4af80c6820 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f4aec008fd0 tx=0x7f4af80b1e00 comp rx=0 tx=0).stop 2023-07-05T23:36:46.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.802+0000 7f4afca87700 1 -- 172.21.15.27:0/35883616 shutdown_connections 2023-07-05T23:36:46.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.802+0000 7f4afca87700 1 --2- 172.21.15.27:0/35883616 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f4ad806ace0 0x7f4ad806d190 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:46.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.802+0000 7f4afca87700 1 --2- 172.21.15.27:0/35883616 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4af80c84c0 0x7f4af80c8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:46.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.802+0000 7f4afca87700 1 --2- 172.21.15.27:0/35883616 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ae0003a00 0x7f4af80c6820 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:46.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.802+0000 7f4afca87700 1 --2- 172.21.15.27:0/35883616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4af815b910 0x7f4af8157890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:46.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.802+0000 7f4afca87700 1 -- 172.21.15.27:0/35883616 >> 172.21.15.27:0/35883616 conn(0x7f4af806d450 msgr2=0x7f4af80c5440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:36:46.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.802+0000 7f4afca87700 1 -- 172.21.15.27:0/35883616 shutdown_connections 2023-07-05T23:36:46.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:46.802+0000 7f4afca87700 1 -- 172.21.15.27:0/35883616 wait complete. 2023-07-05T23:36:46.811 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2023-07-05T23:36:46.817 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":146,"stamp":"2023-07-05T23:36:45.702071+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":102790929,"num_objects":49,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":131,"num_read_kb":117,"num_write":1261,"num_write_kb":1290376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17771,"ondisk_log_size":17771,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":464064,"kb_used_data":203392,"kb_used_omap":0,"kb_used_meta":260608,"kb_avail":754510656,"statfs":{"total":773094113280,"available":772618911744,"internally_reserved":0,"allocated":208273408,"data_stored":206692626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":266862592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003510"},"pg_stats":[{"pgid":"4.3f","version":"30'28","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:28.077809+0000","last_change":"2023-07-05T23:35:28.077860+0000","last_active":"2023-07-05T23:35:28.077809+0000","last_peered":"2023-07-05T23:35:28.077809+0000","last_clean":"2023-07-05T23:35:28.077809+0000","last_became_active":"2023-07-05T23:32:53.342061+0000","last_became_peered":"2023-07-05T23:32:53.342061+0000","last_unstale":"2023-07-05T23:35:28.077809+0000","last_undegraded":"2023-07-05T23:35:28.077809+0000","last_fullsized":"2023-07-05T23:35:28.077809+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'28","last_scrub_stamp":"2023-07-05T23:35:28.077703+0000","last_deep_scrub":"30'28","last_deep_scrub_stamp":"2023-07-05T23:35:28.077703+0000","last_clean_scrub_stamp":"2023-07-05T23:35:28.077703+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:53:22.483440+0000","scrub_duration":0.0019331699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"30'27","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:26.826504+0000","last_change":"2023-07-05T23:35:26.826592+0000","last_active":"2023-07-05T23:35:26.826504+0000","last_peered":"2023-07-05T23:35:26.826504+0000","last_clean":"2023-07-05T23:35:26.826504+0000","last_became_active":"2023-07-05T23:32:53.342843+0000","last_became_peered":"2023-07-05T23:32:53.342843+0000","last_unstale":"2023-07-05T23:35:26.826504+0000","last_undegraded":"2023-07-05T23:35:26.826504+0000","last_fullsized":"2023-07-05T23:35:26.826504+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'27","last_scrub_stamp":"2023-07-05T23:35:26.826382+0000","last_deep_scrub":"30'27","last_deep_scrub_stamp":"2023-07-05T23:35:26.826382+0000","last_clean_scrub_stamp":"2023-07-05T23:35:26.826382+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:27:33.841616+0000","scrub_duration":0.002058448,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"30'43","reported_seq":76,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:36:13.646035+0000","last_change":"2023-07-05T23:36:13.646095+0000","last_active":"2023-07-05T23:36:13.646035+0000","last_peered":"2023-07-05T23:36:13.646035+0000","last_clean":"2023-07-05T23:36:13.646035+0000","last_became_active":"2023-07-05T23:32:53.338973+0000","last_became_peered":"2023-07-05T23:32:53.338973+0000","last_unstale":"2023-07-05T23:36:13.646035+0000","last_undegraded":"2023-07-05T23:36:13.646035+0000","last_fullsized":"2023-07-05T23:36:13.646035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'43","last_scrub_stamp":"2023-07-05T23:36:13.645903+0000","last_deep_scrub":"30'43","last_deep_scrub_stamp":"2023-07-05T23:36:13.645903+0000","last_clean_scrub_stamp":"2023-07-05T23:36:13.645903+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:22:46.066144+0000","scrub_duration":0.0021327379999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"30'24","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:33.415555+0000","last_change":"2023-07-05T23:35:33.415615+0000","last_active":"2023-07-05T23:35:33.415555+0000","last_peered":"2023-07-05T23:35:33.415555+0000","last_clean":"2023-07-05T23:35:33.415555+0000","last_became_active":"2023-07-05T23:32:53.334473+0000","last_became_peered":"2023-07-05T23:32:53.334473+0000","last_unstale":"2023-07-05T23:35:33.415555+0000","last_undegraded":"2023-07-05T23:35:33.415555+0000","last_fullsized":"2023-07-05T23:35:33.415555+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'24","last_scrub_stamp":"2023-07-05T23:35:33.415463+0000","last_deep_scrub":"30'24","last_deep_scrub_stamp":"2023-07-05T23:35:33.415463+0000","last_clean_scrub_stamp":"2023-07-05T23:35:33.415463+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:35:57.145092+0000","scrub_duration":0.0017828779999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"30'34","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:51.557867+0000","last_change":"2023-07-05T23:35:51.557916+0000","last_active":"2023-07-05T23:35:51.557867+0000","last_peered":"2023-07-05T23:35:51.557867+0000","last_clean":"2023-07-05T23:35:51.557867+0000","last_became_active":"2023-07-05T23:32:53.345743+0000","last_became_peered":"2023-07-05T23:32:53.345743+0000","last_unstale":"2023-07-05T23:35:51.557867+0000","last_undegraded":"2023-07-05T23:35:51.557867+0000","last_fullsized":"2023-07-05T23:35:51.557867+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'34","last_scrub_stamp":"2023-07-05T23:35:51.557768+0000","last_deep_scrub":"30'34","last_deep_scrub_stamp":"2023-07-05T23:35:51.557768+0000","last_clean_scrub_stamp":"2023-07-05T23:35:51.557768+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:22:28.327810+0000","scrub_duration":0.00171462,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"30'39","reported_seq":72,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:36:05.569982+0000","last_change":"2023-07-05T23:36:05.570030+0000","last_active":"2023-07-05T23:36:05.569982+0000","last_peered":"2023-07-05T23:36:05.569982+0000","last_clean":"2023-07-05T23:36:05.569982+0000","last_became_active":"2023-07-05T23:32:53.335456+0000","last_became_peered":"2023-07-05T23:32:53.335456+0000","last_unstale":"2023-07-05T23:36:05.569982+0000","last_undegraded":"2023-07-05T23:36:05.569982+0000","last_fullsized":"2023-07-05T23:36:05.569982+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'39","last_scrub_stamp":"2023-07-05T23:36:05.569878+0000","last_deep_scrub":"30'39","last_deep_scrub_stamp":"2023-07-05T23:36:05.569878+0000","last_clean_scrub_stamp":"2023-07-05T23:36:05.569878+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:58:20.957985+0000","scrub_duration":0.001660908,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"30'27","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:49.364981+0000","last_change":"2023-07-05T23:35:49.365055+0000","last_active":"2023-07-05T23:35:49.364981+0000","last_peered":"2023-07-05T23:35:49.364981+0000","last_clean":"2023-07-05T23:35:49.364981+0000","last_became_active":"2023-07-05T23:32:53.340639+0000","last_became_peered":"2023-07-05T23:32:53.340639+0000","last_unstale":"2023-07-05T23:35:49.364981+0000","last_undegraded":"2023-07-05T23:35:49.364981+0000","last_fullsized":"2023-07-05T23:35:49.364981+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'27","last_scrub_stamp":"2023-07-05T23:35:49.364872+0000","last_deep_scrub":"30'27","last_deep_scrub_stamp":"2023-07-05T23:35:49.364872+0000","last_clean_scrub_stamp":"2023-07-05T23:35:49.364872+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:47:50.452938+0000","scrub_duration":0.0017485770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"30'31","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:29.789118+0000","last_change":"2023-07-05T23:35:29.789172+0000","last_active":"2023-07-05T23:35:29.789118+0000","last_peered":"2023-07-05T23:35:29.789118+0000","last_clean":"2023-07-05T23:35:29.789118+0000","last_became_active":"2023-07-05T23:32:53.336216+0000","last_became_peered":"2023-07-05T23:32:53.336216+0000","last_unstale":"2023-07-05T23:35:29.789118+0000","last_undegraded":"2023-07-05T23:35:29.789118+0000","last_fullsized":"2023-07-05T23:35:29.789118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'31","last_scrub_stamp":"2023-07-05T23:35:29.789015+0000","last_deep_scrub":"30'31","last_deep_scrub_stamp":"2023-07-05T23:35:29.789015+0000","last_clean_scrub_stamp":"2023-07-05T23:35:29.789015+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:06:48.212448+0000","scrub_duration":0.001571259,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"30'38","reported_seq":71,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:44.530028+0000","last_change":"2023-07-05T23:35:44.530111+0000","last_active":"2023-07-05T23:35:44.530028+0000","last_peered":"2023-07-05T23:35:44.530028+0000","last_clean":"2023-07-05T23:35:44.530028+0000","last_became_active":"2023-07-05T23:32:53.347948+0000","last_became_peered":"2023-07-05T23:32:53.347948+0000","last_unstale":"2023-07-05T23:35:44.530028+0000","last_undegraded":"2023-07-05T23:35:44.530028+0000","last_fullsized":"2023-07-05T23:35:44.530028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'38","last_scrub_stamp":"2023-07-05T23:35:44.529912+0000","last_deep_scrub":"30'38","last_deep_scrub_stamp":"2023-07-05T23:35:44.529912+0000","last_clean_scrub_stamp":"2023-07-05T23:35:44.529912+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:47:45.617977+0000","scrub_duration":0.001908533,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"30'44","reported_seq":77,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:46.800220+0000","last_change":"2023-07-05T23:35:46.800291+0000","last_active":"2023-07-05T23:35:46.800220+0000","last_peered":"2023-07-05T23:35:46.800220+0000","last_clean":"2023-07-05T23:35:46.800220+0000","last_became_active":"2023-07-05T23:32:53.330135+0000","last_became_peered":"2023-07-05T23:32:53.330135+0000","last_unstale":"2023-07-05T23:35:46.800220+0000","last_undegraded":"2023-07-05T23:35:46.800220+0000","last_fullsized":"2023-07-05T23:35:46.800220+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'44","last_scrub_stamp":"2023-07-05T23:35:46.800082+0000","last_deep_scrub":"30'44","last_deep_scrub_stamp":"2023-07-05T23:35:46.800082+0000","last_clean_scrub_stamp":"2023-07-05T23:35:46.800082+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:58:40.415256+0000","scrub_duration":0.001981516,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"30'25","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:36:03.568650+0000","last_change":"2023-07-05T23:36:03.568698+0000","last_active":"2023-07-05T23:36:03.568650+0000","last_peered":"2023-07-05T23:36:03.568650+0000","last_clean":"2023-07-05T23:36:03.568650+0000","last_became_active":"2023-07-05T23:32:53.341526+0000","last_became_peered":"2023-07-05T23:32:53.341526+0000","last_unstale":"2023-07-05T23:36:03.568650+0000","last_undegraded":"2023-07-05T23:36:03.568650+0000","last_fullsized":"2023-07-05T23:36:03.568650+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'25","last_scrub_stamp":"2023-07-05T23:36:03.568545+0000","last_deep_scrub":"30'25","last_deep_scrub_stamp":"2023-07-05T23:36:03.568545+0000","last_clean_scrub_stamp":"2023-07-05T23:36:03.568545+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:19:51.173415+0000","scrub_duration":0.0021177969999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"30'30","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:39.129286+0000","last_change":"2023-07-05T23:35:39.129369+0000","last_active":"2023-07-05T23:35:39.129286+0000","last_peered":"2023-07-05T23:35:39.129286+0000","last_clean":"2023-07-05T23:35:39.129286+0000","last_became_active":"2023-07-05T23:32:53.337279+0000","last_became_peered":"2023-07-05T23:32:53.337279+0000","last_unstale":"2023-07-05T23:35:39.129286+0000","last_undegraded":"2023-07-05T23:35:39.129286+0000","last_fullsized":"2023-07-05T23:35:39.129286+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'30","last_scrub_stamp":"2023-07-05T23:35:39.129160+0000","last_deep_scrub":"30'30","last_deep_scrub_stamp":"2023-07-05T23:35:39.129160+0000","last_clean_scrub_stamp":"2023-07-05T23:35:39.129160+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:01:23.384296+0000","scrub_duration":0.0019447869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"30'30","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:31.043742+0000","last_change":"2023-07-05T23:35:31.043789+0000","last_active":"2023-07-05T23:35:31.043742+0000","last_peered":"2023-07-05T23:35:31.043742+0000","last_clean":"2023-07-05T23:35:31.043742+0000","last_became_active":"2023-07-05T23:32:53.336083+0000","last_became_peered":"2023-07-05T23:32:53.336083+0000","last_unstale":"2023-07-05T23:35:31.043742+0000","last_undegraded":"2023-07-05T23:35:31.043742+0000","last_fullsized":"2023-07-05T23:35:31.043742+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'30","last_scrub_stamp":"2023-07-05T23:35:31.043651+0000","last_deep_scrub":"30'30","last_deep_scrub_stamp":"2023-07-05T23:35:31.043651+0000","last_clean_scrub_stamp":"2023-07-05T23:35:31.043651+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:00:14.136508+0000","scrub_duration":0.001589949,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"30'32","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:47.783303+0000","last_change":"2023-07-05T23:35:47.783348+0000","last_active":"2023-07-05T23:35:47.783303+0000","last_peered":"2023-07-05T23:35:47.783303+0000","last_clean":"2023-07-05T23:35:47.783303+0000","last_became_active":"2023-07-05T23:32:53.327918+0000","last_became_peered":"2023-07-05T23:32:53.327918+0000","last_unstale":"2023-07-05T23:35:47.783303+0000","last_undegraded":"2023-07-05T23:35:47.783303+0000","last_fullsized":"2023-07-05T23:35:47.783303+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-07-05T23:35:47.783224+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-07-05T23:35:47.783224+0000","last_clean_scrub_stamp":"2023-07-05T23:35:47.783224+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:37:51.419002+0000","scrub_duration":0.0020096649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"30'31","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:36:00.352406+0000","last_change":"2023-07-05T23:36:00.352452+0000","last_active":"2023-07-05T23:36:00.352406+0000","last_peered":"2023-07-05T23:36:00.352406+0000","last_clean":"2023-07-05T23:36:00.352406+0000","last_became_active":"2023-07-05T23:32:53.340246+0000","last_became_peered":"2023-07-05T23:32:53.340246+0000","last_unstale":"2023-07-05T23:36:00.352406+0000","last_undegraded":"2023-07-05T23:36:00.352406+0000","last_fullsized":"2023-07-05T23:36:00.352406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'31","last_scrub_stamp":"2023-07-05T23:36:00.352316+0000","last_deep_scrub":"30'31","last_deep_scrub_stamp":"2023-07-05T23:36:00.352316+0000","last_clean_scrub_stamp":"2023-07-05T23:36:00.352316+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:01:31.956213+0000","scrub_duration":0.0019103480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"30'39","reported_seq":72,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:36:06.559205+0000","last_change":"2023-07-05T23:36:06.559269+0000","last_active":"2023-07-05T23:36:06.559205+0000","last_peered":"2023-07-05T23:36:06.559205+0000","last_clean":"2023-07-05T23:36:06.559205+0000","last_became_active":"2023-07-05T23:32:53.336006+0000","last_became_peered":"2023-07-05T23:32:53.336006+0000","last_unstale":"2023-07-05T23:36:06.559205+0000","last_undegraded":"2023-07-05T23:36:06.559205+0000","last_fullsized":"2023-07-05T23:36:06.559205+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'39","last_scrub_stamp":"2023-07-05T23:36:06.559117+0000","last_deep_scrub":"30'39","last_deep_scrub_stamp":"2023-07-05T23:36:06.559117+0000","last_clean_scrub_stamp":"2023-07-05T23:36:06.559117+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:18:43.649326+0000","scrub_duration":0.00178312,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"30'34","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:41.603516+0000","last_change":"2023-07-05T23:35:41.603564+0000","last_active":"2023-07-05T23:35:41.603516+0000","last_peered":"2023-07-05T23:35:41.603516+0000","last_clean":"2023-07-05T23:35:41.603516+0000","last_became_active":"2023-07-05T23:32:53.345848+0000","last_became_peered":"2023-07-05T23:32:53.345848+0000","last_unstale":"2023-07-05T23:35:41.603516+0000","last_undegraded":"2023-07-05T23:35:41.603516+0000","last_fullsized":"2023-07-05T23:35:41.603516+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'34","last_scrub_stamp":"2023-07-05T23:35:41.603416+0000","last_deep_scrub":"30'34","last_deep_scrub_stamp":"2023-07-05T23:35:41.603416+0000","last_clean_scrub_stamp":"2023-07-05T23:35:41.603416+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:47:37.532728+0000","scrub_duration":0.00170199,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"30'29","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:36:04.597927+0000","last_change":"2023-07-05T23:36:04.597980+0000","last_active":"2023-07-05T23:36:04.597927+0000","last_peered":"2023-07-05T23:36:04.597927+0000","last_clean":"2023-07-05T23:36:04.597927+0000","last_became_active":"2023-07-05T23:32:53.335535+0000","last_became_peered":"2023-07-05T23:32:53.335535+0000","last_unstale":"2023-07-05T23:36:04.597927+0000","last_undegraded":"2023-07-05T23:36:04.597927+0000","last_fullsized":"2023-07-05T23:36:04.597927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'29","last_scrub_stamp":"2023-07-05T23:36:04.597831+0000","last_deep_scrub":"30'29","last_deep_scrub_stamp":"2023-07-05T23:36:04.597831+0000","last_clean_scrub_stamp":"2023-07-05T23:36:04.597831+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:05:21.515109+0000","scrub_duration":0.0019810919999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"30'31","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:27.082265+0000","last_change":"2023-07-05T23:35:27.082315+0000","last_active":"2023-07-05T23:35:27.082265+0000","last_peered":"2023-07-05T23:35:27.082265+0000","last_clean":"2023-07-05T23:35:27.082265+0000","last_became_active":"2023-07-05T23:32:53.338095+0000","last_became_peered":"2023-07-05T23:32:53.338095+0000","last_unstale":"2023-07-05T23:35:27.082265+0000","last_undegraded":"2023-07-05T23:35:27.082265+0000","last_fullsized":"2023-07-05T23:35:27.082265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'31","last_scrub_stamp":"2023-07-05T23:35:27.082179+0000","last_deep_scrub":"30'31","last_deep_scrub_stamp":"2023-07-05T23:35:27.082179+0000","last_clean_scrub_stamp":"2023-07-05T23:35:27.082179+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:05:57.887925+0000","scrub_duration":0.0021665159999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"30'34","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:32.375023+0000","last_change":"2023-07-05T23:35:32.375073+0000","last_active":"2023-07-05T23:35:32.375023+0000","last_peered":"2023-07-05T23:35:32.375023+0000","last_clean":"2023-07-05T23:35:32.375023+0000","last_became_active":"2023-07-05T23:32:53.341783+0000","last_became_peered":"2023-07-05T23:32:53.341783+0000","last_unstale":"2023-07-05T23:35:32.375023+0000","last_undegraded":"2023-07-05T23:35:32.375023+0000","last_fullsized":"2023-07-05T23:35:32.375023+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'34","last_scrub_stamp":"2023-07-05T23:35:32.374915+0000","last_deep_scrub":"30'34","last_deep_scrub_stamp":"2023-07-05T23:35:32.374915+0000","last_clean_scrub_stamp":"2023-07-05T23:35:32.374915+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:37:36.010693+0000","scrub_duration":0.0016638619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"30'40","reported_seq":73,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:36:04.360787+0000","last_change":"2023-07-05T23:36:04.360837+0000","last_active":"2023-07-05T23:36:04.360787+0000","last_peered":"2023-07-05T23:36:04.360787+0000","last_clean":"2023-07-05T23:36:04.360787+0000","last_became_active":"2023-07-05T23:32:53.348108+0000","last_became_peered":"2023-07-05T23:32:53.348108+0000","last_unstale":"2023-07-05T23:36:04.360787+0000","last_undegraded":"2023-07-05T23:36:04.360787+0000","last_fullsized":"2023-07-05T23:36:04.360787+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'40","last_scrub_stamp":"2023-07-05T23:36:04.360681+0000","last_deep_scrub":"30'40","last_deep_scrub_stamp":"2023-07-05T23:36:04.360681+0000","last_clean_scrub_stamp":"2023-07-05T23:36:04.360681+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:48:44.777245+0000","scrub_duration":0.0022089200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"30'32","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:39.617241+0000","last_change":"2023-07-05T23:35:39.617299+0000","last_active":"2023-07-05T23:35:39.617241+0000","last_peered":"2023-07-05T23:35:39.617241+0000","last_clean":"2023-07-05T23:35:39.617241+0000","last_became_active":"2023-07-05T23:32:53.340698+0000","last_became_peered":"2023-07-05T23:32:53.340698+0000","last_unstale":"2023-07-05T23:35:39.617241+0000","last_undegraded":"2023-07-05T23:35:39.617241+0000","last_fullsized":"2023-07-05T23:35:39.617241+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-07-05T23:35:39.617135+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-07-05T23:35:39.617135+0000","last_clean_scrub_stamp":"2023-07-05T23:35:39.617135+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:23:59.478196+0000","scrub_duration":0.001562581,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"30'36","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:45.686994+0000","last_change":"2023-07-05T23:35:45.687058+0000","last_active":"2023-07-05T23:35:45.686994+0000","last_peered":"2023-07-05T23:35:45.686994+0000","last_clean":"2023-07-05T23:35:45.686994+0000","last_became_active":"2023-07-05T23:32:53.345403+0000","last_became_peered":"2023-07-05T23:32:53.345403+0000","last_unstale":"2023-07-05T23:35:45.686994+0000","last_undegraded":"2023-07-05T23:35:45.686994+0000","last_fullsized":"2023-07-05T23:35:45.686994+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'36","last_scrub_stamp":"2023-07-05T23:35:45.686913+0000","last_deep_scrub":"30'36","last_deep_scrub_stamp":"2023-07-05T23:35:45.686913+0000","last_clean_scrub_stamp":"2023-07-05T23:35:45.686913+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:22:22.456955+0000","scrub_duration":0.0012798390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"30'31","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:56.381912+0000","last_change":"2023-07-05T23:35:56.381959+0000","last_active":"2023-07-05T23:35:56.381912+0000","last_peered":"2023-07-05T23:35:56.381912+0000","last_clean":"2023-07-05T23:35:56.381912+0000","last_became_active":"2023-07-05T23:32:53.348053+0000","last_became_peered":"2023-07-05T23:32:53.348053+0000","last_unstale":"2023-07-05T23:35:56.381912+0000","last_undegraded":"2023-07-05T23:35:56.381912+0000","last_fullsized":"2023-07-05T23:35:56.381912+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'31","last_scrub_stamp":"2023-07-05T23:35:56.381814+0000","last_deep_scrub":"30'31","last_deep_scrub_stamp":"2023-07-05T23:35:56.381814+0000","last_clean_scrub_stamp":"2023-07-05T23:35:56.381814+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:22:33.151856+0000","scrub_duration":0.0019954069999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"30'25","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:45.605594+0000","last_change":"2023-07-05T23:35:45.605631+0000","last_active":"2023-07-05T23:35:45.605594+0000","last_peered":"2023-07-05T23:35:45.605594+0000","last_clean":"2023-07-05T23:35:45.605594+0000","last_became_active":"2023-07-05T23:32:53.338935+0000","last_became_peered":"2023-07-05T23:32:53.338935+0000","last_unstale":"2023-07-05T23:35:45.605594+0000","last_undegraded":"2023-07-05T23:35:45.605594+0000","last_fullsized":"2023-07-05T23:35:45.605594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'25","last_scrub_stamp":"2023-07-05T23:35:45.605527+0000","last_deep_scrub":"30'25","last_deep_scrub_stamp":"2023-07-05T23:35:45.605527+0000","last_clean_scrub_stamp":"2023-07-05T23:35:45.605527+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:25:57.165990+0000","scrub_duration":0.001695216,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"30'38","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:58.767545+0000","last_change":"2023-07-05T23:35:58.767634+0000","last_active":"2023-07-05T23:35:58.767545+0000","last_peered":"2023-07-05T23:35:58.767545+0000","last_clean":"2023-07-05T23:35:58.767545+0000","last_became_active":"2023-07-05T23:33:34.898383+0000","last_became_peered":"2023-07-05T23:33:34.898383+0000","last_unstale":"2023-07-05T23:35:58.767545+0000","last_undegraded":"2023-07-05T23:35:58.767545+0000","last_fullsized":"2023-07-05T23:35:58.767545+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'38","last_scrub_stamp":"2023-07-05T23:35:58.767437+0000","last_deep_scrub":"30'38","last_deep_scrub_stamp":"2023-07-05T23:35:58.767437+0000","last_clean_scrub_stamp":"2023-07-05T23:35:58.767437+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:30:54.182990+0000","scrub_duration":0.0021658070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.25","version":"30'26","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:23.832669+0000","last_change":"2023-07-05T23:35:23.832721+0000","last_active":"2023-07-05T23:35:23.832669+0000","last_peered":"2023-07-05T23:35:23.832669+0000","last_clean":"2023-07-05T23:35:23.832669+0000","last_became_active":"2023-07-05T23:32:53.335857+0000","last_became_peered":"2023-07-05T23:32:53.335857+0000","last_unstale":"2023-07-05T23:35:23.832669+0000","last_undegraded":"2023-07-05T23:35:23.832669+0000","last_fullsized":"2023-07-05T23:35:23.832669+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'26","last_scrub_stamp":"2023-07-05T23:35:23.832558+0000","last_deep_scrub":"30'26","last_deep_scrub_stamp":"2023-07-05T23:35:23.832558+0000","last_clean_scrub_stamp":"2023-07-05T23:35:23.832558+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:24:02.493000+0000","scrub_duration":0.001482206,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"30'479","reported_seq":506,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:36:26.739888+0000","last_change":"2023-07-05T23:36:26.739965+0000","last_active":"2023-07-05T23:36:26.739888+0000","last_peered":"2023-07-05T23:36:26.739888+0000","last_clean":"2023-07-05T23:36:26.739888+0000","last_became_active":"2023-07-05T23:32:57.365409+0000","last_became_peered":"2023-07-05T23:32:57.365409+0000","last_unstale":"2023-07-05T23:36:26.739888+0000","last_undegraded":"2023-07-05T23:36:26.739888+0000","last_fullsized":"2023-07-05T23:36:26.739888+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'479","last_scrub_stamp":"2023-07-05T23:36:26.739771+0000","last_deep_scrub":"30'479","last_deep_scrub_stamp":"2023-07-05T23:36:26.739771+0000","last_clean_scrub_stamp":"2023-07-05T23:36:26.739771+0000","objects_scrubbed":1,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:46:44.411387+0000","scrub_duration":0.0070082729999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:41.313810+0000","last_change":"2023-07-05T23:35:41.313864+0000","last_active":"2023-07-05T23:35:41.313810+0000","last_peered":"2023-07-05T23:35:41.313810+0000","last_clean":"2023-07-05T23:35:41.313810+0000","last_became_active":"2023-07-05T23:32:52.901080+0000","last_became_peered":"2023-07-05T23:32:52.901080+0000","last_unstale":"2023-07-05T23:35:41.313810+0000","last_undegraded":"2023-07-05T23:35:41.313810+0000","last_fullsized":"2023-07-05T23:35:41.313810+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2023-07-05T23:35:41.313704+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2023-07-05T23:35:41.313704+0000","last_clean_scrub_stamp":"2023-07-05T23:35:41.313704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:14:58.964233+0000","scrub_duration":0.002060026,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'39","reported_seq":72,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:22.793480+0000","last_change":"2023-07-05T23:35:22.793480+0000","last_active":"2023-07-05T23:35:22.793480+0000","last_peered":"2023-07-05T23:35:22.793480+0000","last_clean":"2023-07-05T23:35:22.793480+0000","last_became_active":"2023-07-05T23:32:53.339464+0000","last_became_peered":"2023-07-05T23:32:53.339464+0000","last_unstale":"2023-07-05T23:35:22.793480+0000","last_undegraded":"2023-07-05T23:35:22.793480+0000","last_fullsized":"2023-07-05T23:35:22.793480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'39","last_scrub_stamp":"2023-07-05T23:35:22.793364+0000","last_deep_scrub":"30'39","last_deep_scrub_stamp":"2023-07-05T23:35:22.793364+0000","last_clean_scrub_stamp":"2023-07-05T23:35:22.793364+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:46:08.645177+0000","scrub_duration":0.0015116330000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"30'446","reported_seq":473,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:52.332953+0000","last_change":"2023-07-05T23:35:52.333015+0000","last_active":"2023-07-05T23:35:52.332953+0000","last_peered":"2023-07-05T23:35:52.332953+0000","last_clean":"2023-07-05T23:35:52.332953+0000","last_became_active":"2023-07-05T23:32:57.353465+0000","last_became_peered":"2023-07-05T23:32:57.353465+0000","last_unstale":"2023-07-05T23:35:52.332953+0000","last_undegraded":"2023-07-05T23:35:52.332953+0000","last_fullsized":"2023-07-05T23:35:52.332953+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'446","last_scrub_stamp":"2023-07-05T23:35:52.332863+0000","last_deep_scrub":"30'446","last_deep_scrub_stamp":"2023-07-05T23:35:52.332863+0000","last_clean_scrub_stamp":"2023-07-05T23:35:52.332863+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:59:24.781573+0000","scrub_duration":0.002013571,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:33.568592+0000","last_change":"2023-07-05T23:35:33.568640+0000","last_active":"2023-07-05T23:35:33.568592+0000","last_peered":"2023-07-05T23:35:33.568592+0000","last_clean":"2023-07-05T23:35:33.568592+0000","last_became_active":"2023-07-05T23:32:52.909347+0000","last_became_peered":"2023-07-05T23:32:52.909347+0000","last_unstale":"2023-07-05T23:35:33.568592+0000","last_undegraded":"2023-07-05T23:35:33.568592+0000","last_fullsized":"2023-07-05T23:35:33.568592+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:35:33.568495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:35:33.568495+0000","last_clean_scrub_stamp":"2023-07-05T23:35:33.568495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:02:17.042409+0000","scrub_duration":0.001426716,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"30'31","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:21.633620+0000","last_change":"2023-07-05T23:35:21.633689+0000","last_active":"2023-07-05T23:35:21.633620+0000","last_peered":"2023-07-05T23:35:21.633620+0000","last_clean":"2023-07-05T23:35:21.633620+0000","last_became_active":"2023-07-05T23:32:53.338825+0000","last_became_peered":"2023-07-05T23:32:53.338825+0000","last_unstale":"2023-07-05T23:35:21.633620+0000","last_undegraded":"2023-07-05T23:35:21.633620+0000","last_fullsized":"2023-07-05T23:35:21.633620+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'31","last_scrub_stamp":"2023-07-05T23:35:21.633532+0000","last_deep_scrub":"30'31","last_deep_scrub_stamp":"2023-07-05T23:35:21.633532+0000","last_clean_scrub_stamp":"2023-07-05T23:35:21.633532+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:17:27.662797+0000","scrub_duration":0.001837602,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"30'462","reported_seq":489,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:57.755099+0000","last_change":"2023-07-05T23:35:57.755228+0000","last_active":"2023-07-05T23:35:57.755099+0000","last_peered":"2023-07-05T23:35:57.755099+0000","last_clean":"2023-07-05T23:35:57.755099+0000","last_became_active":"2023-07-05T23:32:57.358965+0000","last_became_peered":"2023-07-05T23:32:57.358965+0000","last_unstale":"2023-07-05T23:35:57.755099+0000","last_undegraded":"2023-07-05T23:35:57.755099+0000","last_fullsized":"2023-07-05T23:35:57.755099+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'462","last_scrub_stamp":"2023-07-05T23:35:57.754987+0000","last_deep_scrub":"30'462","last_deep_scrub_stamp":"2023-07-05T23:35:57.754987+0000","last_clean_scrub_stamp":"2023-07-05T23:35:57.754987+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:58:26.611108+0000","scrub_duration":0.0021636189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"30'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:33.640451+0000","last_change":"2023-07-05T23:35:33.640503+0000","last_active":"2023-07-05T23:35:33.640451+0000","last_peered":"2023-07-05T23:35:33.640451+0000","last_clean":"2023-07-05T23:35:33.640451+0000","last_became_active":"2023-07-05T23:32:52.908756+0000","last_became_peered":"2023-07-05T23:32:52.908756+0000","last_unstale":"2023-07-05T23:35:33.640451+0000","last_undegraded":"2023-07-05T23:35:33.640451+0000","last_fullsized":"2023-07-05T23:35:33.640451+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2023-07-05T23:35:33.640351+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2023-07-05T23:35:33.640351+0000","last_clean_scrub_stamp":"2023-07-05T23:35:33.640351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:23:53.501412+0000","scrub_duration":0.001423014,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"30'30","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:43.356371+0000","last_change":"2023-07-05T23:35:43.356419+0000","last_active":"2023-07-05T23:35:43.356371+0000","last_peered":"2023-07-05T23:35:43.356371+0000","last_clean":"2023-07-05T23:35:43.356371+0000","last_became_active":"2023-07-05T23:32:53.337480+0000","last_became_peered":"2023-07-05T23:32:53.337480+0000","last_unstale":"2023-07-05T23:35:43.356371+0000","last_undegraded":"2023-07-05T23:35:43.356371+0000","last_fullsized":"2023-07-05T23:35:43.356371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'30","last_scrub_stamp":"2023-07-05T23:35:43.356270+0000","last_deep_scrub":"30'30","last_deep_scrub_stamp":"2023-07-05T23:35:43.356270+0000","last_clean_scrub_stamp":"2023-07-05T23:35:43.356270+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:45:04.042706+0000","scrub_duration":0.001661778,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"30'473","reported_seq":500,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:48.410604+0000","last_change":"2023-07-05T23:35:48.410698+0000","last_active":"2023-07-05T23:35:48.410604+0000","last_peered":"2023-07-05T23:35:48.410604+0000","last_clean":"2023-07-05T23:35:48.410604+0000","last_became_active":"2023-07-05T23:32:57.355940+0000","last_became_peered":"2023-07-05T23:32:57.355940+0000","last_unstale":"2023-07-05T23:35:48.410604+0000","last_undegraded":"2023-07-05T23:35:48.410604+0000","last_fullsized":"2023-07-05T23:35:48.410604+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'473","last_scrub_stamp":"2023-07-05T23:35:48.410456+0000","last_deep_scrub":"30'473","last_deep_scrub_stamp":"2023-07-05T23:35:48.410456+0000","last_clean_scrub_stamp":"2023-07-05T23:35:48.410456+0000","objects_scrubbed":1,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:47:15.076777+0000","scrub_duration":0.0067811599999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"30'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:36.599539+0000","last_change":"2023-07-05T23:35:36.599624+0000","last_active":"2023-07-05T23:35:36.599539+0000","last_peered":"2023-07-05T23:35:36.599539+0000","last_clean":"2023-07-05T23:35:36.599539+0000","last_became_active":"2023-07-05T23:32:52.904140+0000","last_became_peered":"2023-07-05T23:32:52.904140+0000","last_unstale":"2023-07-05T23:35:36.599539+0000","last_undegraded":"2023-07-05T23:35:36.599539+0000","last_fullsized":"2023-07-05T23:35:36.599539+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2023-07-05T23:35:36.599420+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2023-07-05T23:35:36.599420+0000","last_clean_scrub_stamp":"2023-07-05T23:35:36.599420+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:06:55.022852+0000","scrub_duration":0.0020385260000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"30'27","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:37.731303+0000","last_change":"2023-07-05T23:35:37.731363+0000","last_active":"2023-07-05T23:35:37.731303+0000","last_peered":"2023-07-05T23:35:37.731303+0000","last_clean":"2023-07-05T23:35:37.731303+0000","last_became_active":"2023-07-05T23:32:53.338248+0000","last_became_peered":"2023-07-05T23:32:53.338248+0000","last_unstale":"2023-07-05T23:35:37.731303+0000","last_undegraded":"2023-07-05T23:35:37.731303+0000","last_fullsized":"2023-07-05T23:35:37.731303+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'27","last_scrub_stamp":"2023-07-05T23:35:37.731211+0000","last_deep_scrub":"30'27","last_deep_scrub_stamp":"2023-07-05T23:35:37.731211+0000","last_clean_scrub_stamp":"2023-07-05T23:35:37.731211+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:55:31.804023+0000","scrub_duration":0.001714728,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"30'457","reported_seq":484,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:36:06.361694+0000","last_change":"2023-07-05T23:36:06.361807+0000","last_active":"2023-07-05T23:36:06.361694+0000","last_peered":"2023-07-05T23:36:06.361694+0000","last_clean":"2023-07-05T23:36:06.361694+0000","last_became_active":"2023-07-05T23:32:57.357039+0000","last_became_peered":"2023-07-05T23:32:57.357039+0000","last_unstale":"2023-07-05T23:36:06.361694+0000","last_undegraded":"2023-07-05T23:36:06.361694+0000","last_fullsized":"2023-07-05T23:36:06.361694+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'457","last_scrub_stamp":"2023-07-05T23:36:06.361543+0000","last_deep_scrub":"30'457","last_deep_scrub_stamp":"2023-07-05T23:36:06.361543+0000","last_clean_scrub_stamp":"2023-07-05T23:36:06.361543+0000","objects_scrubbed":2,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:50:04.731815+0000","scrub_duration":0.01125281,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:37.856933+0000","last_change":"2023-07-05T23:35:37.857007+0000","last_active":"2023-07-05T23:35:37.856933+0000","last_peered":"2023-07-05T23:35:37.856933+0000","last_clean":"2023-07-05T23:35:37.856933+0000","last_became_active":"2023-07-05T23:32:52.900352+0000","last_became_peered":"2023-07-05T23:32:52.900352+0000","last_unstale":"2023-07-05T23:35:37.856933+0000","last_undegraded":"2023-07-05T23:35:37.856933+0000","last_fullsized":"2023-07-05T23:35:37.856933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:35:37.856826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:35:37.856826+0000","last_clean_scrub_stamp":"2023-07-05T23:35:37.856826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:47:38.944891+0000","scrub_duration":0.001391553,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"30'36","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:51.627133+0000","last_change":"2023-07-05T23:35:51.627180+0000","last_active":"2023-07-05T23:35:51.627133+0000","last_peered":"2023-07-05T23:35:51.627133+0000","last_clean":"2023-07-05T23:35:51.627133+0000","last_became_active":"2023-07-05T23:32:53.346373+0000","last_became_peered":"2023-07-05T23:32:53.346373+0000","last_unstale":"2023-07-05T23:35:51.627133+0000","last_undegraded":"2023-07-05T23:35:51.627133+0000","last_fullsized":"2023-07-05T23:35:51.627133+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'36","last_scrub_stamp":"2023-07-05T23:35:51.627048+0000","last_deep_scrub":"30'36","last_deep_scrub_stamp":"2023-07-05T23:35:51.627048+0000","last_clean_scrub_stamp":"2023-07-05T23:35:51.627048+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:58:20.483169+0000","scrub_duration":0.0018575690000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"30'483","reported_seq":510,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:53.603528+0000","last_change":"2023-07-05T23:35:53.603599+0000","last_active":"2023-07-05T23:35:53.603528+0000","last_peered":"2023-07-05T23:35:53.603528+0000","last_clean":"2023-07-05T23:35:53.603528+0000","last_became_active":"2023-07-05T23:32:57.365200+0000","last_became_peered":"2023-07-05T23:32:57.365200+0000","last_unstale":"2023-07-05T23:35:53.603528+0000","last_undegraded":"2023-07-05T23:35:53.603528+0000","last_fullsized":"2023-07-05T23:35:53.603528+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'483","last_scrub_stamp":"2023-07-05T23:35:53.603424+0000","last_deep_scrub":"30'483","last_deep_scrub_stamp":"2023-07-05T23:35:53.603424+0000","last_clean_scrub_stamp":"2023-07-05T23:35:53.603424+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:49:51.973696+0000","scrub_duration":0.002277004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"30'14","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:43.257611+0000","last_change":"2023-07-05T23:35:43.257685+0000","last_active":"2023-07-05T23:35:43.257611+0000","last_peered":"2023-07-05T23:35:43.257611+0000","last_clean":"2023-07-05T23:35:43.257611+0000","last_became_active":"2023-07-05T23:32:52.912749+0000","last_became_peered":"2023-07-05T23:32:52.912749+0000","last_unstale":"2023-07-05T23:35:43.257611+0000","last_undegraded":"2023-07-05T23:35:43.257611+0000","last_fullsized":"2023-07-05T23:35:43.257611+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'14","last_scrub_stamp":"2023-07-05T23:35:43.257470+0000","last_deep_scrub":"30'14","last_deep_scrub_stamp":"2023-07-05T23:35:43.257470+0000","last_clean_scrub_stamp":"2023-07-05T23:35:43.257470+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:13:19.970455+0000","scrub_duration":0.0041172719999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"30'42","reported_seq":75,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:41.629692+0000","last_change":"2023-07-05T23:35:41.629741+0000","last_active":"2023-07-05T23:35:41.629692+0000","last_peered":"2023-07-05T23:35:41.629692+0000","last_clean":"2023-07-05T23:35:41.629692+0000","last_became_active":"2023-07-05T23:32:53.339001+0000","last_became_peered":"2023-07-05T23:32:53.339001+0000","last_unstale":"2023-07-05T23:35:41.629692+0000","last_undegraded":"2023-07-05T23:35:41.629692+0000","last_fullsized":"2023-07-05T23:35:41.629692+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'42","last_scrub_stamp":"2023-07-05T23:35:41.629594+0000","last_deep_scrub":"30'42","last_deep_scrub_stamp":"2023-07-05T23:35:41.629594+0000","last_clean_scrub_stamp":"2023-07-05T23:35:41.629594+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:24:01.490655+0000","scrub_duration":0.0017554409999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"30'476","reported_seq":503,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:50.657476+0000","last_change":"2023-07-05T23:35:50.657546+0000","last_active":"2023-07-05T23:35:50.657476+0000","last_peered":"2023-07-05T23:35:50.657476+0000","last_clean":"2023-07-05T23:35:50.657476+0000","last_became_active":"2023-07-05T23:32:57.353848+0000","last_became_peered":"2023-07-05T23:32:57.353848+0000","last_unstale":"2023-07-05T23:35:50.657476+0000","last_undegraded":"2023-07-05T23:35:50.657476+0000","last_fullsized":"2023-07-05T23:35:50.657476+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'476","last_scrub_stamp":"2023-07-05T23:35:50.657366+0000","last_deep_scrub":"30'476","last_deep_scrub_stamp":"2023-07-05T23:35:50.657366+0000","last_clean_scrub_stamp":"2023-07-05T23:35:50.657366+0000","objects_scrubbed":0,"log_size":476,"log_dups_size":0,"ondisk_log_size":476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:59:33.017524+0000","scrub_duration":0.00215351,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"30'402","reported_seq":437,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:43.308198+0000","last_change":"2023-07-05T23:35:43.308282+0000","last_active":"2023-07-05T23:35:43.308198+0000","last_peered":"2023-07-05T23:35:43.308198+0000","last_clean":"2023-07-05T23:35:43.308198+0000","last_became_active":"2023-07-05T23:32:52.904318+0000","last_became_peered":"2023-07-05T23:32:52.904318+0000","last_unstale":"2023-07-05T23:35:43.308198+0000","last_undegraded":"2023-07-05T23:35:43.308198+0000","last_fullsized":"2023-07-05T23:35:43.308198+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'402","last_scrub_stamp":"2023-07-05T23:35:43.308095+0000","last_deep_scrub":"30'402","last_deep_scrub_stamp":"2023-07-05T23:35:43.308095+0000","last_clean_scrub_stamp":"2023-07-05T23:35:43.308095+0000","objects_scrubbed":4,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:30:38.723647+0000","scrub_duration":0.0079608939999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1528715,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":399,"num_write_kb":1765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"30'41","reported_seq":74,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:38.344828+0000","last_change":"2023-07-05T23:35:38.344911+0000","last_active":"2023-07-05T23:35:38.344828+0000","last_peered":"2023-07-05T23:35:38.344828+0000","last_clean":"2023-07-05T23:35:38.344828+0000","last_became_active":"2023-07-05T23:32:53.339583+0000","last_became_peered":"2023-07-05T23:32:53.339583+0000","last_unstale":"2023-07-05T23:35:38.344828+0000","last_undegraded":"2023-07-05T23:35:38.344828+0000","last_fullsized":"2023-07-05T23:35:38.344828+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'41","last_scrub_stamp":"2023-07-05T23:35:38.344698+0000","last_deep_scrub":"30'41","last_deep_scrub_stamp":"2023-07-05T23:35:38.344698+0000","last_clean_scrub_stamp":"2023-07-05T23:35:38.344698+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:55:53.973802+0000","scrub_duration":0.001677949,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"30'441","reported_seq":468,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:50.781752+0000","last_change":"2023-07-05T23:35:50.781816+0000","last_active":"2023-07-05T23:35:50.781752+0000","last_peered":"2023-07-05T23:35:50.781752+0000","last_clean":"2023-07-05T23:35:50.781752+0000","last_became_active":"2023-07-05T23:32:57.365204+0000","last_became_peered":"2023-07-05T23:32:57.365204+0000","last_unstale":"2023-07-05T23:35:50.781752+0000","last_undegraded":"2023-07-05T23:35:50.781752+0000","last_fullsized":"2023-07-05T23:35:50.781752+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'441","last_scrub_stamp":"2023-07-05T23:35:50.781660+0000","last_deep_scrub":"30'441","last_deep_scrub_stamp":"2023-07-05T23:35:50.781660+0000","last_clean_scrub_stamp":"2023-07-05T23:35:50.781660+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:58:19.637781+0000","scrub_duration":0.0024078680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"30'5","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:45.290604+0000","last_change":"2023-07-05T23:35:45.290655+0000","last_active":"2023-07-05T23:35:45.290604+0000","last_peered":"2023-07-05T23:35:45.290604+0000","last_clean":"2023-07-05T23:35:45.290604+0000","last_became_active":"2023-07-05T23:32:52.907970+0000","last_became_peered":"2023-07-05T23:32:52.907970+0000","last_unstale":"2023-07-05T23:35:45.290604+0000","last_undegraded":"2023-07-05T23:35:45.290604+0000","last_fullsized":"2023-07-05T23:35:45.290604+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'5","last_scrub_stamp":"2023-07-05T23:35:45.290514+0000","last_deep_scrub":"30'5","last_deep_scrub_stamp":"2023-07-05T23:35:45.290514+0000","last_clean_scrub_stamp":"2023-07-05T23:35:45.290514+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:14:55.311137+0000","scrub_duration":0.003099306,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"30'29","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:27.578398+0000","last_change":"2023-07-05T23:35:27.578448+0000","last_active":"2023-07-05T23:35:27.578398+0000","last_peered":"2023-07-05T23:35:27.578398+0000","last_clean":"2023-07-05T23:35:27.578398+0000","last_became_active":"2023-07-05T23:32:53.339827+0000","last_became_peered":"2023-07-05T23:32:53.339827+0000","last_unstale":"2023-07-05T23:35:27.578398+0000","last_undegraded":"2023-07-05T23:35:27.578398+0000","last_fullsized":"2023-07-05T23:35:27.578398+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'29","last_scrub_stamp":"2023-07-05T23:35:27.578299+0000","last_deep_scrub":"30'29","last_deep_scrub_stamp":"2023-07-05T23:35:27.578299+0000","last_clean_scrub_stamp":"2023-07-05T23:35:27.578299+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:27:34.593533+0000","scrub_duration":0.0015027510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"30'475","reported_seq":502,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:57.600364+0000","last_change":"2023-07-05T23:35:57.600491+0000","last_active":"2023-07-05T23:35:57.600364+0000","last_peered":"2023-07-05T23:35:57.600364+0000","last_clean":"2023-07-05T23:35:57.600364+0000","last_became_active":"2023-07-05T23:32:57.354235+0000","last_became_peered":"2023-07-05T23:32:57.354235+0000","last_unstale":"2023-07-05T23:35:57.600364+0000","last_undegraded":"2023-07-05T23:35:57.600364+0000","last_fullsized":"2023-07-05T23:35:57.600364+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'475","last_scrub_stamp":"2023-07-05T23:35:57.600234+0000","last_deep_scrub":"30'475","last_deep_scrub_stamp":"2023-07-05T23:35:57.600234+0000","last_clean_scrub_stamp":"2023-07-05T23:35:57.600234+0000","objects_scrubbed":1,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:15:15.250763+0000","scrub_duration":0.0074268889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:31.639525+0000","last_change":"2023-07-05T23:35:31.639611+0000","last_active":"2023-07-05T23:35:31.639525+0000","last_peered":"2023-07-05T23:35:31.639525+0000","last_clean":"2023-07-05T23:35:31.639525+0000","last_became_active":"2023-07-05T23:32:52.900387+0000","last_became_peered":"2023-07-05T23:32:52.900387+0000","last_unstale":"2023-07-05T23:35:31.639525+0000","last_undegraded":"2023-07-05T23:35:31.639525+0000","last_fullsized":"2023-07-05T23:35:31.639525+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:35:31.639414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:35:31.639414+0000","last_clean_scrub_stamp":"2023-07-05T23:35:31.639414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:02:15.113328+0000","scrub_duration":0.0019919690000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"30'33","reported_seq":66,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:44.792740+0000","last_change":"2023-07-05T23:35:44.792823+0000","last_active":"2023-07-05T23:35:44.792740+0000","last_peered":"2023-07-05T23:35:44.792740+0000","last_clean":"2023-07-05T23:35:44.792740+0000","last_became_active":"2023-07-05T23:32:53.335513+0000","last_became_peered":"2023-07-05T23:32:53.335513+0000","last_unstale":"2023-07-05T23:35:44.792740+0000","last_undegraded":"2023-07-05T23:35:44.792740+0000","last_fullsized":"2023-07-05T23:35:44.792740+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'33","last_scrub_stamp":"2023-07-05T23:35:44.792639+0000","last_deep_scrub":"30'33","last_deep_scrub_stamp":"2023-07-05T23:35:44.792639+0000","last_clean_scrub_stamp":"2023-07-05T23:35:44.792639+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:22:21.562681+0000","scrub_duration":0.0015213340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"30'450","reported_seq":477,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:52.614119+0000","last_change":"2023-07-05T23:35:52.614243+0000","last_active":"2023-07-05T23:35:52.614119+0000","last_peered":"2023-07-05T23:35:52.614119+0000","last_clean":"2023-07-05T23:35:52.614119+0000","last_became_active":"2023-07-05T23:32:57.362407+0000","last_became_peered":"2023-07-05T23:32:57.362407+0000","last_unstale":"2023-07-05T23:35:52.614119+0000","last_undegraded":"2023-07-05T23:35:52.614119+0000","last_fullsized":"2023-07-05T23:35:52.614119+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'450","last_scrub_stamp":"2023-07-05T23:35:52.614000+0000","last_deep_scrub":"30'450","last_deep_scrub_stamp":"2023-07-05T23:35:52.614000+0000","last_clean_scrub_stamp":"2023-07-05T23:35:52.614000+0000","objects_scrubbed":1,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:48:33.030564+0000","scrub_duration":0.0068755639999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"30'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:42.252627+0000","last_change":"2023-07-05T23:35:42.252721+0000","last_active":"2023-07-05T23:35:42.252627+0000","last_peered":"2023-07-05T23:35:42.252627+0000","last_clean":"2023-07-05T23:35:42.252627+0000","last_became_active":"2023-07-05T23:32:52.905595+0000","last_became_peered":"2023-07-05T23:32:52.905595+0000","last_unstale":"2023-07-05T23:35:42.252627+0000","last_undegraded":"2023-07-05T23:35:42.252627+0000","last_fullsized":"2023-07-05T23:35:42.252627+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2023-07-05T23:35:42.252504+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2023-07-05T23:35:42.252504+0000","last_clean_scrub_stamp":"2023-07-05T23:35:42.252504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:58:36.662409+0000","scrub_duration":0.0015537260000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"30'40","reported_seq":73,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:53.637883+0000","last_change":"2023-07-05T23:35:53.637930+0000","last_active":"2023-07-05T23:35:53.637883+0000","last_peered":"2023-07-05T23:35:53.637883+0000","last_clean":"2023-07-05T23:35:53.637883+0000","last_became_active":"2023-07-05T23:32:53.342033+0000","last_became_peered":"2023-07-05T23:32:53.342033+0000","last_unstale":"2023-07-05T23:35:53.637883+0000","last_undegraded":"2023-07-05T23:35:53.637883+0000","last_fullsized":"2023-07-05T23:35:53.637883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'40","last_scrub_stamp":"2023-07-05T23:35:53.637796+0000","last_deep_scrub":"30'40","last_deep_scrub_stamp":"2023-07-05T23:35:53.637796+0000","last_clean_scrub_stamp":"2023-07-05T23:35:53.637796+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:58:47.252971+0000","scrub_duration":0.001377063,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"30'495","reported_seq":522,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:56.801854+0000","last_change":"2023-07-05T23:35:56.801956+0000","last_active":"2023-07-05T23:35:56.801854+0000","last_peered":"2023-07-05T23:35:56.801854+0000","last_clean":"2023-07-05T23:35:56.801854+0000","last_became_active":"2023-07-05T23:32:57.359532+0000","last_became_peered":"2023-07-05T23:32:57.359532+0000","last_unstale":"2023-07-05T23:35:56.801854+0000","last_undegraded":"2023-07-05T23:35:56.801854+0000","last_fullsized":"2023-07-05T23:35:56.801854+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'495","last_scrub_stamp":"2023-07-05T23:35:56.801731+0000","last_deep_scrub":"30'495","last_deep_scrub_stamp":"2023-07-05T23:35:56.801731+0000","last_clean_scrub_stamp":"2023-07-05T23:35:56.801731+0000","objects_scrubbed":1,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:15:14.452259+0000","scrub_duration":0.0064926660000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":46080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"30'12","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:27.409720+0000","last_change":"2023-07-05T23:35:27.409779+0000","last_active":"2023-07-05T23:35:27.409720+0000","last_peered":"2023-07-05T23:35:27.409720+0000","last_clean":"2023-07-05T23:35:27.409720+0000","last_became_active":"2023-07-05T23:32:52.903419+0000","last_became_peered":"2023-07-05T23:32:52.903419+0000","last_unstale":"2023-07-05T23:35:27.409720+0000","last_undegraded":"2023-07-05T23:35:27.409720+0000","last_fullsized":"2023-07-05T23:35:27.409720+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'12","last_scrub_stamp":"2023-07-05T23:35:27.409640+0000","last_deep_scrub":"30'12","last_deep_scrub_stamp":"2023-07-05T23:35:27.409640+0000","last_clean_scrub_stamp":"2023-07-05T23:35:27.409640+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:48:23.989282+0000","scrub_duration":0.0045973059999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"30'32","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:25.668033+0000","last_change":"2023-07-05T23:35:25.668080+0000","last_active":"2023-07-05T23:35:25.668033+0000","last_peered":"2023-07-05T23:35:25.668033+0000","last_clean":"2023-07-05T23:35:25.668033+0000","last_became_active":"2023-07-05T23:32:53.341162+0000","last_became_peered":"2023-07-05T23:32:53.341162+0000","last_unstale":"2023-07-05T23:35:25.668033+0000","last_undegraded":"2023-07-05T23:35:25.668033+0000","last_fullsized":"2023-07-05T23:35:25.668033+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-07-05T23:35:25.667940+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-07-05T23:35:25.667940+0000","last_clean_scrub_stamp":"2023-07-05T23:35:25.667940+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:02:09.141854+0000","scrub_duration":0.0023076949999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"30'445","reported_seq":472,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:36:07.409609+0000","last_change":"2023-07-05T23:36:07.409742+0000","last_active":"2023-07-05T23:36:07.409609+0000","last_peered":"2023-07-05T23:36:07.409609+0000","last_clean":"2023-07-05T23:36:07.409609+0000","last_became_active":"2023-07-05T23:32:57.357082+0000","last_became_peered":"2023-07-05T23:32:57.357082+0000","last_unstale":"2023-07-05T23:36:07.409609+0000","last_undegraded":"2023-07-05T23:36:07.409609+0000","last_fullsized":"2023-07-05T23:36:07.409609+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'445","last_scrub_stamp":"2023-07-05T23:36:07.409487+0000","last_deep_scrub":"30'445","last_deep_scrub_stamp":"2023-07-05T23:36:07.409487+0000","last_clean_scrub_stamp":"2023-07-05T23:36:07.409487+0000","objects_scrubbed":3,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:56:23.038591+0000","scrub_duration":0.014890028,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"30'2","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:27.155588+0000","last_change":"2023-07-05T23:35:27.155648+0000","last_active":"2023-07-05T23:35:27.155588+0000","last_peered":"2023-07-05T23:35:27.155588+0000","last_clean":"2023-07-05T23:35:27.155588+0000","last_became_active":"2023-07-05T23:32:52.907397+0000","last_became_peered":"2023-07-05T23:32:52.907397+0000","last_unstale":"2023-07-05T23:35:27.155588+0000","last_undegraded":"2023-07-05T23:35:27.155588+0000","last_fullsized":"2023-07-05T23:35:27.155588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2023-07-05T23:35:27.155474+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2023-07-05T23:35:27.155474+0000","last_clean_scrub_stamp":"2023-07-05T23:35:27.155474+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:58:59.604184+0000","scrub_duration":0.00301433,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"30'29","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:24.804906+0000","last_change":"2023-07-05T23:35:24.804959+0000","last_active":"2023-07-05T23:35:24.804906+0000","last_peered":"2023-07-05T23:35:24.804906+0000","last_clean":"2023-07-05T23:35:24.804906+0000","last_became_active":"2023-07-05T23:32:53.333978+0000","last_became_peered":"2023-07-05T23:32:53.333978+0000","last_unstale":"2023-07-05T23:35:24.804906+0000","last_undegraded":"2023-07-05T23:35:24.804906+0000","last_fullsized":"2023-07-05T23:35:24.804906+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'29","last_scrub_stamp":"2023-07-05T23:35:24.804794+0000","last_deep_scrub":"30'29","last_deep_scrub_stamp":"2023-07-05T23:35:24.804794+0000","last_clean_scrub_stamp":"2023-07-05T23:35:24.804794+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:02:08.278708+0000","scrub_duration":0.001601922,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"30'423","reported_seq":450,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:50.138538+0000","last_change":"2023-07-05T23:35:50.138658+0000","last_active":"2023-07-05T23:35:50.138538+0000","last_peered":"2023-07-05T23:35:50.138538+0000","last_clean":"2023-07-05T23:35:50.138538+0000","last_became_active":"2023-07-05T23:32:57.361892+0000","last_became_peered":"2023-07-05T23:32:57.361892+0000","last_unstale":"2023-07-05T23:35:50.138538+0000","last_undegraded":"2023-07-05T23:35:50.138538+0000","last_fullsized":"2023-07-05T23:35:50.138538+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'423","last_scrub_stamp":"2023-07-05T23:35:50.138422+0000","last_deep_scrub":"30'423","last_deep_scrub_stamp":"2023-07-05T23:35:50.138422+0000","last_clean_scrub_stamp":"2023-07-05T23:35:50.138422+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:11:32.924812+0000","scrub_duration":0.0023489349999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"30'3","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:48.318102+0000","last_change":"2023-07-05T23:35:48.318154+0000","last_active":"2023-07-05T23:35:48.318102+0000","last_peered":"2023-07-05T23:35:48.318102+0000","last_clean":"2023-07-05T23:35:48.318102+0000","last_became_active":"2023-07-05T23:32:52.907975+0000","last_became_peered":"2023-07-05T23:32:52.907975+0000","last_unstale":"2023-07-05T23:35:48.318102+0000","last_undegraded":"2023-07-05T23:35:48.318102+0000","last_fullsized":"2023-07-05T23:35:48.318102+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2023-07-05T23:35:48.318009+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2023-07-05T23:35:48.318009+0000","last_clean_scrub_stamp":"2023-07-05T23:35:48.318009+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:55:42.390822+0000","scrub_duration":0.0027735860000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"30'32","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:36:02.525961+0000","last_change":"2023-07-05T23:36:02.526009+0000","last_active":"2023-07-05T23:36:02.525961+0000","last_peered":"2023-07-05T23:36:02.525961+0000","last_clean":"2023-07-05T23:36:02.525961+0000","last_became_active":"2023-07-05T23:32:53.339543+0000","last_became_peered":"2023-07-05T23:32:53.339543+0000","last_unstale":"2023-07-05T23:36:02.525961+0000","last_undegraded":"2023-07-05T23:36:02.525961+0000","last_fullsized":"2023-07-05T23:36:02.525961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-07-05T23:36:02.525863+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-07-05T23:36:02.525863+0000","last_clean_scrub_stamp":"2023-07-05T23:36:02.525863+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:11:35.060811+0000","scrub_duration":0.0021218999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"30'472","reported_seq":499,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:54.120168+0000","last_change":"2023-07-05T23:35:54.120297+0000","last_active":"2023-07-05T23:35:54.120168+0000","last_peered":"2023-07-05T23:35:54.120168+0000","last_clean":"2023-07-05T23:35:54.120168+0000","last_became_active":"2023-07-05T23:32:57.360614+0000","last_became_peered":"2023-07-05T23:32:57.360614+0000","last_unstale":"2023-07-05T23:35:54.120168+0000","last_undegraded":"2023-07-05T23:35:54.120168+0000","last_fullsized":"2023-07-05T23:35:54.120168+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'472","last_scrub_stamp":"2023-07-05T23:35:54.119957+0000","last_deep_scrub":"30'472","last_deep_scrub_stamp":"2023-07-05T23:35:54.119957+0000","last_clean_scrub_stamp":"2023-07-05T23:35:54.119957+0000","objects_scrubbed":2,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:25:06.383829+0000","scrub_duration":0.01146981,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"30'2","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:47.312152+0000","last_change":"2023-07-05T23:35:47.312205+0000","last_active":"2023-07-05T23:35:47.312152+0000","last_peered":"2023-07-05T23:35:47.312152+0000","last_clean":"2023-07-05T23:35:47.312152+0000","last_became_active":"2023-07-05T23:32:52.907441+0000","last_became_peered":"2023-07-05T23:32:52.907441+0000","last_unstale":"2023-07-05T23:35:47.312152+0000","last_undegraded":"2023-07-05T23:35:47.312152+0000","last_fullsized":"2023-07-05T23:35:47.312152+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2023-07-05T23:35:47.312050+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2023-07-05T23:35:47.312050+0000","last_clean_scrub_stamp":"2023-07-05T23:35:47.312050+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:44:29.196719+0000","scrub_duration":0.0028692190000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"30'32","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:38.470273+0000","last_change":"2023-07-05T23:35:38.470324+0000","last_active":"2023-07-05T23:35:38.470273+0000","last_peered":"2023-07-05T23:35:38.470273+0000","last_clean":"2023-07-05T23:35:38.470273+0000","last_became_active":"2023-07-05T23:32:53.343566+0000","last_became_peered":"2023-07-05T23:32:53.343566+0000","last_unstale":"2023-07-05T23:35:38.470273+0000","last_undegraded":"2023-07-05T23:35:38.470273+0000","last_fullsized":"2023-07-05T23:35:38.470273+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-07-05T23:35:38.470192+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-07-05T23:35:38.470192+0000","last_clean_scrub_stamp":"2023-07-05T23:35:38.470192+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:00:40.790153+0000","scrub_duration":0.0021110870000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"30'486","reported_seq":513,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:41.144469+0000","last_change":"2023-07-05T23:35:41.144576+0000","last_active":"2023-07-05T23:35:41.144469+0000","last_peered":"2023-07-05T23:35:41.144469+0000","last_clean":"2023-07-05T23:35:41.144469+0000","last_became_active":"2023-07-05T23:32:57.356091+0000","last_became_peered":"2023-07-05T23:32:57.356091+0000","last_unstale":"2023-07-05T23:35:41.144469+0000","last_undegraded":"2023-07-05T23:35:41.144469+0000","last_fullsized":"2023-07-05T23:35:41.144469+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'486","last_scrub_stamp":"2023-07-05T23:35:41.144349+0000","last_deep_scrub":"30'486","last_deep_scrub_stamp":"2023-07-05T23:35:41.144349+0000","last_clean_scrub_stamp":"2023-07-05T23:35:41.144349+0000","objects_scrubbed":0,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:00:43.464311+0000","scrub_duration":0.0026373849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"30'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:32.851440+0000","last_change":"2023-07-05T23:35:32.851538+0000","last_active":"2023-07-05T23:35:32.851440+0000","last_peered":"2023-07-05T23:35:32.851440+0000","last_clean":"2023-07-05T23:35:32.851440+0000","last_became_active":"2023-07-05T23:32:52.905988+0000","last_became_peered":"2023-07-05T23:32:52.905988+0000","last_unstale":"2023-07-05T23:35:32.851440+0000","last_undegraded":"2023-07-05T23:35:32.851440+0000","last_fullsized":"2023-07-05T23:35:32.851440+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2023-07-05T23:35:32.851307+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2023-07-05T23:35:32.851307+0000","last_clean_scrub_stamp":"2023-07-05T23:35:32.851307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:23:52.712368+0000","scrub_duration":0.00186185,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"30'32","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:24.662045+0000","last_change":"2023-07-05T23:35:24.662084+0000","last_active":"2023-07-05T23:35:24.662045+0000","last_peered":"2023-07-05T23:35:24.662045+0000","last_clean":"2023-07-05T23:35:24.662045+0000","last_became_active":"2023-07-05T23:32:53.339382+0000","last_became_peered":"2023-07-05T23:32:53.339382+0000","last_unstale":"2023-07-05T23:35:24.662045+0000","last_undegraded":"2023-07-05T23:35:24.662045+0000","last_fullsized":"2023-07-05T23:35:24.662045+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-07-05T23:35:24.661961+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-07-05T23:35:24.661961+0000","last_clean_scrub_stamp":"2023-07-05T23:35:24.661961+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:58:57.110671+0000","scrub_duration":0.0012445749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"30'472","reported_seq":499,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:45.141454+0000","last_change":"2023-07-05T23:35:45.141553+0000","last_active":"2023-07-05T23:35:45.141454+0000","last_peered":"2023-07-05T23:35:45.141454+0000","last_clean":"2023-07-05T23:35:45.141454+0000","last_became_active":"2023-07-05T23:32:57.354576+0000","last_became_peered":"2023-07-05T23:32:57.354576+0000","last_unstale":"2023-07-05T23:35:45.141454+0000","last_undegraded":"2023-07-05T23:35:45.141454+0000","last_fullsized":"2023-07-05T23:35:45.141454+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'472","last_scrub_stamp":"2023-07-05T23:35:45.141356+0000","last_deep_scrub":"30'472","last_deep_scrub_stamp":"2023-07-05T23:35:45.141356+0000","last_clean_scrub_stamp":"2023-07-05T23:35:45.141356+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:45:05.827792+0000","scrub_duration":0.002439751,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":27648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"30'5","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:30.548358+0000","last_change":"2023-07-05T23:35:30.548410+0000","last_active":"2023-07-05T23:35:30.548358+0000","last_peered":"2023-07-05T23:35:30.548358+0000","last_clean":"2023-07-05T23:35:30.548358+0000","last_became_active":"2023-07-05T23:32:52.906187+0000","last_became_peered":"2023-07-05T23:32:52.906187+0000","last_unstale":"2023-07-05T23:35:30.548358+0000","last_undegraded":"2023-07-05T23:35:30.548358+0000","last_fullsized":"2023-07-05T23:35:30.548358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'5","last_scrub_stamp":"2023-07-05T23:35:30.548235+0000","last_deep_scrub":"30'5","last_deep_scrub_stamp":"2023-07-05T23:35:30.548235+0000","last_clean_scrub_stamp":"2023-07-05T23:35:30.548235+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:06:48.971667+0000","scrub_duration":0.0031165590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"30'27","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:36.389104+0000","last_change":"2023-07-05T23:35:36.389175+0000","last_active":"2023-07-05T23:35:36.389104+0000","last_peered":"2023-07-05T23:35:36.389104+0000","last_clean":"2023-07-05T23:35:36.389104+0000","last_became_active":"2023-07-05T23:32:53.343393+0000","last_became_peered":"2023-07-05T23:32:53.343393+0000","last_unstale":"2023-07-05T23:35:36.389104+0000","last_undegraded":"2023-07-05T23:35:36.389104+0000","last_fullsized":"2023-07-05T23:35:36.389104+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'27","last_scrub_stamp":"2023-07-05T23:35:36.388980+0000","last_deep_scrub":"30'27","last_deep_scrub_stamp":"2023-07-05T23:35:36.388980+0000","last_clean_scrub_stamp":"2023-07-05T23:35:36.388980+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:48:16.805544+0000","scrub_duration":0.0021672190000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"30'457","reported_seq":484,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:51.707975+0000","last_change":"2023-07-05T23:35:51.708100+0000","last_active":"2023-07-05T23:35:51.707975+0000","last_peered":"2023-07-05T23:35:51.707975+0000","last_clean":"2023-07-05T23:35:51.707975+0000","last_became_active":"2023-07-05T23:32:57.362431+0000","last_became_peered":"2023-07-05T23:32:57.362431+0000","last_unstale":"2023-07-05T23:35:51.707975+0000","last_undegraded":"2023-07-05T23:35:51.707975+0000","last_fullsized":"2023-07-05T23:35:51.707975+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'457","last_scrub_stamp":"2023-07-05T23:35:51.707863+0000","last_deep_scrub":"30'457","last_deep_scrub_stamp":"2023-07-05T23:35:51.707863+0000","last_clean_scrub_stamp":"2023-07-05T23:35:51.707863+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:22:28.477905+0000","scrub_duration":0.0021919309999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"30'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:28.449465+0000","last_change":"2023-07-05T23:35:28.449517+0000","last_active":"2023-07-05T23:35:28.449465+0000","last_peered":"2023-07-05T23:35:28.449465+0000","last_clean":"2023-07-05T23:35:28.449465+0000","last_became_active":"2023-07-05T23:32:52.907983+0000","last_became_peered":"2023-07-05T23:32:52.907983+0000","last_unstale":"2023-07-05T23:35:28.449465+0000","last_undegraded":"2023-07-05T23:35:28.449465+0000","last_fullsized":"2023-07-05T23:35:28.449465+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2023-07-05T23:35:28.449359+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2023-07-05T23:35:28.449359+0000","last_clean_scrub_stamp":"2023-07-05T23:35:28.449359+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:35:25.750621+0000","scrub_duration":0.001700666,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"30'30","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:35.360758+0000","last_change":"2023-07-05T23:35:35.360814+0000","last_active":"2023-07-05T23:35:35.360758+0000","last_peered":"2023-07-05T23:35:35.360758+0000","last_clean":"2023-07-05T23:35:35.360758+0000","last_became_active":"2023-07-05T23:32:53.338903+0000","last_became_peered":"2023-07-05T23:32:53.338903+0000","last_unstale":"2023-07-05T23:35:35.360758+0000","last_undegraded":"2023-07-05T23:35:35.360758+0000","last_fullsized":"2023-07-05T23:35:35.360758+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'30","last_scrub_stamp":"2023-07-05T23:35:35.360651+0000","last_deep_scrub":"30'30","last_deep_scrub_stamp":"2023-07-05T23:35:35.360651+0000","last_clean_scrub_stamp":"2023-07-05T23:35:35.360651+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:58:04.216771+0000","scrub_duration":0.001803224,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'492","reported_seq":519,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:52.842638+0000","last_change":"2023-07-05T23:35:52.842710+0000","last_active":"2023-07-05T23:35:52.842638+0000","last_peered":"2023-07-05T23:35:52.842638+0000","last_clean":"2023-07-05T23:35:52.842638+0000","last_became_active":"2023-07-05T23:32:57.356611+0000","last_became_peered":"2023-07-05T23:32:57.356611+0000","last_unstale":"2023-07-05T23:35:52.842638+0000","last_undegraded":"2023-07-05T23:35:52.842638+0000","last_fullsized":"2023-07-05T23:35:52.842638+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'492","last_scrub_stamp":"2023-07-05T23:35:52.842519+0000","last_deep_scrub":"30'492","last_deep_scrub_stamp":"2023-07-05T23:35:52.842519+0000","last_clean_scrub_stamp":"2023-07-05T23:35:52.842519+0000","objects_scrubbed":1,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:49:51.212791+0000","scrub_duration":0.0070507490000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":51200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:45.280959+0000","last_change":"2023-07-05T23:35:45.281054+0000","last_active":"2023-07-05T23:35:45.280959+0000","last_peered":"2023-07-05T23:35:45.280959+0000","last_clean":"2023-07-05T23:35:45.280959+0000","last_became_active":"2023-07-05T23:32:52.906779+0000","last_became_peered":"2023-07-05T23:32:52.906779+0000","last_unstale":"2023-07-05T23:35:45.280959+0000","last_undegraded":"2023-07-05T23:35:45.280959+0000","last_fullsized":"2023-07-05T23:35:45.280959+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:35:45.280812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:35:45.280812+0000","last_clean_scrub_stamp":"2023-07-05T23:35:45.280812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:51:49.240572+0000","scrub_duration":0.0016633380000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"30'17","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:23.577489+0000","last_change":"2023-07-05T23:35:23.577540+0000","last_active":"2023-07-05T23:35:23.577489+0000","last_peered":"2023-07-05T23:35:23.577489+0000","last_clean":"2023-07-05T23:35:23.577489+0000","last_became_active":"2023-07-05T23:32:53.339869+0000","last_became_peered":"2023-07-05T23:32:53.339869+0000","last_unstale":"2023-07-05T23:35:23.577489+0000","last_undegraded":"2023-07-05T23:35:23.577489+0000","last_fullsized":"2023-07-05T23:35:23.577489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'17","last_scrub_stamp":"2023-07-05T23:35:23.577389+0000","last_deep_scrub":"30'17","last_deep_scrub_stamp":"2023-07-05T23:35:23.577389+0000","last_clean_scrub_stamp":"2023-07-05T23:35:23.577389+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:47:24.665455+0000","scrub_duration":0.0013589629999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"30'497","reported_seq":524,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:36:19.703789+0000","last_change":"2023-07-05T23:36:19.703858+0000","last_active":"2023-07-05T23:36:19.703789+0000","last_peered":"2023-07-05T23:36:19.703789+0000","last_clean":"2023-07-05T23:36:19.703789+0000","last_became_active":"2023-07-05T23:32:57.363409+0000","last_became_peered":"2023-07-05T23:32:57.363409+0000","last_unstale":"2023-07-05T23:36:19.703789+0000","last_undegraded":"2023-07-05T23:36:19.703789+0000","last_fullsized":"2023-07-05T23:36:19.703789+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'497","last_scrub_stamp":"2023-07-05T23:36:19.703692+0000","last_deep_scrub":"30'497","last_deep_scrub_stamp":"2023-07-05T23:36:19.703692+0000","last_clean_scrub_stamp":"2023-07-05T23:36:19.703692+0000","objects_scrubbed":0,"log_size":497,"log_dups_size":0,"ondisk_log_size":497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:10:44.101467+0000","scrub_duration":0.0024795989999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:35.704543+0000","last_change":"2023-07-05T23:35:35.704595+0000","last_active":"2023-07-05T23:35:35.704543+0000","last_peered":"2023-07-05T23:35:35.704543+0000","last_clean":"2023-07-05T23:35:35.704543+0000","last_became_active":"2023-07-05T23:32:52.909169+0000","last_became_peered":"2023-07-05T23:32:52.909169+0000","last_unstale":"2023-07-05T23:35:35.704543+0000","last_undegraded":"2023-07-05T23:35:35.704543+0000","last_fullsized":"2023-07-05T23:35:35.704543+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:35:35.704430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:35:35.704430+0000","last_clean_scrub_stamp":"2023-07-05T23:35:35.704430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:47:31.633741+0000","scrub_duration":0.0014660249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"30'28","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:46.648910+0000","last_change":"2023-07-05T23:35:46.648958+0000","last_active":"2023-07-05T23:35:46.648910+0000","last_peered":"2023-07-05T23:35:46.648910+0000","last_clean":"2023-07-05T23:35:46.648910+0000","last_became_active":"2023-07-05T23:32:53.342420+0000","last_became_peered":"2023-07-05T23:32:53.342420+0000","last_unstale":"2023-07-05T23:35:46.648910+0000","last_undegraded":"2023-07-05T23:35:46.648910+0000","last_fullsized":"2023-07-05T23:35:46.648910+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'28","last_scrub_stamp":"2023-07-05T23:35:46.648809+0000","last_deep_scrub":"30'28","last_deep_scrub_stamp":"2023-07-05T23:35:46.648809+0000","last_clean_scrub_stamp":"2023-07-05T23:35:46.648809+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:34:43.580605+0000","scrub_duration":0.001639901,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"30'504","reported_seq":531,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:54.645376+0000","last_change":"2023-07-05T23:35:54.645456+0000","last_active":"2023-07-05T23:35:54.645376+0000","last_peered":"2023-07-05T23:35:54.645376+0000","last_clean":"2023-07-05T23:35:54.645376+0000","last_became_active":"2023-07-05T23:32:57.358647+0000","last_became_peered":"2023-07-05T23:32:57.358647+0000","last_unstale":"2023-07-05T23:35:54.645376+0000","last_undegraded":"2023-07-05T23:35:54.645376+0000","last_fullsized":"2023-07-05T23:35:54.645376+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'504","last_scrub_stamp":"2023-07-05T23:35:54.645268+0000","last_deep_scrub":"30'504","last_deep_scrub_stamp":"2023-07-05T23:35:54.645268+0000","last_clean_scrub_stamp":"2023-07-05T23:35:54.645268+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:37:58.281046+0000","scrub_duration":0.0024869089999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:26.562376+0000","last_change":"2023-07-05T23:35:26.562422+0000","last_active":"2023-07-05T23:35:26.562376+0000","last_peered":"2023-07-05T23:35:26.562376+0000","last_clean":"2023-07-05T23:35:26.562376+0000","last_became_active":"2023-07-05T23:32:47.790546+0000","last_became_peered":"2023-07-05T23:32:47.790546+0000","last_unstale":"2023-07-05T23:35:26.562376+0000","last_undegraded":"2023-07-05T23:35:26.562376+0000","last_fullsized":"2023-07-05T23:35:26.562376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:35:26.562263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:35:26.562263+0000","last_clean_scrub_stamp":"2023-07-05T23:35:26.562263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:58:59.010972+0000","scrub_duration":0.0014801910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"30'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:35.839097+0000","last_change":"2023-07-05T23:35:35.839146+0000","last_active":"2023-07-05T23:35:35.839097+0000","last_peered":"2023-07-05T23:35:35.839097+0000","last_clean":"2023-07-05T23:35:35.839097+0000","last_became_active":"2023-07-05T23:32:52.912682+0000","last_became_peered":"2023-07-05T23:32:52.912682+0000","last_unstale":"2023-07-05T23:35:35.839097+0000","last_undegraded":"2023-07-05T23:35:35.839097+0000","last_fullsized":"2023-07-05T23:35:35.839097+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2023-07-05T23:35:35.838992+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2023-07-05T23:35:35.838992+0000","last_clean_scrub_stamp":"2023-07-05T23:35:35.838992+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:44:17.723660+0000","scrub_duration":0.001818807,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"30'30","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:39.577561+0000","last_change":"2023-07-05T23:35:39.577622+0000","last_active":"2023-07-05T23:35:39.577561+0000","last_peered":"2023-07-05T23:35:39.577561+0000","last_clean":"2023-07-05T23:35:39.577561+0000","last_became_active":"2023-07-05T23:32:53.335073+0000","last_became_peered":"2023-07-05T23:32:53.335073+0000","last_unstale":"2023-07-05T23:35:39.577561+0000","last_undegraded":"2023-07-05T23:35:39.577561+0000","last_fullsized":"2023-07-05T23:35:39.577561+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'30","last_scrub_stamp":"2023-07-05T23:35:39.577456+0000","last_deep_scrub":"30'30","last_deep_scrub_stamp":"2023-07-05T23:35:39.577456+0000","last_clean_scrub_stamp":"2023-07-05T23:35:39.577456+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:58:33.987361+0000","scrub_duration":0.002451389,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"30'450","reported_seq":477,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:58.780923+0000","last_change":"2023-07-05T23:35:58.781006+0000","last_active":"2023-07-05T23:35:58.780923+0000","last_peered":"2023-07-05T23:35:58.780923+0000","last_clean":"2023-07-05T23:35:58.780923+0000","last_became_active":"2023-07-05T23:32:57.368030+0000","last_became_peered":"2023-07-05T23:32:57.368030+0000","last_unstale":"2023-07-05T23:35:58.780923+0000","last_undegraded":"2023-07-05T23:35:58.780923+0000","last_fullsized":"2023-07-05T23:35:58.780923+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'450","last_scrub_stamp":"2023-07-05T23:35:58.780819+0000","last_deep_scrub":"30'450","last_deep_scrub_stamp":"2023-07-05T23:35:58.780819+0000","last_clean_scrub_stamp":"2023-07-05T23:35:58.780819+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:48:39.197384+0000","scrub_duration":0.0023398440000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:31.801037+0000","last_change":"2023-07-05T23:35:31.801102+0000","last_active":"2023-07-05T23:35:31.801037+0000","last_peered":"2023-07-05T23:35:31.801037+0000","last_clean":"2023-07-05T23:35:31.801037+0000","last_became_active":"2023-07-05T23:32:47.761996+0000","last_became_peered":"2023-07-05T23:32:47.761996+0000","last_unstale":"2023-07-05T23:35:31.801037+0000","last_undegraded":"2023-07-05T23:35:31.801037+0000","last_fullsized":"2023-07-05T23:35:31.801037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:35:31.800926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:35:31.800926+0000","last_clean_scrub_stamp":"2023-07-05T23:35:31.800926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:13:08.513911+0000","scrub_duration":0.0015452980000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:44.271904+0000","last_change":"2023-07-05T23:35:44.271952+0000","last_active":"2023-07-05T23:35:44.271904+0000","last_peered":"2023-07-05T23:35:44.271904+0000","last_clean":"2023-07-05T23:35:44.271904+0000","last_became_active":"2023-07-05T23:32:52.904202+0000","last_became_peered":"2023-07-05T23:32:52.904202+0000","last_unstale":"2023-07-05T23:35:44.271904+0000","last_undegraded":"2023-07-05T23:35:44.271904+0000","last_fullsized":"2023-07-05T23:35:44.271904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:35:44.271815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:35:44.271815+0000","last_clean_scrub_stamp":"2023-07-05T23:35:44.271815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:29:53.965209+0000","scrub_duration":0.0020349460000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"30'30","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:38.621680+0000","last_change":"2023-07-05T23:35:38.621729+0000","last_active":"2023-07-05T23:35:38.621680+0000","last_peered":"2023-07-05T23:35:38.621680+0000","last_clean":"2023-07-05T23:35:38.621680+0000","last_became_active":"2023-07-05T23:32:53.338626+0000","last_became_peered":"2023-07-05T23:32:53.338626+0000","last_unstale":"2023-07-05T23:35:38.621680+0000","last_undegraded":"2023-07-05T23:35:38.621680+0000","last_fullsized":"2023-07-05T23:35:38.621680+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'30","last_scrub_stamp":"2023-07-05T23:35:38.621586+0000","last_deep_scrub":"30'30","last_deep_scrub_stamp":"2023-07-05T23:35:38.621586+0000","last_clean_scrub_stamp":"2023-07-05T23:35:38.621586+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:06:57.045018+0000","scrub_duration":0.001417272,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"30'489","reported_seq":516,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:52.150975+0000","last_change":"2023-07-05T23:35:52.151097+0000","last_active":"2023-07-05T23:35:52.150975+0000","last_peered":"2023-07-05T23:35:52.150975+0000","last_clean":"2023-07-05T23:35:52.150975+0000","last_became_active":"2023-07-05T23:32:57.355882+0000","last_became_peered":"2023-07-05T23:32:57.355882+0000","last_unstale":"2023-07-05T23:35:52.150975+0000","last_undegraded":"2023-07-05T23:35:52.150975+0000","last_fullsized":"2023-07-05T23:35:52.150975+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'489","last_scrub_stamp":"2023-07-05T23:35:52.150821+0000","last_deep_scrub":"30'489","last_deep_scrub_stamp":"2023-07-05T23:35:52.150821+0000","last_clean_scrub_stamp":"2023-07-05T23:35:52.150821+0000","objects_scrubbed":2,"log_size":489,"log_dups_size":0,"ondisk_log_size":489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:47:18.817141+0000","scrub_duration":0.010813102,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":55296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:22.970005+0000","last_change":"2023-07-05T23:35:22.970044+0000","last_active":"2023-07-05T23:35:22.970005+0000","last_peered":"2023-07-05T23:35:22.970005+0000","last_clean":"2023-07-05T23:35:22.970005+0000","last_became_active":"2023-07-05T23:32:47.979348+0000","last_became_peered":"2023-07-05T23:32:47.979348+0000","last_unstale":"2023-07-05T23:35:22.970005+0000","last_undegraded":"2023-07-05T23:35:22.970005+0000","last_fullsized":"2023-07-05T23:35:22.970005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:35:22.969930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:35:22.969930+0000","last_clean_scrub_stamp":"2023-07-05T23:35:22.969930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:04:30.215991+0000","scrub_duration":0.0013098879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:30.605928+0000","last_change":"2023-07-05T23:35:30.605974+0000","last_active":"2023-07-05T23:35:30.605928+0000","last_peered":"2023-07-05T23:35:30.605928+0000","last_clean":"2023-07-05T23:35:30.605928+0000","last_became_active":"2023-07-05T23:32:52.907307+0000","last_became_peered":"2023-07-05T23:32:52.907307+0000","last_unstale":"2023-07-05T23:35:30.605928+0000","last_undegraded":"2023-07-05T23:35:30.605928+0000","last_fullsized":"2023-07-05T23:35:30.605928+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:35:30.605843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:35:30.605843+0000","last_clean_scrub_stamp":"2023-07-05T23:35:30.605843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:46:16.457656+0000","scrub_duration":0.0017402780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"30'29","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:43.580664+0000","last_change":"2023-07-05T23:35:43.580744+0000","last_active":"2023-07-05T23:35:43.580664+0000","last_peered":"2023-07-05T23:35:43.580664+0000","last_clean":"2023-07-05T23:35:43.580664+0000","last_became_active":"2023-07-05T23:32:53.337896+0000","last_became_peered":"2023-07-05T23:32:53.337896+0000","last_unstale":"2023-07-05T23:35:43.580664+0000","last_undegraded":"2023-07-05T23:35:43.580664+0000","last_fullsized":"2023-07-05T23:35:43.580664+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'29","last_scrub_stamp":"2023-07-05T23:35:43.580552+0000","last_deep_scrub":"30'29","last_deep_scrub_stamp":"2023-07-05T23:35:43.580552+0000","last_clean_scrub_stamp":"2023-07-05T23:35:43.580552+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:47:39.509863+0000","scrub_duration":0.001819665,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"30'478","reported_seq":505,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:36:12.296499+0000","last_change":"2023-07-05T23:36:12.296585+0000","last_active":"2023-07-05T23:36:12.296499+0000","last_peered":"2023-07-05T23:36:12.296499+0000","last_clean":"2023-07-05T23:36:12.296499+0000","last_became_active":"2023-07-05T23:32:57.355475+0000","last_became_peered":"2023-07-05T23:32:57.355475+0000","last_unstale":"2023-07-05T23:36:12.296499+0000","last_undegraded":"2023-07-05T23:36:12.296499+0000","last_fullsized":"2023-07-05T23:36:12.296499+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'478","last_scrub_stamp":"2023-07-05T23:36:12.296398+0000","last_deep_scrub":"30'478","last_deep_scrub_stamp":"2023-07-05T23:36:12.296398+0000","last_clean_scrub_stamp":"2023-07-05T23:36:12.296398+0000","objects_scrubbed":1,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:31:07.711950+0000","scrub_duration":0.0068322039999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:30.765164+0000","last_change":"2023-07-05T23:35:30.765209+0000","last_active":"2023-07-05T23:35:30.765164+0000","last_peered":"2023-07-05T23:35:30.765164+0000","last_clean":"2023-07-05T23:35:30.765164+0000","last_became_active":"2023-07-05T23:32:47.761392+0000","last_became_peered":"2023-07-05T23:32:47.761392+0000","last_unstale":"2023-07-05T23:35:30.765164+0000","last_undegraded":"2023-07-05T23:35:30.765164+0000","last_fullsized":"2023-07-05T23:35:30.765164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:35:30.765068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:35:30.765068+0000","last_clean_scrub_stamp":"2023-07-05T23:35:30.765068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:58:25.174973+0000","scrub_duration":0.0016083200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"30'119","reported_seq":200,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:31.132526+0000","last_change":"2023-07-05T23:35:31.132526+0000","last_active":"2023-07-05T23:35:31.132526+0000","last_peered":"2023-07-05T23:35:31.132526+0000","last_clean":"2023-07-05T23:35:31.132526+0000","last_became_active":"2023-07-05T23:32:42.736736+0000","last_became_peered":"2023-07-05T23:32:42.736736+0000","last_unstale":"2023-07-05T23:35:31.132526+0000","last_undegraded":"2023-07-05T23:35:31.132526+0000","last_fullsized":"2023-07-05T23:35:31.132526+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'119","last_scrub_stamp":"2023-07-05T23:35:31.132330+0000","last_deep_scrub":"30'119","last_deep_scrub_stamp":"2023-07-05T23:35:31.132330+0000","last_clean_scrub_stamp":"2023-07-05T23:35:31.132330+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:46:16.984143+0000","scrub_duration":0.00536033,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:36.754162+0000","last_change":"2023-07-05T23:35:36.754217+0000","last_active":"2023-07-05T23:35:36.754162+0000","last_peered":"2023-07-05T23:35:36.754162+0000","last_clean":"2023-07-05T23:35:36.754162+0000","last_became_active":"2023-07-05T23:32:52.912684+0000","last_became_peered":"2023-07-05T23:32:52.912684+0000","last_unstale":"2023-07-05T23:35:36.754162+0000","last_undegraded":"2023-07-05T23:35:36.754162+0000","last_fullsized":"2023-07-05T23:35:36.754162+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:35:36.754056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:35:36.754056+0000","last_clean_scrub_stamp":"2023-07-05T23:35:36.754056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:44:18.638725+0000","scrub_duration":0.0017168890000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"30'32","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:47.404403+0000","last_change":"2023-07-05T23:35:47.404459+0000","last_active":"2023-07-05T23:35:47.404403+0000","last_peered":"2023-07-05T23:35:47.404403+0000","last_clean":"2023-07-05T23:35:47.404403+0000","last_became_active":"2023-07-05T23:32:53.343848+0000","last_became_peered":"2023-07-05T23:32:53.343848+0000","last_unstale":"2023-07-05T23:35:47.404403+0000","last_undegraded":"2023-07-05T23:35:47.404403+0000","last_fullsized":"2023-07-05T23:35:47.404403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-07-05T23:35:47.404309+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-07-05T23:35:47.404309+0000","last_clean_scrub_stamp":"2023-07-05T23:35:47.404309+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:46:50.341000+0000","scrub_duration":0.0015473119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"30'453","reported_seq":480,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:53.846180+0000","last_change":"2023-07-05T23:35:53.846247+0000","last_active":"2023-07-05T23:35:53.846180+0000","last_peered":"2023-07-05T23:35:53.846180+0000","last_clean":"2023-07-05T23:35:53.846180+0000","last_became_active":"2023-07-05T23:32:57.365013+0000","last_became_peered":"2023-07-05T23:32:57.365013+0000","last_unstale":"2023-07-05T23:35:53.846180+0000","last_undegraded":"2023-07-05T23:35:53.846180+0000","last_fullsized":"2023-07-05T23:35:53.846180+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'453","last_scrub_stamp":"2023-07-05T23:35:53.846088+0000","last_deep_scrub":"30'453","last_deep_scrub_stamp":"2023-07-05T23:35:53.846088+0000","last_clean_scrub_stamp":"2023-07-05T23:35:53.846088+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:56:09.475192+0000","scrub_duration":0.0022154990000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:34.134050+0000","last_change":"2023-07-05T23:35:34.134097+0000","last_active":"2023-07-05T23:35:34.134050+0000","last_peered":"2023-07-05T23:35:34.134050+0000","last_clean":"2023-07-05T23:35:34.134050+0000","last_became_active":"2023-07-05T23:32:47.767297+0000","last_became_peered":"2023-07-05T23:32:47.767297+0000","last_unstale":"2023-07-05T23:35:34.134050+0000","last_undegraded":"2023-07-05T23:35:34.134050+0000","last_fullsized":"2023-07-05T23:35:34.134050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:35:34.133947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:35:34.133947+0000","last_clean_scrub_stamp":"2023-07-05T23:35:34.133947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:00:27.997249+0000","scrub_duration":0.0020560800000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"30'16","reported_seq":66,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:28.696907+0000","last_change":"2023-07-05T23:35:28.696959+0000","last_active":"2023-07-05T23:35:28.696907+0000","last_peered":"2023-07-05T23:35:28.696907+0000","last_clean":"2023-07-05T23:35:28.696907+0000","last_became_active":"2023-07-05T23:32:52.906204+0000","last_became_peered":"2023-07-05T23:32:52.906204+0000","last_unstale":"2023-07-05T23:35:28.696907+0000","last_undegraded":"2023-07-05T23:35:28.696907+0000","last_fullsized":"2023-07-05T23:35:28.696907+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'16","last_scrub_stamp":"2023-07-05T23:35:28.696811+0000","last_deep_scrub":"30'16","last_deep_scrub_stamp":"2023-07-05T23:35:28.696811+0000","last_clean_scrub_stamp":"2023-07-05T23:35:28.696811+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:46:14.548624+0000","scrub_duration":0.0020850030000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7752,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":17,"num_write":15,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"30'28","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:42.625154+0000","last_change":"2023-07-05T23:35:42.625231+0000","last_active":"2023-07-05T23:35:42.625154+0000","last_peered":"2023-07-05T23:35:42.625154+0000","last_clean":"2023-07-05T23:35:42.625154+0000","last_became_active":"2023-07-05T23:32:53.340061+0000","last_became_peered":"2023-07-05T23:32:53.340061+0000","last_unstale":"2023-07-05T23:35:42.625154+0000","last_undegraded":"2023-07-05T23:35:42.625154+0000","last_fullsized":"2023-07-05T23:35:42.625154+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'28","last_scrub_stamp":"2023-07-05T23:35:42.624996+0000","last_deep_scrub":"30'28","last_deep_scrub_stamp":"2023-07-05T23:35:42.624996+0000","last_clean_scrub_stamp":"2023-07-05T23:35:42.624996+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:44:24.509665+0000","scrub_duration":0.001641656,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"30'503","reported_seq":530,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:49.385259+0000","last_change":"2023-07-05T23:35:49.385368+0000","last_active":"2023-07-05T23:35:49.385259+0000","last_peered":"2023-07-05T23:35:49.385259+0000","last_clean":"2023-07-05T23:35:49.385259+0000","last_became_active":"2023-07-05T23:32:57.361941+0000","last_became_peered":"2023-07-05T23:32:57.361941+0000","last_unstale":"2023-07-05T23:35:49.385259+0000","last_undegraded":"2023-07-05T23:35:49.385259+0000","last_fullsized":"2023-07-05T23:35:49.385259+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'503","last_scrub_stamp":"2023-07-05T23:35:49.385143+0000","last_deep_scrub":"30'503","last_deep_scrub_stamp":"2023-07-05T23:35:49.385143+0000","last_clean_scrub_stamp":"2023-07-05T23:35:49.385143+0000","objects_scrubbed":2,"log_size":503,"log_dups_size":0,"ondisk_log_size":503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:17:55.414408+0000","scrub_duration":0.010069819000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:35.179206+0000","last_change":"2023-07-05T23:35:35.179285+0000","last_active":"2023-07-05T23:35:35.179206+0000","last_peered":"2023-07-05T23:35:35.179206+0000","last_clean":"2023-07-05T23:35:35.179206+0000","last_became_active":"2023-07-05T23:32:47.790408+0000","last_became_peered":"2023-07-05T23:32:47.790408+0000","last_unstale":"2023-07-05T23:35:35.179206+0000","last_undegraded":"2023-07-05T23:35:35.179206+0000","last_fullsized":"2023-07-05T23:35:35.179206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:35:35.179072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:35:35.179072+0000","last_clean_scrub_stamp":"2023-07-05T23:35:35.179072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:27:42.194306+0000","scrub_duration":0.001815529,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"30'2","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:35.571238+0000","last_change":"2023-07-05T23:35:35.571330+0000","last_active":"2023-07-05T23:35:35.571238+0000","last_peered":"2023-07-05T23:35:35.571238+0000","last_clean":"2023-07-05T23:35:35.571238+0000","last_became_active":"2023-07-05T23:32:52.908379+0000","last_became_peered":"2023-07-05T23:32:52.908379+0000","last_unstale":"2023-07-05T23:35:35.571238+0000","last_undegraded":"2023-07-05T23:35:35.571238+0000","last_fullsized":"2023-07-05T23:35:35.571238+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2023-07-05T23:35:35.571122+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2023-07-05T23:35:35.571122+0000","last_clean_scrub_stamp":"2023-07-05T23:35:35.571122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:27:42.586356+0000","scrub_duration":0.0016887200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"30'34","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:43.575930+0000","last_change":"2023-07-05T23:35:43.575987+0000","last_active":"2023-07-05T23:35:43.575930+0000","last_peered":"2023-07-05T23:35:43.575930+0000","last_clean":"2023-07-05T23:35:43.575930+0000","last_became_active":"2023-07-05T23:32:53.330771+0000","last_became_peered":"2023-07-05T23:32:53.330771+0000","last_unstale":"2023-07-05T23:35:43.575930+0000","last_undegraded":"2023-07-05T23:35:43.575930+0000","last_fullsized":"2023-07-05T23:35:43.575930+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'34","last_scrub_stamp":"2023-07-05T23:35:43.575837+0000","last_deep_scrub":"30'34","last_deep_scrub_stamp":"2023-07-05T23:35:43.575837+0000","last_clean_scrub_stamp":"2023-07-05T23:35:43.575837+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:55:37.648649+0000","scrub_duration":0.00188262,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"30'487","reported_seq":514,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:36:29.658721+0000","last_change":"2023-07-05T23:36:29.658791+0000","last_active":"2023-07-05T23:36:29.658721+0000","last_peered":"2023-07-05T23:36:29.658721+0000","last_clean":"2023-07-05T23:36:29.658721+0000","last_became_active":"2023-07-05T23:32:57.356797+0000","last_became_peered":"2023-07-05T23:32:57.356797+0000","last_unstale":"2023-07-05T23:36:29.658721+0000","last_undegraded":"2023-07-05T23:36:29.658721+0000","last_fullsized":"2023-07-05T23:36:29.658721+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'487","last_scrub_stamp":"2023-07-05T23:36:29.658613+0000","last_deep_scrub":"30'487","last_deep_scrub_stamp":"2023-07-05T23:36:29.658613+0000","last_clean_scrub_stamp":"2023-07-05T23:36:29.658613+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:16:55.508026+0000","scrub_duration":0.0024071800000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"30'4","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:32.616690+0000","last_change":"2023-07-05T23:35:32.616740+0000","last_active":"2023-07-05T23:35:32.616690+0000","last_peered":"2023-07-05T23:35:32.616690+0000","last_clean":"2023-07-05T23:35:32.616690+0000","last_became_active":"2023-07-05T23:32:52.905704+0000","last_became_peered":"2023-07-05T23:32:52.905704+0000","last_unstale":"2023-07-05T23:35:32.616690+0000","last_undegraded":"2023-07-05T23:35:32.616690+0000","last_fullsized":"2023-07-05T23:35:32.616690+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2023-07-05T23:35:32.616594+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2023-07-05T23:35:32.616594+0000","last_clean_scrub_stamp":"2023-07-05T23:35:32.616594+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:13:09.329579+0000","scrub_duration":0.0031987550000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:23.554123+0000","last_change":"2023-07-05T23:35:23.554182+0000","last_active":"2023-07-05T23:35:23.554123+0000","last_peered":"2023-07-05T23:35:23.554123+0000","last_clean":"2023-07-05T23:35:23.554123+0000","last_became_active":"2023-07-05T23:32:47.768844+0000","last_became_peered":"2023-07-05T23:32:47.768844+0000","last_unstale":"2023-07-05T23:35:23.554123+0000","last_undegraded":"2023-07-05T23:35:23.554123+0000","last_fullsized":"2023-07-05T23:35:23.554123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:35:23.554014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:35:23.554014+0000","last_clean_scrub_stamp":"2023-07-05T23:35:23.554014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:17:29.583280+0000","scrub_duration":0.0020942920000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"30'25","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:56.137007+0000","last_change":"2023-07-05T23:35:56.137087+0000","last_active":"2023-07-05T23:35:56.137007+0000","last_peered":"2023-07-05T23:35:56.137007+0000","last_clean":"2023-07-05T23:35:56.137007+0000","last_became_active":"2023-07-05T23:33:35.012290+0000","last_became_peered":"2023-07-05T23:33:35.012290+0000","last_unstale":"2023-07-05T23:35:56.137007+0000","last_undegraded":"2023-07-05T23:35:56.137007+0000","last_fullsized":"2023-07-05T23:35:56.137007+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'25","last_scrub_stamp":"2023-07-05T23:35:56.136865+0000","last_deep_scrub":"30'25","last_deep_scrub_stamp":"2023-07-05T23:35:56.136865+0000","last_clean_scrub_stamp":"2023-07-05T23:35:56.136865+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:59:28.585575+0000","scrub_duration":0.0022280490000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"30'449","reported_seq":476,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:54.599522+0000","last_change":"2023-07-05T23:35:54.599625+0000","last_active":"2023-07-05T23:35:54.599522+0000","last_peered":"2023-07-05T23:35:54.599522+0000","last_clean":"2023-07-05T23:35:54.599522+0000","last_became_active":"2023-07-05T23:32:57.362112+0000","last_became_peered":"2023-07-05T23:32:57.362112+0000","last_unstale":"2023-07-05T23:35:54.599522+0000","last_undegraded":"2023-07-05T23:35:54.599522+0000","last_fullsized":"2023-07-05T23:35:54.599522+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'449","last_scrub_stamp":"2023-07-05T23:35:54.599336+0000","last_deep_scrub":"30'449","last_deep_scrub_stamp":"2023-07-05T23:35:54.599336+0000","last_clean_scrub_stamp":"2023-07-05T23:35:54.599336+0000","objects_scrubbed":2,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:56:10.228440+0000","scrub_duration":0.011051040999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":46080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:25.353416+0000","last_change":"2023-07-05T23:35:25.353461+0000","last_active":"2023-07-05T23:35:25.353416+0000","last_peered":"2023-07-05T23:35:25.353416+0000","last_clean":"2023-07-05T23:35:25.353416+0000","last_became_active":"2023-07-05T23:32:47.769141+0000","last_became_peered":"2023-07-05T23:32:47.769141+0000","last_unstale":"2023-07-05T23:35:25.353416+0000","last_undegraded":"2023-07-05T23:35:25.353416+0000","last_fullsized":"2023-07-05T23:35:25.353416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-05T23:35:25.353313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-05T23:35:25.353313+0000","last_clean_scrub_stamp":"2023-07-05T23:35:25.353313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:53:19.759050+0000","scrub_duration":0.0014175699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"30'13","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:38.600293+0000","last_change":"2023-07-05T23:35:38.600354+0000","last_active":"2023-07-05T23:35:38.600293+0000","last_peered":"2023-07-05T23:35:38.600293+0000","last_clean":"2023-07-05T23:35:38.600293+0000","last_became_active":"2023-07-05T23:32:52.905451+0000","last_became_peered":"2023-07-05T23:32:52.905451+0000","last_unstale":"2023-07-05T23:35:38.600293+0000","last_undegraded":"2023-07-05T23:35:38.600293+0000","last_fullsized":"2023-07-05T23:35:38.600293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'13","last_scrub_stamp":"2023-07-05T23:35:38.600196+0000","last_deep_scrub":"30'13","last_deep_scrub_stamp":"2023-07-05T23:35:38.600196+0000","last_clean_scrub_stamp":"2023-07-05T23:35:38.600196+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:13:15.313181+0000","scrub_duration":0.0019374049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"30'21","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:51.362930+0000","last_change":"2023-07-05T23:35:51.362986+0000","last_active":"2023-07-05T23:35:51.362930+0000","last_peered":"2023-07-05T23:35:51.362930+0000","last_clean":"2023-07-05T23:35:51.362930+0000","last_became_active":"2023-07-05T23:32:53.332159+0000","last_became_peered":"2023-07-05T23:32:53.332159+0000","last_unstale":"2023-07-05T23:35:51.362930+0000","last_undegraded":"2023-07-05T23:35:51.362930+0000","last_fullsized":"2023-07-05T23:35:51.362930+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'21","last_scrub_stamp":"2023-07-05T23:35:51.362824+0000","last_deep_scrub":"30'21","last_deep_scrub_stamp":"2023-07-05T23:35:51.362824+0000","last_clean_scrub_stamp":"2023-07-05T23:35:51.362824+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:38:41.943629+0000","scrub_duration":0.0015691850000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"30'470","reported_seq":497,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:53.770574+0000","last_change":"2023-07-05T23:35:53.770643+0000","last_active":"2023-07-05T23:35:53.770574+0000","last_peered":"2023-07-05T23:35:53.770574+0000","last_clean":"2023-07-05T23:35:53.770574+0000","last_became_active":"2023-07-05T23:32:57.363620+0000","last_became_peered":"2023-07-05T23:32:57.363620+0000","last_unstale":"2023-07-05T23:35:53.770574+0000","last_undegraded":"2023-07-05T23:35:53.770574+0000","last_fullsized":"2023-07-05T23:35:53.770574+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'470","last_scrub_stamp":"2023-07-05T23:35:53.770477+0000","last_deep_scrub":"30'470","last_deep_scrub_stamp":"2023-07-05T23:35:53.770477+0000","last_clean_scrub_stamp":"2023-07-05T23:35:53.770477+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:58:47.385652+0000","scrub_duration":0.001943052,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:37.555778+0000","last_change":"2023-07-05T23:35:37.555838+0000","last_active":"2023-07-05T23:35:37.555778+0000","last_peered":"2023-07-05T23:35:37.555778+0000","last_clean":"2023-07-05T23:35:37.555778+0000","last_became_active":"2023-07-05T23:32:52.908111+0000","last_became_peered":"2023-07-05T23:32:52.908111+0000","last_unstale":"2023-07-05T23:35:37.555778+0000","last_undegraded":"2023-07-05T23:35:37.555778+0000","last_fullsized":"2023-07-05T23:35:37.555778+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2023-07-05T23:35:37.555686+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2023-07-05T23:35:37.555686+0000","last_clean_scrub_stamp":"2023-07-05T23:35:37.555686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:58:31.965591+0000","scrub_duration":0.0016203809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"30'32","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:32.063729+0000","last_change":"2023-07-05T23:35:32.063812+0000","last_active":"2023-07-05T23:35:32.063729+0000","last_peered":"2023-07-05T23:35:32.063729+0000","last_clean":"2023-07-05T23:35:32.063729+0000","last_became_active":"2023-07-05T23:32:53.339686+0000","last_became_peered":"2023-07-05T23:32:53.339686+0000","last_unstale":"2023-07-05T23:35:32.063729+0000","last_undegraded":"2023-07-05T23:35:32.063729+0000","last_fullsized":"2023-07-05T23:35:32.063729+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-07-05T23:35:32.063608+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-07-05T23:35:32.063608+0000","last_clean_scrub_stamp":"2023-07-05T23:35:32.063608+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:53:42.153964+0000","scrub_duration":0.0016321899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"30'478","reported_seq":505,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:36:10.298535+0000","last_change":"2023-07-05T23:36:10.298624+0000","last_active":"2023-07-05T23:36:10.298535+0000","last_peered":"2023-07-05T23:36:10.298535+0000","last_clean":"2023-07-05T23:36:10.298535+0000","last_became_active":"2023-07-05T23:32:57.355910+0000","last_became_peered":"2023-07-05T23:32:57.355910+0000","last_unstale":"2023-07-05T23:36:10.298535+0000","last_undegraded":"2023-07-05T23:36:10.298535+0000","last_fullsized":"2023-07-05T23:36:10.298535+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'478","last_scrub_stamp":"2023-07-05T23:36:10.298416+0000","last_deep_scrub":"30'478","last_deep_scrub_stamp":"2023-07-05T23:36:10.298416+0000","last_clean_scrub_stamp":"2023-07-05T23:36:10.298416+0000","objects_scrubbed":1,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:15:27.948944+0000","scrub_duration":0.0069478090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"30'3","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:34.865970+0000","last_change":"2023-07-05T23:35:34.866032+0000","last_active":"2023-07-05T23:35:34.865970+0000","last_peered":"2023-07-05T23:35:34.865970+0000","last_clean":"2023-07-05T23:35:34.865970+0000","last_became_active":"2023-07-05T23:32:52.899159+0000","last_became_peered":"2023-07-05T23:32:52.899159+0000","last_unstale":"2023-07-05T23:35:34.865970+0000","last_undegraded":"2023-07-05T23:35:34.865970+0000","last_fullsized":"2023-07-05T23:35:34.865970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2023-07-05T23:35:34.865874+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2023-07-05T23:35:34.865874+0000","last_clean_scrub_stamp":"2023-07-05T23:35:34.865874+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:47:30.795186+0000","scrub_duration":0.0029783230000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"30'24","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:37.340324+0000","last_change":"2023-07-05T23:35:37.340375+0000","last_active":"2023-07-05T23:35:37.340324+0000","last_peered":"2023-07-05T23:35:37.340324+0000","last_clean":"2023-07-05T23:35:37.340324+0000","last_became_active":"2023-07-05T23:32:53.343262+0000","last_became_peered":"2023-07-05T23:32:53.343262+0000","last_unstale":"2023-07-05T23:35:37.340324+0000","last_undegraded":"2023-07-05T23:35:37.340324+0000","last_fullsized":"2023-07-05T23:35:37.340324+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'24","last_scrub_stamp":"2023-07-05T23:35:37.340221+0000","last_deep_scrub":"30'24","last_deep_scrub_stamp":"2023-07-05T23:35:37.340221+0000","last_clean_scrub_stamp":"2023-07-05T23:35:37.340221+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:49:35.710493+0000","scrub_duration":0.0018883940000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"30'465","reported_seq":492,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:51.796756+0000","last_change":"2023-07-05T23:35:51.796846+0000","last_active":"2023-07-05T23:35:51.796756+0000","last_peered":"2023-07-05T23:35:51.796756+0000","last_clean":"2023-07-05T23:35:51.796756+0000","last_became_active":"2023-07-05T23:32:57.365087+0000","last_became_peered":"2023-07-05T23:32:57.365087+0000","last_unstale":"2023-07-05T23:35:51.796756+0000","last_undegraded":"2023-07-05T23:35:51.796756+0000","last_fullsized":"2023-07-05T23:35:51.796756+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'465","last_scrub_stamp":"2023-07-05T23:35:51.796641+0000","last_deep_scrub":"30'465","last_deep_scrub_stamp":"2023-07-05T23:35:51.796641+0000","last_clean_scrub_stamp":"2023-07-05T23:35:51.796641+0000","objects_scrubbed":1,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:48:32.213205+0000","scrub_duration":0.0070808599999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"30'4","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:36.815441+0000","last_change":"2023-07-05T23:35:36.815520+0000","last_active":"2023-07-05T23:35:36.815441+0000","last_peered":"2023-07-05T23:35:36.815441+0000","last_clean":"2023-07-05T23:35:36.815441+0000","last_became_active":"2023-07-05T23:32:52.901689+0000","last_became_peered":"2023-07-05T23:32:52.901689+0000","last_unstale":"2023-07-05T23:35:36.815441+0000","last_undegraded":"2023-07-05T23:35:36.815441+0000","last_fullsized":"2023-07-05T23:35:36.815441+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2023-07-05T23:35:36.815346+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2023-07-05T23:35:36.815346+0000","last_clean_scrub_stamp":"2023-07-05T23:35:36.815346+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:55:30.888158+0000","scrub_duration":0.00274881,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'23","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:27.474074+0000","last_change":"2023-07-05T23:35:27.474123+0000","last_active":"2023-07-05T23:35:27.474074+0000","last_peered":"2023-07-05T23:35:27.474074+0000","last_clean":"2023-07-05T23:35:27.474074+0000","last_became_active":"2023-07-05T23:32:53.346553+0000","last_became_peered":"2023-07-05T23:32:53.346553+0000","last_unstale":"2023-07-05T23:35:27.474074+0000","last_undegraded":"2023-07-05T23:35:27.474074+0000","last_fullsized":"2023-07-05T23:35:27.474074+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'23","last_scrub_stamp":"2023-07-05T23:35:27.473982+0000","last_deep_scrub":"30'23","last_deep_scrub_stamp":"2023-07-05T23:35:27.473982+0000","last_clean_scrub_stamp":"2023-07-05T23:35:27.473982+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:59:09.834139+0000","scrub_duration":0.00189398,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"30'487","reported_seq":514,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:36:27.705399+0000","last_change":"2023-07-05T23:36:27.705461+0000","last_active":"2023-07-05T23:36:27.705399+0000","last_peered":"2023-07-05T23:36:27.705399+0000","last_clean":"2023-07-05T23:36:27.705399+0000","last_became_active":"2023-07-05T23:32:57.352716+0000","last_became_peered":"2023-07-05T23:32:57.352716+0000","last_unstale":"2023-07-05T23:36:27.705399+0000","last_undegraded":"2023-07-05T23:36:27.705399+0000","last_fullsized":"2023-07-05T23:36:27.705399+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'487","last_scrub_stamp":"2023-07-05T23:36:27.705293+0000","last_deep_scrub":"30'487","last_deep_scrub_stamp":"2023-07-05T23:36:27.705293+0000","last_clean_scrub_stamp":"2023-07-05T23:36:27.705293+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T00:37:12.246762+0000","scrub_duration":0.0022375860000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:31.581893+0000","last_change":"2023-07-05T23:35:31.581975+0000","last_active":"2023-07-05T23:35:31.581893+0000","last_peered":"2023-07-05T23:35:31.581893+0000","last_clean":"2023-07-05T23:35:31.581893+0000","last_became_active":"2023-07-05T23:32:52.906688+0000","last_became_peered":"2023-07-05T23:32:52.906688+0000","last_unstale":"2023-07-05T23:35:31.581893+0000","last_undegraded":"2023-07-05T23:35:31.581893+0000","last_fullsized":"2023-07-05T23:35:31.581893+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2023-07-05T23:35:31.581776+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2023-07-05T23:35:31.581776+0000","last_clean_scrub_stamp":"2023-07-05T23:35:31.581776+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:58:25.991680+0000","scrub_duration":0.001758639,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"30'32","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:47.672594+0000","last_change":"2023-07-05T23:35:47.672645+0000","last_active":"2023-07-05T23:35:47.672594+0000","last_peered":"2023-07-05T23:35:47.672594+0000","last_clean":"2023-07-05T23:35:47.672594+0000","last_became_active":"2023-07-05T23:32:53.346652+0000","last_became_peered":"2023-07-05T23:32:53.346652+0000","last_unstale":"2023-07-05T23:35:47.672594+0000","last_undegraded":"2023-07-05T23:35:47.672594+0000","last_fullsized":"2023-07-05T23:35:47.672594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-07-05T23:35:47.672502+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-07-05T23:35:47.672502+0000","last_clean_scrub_stamp":"2023-07-05T23:35:47.672502+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:58:41.287677+0000","scrub_duration":0.001513707,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"30'495","reported_seq":522,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:47.653110+0000","last_change":"2023-07-05T23:35:47.653219+0000","last_active":"2023-07-05T23:35:47.653110+0000","last_peered":"2023-07-05T23:35:47.653110+0000","last_clean":"2023-07-05T23:35:47.653110+0000","last_became_active":"2023-07-05T23:32:57.356637+0000","last_became_peered":"2023-07-05T23:32:57.356637+0000","last_unstale":"2023-07-05T23:35:47.653110+0000","last_undegraded":"2023-07-05T23:35:47.653110+0000","last_fullsized":"2023-07-05T23:35:47.653110+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'495","last_scrub_stamp":"2023-07-05T23:35:47.653002+0000","last_deep_scrub":"30'495","last_deep_scrub_stamp":"2023-07-05T23:35:47.653002+0000","last_clean_scrub_stamp":"2023-07-05T23:35:47.653002+0000","objects_scrubbed":2,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:54:32.892802+0000","scrub_duration":0.011149088999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"30'7","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:33.566089+0000","last_change":"2023-07-05T23:35:33.566152+0000","last_active":"2023-07-05T23:35:33.566089+0000","last_peered":"2023-07-05T23:35:33.566089+0000","last_clean":"2023-07-05T23:35:33.566089+0000","last_became_active":"2023-07-05T23:32:52.903823+0000","last_became_peered":"2023-07-05T23:32:52.903823+0000","last_unstale":"2023-07-05T23:35:33.566089+0000","last_undegraded":"2023-07-05T23:35:33.566089+0000","last_fullsized":"2023-07-05T23:35:33.566089+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'7","last_scrub_stamp":"2023-07-05T23:35:33.566002+0000","last_deep_scrub":"30'7","last_deep_scrub_stamp":"2023-07-05T23:35:33.566002+0000","last_clean_scrub_stamp":"2023-07-05T23:35:33.566002+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:27:40.581236+0000","scrub_duration":0.0037408099999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"30'42","reported_seq":75,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:36:00.478716+0000","last_change":"2023-07-05T23:36:00.478767+0000","last_active":"2023-07-05T23:36:00.478716+0000","last_peered":"2023-07-05T23:36:00.478716+0000","last_clean":"2023-07-05T23:36:00.478716+0000","last_became_active":"2023-07-05T23:32:53.339863+0000","last_became_peered":"2023-07-05T23:32:53.339863+0000","last_unstale":"2023-07-05T23:36:00.478716+0000","last_undegraded":"2023-07-05T23:36:00.478716+0000","last_fullsized":"2023-07-05T23:36:00.478716+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'42","last_scrub_stamp":"2023-07-05T23:36:00.478608+0000","last_deep_scrub":"30'42","last_deep_scrub_stamp":"2023-07-05T23:36:00.478608+0000","last_clean_scrub_stamp":"2023-07-05T23:36:00.478608+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:32:36.569699+0000","scrub_duration":0.0015116839999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"30'50","reported_seq":83,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:37.493267+0000","last_change":"2023-07-05T23:35:37.493321+0000","last_active":"2023-07-05T23:35:37.493267+0000","last_peered":"2023-07-05T23:35:37.493267+0000","last_clean":"2023-07-05T23:35:37.493267+0000","last_became_active":"2023-07-05T23:32:53.336759+0000","last_became_peered":"2023-07-05T23:32:53.336759+0000","last_unstale":"2023-07-05T23:35:37.493267+0000","last_undegraded":"2023-07-05T23:35:37.493267+0000","last_fullsized":"2023-07-05T23:35:37.493267+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'50","last_scrub_stamp":"2023-07-05T23:35:37.493181+0000","last_deep_scrub":"30'50","last_deep_scrub_stamp":"2023-07-05T23:35:37.493181+0000","last_clean_scrub_stamp":"2023-07-05T23:35:37.493181+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:01:21.748318+0000","scrub_duration":0.001613509,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"30'46","reported_seq":79,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:48.678427+0000","last_change":"2023-07-05T23:35:48.678473+0000","last_active":"2023-07-05T23:35:48.678427+0000","last_peered":"2023-07-05T23:35:48.678427+0000","last_clean":"2023-07-05T23:35:48.678427+0000","last_became_active":"2023-07-05T23:32:53.345711+0000","last_became_peered":"2023-07-05T23:32:53.345711+0000","last_unstale":"2023-07-05T23:35:48.678427+0000","last_undegraded":"2023-07-05T23:35:48.678427+0000","last_fullsized":"2023-07-05T23:35:48.678427+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'46","last_scrub_stamp":"2023-07-05T23:35:48.678317+0000","last_deep_scrub":"30'46","last_deep_scrub_stamp":"2023-07-05T23:35:48.678317+0000","last_clean_scrub_stamp":"2023-07-05T23:35:48.678317+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:37:52.314095+0000","scrub_duration":0.001454442,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"30'34","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:31.415358+0000","last_change":"2023-07-05T23:35:31.415413+0000","last_active":"2023-07-05T23:35:31.415358+0000","last_peered":"2023-07-05T23:35:31.415358+0000","last_clean":"2023-07-05T23:35:31.415358+0000","last_became_active":"2023-07-05T23:32:53.339431+0000","last_became_peered":"2023-07-05T23:32:53.339431+0000","last_unstale":"2023-07-05T23:35:31.415358+0000","last_undegraded":"2023-07-05T23:35:31.415358+0000","last_fullsized":"2023-07-05T23:35:31.415358+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'34","last_scrub_stamp":"2023-07-05T23:35:31.415263+0000","last_deep_scrub":"30'34","last_deep_scrub_stamp":"2023-07-05T23:35:31.415263+0000","last_clean_scrub_stamp":"2023-07-05T23:35:31.415263+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:58:25.030438+0000","scrub_duration":0.0015583839999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"30'31","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:38.732951+0000","last_change":"2023-07-05T23:35:38.733005+0000","last_active":"2023-07-05T23:35:38.732951+0000","last_peered":"2023-07-05T23:35:38.732951+0000","last_clean":"2023-07-05T23:35:38.732951+0000","last_became_active":"2023-07-05T23:32:53.335181+0000","last_became_peered":"2023-07-05T23:32:53.335181+0000","last_unstale":"2023-07-05T23:35:38.732951+0000","last_undegraded":"2023-07-05T23:35:38.732951+0000","last_fullsized":"2023-07-05T23:35:38.732951+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'31","last_scrub_stamp":"2023-07-05T23:35:38.732855+0000","last_deep_scrub":"30'31","last_deep_scrub_stamp":"2023-07-05T23:35:38.732855+0000","last_clean_scrub_stamp":"2023-07-05T23:35:38.732855+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:47:39.820920+0000","scrub_duration":0.0020207810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"30'32","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-05T23:35:40.615959+0000","last_change":"2023-07-05T23:35:40.616010+0000","last_active":"2023-07-05T23:35:40.615959+0000","last_peered":"2023-07-05T23:35:40.615959+0000","last_clean":"2023-07-05T23:35:40.615959+0000","last_became_active":"2023-07-05T23:32:53.337835+0000","last_became_peered":"2023-07-05T23:32:53.337835+0000","last_unstale":"2023-07-05T23:35:40.615959+0000","last_undegraded":"2023-07-05T23:35:40.615959+0000","last_fullsized":"2023-07-05T23:35:40.615959+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-07-05T23:35:40.615858+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-07-05T23:35:40.615858+0000","last_clean_scrub_stamp":"2023-07-05T23:35:40.615858+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:13:17.328843+0000","scrub_duration":0.0021545140000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":614,"num_write_kb":1286144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":201326592,"data_stored":201326592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15089,"ondisk_log_size":15089,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2060,"ondisk_log_size":2060,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1537265,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":15,"num_read_kb":17,"num_write":488,"num_write_kb":1816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3137536,"data_stored":3074530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":503,"ondisk_log_size":503,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574901,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68284,"kb_used_data":33140,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94303556,"statfs":{"total":96636764160,"available":96566841344,"internally_reserved":0,"allocated":33935360,"data_stored":33715425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 5 23:35:45 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":1.1919999999999999,"15min":0.79100000000000004},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.65900000000000003,"5min":12.042,"15min":12.042},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":2.2799999999999998,"15min":1.726},"min":{"1min":0.32900000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.82999999999999996,"5min":26.367999999999999,"15min":26.367999999999999},"last":0.52600000000000002}]},{"osd":1,"last update":"Wed Jul 5 23:35:45 2023","interfaces":[{"interface":"back","average":{"1min":2.6160000000000001,"5min":1.659,"15min":1.0289999999999999},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":28.850000000000001,"5min":28.850000000000001,"15min":28.850000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":2.1789999999999998,"5min":1.5960000000000001,"15min":0.93000000000000005},"min":{"1min":0.30199999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":28.797999999999998,"5min":28.797999999999998,"15min":28.797999999999998},"last":0.69199999999999995}]},{"osd":2,"last update":"Wed Jul 5 23:35:45 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":1.5629999999999999,"15min":1.2470000000000001},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.88900000000000001,"5min":11.997,"15min":11.997},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.67800000000000005,"5min":1.778,"15min":1.0580000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":3.1219999999999999,"5min":26.419,"15min":26.419},"last":0.68200000000000005}]},{"osd":3,"last update":"Wed Jul 5 23:35:45 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":1.54,"15min":0.93999999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":4.9480000000000004,"5min":24.094000000000001,"15min":24.094000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.55400000000000005,"5min":1.5629999999999999,"15min":0.94099999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.79300000000000004,"5min":22.588000000000001,"15min":22.588000000000001},"last":0.72799999999999998}]},{"osd":4,"last update":"Wed Jul 5 23:35:45 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":1.0940000000000001,"15min":0.71699999999999997},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.73199999999999998,"5min":12.173999999999999,"15min":12.173999999999999},"last":0.37},{"interface":"front","average":{"1min":0.44700000000000001,"5min":1.1240000000000001,"15min":0.751},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.66000000000000003,"5min":12.151,"15min":12.151},"last":0.41899999999999998}]},{"osd":5,"last update":"Wed Jul 5 23:35:45 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":1.206,"15min":0.77800000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.76400000000000001,"5min":19.954999999999998,"15min":19.954999999999998},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":1.1990000000000001,"15min":0.80400000000000005},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.70599999999999996,"5min":21.870999999999999,"15min":21.870999999999999},"last":0.47899999999999998}]},{"osd":6,"last update":"Wed Jul 5 23:35:45 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":1.585,"15min":0.95199999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.68600000000000005,"5min":20.212,"15min":20.212},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.97099999999999997,"15min":0.73599999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77700000000000002,"5min":12.010999999999999,"15min":12.010999999999999},"last":0.50700000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574901,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57992,"kb_used_data":26944,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94313848,"statfs":{"total":96636764160,"available":96577380352,"internally_reserved":0,"allocated":27590656,"data_stored":27401822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 5 23:35:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":2.0630000000000002,"15min":1.028},"min":{"1min":0.39700000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":9.9100000000000001,"5min":24.012,"15min":24.012},"last":0.61799999999999999},{"interface":"front","average":{"1min":1.2689999999999999,"5min":2.0619999999999998,"15min":1.022},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":10.098000000000001,"5min":27.036000000000001,"15min":27.036000000000001},"last":0.51800000000000002}]},{"osd":1,"last update":"Wed Jul 5 23:35:44 2023","interfaces":[{"interface":"back","average":{"1min":2.3399999999999999,"5min":2.1890000000000001,"15min":1.0649999999999999},"min":{"1min":0.42199999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":24.684000000000001,"5min":24.684000000000001,"15min":24.684000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":1.28,"5min":2.141,"15min":1.085},"min":{"1min":0.35599999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":9.9730000000000008,"5min":23.943000000000001,"15min":23.943000000000001},"last":0.65500000000000003}]},{"osd":2,"last update":"Wed Jul 5 23:35:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":2.0270000000000001,"15min":1.0409999999999999},"min":{"1min":0.45600000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":9.9440000000000008,"5min":25.658000000000001,"15min":25.658000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":1.7549999999999999,"5min":1.8819999999999999,"15min":1.014},"min":{"1min":0.38600000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":10.135,"5min":27.062000000000001,"15min":27.062000000000001},"last":0.55400000000000005}]},{"osd":3,"last update":"Wed Jul 5 23:35:44 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":1.821,"15min":0.98799999999999999},"min":{"1min":0.41299999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":2.0030000000000001,"5min":27.108000000000001,"15min":27.108000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":1.4099999999999999,"5min":2.1469999999999998,"15min":1.085},"min":{"1min":0.39500000000000002,"5min":0.377,"15min":0.377},"max":{"1min":10.047000000000001,"5min":19.940000000000001,"15min":19.940000000000001},"last":0.54300000000000004}]},{"osd":4,"last update":"Wed Jul 5 23:35:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":2.0489999999999999,"15min":1.044},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.087,"5min":26,"15min":26},"last":0.35099999999999998},{"interface":"front","average":{"1min":1.96,"5min":1.7569999999999999,"15min":0.97699999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":20.593,"5min":27.085000000000001,"15min":27.085000000000001},"last":0.38500000000000001}]},{"osd":5,"last update":"Wed Jul 5 23:35:44 2023","interfaces":[{"interface":"back","average":{"1min":1.9359999999999999,"5min":1.8320000000000001,"15min":0.97799999999999998},"min":{"1min":0.32500000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":20.643000000000001,"5min":20.643000000000001,"15min":20.643000000000001},"last":0.37},{"interface":"front","average":{"1min":1.998,"5min":2.056,"15min":1.0960000000000001},"min":{"1min":0.37,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":20.353999999999999,"5min":20.353999999999999,"15min":20.353999999999999},"last":0.41699999999999998}]},{"osd":7,"last update":"Wed Jul 5 23:35:44 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":1.6279999999999999,"15min":0.94599999999999995},"min":{"1min":0.42699999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.0149999999999999,"5min":26.992000000000001,"15min":26.992000000000001},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":1.7270000000000001,"15min":0.98099999999999998},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.1100000000000001,"5min":19.998999999999999,"15min":19.998999999999999},"last":0.40699999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574901,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53896,"kb_used_data":22848,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94317944,"statfs":{"total":96636764160,"available":96581574656,"internally_reserved":0,"allocated":23396352,"data_stored":23207518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 5 23:35:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.2,"15min":0.63800000000000001},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":10.971,"5min":14.039999999999999,"15min":14.039999999999999},"last":0.38500000000000001},{"interface":"front","average":{"1min":1.681,"5min":1.3300000000000001,"15min":0.68700000000000006},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":13.132,"5min":18.006,"15min":18.006},"last":0.49099999999999999}]},{"osd":2,"last update":"Wed Jul 5 23:35:49 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.3140000000000001,"15min":0.69399999999999995},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":11.026999999999999,"5min":14.092000000000001,"15min":14.092000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":2.4039999999999999,"5min":1.5800000000000001,"15min":0.77200000000000002},"min":{"1min":0.26500000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":22.966999999999999,"5min":22.966999999999999,"15min":22.966999999999999},"last":0.52100000000000002}]},{"osd":3,"last update":"Wed Jul 5 23:35:49 2023","interfaces":[{"interface":"back","average":{"1min":1.8759999999999999,"5min":1.613,"15min":0.80300000000000005},"min":{"1min":0.27200000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":22.885000000000002,"5min":22.885000000000002,"15min":22.885000000000002},"last":0.46800000000000003},{"interface":"front","average":{"1min":1.101,"5min":1.109,"15min":0.64100000000000001},"min":{"1min":0.28499999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":13.103,"5min":14.377000000000001,"15min":14.377000000000001},"last":0.44400000000000001}]},{"osd":4,"last update":"Wed Jul 5 23:35:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.603,"15min":0.92700000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":11.003,"5min":14.004,"15min":14.004},"last":0.67500000000000004},{"interface":"front","average":{"1min":2.0369999999999999,"5min":1.903,"15min":1.018},"min":{"1min":0.42299999999999999,"5min":0.371,"15min":0.371},"max":{"1min":22.995999999999999,"5min":22.995999999999999,"15min":22.995999999999999},"last":0.77500000000000002}]},{"osd":5,"last update":"Wed Jul 5 23:35:49 2023","interfaces":[{"interface":"back","average":{"1min":1.8899999999999999,"5min":1.804,"15min":1.018},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":13.053000000000001,"5min":24.949999999999999,"15min":24.949999999999999},"last":0.82699999999999996},{"interface":"front","average":{"1min":1.254,"5min":1.839,"15min":1.0509999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":11.08,"5min":21.945,"15min":21.945},"last":0.64000000000000001}]},{"osd":6,"last update":"Wed Jul 5 23:35:49 2023","interfaces":[{"interface":"back","average":{"1min":1.6719999999999999,"5min":1.5549999999999999,"15min":0.92200000000000004},"min":{"1min":0.40799999999999997,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":13.016999999999999,"5min":17.981999999999999,"15min":17.981999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":1.236,"5min":1.833,"15min":1.038},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":11.050000000000001,"5min":24.943000000000001,"15min":24.943000000000001},"last":0.75700000000000001}]},{"osd":7,"last update":"Wed Jul 5 23:35:49 2023","interfaces":[{"interface":"back","average":{"1min":2.6440000000000001,"5min":2.0249999999999999,"15min":1.091},"min":{"1min":0.46200000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":23.021999999999998,"5min":23.021999999999998,"15min":23.021999999999998},"last":0.69799999999999995},{"interface":"front","average":{"1min":1.9019999999999999,"5min":1.5349999999999999,"15min":0.92100000000000004},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":13.077999999999999,"5min":14.352,"15min":14.352},"last":0.79000000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574901,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54488,"kb_used_data":23440,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94317352,"statfs":{"total":96636764160,"available":96580968448,"internally_reserved":0,"allocated":24002560,"data_stored":23806220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Jul 5 23:35:42 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":1.202,"15min":0.61899999999999999},"min":{"1min":0.22800000000000001,"5min":0.185,"15min":0.185},"max":{"1min":6.1029999999999998,"5min":23.974,"15min":23.974},"last":0.33800000000000002},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.476,"15min":0.71999999999999997},"min":{"1min":0.28699999999999998,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":16.966000000000001,"5min":32.256999999999998,"15min":32.256999999999998},"last":0.376}]},{"osd":2,"last update":"Wed Jul 5 23:35:42 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":1.0549999999999999,"15min":0.59999999999999998},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":5.9699999999999998,"5min":16.157,"15min":16.157},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.80100000000000005,"5min":1.1140000000000001,"15min":0.61499999999999999},"min":{"1min":0.25900000000000001,"5min":0.254,"15min":0.254},"max":{"1min":6.0620000000000003,"5min":14.91,"15min":14.91},"last":0.47499999999999998}]},{"osd":3,"last update":"Wed Jul 5 23:35:42 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.667,"15min":0.80300000000000005},"min":{"1min":0.27600000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":6.133,"5min":16.928999999999998,"15min":16.928999999999998},"last":0.437},{"interface":"front","average":{"1min":0.872,"5min":0.92100000000000004,"15min":0.59399999999999997},"min":{"1min":0.34799999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":6.0039999999999996,"5min":11.923999999999999,"15min":11.923999999999999},"last":0.45600000000000002}]},{"osd":4,"last update":"Wed Jul 5 23:35:42 2023","interfaces":[{"interface":"back","average":{"1min":1.403,"5min":1.556,"15min":0.90200000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":12.066000000000001,"5min":16.838000000000001,"15min":16.838000000000001},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.98899999999999999,"5min":1.712,"15min":0.96499999999999997},"min":{"1min":0.40000000000000002,"5min":0.374,"15min":0.374},"max":{"1min":5.9320000000000004,"5min":23.905999999999999,"15min":23.905999999999999},"last":0.79800000000000004}]},{"osd":5,"last update":"Wed Jul 5 23:35:42 2023","interfaces":[{"interface":"back","average":{"1min":2.073,"5min":1.722,"15min":0.97999999999999998},"min":{"1min":0.41299999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":16.928999999999998,"5min":17.824000000000002,"15min":17.824000000000002},"last":0.73299999999999998},{"interface":"front","average":{"1min":1.423,"5min":1.6619999999999999,"15min":0.96199999999999997},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":12.034000000000001,"5min":16.905000000000001,"15min":16.905000000000001},"last":0.82399999999999995}]},{"osd":6,"last update":"Wed Jul 5 23:35:42 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":1.113,"15min":0.77900000000000003},"min":{"1min":0.47099999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":6.0369999999999999,"5min":10.102,"15min":10.102},"last":0.65600000000000003},{"interface":"front","average":{"1min":1.29,"5min":1.6859999999999999,"15min":0.97799999999999998},"min":{"1min":0.45800000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":11.994999999999999,"5min":32.298999999999999,"15min":32.298999999999999},"last":0.753}]},{"osd":7,"last update":"Wed Jul 5 23:35:42 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.599,"15min":0.95699999999999996},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":11.933,"5min":14.946,"15min":14.946},"last":0.77600000000000002},{"interface":"front","average":{"1min":2.016,"5min":1.9379999999999999,"15min":1.054},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":15.031000000000001,"5min":16.878,"15min":16.878},"last":0.67800000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574902,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55944,"kb_used_data":24896,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94315896,"statfs":{"total":96636764160,"available":96579477504,"internally_reserved":0,"allocated":25493504,"data_stored":25304670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 5 23:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":1.7529999999999999,"15min":0.95599999999999996},"min":{"1min":0.24399999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":6.3879999999999999,"5min":29.716000000000001,"15min":29.716000000000001},"last":0.33600000000000002},{"interface":"front","average":{"1min":1.409,"5min":1.8879999999999999,"15min":1.0389999999999999},"min":{"1min":0.29399999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":17.940000000000001,"5min":21.699000000000002,"15min":21.699000000000002},"last":0.42399999999999999}]},{"osd":1,"last update":"Wed Jul 5 23:35:49 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.7949999999999999,"15min":1.0189999999999999},"min":{"1min":0.309,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":11.032,"5min":23.053000000000001,"15min":23.053000000000001},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.71099999999999997,"5min":1.589,"15min":0.94699999999999995},"min":{"1min":0.311,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":5.1820000000000004,"5min":29.632999999999999,"15min":29.632999999999999},"last":0.376}]},{"osd":3,"last update":"Wed Jul 5 23:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":1.1279999999999999,"15min":0.753},"min":{"1min":0.28599999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.0920000000000001,"5min":22.018000000000001,"15min":22.018000000000001},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.78900000000000003,"5min":1.5620000000000001,"15min":0.98399999999999999},"min":{"1min":0.34899999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":6.468,"5min":29.686,"15min":29.686},"last":0.51300000000000001}]},{"osd":4,"last update":"Wed Jul 5 23:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":2.0800000000000001,"15min":1.2410000000000001},"min":{"1min":0.443,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":6.4180000000000001,"5min":29.768999999999998,"15min":29.768999999999998},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.98199999999999998,"5min":2.1680000000000001,"15min":1.2869999999999999},"min":{"1min":0.45100000000000001,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":7,"5min":21.16,"15min":21.16},"last":0.53000000000000003}]},{"osd":5,"last update":"Wed Jul 5 23:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":2.3650000000000002,"15min":1.337},"min":{"1min":0.505,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":6.9400000000000004,"5min":22.927,"15min":22.927},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":1.768,"15min":1.1519999999999999},"min":{"1min":0.42399999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.755,"5min":23.120000000000001,"15min":23.120000000000001},"last":0.499}]},{"osd":6,"last update":"Wed Jul 5 23:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":1.8400000000000001,"15min":1.1799999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.83399999999999996,"5min":23.173999999999999,"15min":23.173999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.95299999999999996,"5min":2.3769999999999998,"15min":1.361},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":6.4400000000000004,"5min":29.742999999999999,"15min":29.742999999999999},"last":0.63500000000000001}]},{"osd":7,"last update":"Wed Jul 5 23:35:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":2.4510000000000001,"15min":1.391},"min":{"1min":0.47399999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":6.9749999999999996,"5min":32.924999999999997,"15min":32.924999999999997},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.63600000000000001,"5min":2.0920000000000001,"15min":1.288},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.88900000000000001,"5min":30.594999999999999,"15min":30.594999999999999},"last":0.621}]}]},{"osd":3,"up_from":13,"seq":55834574901,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51852,"kb_used_data":20804,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94319988,"statfs":{"total":96636764160,"available":96583667712,"internally_reserved":0,"allocated":21303296,"data_stored":21110456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 5 23:35:53 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":1.4199999999999999,"15min":0.76600000000000001},"min":{"1min":0.26000000000000001,"5min":0.25,"15min":0.25},"max":{"1min":8.032,"5min":22.948,"15min":22.948},"last":0.47399999999999998},{"interface":"front","average":{"1min":3.8399999999999999,"5min":2.052,"15min":1.0029999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":61.006999999999998,"5min":61.006999999999998,"15min":61.006999999999998},"last":0.53100000000000003}]},{"osd":1,"last update":"Wed Jul 5 23:35:53 2023","interfaces":[{"interface":"back","average":{"1min":3.5840000000000001,"5min":1.978,"15min":1.1399999999999999},"min":{"1min":0.247,"5min":0.246,"15min":0.246},"max":{"1min":58.177999999999997,"5min":58.177999999999997,"15min":58.177999999999997},"last":0.63800000000000001},{"interface":"front","average":{"1min":3.4969999999999999,"5min":2.0590000000000002,"15min":1.1930000000000001},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":54.911000000000001,"5min":54.911000000000001,"15min":54.911000000000001},"last":0.52300000000000002}]},{"osd":2,"last update":"Wed Jul 5 23:35:53 2023","interfaces":[{"interface":"back","average":{"1min":2.4980000000000002,"5min":1.6299999999999999,"15min":0.88800000000000001},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":37.674999999999997,"5min":37.674999999999997,"15min":37.674999999999997},"last":0.45100000000000001},{"interface":"front","average":{"1min":1.286,"5min":1.3600000000000001,"15min":0.78000000000000003},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":14.624000000000001,"5min":14.624000000000001,"15min":14.624000000000001},"last":0.60399999999999998}]},{"osd":4,"last update":"Wed Jul 5 23:35:53 2023","interfaces":[{"interface":"back","average":{"1min":2.7309999999999999,"5min":1.798,"15min":1.0249999999999999},"min":{"1min":0.39300000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":37.648000000000003,"5min":37.648000000000003,"15min":37.648000000000003},"last":0.57399999999999995},{"interface":"front","average":{"1min":1.373,"5min":1.7470000000000001,"15min":1.0329999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":14.361000000000001,"5min":22.882000000000001,"15min":22.882000000000001},"last":0.68400000000000005}]},{"osd":5,"last update":"Wed Jul 5 23:35:53 2023","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":2.0609999999999999,"15min":1.155},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":14.435,"5min":23.004999999999999,"15min":23.004999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.92300000000000004,"5min":1.7729999999999999,"15min":1.073},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":4.4329999999999998,"5min":18.959,"15min":18.959},"last":0.73099999999999998}]},{"osd":6,"last update":"Wed Jul 5 23:35:53 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":1.47,"15min":0.97499999999999998},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":4.6879999999999997,"5min":18.923999999999999,"15min":18.923999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":2.734,"5min":2.0649999999999999,"15min":1.143},"min":{"1min":0.44500000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":37.619,"5min":37.619,"15min":37.619},"last":0.622}]},{"osd":7,"last update":"Wed Jul 5 23:35:53 2023","interfaces":[{"interface":"back","average":{"1min":2.75,"5min":2.0019999999999998,"15min":1.1120000000000001},"min":{"1min":0.47699999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":37.555999999999997,"5min":37.555999999999997,"15min":37.555999999999997},"last":0.71399999999999997},{"interface":"front","average":{"1min":1.462,"5min":1.9219999999999999,"15min":1.1259999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":14.747999999999999,"5min":22.974,"15min":22.974},"last":0.746}]}]},{"osd":4,"up_from":13,"seq":55834574902,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61560,"kb_used_data":26416,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94310280,"statfs":{"total":96636764160,"available":96573726720,"internally_reserved":0,"allocated":27049984,"data_stored":26841193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 5 23:35:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":1.4610000000000001,"15min":0.82799999999999996},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":3.3119999999999998,"5min":16.655999999999999,"15min":16.655999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.53500000000000003,"5min":1.5189999999999999,"15min":0.85199999999999998},"min":{"1min":0.32300000000000001,"5min":0.307,"15min":0.307},"max":{"1min":1.1140000000000001,"5min":18.661999999999999,"15min":18.661999999999999},"last":0.58799999999999997}]},{"osd":1,"last update":"Wed Jul 5 23:35:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":1.4770000000000001,"15min":0.81999999999999995},"min":{"1min":0.33000000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.77400000000000002,"5min":18.991,"15min":18.991},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.51900000000000002,"5min":1.8420000000000001,"15min":0.94999999999999996},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71199999999999997,"5min":23.879000000000001,"15min":23.879000000000001},"last":0.57499999999999996}]},{"osd":2,"last update":"Wed Jul 5 23:35:48 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":1.907,"15min":1.0149999999999999},"min":{"1min":0.36799999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":8.7750000000000004,"5min":23.805,"15min":23.805},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":1.6639999999999999,"15min":0.92000000000000004},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.1839999999999999,"5min":18.707000000000001,"15min":18.707000000000001},"last":0.501}]},{"osd":3,"last update":"Wed Jul 5 23:35:48 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":1.6259999999999999,"15min":0.89200000000000002},"min":{"1min":0.38200000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.0229999999999999,"5min":22.966999999999999,"15min":22.966999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.77600000000000002,"5min":1.72,"15min":0.95799999999999996},"min":{"1min":0.36499999999999999,"5min":0.314,"15min":0.314},"max":{"1min":5.391,"5min":23.843,"15min":23.843},"last":0.47699999999999998}]},{"osd":5,"last update":"Wed Jul 5 23:35:48 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":1.327,"15min":0.753},"min":{"1min":0.315,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.70099999999999996,"5min":16.574999999999999,"15min":16.574999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.45000000000000001,"5min":1.1719999999999999,"15min":0.73999999999999999},"min":{"1min":0.34100000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.624,"5min":18.693999999999999,"15min":18.693999999999999},"last":0.48599999999999999}]},{"osd":6,"last update":"Wed Jul 5 23:35:48 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":1.4139999999999999,"15min":0.82299999999999995},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.80200000000000005,"5min":17.983000000000001,"15min":17.983000000000001},"last":0.376},{"interface":"front","average":{"1min":0.51100000000000001,"5min":1.3220000000000001,"15min":0.80700000000000005},"min":{"1min":0.375,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.79400000000000004,"5min":16.622,"15min":16.622},"last":0.40000000000000002}]},{"osd":7,"last update":"Wed Jul 5 23:35:48 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":1.2130000000000001,"15min":0.76900000000000002},"min":{"1min":0.35799999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.82899999999999996,"5min":22.931000000000001,"15min":22.931000000000001},"last":0.442},{"interface":"front","average":{"1min":0.54900000000000004,"5min":1.3,"15min":0.82199999999999995},"min":{"1min":0.39900000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.90200000000000002,"5min":18.966000000000001,"15min":18.966000000000001},"last":0.42899999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574901,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60048,"kb_used_data":24904,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94311792,"statfs":{"total":96636764160,"available":96575275008,"internally_reserved":0,"allocated":25501696,"data_stored":25305322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 5 23:36:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":1.74,"15min":0.91200000000000003},"min":{"1min":0.36799999999999999,"5min":0.253,"15min":0.253},"max":{"1min":0.74399999999999999,"5min":18.867999999999999,"15min":18.867999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.63,"5min":1.552,"15min":0.94799999999999995},"min":{"1min":0.40600000000000003,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.78800000000000003,"5min":18.099,"15min":18.099},"last":0.622}]},{"osd":1,"last update":"Wed Jul 5 23:36:43 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":1.486,"15min":0.88500000000000001},"min":{"1min":0.47799999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.82799999999999996,"5min":18.071999999999999,"15min":18.071999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.59899999999999998,"5min":1.7589999999999999,"15min":0.997},"min":{"1min":0.42199999999999999,"5min":0.247,"15min":0.247},"max":{"1min":0.80300000000000005,"5min":17.004999999999999,"15min":17.004999999999999},"last":0.60499999999999998}]},{"osd":2,"last update":"Wed Jul 5 23:36:43 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":1.8979999999999999,"15min":1.014},"min":{"1min":0.42199999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.78200000000000003,"5min":22.177,"15min":22.177},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.59099999999999997,"5min":1.8320000000000001,"15min":1},"min":{"1min":0.435,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.77900000000000003,"5min":18.902999999999999,"15min":18.902999999999999},"last":0.63300000000000001}]},{"osd":3,"last update":"Wed Jul 5 23:36:43 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":1.573,"15min":0.91500000000000004},"min":{"1min":0.38500000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.73999999999999999,"5min":18.032,"15min":18.032},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.63400000000000001,"5min":1.702,"15min":1.026},"min":{"1min":0.495,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.77000000000000002,"5min":17.029,"15min":17.029},"last":0.64400000000000002}]},{"osd":4,"last update":"Wed Jul 5 23:36:43 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":1.585,"15min":0.88},"min":{"1min":0.313,"5min":0.252,"15min":0.252},"max":{"1min":0.64100000000000001,"5min":18.957000000000001,"15min":18.957000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.48899999999999999,"5min":1.29,"15min":0.82099999999999995},"min":{"1min":0.33800000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.68100000000000005,"5min":18.123999999999999,"15min":18.123999999999999},"last":0.43099999999999999}]},{"osd":6,"last update":"Wed Jul 5 23:36:43 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":1.4390000000000001,"15min":0.86599999999999999},"min":{"1min":0.38800000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.78800000000000003,"5min":16.954000000000001,"15min":16.954000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.53800000000000003,"5min":1.48,"15min":0.88},"min":{"1min":0.36199999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.69799999999999995,"5min":18.928000000000001,"15min":18.928000000000001},"last":0.53400000000000003}]},{"osd":7,"last update":"Wed Jul 5 23:36:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":1.1879999999999999,"15min":0.79200000000000004},"min":{"1min":0.40300000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.76800000000000002,"5min":12.991,"15min":12.991},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.57899999999999996,"5min":1.2450000000000001,"15min":0.83299999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81100000000000005,"5min":16.98,"15min":16.98},"last":0.47199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":8334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1556480,"data_stored":1536523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1556480,"data_stored":1528931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":23068672,"data_stored":23068672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23068672,"data_stored":23068672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":25165824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":25165824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":25165824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":27262976,"data_stored":27262976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":31457280,"data_stored":31457280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-05T23:36:46.881 DEBUG:teuthology.orchestra.run.smithi027:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-07-05T23:36:47.007 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.003+0000 7faa94af4700 1 Processor -- start 2023-07-05T23:36:47.008 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.004+0000 7faa94af4700 1 -- start start 2023-07-05T23:36:47.008 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.004+0000 7faa94af4700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7faa900b23a0 0x7faa9006cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:47.008 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.004+0000 7faa94af4700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7faa9015d2d0 0x7faa900b2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:47.008 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.004+0000 7faa94af4700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faa9015fe40 0x7faa901602c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:47.009 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.004+0000 7faa94af4700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa9015d820 con 0x7faa9015d2d0 2023-07-05T23:36:47.009 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.004+0000 7faa94af4700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa9015c720 con 0x7faa900b23a0 2023-07-05T23:36:47.009 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.004+0000 7faa94af4700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa900d03a0 con 0x7faa9015fe40 2023-07-05T23:36:47.009 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.005+0000 7faa8dd9b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7faa9015d2d0 0x7faa900b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:47.009 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.005+0000 7faa8dd9b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7faa9015d2d0 0x7faa900b2770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46820/0 (socket says 172.21.15.27:46820) 2023-07-05T23:36:47.010 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.005+0000 7faa8dd9b700 1 -- 172.21.15.27:0/2427943809 learned_addr learned my addr 172.21.15.27:0/2427943809 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:36:47.010 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.005+0000 7faa8e59c700 1 --2- 172.21.15.27:0/2427943809 >> v2:172.21.15.162:3300/0 conn(0x7faa900b23a0 0x7faa9006cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:47.010 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.005+0000 7faa8ed9d700 1 --2- 172.21.15.27:0/2427943809 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faa9015fe40 0x7faa901602c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:47.010 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.005+0000 7faa8dd9b700 1 -- 172.21.15.27:0/2427943809 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faa9015fe40 msgr2=0x7faa901602c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:36:47.010 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.005+0000 7faa8dd9b700 1 --2- 172.21.15.27:0/2427943809 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faa9015fe40 0x7faa901602c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:47.011 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.005+0000 7faa8dd9b700 1 -- 172.21.15.27:0/2427943809 >> v2:172.21.15.162:3300/0 conn(0x7faa900b23a0 msgr2=0x7faa9006cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:36:47.011 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.005+0000 7faa8dd9b700 1 --2- 172.21.15.27:0/2427943809 >> v2:172.21.15.162:3300/0 conn(0x7faa900b23a0 0x7faa9006cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:47.012 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.005+0000 7faa8dd9b700 1 -- 172.21.15.27:0/2427943809 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa900b2cb0 con 0x7faa9015d2d0 2023-07-05T23:36:47.012 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.005+0000 7faa8dd9b700 1 --2- 172.21.15.27:0/2427943809 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faa9015d2d0 0x7faa900b2770 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7faa900723c0 tx=0x7faa80009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e0820f7373d1bd server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:36:47.012 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.005+0000 7faa8d59a700 1 -- 172.21.15.27:0/2427943809 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa8000b870 con 0x7faa9015d2d0 2023-07-05T23:36:47.012 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.005+0000 7faa8d59a700 1 -- 172.21.15.27:0/2427943809 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa8000b9d0 con 0x7faa9015d2d0 2023-07-05T23:36:47.013 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.005+0000 7faa8d59a700 1 -- 172.21.15.27:0/2427943809 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa8000bd60 con 0x7faa9015d2d0 2023-07-05T23:36:47.016 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.006+0000 7faa94af4700 1 -- 172.21.15.27:0/2427943809 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faa9015d2d0 msgr2=0x7faa900b2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:47.017 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.006+0000 7faa94af4700 1 --2- 172.21.15.27:0/2427943809 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faa9015d2d0 0x7faa900b2770 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7faa900723c0 tx=0x7faa80009bd0 comp rx=0 tx=0).stop 2023-07-05T23:36:47.017 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.006+0000 7faa94af4700 1 -- 172.21.15.27:0/2427943809 shutdown_connections 2023-07-05T23:36:47.017 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.006+0000 7faa94af4700 1 --2- 172.21.15.27:0/2427943809 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faa9015fe40 0x7faa901602c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:47.018 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.006+0000 7faa94af4700 1 --2- 172.21.15.27:0/2427943809 >> v2:172.21.15.162:3300/0 conn(0x7faa900b23a0 0x7faa9006cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:47.018 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.006+0000 7faa94af4700 1 --2- 172.21.15.27:0/2427943809 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faa9015d2d0 0x7faa900b2770 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:47.018 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.006+0000 7faa94af4700 1 -- 172.21.15.27:0/2427943809 >> 172.21.15.27:0/2427943809 conn(0x7faa9006e5c0 msgr2=0x7faa9006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:36:47.018 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.006+0000 7faa94af4700 1 -- 172.21.15.27:0/2427943809 shutdown_connections 2023-07-05T23:36:47.018 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.006+0000 7faa94af4700 1 -- 172.21.15.27:0/2427943809 wait complete. 2023-07-05T23:36:47.019 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.007+0000 7faa94af4700 1 Processor -- start 2023-07-05T23:36:47.019 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.007+0000 7faa94af4700 1 -- start start 2023-07-05T23:36:47.019 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.008+0000 7faa94af4700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faa900b23a0 0x7faa901510e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:47.019 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.008+0000 7faa94af4700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faa9015d2d0 0x7faa901e5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:47.019 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.008+0000 7faa94af4700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa9015fe40 0x7faa901598f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:47.020 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.008+0000 7faa94af4700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa90151620 con 0x7faa9015d2d0 2023-07-05T23:36:47.020 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.008+0000 7faa94af4700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa901e66b0 con 0x7faa9015fe40 2023-07-05T23:36:47.020 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.008+0000 7faa94af4700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa901e6990 con 0x7faa900b23a0 2023-07-05T23:36:47.020 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.008+0000 7faa8dd9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faa9015d2d0 0x7faa901e5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:47.020 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.008+0000 7faa8dd9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faa9015d2d0 0x7faa901e5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46828/0 (socket says 172.21.15.27:46828) 2023-07-05T23:36:47.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.008+0000 7faa8dd9b700 1 -- 172.21.15.27:0/3729752576 learned_addr learned my addr 172.21.15.27:0/3729752576 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:36:47.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.008+0000 7faa8ed9d700 1 --2- 172.21.15.27:0/3729752576 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa9015fe40 0x7faa901598f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:47.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.008+0000 7faa8e59c700 1 --2- 172.21.15.27:0/3729752576 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faa900b23a0 0x7faa901510e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:47.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.008+0000 7faa8dd9b700 1 -- 172.21.15.27:0/3729752576 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faa900b23a0 msgr2=0x7faa901510e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:47.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.008+0000 7faa8dd9b700 1 --2- 172.21.15.27:0/3729752576 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faa900b23a0 0x7faa901510e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:47.022 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.008+0000 7faa8dd9b700 1 -- 172.21.15.27:0/3729752576 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa9015fe40 msgr2=0x7faa901598f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:47.022 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.008+0000 7faa8dd9b700 1 --2- 172.21.15.27:0/3729752576 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa9015fe40 0x7faa901598f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:47.022 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.008+0000 7faa8dd9b700 1 -- 172.21.15.27:0/3729752576 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa80009550 con 0x7faa9015d2d0 2023-07-05T23:36:47.022 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.008+0000 7faa8ed9d700 1 --2- 172.21.15.27:0/3729752576 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa9015fe40 0x7faa901598f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T23:36:47.022 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.008+0000 7faa8e59c700 1 --2- 172.21.15.27:0/3729752576 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faa900b23a0 0x7faa901510e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T23:36:47.023 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.009+0000 7faa8dd9b700 1 --2- 172.21.15.27:0/3729752576 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faa9015d2d0 0x7faa901e5c60 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7faa80000c00 tx=0x7faa80004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:36:47.023 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.009+0000 7faa7effd700 1 -- 172.21.15.27:0/3729752576 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa80004540 con 0x7faa9015d2d0 2023-07-05T23:36:47.023 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.009+0000 7faa7effd700 1 -- 172.21.15.27:0/3729752576 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa800036a0 con 0x7faa9015d2d0 2023-07-05T23:36:47.023 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.009+0000 7faa94af4700 1 -- 172.21.15.27:0/3729752576 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa901e6c70 con 0x7faa9015d2d0 2023-07-05T23:36:47.023 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.009+0000 7faa7effd700 1 -- 172.21.15.27:0/3729752576 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa80003a50 con 0x7faa9015d2d0 2023-07-05T23:36:47.024 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.009+0000 7faa94af4700 1 -- 172.21.15.27:0/3729752576 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa901e7230 con 0x7faa9015d2d0 2023-07-05T23:36:47.024 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.010+0000 7faa94af4700 1 -- 172.21.15.27:0/3729752576 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa9004ea20 con 0x7faa9015d2d0 2023-07-05T23:36:47.024 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.010+0000 7faa7effd700 1 -- 172.21.15.27:0/3729752576 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7faa80021070 con 0x7faa9015d2d0 2023-07-05T23:36:47.024 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.011+0000 7faa7effd700 1 --2- 172.21.15.27:0/3729752576 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7faa7006ace0 0x7faa7006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:47.024 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.011+0000 7faa7effd700 1 -- 172.21.15.27:0/3729752576 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7faa8008ae80 con 0x7faa9015d2d0 2023-07-05T23:36:47.025 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.011+0000 7faa8e59c700 1 --2- 172.21.15.27:0/3729752576 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7faa7006ace0 0x7faa7006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:47.025 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.011+0000 7faa8e59c700 1 --2- 172.21.15.27:0/3729752576 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7faa7006ace0 0x7faa7006d190 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7faa9015c060 tx=0x7faa84008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:36:47.025 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.015+0000 7faa7effd700 1 -- 172.21.15.27:0/3729752576 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7faa80055db0 con 0x7faa9015d2d0 2023-07-05T23:36:47.215 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.213+0000 7faa94af4700 1 -- 172.21.15.27:0/3729752576 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7faa9006cff0 con 0x7faa9015d2d0 2023-07-05T23:36:47.219 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.216+0000 7faa7effd700 1 -- 172.21.15.27:0/3729752576 <== mon.0 v2:172.21.15.27:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7faa80055db0 con 0x7faa9015d2d0 2023-07-05T23:36:47.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.217+0000 7faa7effd700 1 -- 172.21.15.27:0/3729752576 <== mon.0 v2:172.21.15.27:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) v1 ==== 123+0+0 (secure 0 0 0) 0x7faa800150c0 con 0x7faa9015d2d0 2023-07-05T23:36:47.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.219+0000 7faa94af4700 1 -- 172.21.15.27:0/3729752576 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7faa7006ace0 msgr2=0x7faa7006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:47.222 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.219+0000 7faa94af4700 1 --2- 172.21.15.27:0/3729752576 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7faa7006ace0 0x7faa7006d190 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7faa9015c060 tx=0x7faa84008040 comp rx=0 tx=0).stop 2023-07-05T23:36:47.222 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.219+0000 7faa94af4700 1 -- 172.21.15.27:0/3729752576 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faa9015d2d0 msgr2=0x7faa901e5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:47.222 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.219+0000 7faa94af4700 1 --2- 172.21.15.27:0/3729752576 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faa9015d2d0 0x7faa901e5c60 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7faa80000c00 tx=0x7faa80004750 comp rx=0 tx=0).stop 2023-07-05T23:36:47.222 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.219+0000 7faa94af4700 1 -- 172.21.15.27:0/3729752576 shutdown_connections 2023-07-05T23:36:47.223 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.219+0000 7faa94af4700 1 --2- 172.21.15.27:0/3729752576 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa9015fe40 0x7faa901598f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:47.223 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.219+0000 7faa94af4700 1 --2- 172.21.15.27:0/3729752576 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7faa7006ace0 0x7faa7006d190 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:47.223 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.219+0000 7faa94af4700 1 --2- 172.21.15.27:0/3729752576 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faa900b23a0 0x7faa901510e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:47.223 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.219+0000 7faa94af4700 1 --2- 172.21.15.27:0/3729752576 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faa9015d2d0 0x7faa901e5c60 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:47.223 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.219+0000 7faa94af4700 1 -- 172.21.15.27:0/3729752576 >> 172.21.15.27:0/3729752576 conn(0x7faa9006e5c0 msgr2=0x7faa900b1730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:36:47.224 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.219+0000 7faa94af4700 1 -- 172.21.15.27:0/3729752576 shutdown_connections 2023-07-05T23:36:47.224 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.220+0000 7faa94af4700 1 -- 172.21.15.27:0/3729752576 wait complete. 2023-07-05T23:36:47.234 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-05T23:36:47.234 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-05T23:36:47.358 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.356+0000 7f6b7cd0c700 1 Processor -- start 2023-07-05T23:36:47.358 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.356+0000 7f6b7cd0c700 1 -- start start 2023-07-05T23:36:47.360 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.357+0000 7f6b7cd0c700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6b7815c420 0x7f6b78069ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:47.361 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.357+0000 7f6b7cd0c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f6b780b08d0 0x7f6b7806a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:47.361 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.357+0000 7f6b7cd0c700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b7815c7f0 0x7f6b780cc020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:47.361 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.357+0000 7f6b7cd0c700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b780cf2a0 con 0x7f6b780b08d0 2023-07-05T23:36:47.361 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.357+0000 7f6b7cd0c700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b780ce690 con 0x7f6b7815c420 2023-07-05T23:36:47.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.357+0000 7f6b7cd0c700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b780ce970 con 0x7f6b7815c7f0 2023-07-05T23:36:47.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.357+0000 7f6b75d9b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f6b780b08d0 0x7f6b7806a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:47.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.357+0000 7f6b75d9b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f6b780b08d0 0x7f6b7806a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46834/0 (socket says 172.21.15.27:46834) 2023-07-05T23:36:47.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.357+0000 7f6b75d9b700 1 -- 172.21.15.27:0/1206631686 learned_addr learned my addr 172.21.15.27:0/1206631686 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:36:47.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.357+0000 7f6b7659c700 1 --2- 172.21.15.27:0/1206631686 >> v2:172.21.15.162:3300/0 conn(0x7f6b7815c420 0x7f6b78069ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:47.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.357+0000 7f6b76d9d700 1 --2- 172.21.15.27:0/1206631686 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b7815c7f0 0x7f6b780cc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:47.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.358+0000 7f6b75d9b700 1 -- 172.21.15.27:0/1206631686 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b7815c7f0 msgr2=0x7f6b780cc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:36:47.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.358+0000 7f6b75d9b700 1 --2- 172.21.15.27:0/1206631686 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b7815c7f0 0x7f6b780cc020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:47.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.358+0000 7f6b75d9b700 1 -- 172.21.15.27:0/1206631686 >> v2:172.21.15.162:3300/0 conn(0x7f6b7815c420 msgr2=0x7f6b78069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:36:47.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.358+0000 7f6b75d9b700 1 --2- 172.21.15.27:0/1206631686 >> v2:172.21.15.162:3300/0 conn(0x7f6b7815c420 0x7f6b78069ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:47.364 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.358+0000 7f6b75d9b700 1 -- 172.21.15.27:0/1206631686 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b780cec50 con 0x7f6b780b08d0 2023-07-05T23:36:47.364 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.358+0000 7f6b7659c700 1 --2- 172.21.15.27:0/1206631686 >> v2:172.21.15.162:3300/0 conn(0x7f6b7815c420 0x7f6b78069ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T23:36:47.364 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.358+0000 7f6b75d9b700 1 --2- 172.21.15.27:0/1206631686 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b780b08d0 0x7f6b7806a430 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f6b7806af50 tx=0x7f6b68009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3147cc0efc2d5f2f server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:36:47.364 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.358+0000 7f6b7559a700 1 -- 172.21.15.27:0/1206631686 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6800b870 con 0x7f6b780b08d0 2023-07-05T23:36:47.364 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.358+0000 7f6b7559a700 1 -- 172.21.15.27:0/1206631686 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f6b6800b9d0 con 0x7f6b780b08d0 2023-07-05T23:36:47.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.358+0000 7f6b7559a700 1 -- 172.21.15.27:0/1206631686 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6800bd80 con 0x7f6b780b08d0 2023-07-05T23:36:47.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.358+0000 7f6b7cd0c700 1 -- 172.21.15.27:0/1206631686 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b780b08d0 msgr2=0x7f6b7806a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:47.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.358+0000 7f6b7cd0c700 1 --2- 172.21.15.27:0/1206631686 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b780b08d0 0x7f6b7806a430 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f6b7806af50 tx=0x7f6b68009bd0 comp rx=0 tx=0).stop 2023-07-05T23:36:47.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.359+0000 7f6b7cd0c700 1 -- 172.21.15.27:0/1206631686 shutdown_connections 2023-07-05T23:36:47.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.359+0000 7f6b7cd0c700 1 --2- 172.21.15.27:0/1206631686 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b7815c7f0 0x7f6b780cc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:47.366 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.359+0000 7f6b7cd0c700 1 --2- 172.21.15.27:0/1206631686 >> v2:172.21.15.162:3300/0 conn(0x7f6b7815c420 0x7f6b78069ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:47.366 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.359+0000 7f6b7cd0c700 1 --2- 172.21.15.27:0/1206631686 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b780b08d0 0x7f6b7806a430 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:47.366 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.359+0000 7f6b7cd0c700 1 -- 172.21.15.27:0/1206631686 >> 172.21.15.27:0/1206631686 conn(0x7f6b7806b920 msgr2=0x7f6b780cf7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:36:47.366 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.359+0000 7f6b7cd0c700 1 -- 172.21.15.27:0/1206631686 shutdown_connections 2023-07-05T23:36:47.366 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.359+0000 7f6b7cd0c700 1 -- 172.21.15.27:0/1206631686 wait complete. 2023-07-05T23:36:47.369 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.360+0000 7f6b7cd0c700 1 Processor -- start 2023-07-05T23:36:47.369 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.360+0000 7f6b7cd0c700 1 -- start start 2023-07-05T23:36:47.369 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.361+0000 7f6b7cd0c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b780b08d0 0x7f6b78150c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:47.369 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.361+0000 7f6b7cd0c700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b7815c420 0x7f6b780adbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:47.369 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.361+0000 7f6b7cd0c700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b7815c7f0 0x7f6b7815acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:47.370 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.361+0000 7f6b7cd0c700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b781f2230 con 0x7f6b780b08d0 2023-07-05T23:36:47.370 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.361+0000 7f6b7cd0c700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7809d570 con 0x7f6b7815c7f0 2023-07-05T23:36:47.370 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.361+0000 7f6b7cd0c700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7809d0e0 con 0x7f6b7815c420 2023-07-05T23:36:47.370 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.361+0000 7f6b7659c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b780b08d0 0x7f6b78150c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:47.370 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.361+0000 7f6b7659c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b780b08d0 0x7f6b78150c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46840/0 (socket says 172.21.15.27:46840) 2023-07-05T23:36:47.371 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.361+0000 7f6b7659c700 1 -- 172.21.15.27:0/1248823835 learned_addr learned my addr 172.21.15.27:0/1248823835 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:36:47.371 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.361+0000 7f6b76d9d700 1 --2- 172.21.15.27:0/1248823835 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b7815c7f0 0x7f6b7815acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:47.371 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.361+0000 7f6b75d9b700 1 --2- 172.21.15.27:0/1248823835 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b7815c420 0x7f6b780adbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:47.371 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.361+0000 7f6b7659c700 1 -- 172.21.15.27:0/1248823835 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b7815c420 msgr2=0x7f6b780adbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:47.371 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.361+0000 7f6b7659c700 1 --2- 172.21.15.27:0/1248823835 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b7815c420 0x7f6b780adbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:47.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.361+0000 7f6b7659c700 1 -- 172.21.15.27:0/1248823835 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b7815c7f0 msgr2=0x7f6b7815acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:47.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.361+0000 7f6b7659c700 1 --2- 172.21.15.27:0/1248823835 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b7815c7f0 0x7f6b7815acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:47.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.361+0000 7f6b7659c700 1 -- 172.21.15.27:0/1248823835 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b68009550 con 0x7f6b780b08d0 2023-07-05T23:36:47.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.361+0000 7f6b7659c700 1 --2- 172.21.15.27:0/1248823835 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b780b08d0 0x7f6b78150c30 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c00e840 tx=0x7f6b6c00eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:36:47.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.362+0000 7f6b66ffd700 1 -- 172.21.15.27:0/1248823835 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6c013610 con 0x7f6b780b08d0 2023-07-05T23:36:47.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.362+0000 7f6b66ffd700 1 -- 172.21.15.27:0/1248823835 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f6b6c013770 con 0x7f6b780b08d0 2023-07-05T23:36:47.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.362+0000 7f6b7cd0c700 1 -- 172.21.15.27:0/1248823835 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b78151170 con 0x7f6b780b08d0 2023-07-05T23:36:47.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.362+0000 7f6b66ffd700 1 -- 172.21.15.27:0/1248823835 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6c013b40 con 0x7f6b780b08d0 2023-07-05T23:36:47.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.362+0000 7f6b7cd0c700 1 -- 172.21.15.27:0/1248823835 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b7809ca90 con 0x7f6b780b08d0 2023-07-05T23:36:47.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.363+0000 7f6b7cd0c700 1 -- 172.21.15.27:0/1248823835 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b7809d3c0 con 0x7f6b780b08d0 2023-07-05T23:36:47.374 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.363+0000 7f6b66ffd700 1 -- 172.21.15.27:0/1248823835 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6b6c013ca0 con 0x7f6b780b08d0 2023-07-05T23:36:47.374 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.364+0000 7f6b66ffd700 1 --2- 172.21.15.27:0/1248823835 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f6b5806ace0 0x7f6b5806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:47.374 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.364+0000 7f6b66ffd700 1 -- 172.21.15.27:0/1248823835 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6b6c089440 con 0x7f6b780b08d0 2023-07-05T23:36:47.374 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.364+0000 7f6b75d9b700 1 --2- 172.21.15.27:0/1248823835 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f6b5806ace0 0x7f6b5806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:47.374 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.364+0000 7f6b75d9b700 1 --2- 172.21.15.27:0/1248823835 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f6b5806ace0 0x7f6b5806d190 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6b68014040 tx=0x7f6b68008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:36:47.375 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.368+0000 7f6b66ffd700 1 -- 172.21.15.27:0/1248823835 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6b6c057b20 con 0x7f6b780b08d0 2023-07-05T23:36:47.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.607+0000 7f6b7cd0c700 1 -- 172.21.15.27:0/1248823835 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6b78073910 con 0x7f6b780b08d0 2023-07-05T23:36:47.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.607+0000 7f6b66ffd700 1 -- 172.21.15.27:0/1248823835 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4670 (secure 0 0 0) 0x7f6b6c0576b0 con 0x7f6b780b08d0 2023-07-05T23:36:47.610 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:36:47.610 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/4263442347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":4263442347},{"type":"v1","addr":"172.21.15.162:6837","nonce":4263442347}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/2486008632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2486008632},{"type":"v1","addr":"172.21.15.162:6836","nonce":2486008632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/217781445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":217781445},{"type":"v1","addr":"172.21.15.27:6834","nonce":217781445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-05T23:32:53.313219+0000","modified":"2023-07-05T23:33:16.797372+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6835/3387103520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":3387103520},{"type":"v1","addr":"172.21.15.27:6835","nonce":3387103520}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-05T23:36:47.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.609+0000 7f6b7cd0c700 1 -- 172.21.15.27:0/1248823835 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f6b5806ace0 msgr2=0x7f6b5806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:47.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.609+0000 7f6b7cd0c700 1 --2- 172.21.15.27:0/1248823835 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f6b5806ace0 0x7f6b5806d190 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6b68014040 tx=0x7f6b68008030 comp rx=0 tx=0).stop 2023-07-05T23:36:47.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.609+0000 7f6b7cd0c700 1 -- 172.21.15.27:0/1248823835 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b780b08d0 msgr2=0x7f6b78150c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:47.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.609+0000 7f6b7cd0c700 1 --2- 172.21.15.27:0/1248823835 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b780b08d0 0x7f6b78150c30 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c00e840 tx=0x7f6b6c00eb50 comp rx=0 tx=0).stop 2023-07-05T23:36:47.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.610+0000 7f6b7cd0c700 1 -- 172.21.15.27:0/1248823835 shutdown_connections 2023-07-05T23:36:47.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.610+0000 7f6b7cd0c700 1 --2- 172.21.15.27:0/1248823835 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b7815c7f0 0x7f6b7815acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:47.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.610+0000 7f6b7cd0c700 1 --2- 172.21.15.27:0/1248823835 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f6b5806ace0 0x7f6b5806d190 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:47.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.610+0000 7f6b7cd0c700 1 --2- 172.21.15.27:0/1248823835 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b780b08d0 0x7f6b78150c30 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:47.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.610+0000 7f6b7cd0c700 1 --2- 172.21.15.27:0/1248823835 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b7815c420 0x7f6b780adbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:47.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.610+0000 7f6b7cd0c700 1 -- 172.21.15.27:0/1248823835 >> 172.21.15.27:0/1248823835 conn(0x7f6b7806b920 msgr2=0x7f6b780b2660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:36:47.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.610+0000 7f6b7cd0c700 1 -- 172.21.15.27:0/1248823835 shutdown_connections 2023-07-05T23:36:47.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.610+0000 7f6b7cd0c700 1 -- 172.21.15.27:0/1248823835 wait complete. 2023-07-05T23:36:47.614 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 9 2023-07-05T23:36:47.627 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-05T23:36:47.752 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.750+0000 7f0d1986f700 1 Processor -- start 2023-07-05T23:36:47.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.750+0000 7f0d1986f700 1 -- start start 2023-07-05T23:36:47.754 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.751+0000 7f0d1986f700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d1415a820 0x7f0d140caf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:47.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.751+0000 7f0d1986f700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f0d140d0b00 0x7f0d1415abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:47.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.751+0000 7f0d1986f700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d140cfa60 con 0x7f0d140d0f70 2023-07-05T23:36:47.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.751+0000 7f0d1986f700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d14154a80 con 0x7f0d140d0b00 2023-07-05T23:36:47.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.751+0000 7f0d1986f700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d140cfd40 con 0x7f0d1415a820 2023-07-05T23:36:47.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.751+0000 7f0d127fc700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f0d140d0b00 0x7f0d1415abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:47.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.751+0000 7f0d127fc700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f0d140d0b00 0x7f0d1415abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46848/0 (socket says 172.21.15.27:46848) 2023-07-05T23:36:47.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.751+0000 7f0d127fc700 1 -- 172.21.15.27:0/1153635202 learned_addr learned my addr 172.21.15.27:0/1153635202 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:36:47.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.751+0000 7f0d12ffd700 1 --2- 172.21.15.27:0/1153635202 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d1415a820 0x7f0d140caf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:47.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.752+0000 7f0d127fc700 1 -- 172.21.15.27:0/1153635202 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d1415a820 msgr2=0x7f0d140caf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:36:47.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.752+0000 7f0d127fc700 1 --2- 172.21.15.27:0/1153635202 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d1415a820 0x7f0d140caf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:47.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.752+0000 7f0d127fc700 1 -- 172.21.15.27:0/1153635202 >> v1:172.21.15.162:6789/0 conn(0x7f0d140d0f70 legacy=0x7f0d140ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:47.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.752+0000 7f0d127fc700 1 -- 172.21.15.27:0/1153635202 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d140d0020 con 0x7f0d140d0b00 2023-07-05T23:36:47.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.752+0000 7f0d127fc700 1 --2- 172.21.15.27:0/1153635202 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0d140d0b00 0x7f0d1415abf0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f0d040098f0 tx=0x7f0d04009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa38079b6019813e server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:36:47.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.752+0000 7f0d11ffb700 1 -- 172.21.15.27:0/1153635202 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d04011830 con 0x7f0d140d0b00 2023-07-05T23:36:47.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.752+0000 7f0d11ffb700 1 -- 172.21.15.27:0/1153635202 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f0d04011990 con 0x7f0d140d0b00 2023-07-05T23:36:47.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.752+0000 7f0d11ffb700 1 -- 172.21.15.27:0/1153635202 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d04011d40 con 0x7f0d140d0b00 2023-07-05T23:36:47.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.752+0000 7f0d1986f700 1 -- 172.21.15.27:0/1153635202 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0d140d0b00 msgr2=0x7f0d1415abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:47.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.752+0000 7f0d1986f700 1 --2- 172.21.15.27:0/1153635202 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0d140d0b00 0x7f0d1415abf0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f0d040098f0 tx=0x7f0d04009c00 comp rx=0 tx=0).stop 2023-07-05T23:36:47.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.752+0000 7f0d1986f700 1 -- 172.21.15.27:0/1153635202 shutdown_connections 2023-07-05T23:36:47.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.752+0000 7f0d1986f700 1 --2- 172.21.15.27:0/1153635202 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d1415a820 0x7f0d140caf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:47.760 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.752+0000 7f0d1986f700 1 --2- 172.21.15.27:0/1153635202 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0d140d0b00 0x7f0d1415abf0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:47.760 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.753+0000 7f0d1986f700 1 -- 172.21.15.27:0/1153635202 >> 172.21.15.27:0/1153635202 conn(0x7f0d1406e530 msgr2=0x7f0d1406e900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:36:47.760 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.753+0000 7f0d1986f700 1 -- 172.21.15.27:0/1153635202 shutdown_connections 2023-07-05T23:36:47.760 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.753+0000 7f0d1986f700 1 -- 172.21.15.27:0/1153635202 wait complete. 2023-07-05T23:36:47.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.754+0000 7f0d1986f700 1 Processor -- start 2023-07-05T23:36:47.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.754+0000 7f0d1986f700 1 -- start start 2023-07-05T23:36:47.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.755+0000 7f0d1986f700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d140d0b00 0x7f0d14153d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:47.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.755+0000 7f0d1986f700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d140d0f70 0x7f0d1415bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:47.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.755+0000 7f0d1986f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0d1415a820 0x7f0d141ef930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:47.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.755+0000 7f0d1986f700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1415ad20 con 0x7f0d1415a820 2023-07-05T23:36:47.764 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.755+0000 7f0d1986f700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1415b000 con 0x7f0d140d0b00 2023-07-05T23:36:47.764 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.755+0000 7f0d1986f700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1415b2e0 con 0x7f0d140d0f70 2023-07-05T23:36:47.764 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.755+0000 7f0d137fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0d1415a820 0x7f0d141ef930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:47.764 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.755+0000 7f0d137fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0d1415a820 0x7f0d141ef930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46858/0 (socket says 172.21.15.27:46858) 2023-07-05T23:36:47.765 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.755+0000 7f0d137fe700 1 -- 172.21.15.27:0/410349122 learned_addr learned my addr 172.21.15.27:0/410349122 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:36:47.765 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.755+0000 7f0d127fc700 1 --2- 172.21.15.27:0/410349122 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d140d0f70 0x7f0d1415bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:47.765 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.755+0000 7f0d12ffd700 1 --2- 172.21.15.27:0/410349122 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d140d0b00 0x7f0d14153d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:47.765 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.755+0000 7f0d137fe700 1 -- 172.21.15.27:0/410349122 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d140d0f70 msgr2=0x7f0d1415bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:47.765 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.755+0000 7f0d137fe700 1 --2- 172.21.15.27:0/410349122 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d140d0f70 0x7f0d1415bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:47.766 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.755+0000 7f0d137fe700 1 -- 172.21.15.27:0/410349122 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d140d0b00 msgr2=0x7f0d14153d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:47.766 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.755+0000 7f0d137fe700 1 --2- 172.21.15.27:0/410349122 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d140d0b00 0x7f0d14153d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:47.766 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.755+0000 7f0d137fe700 1 -- 172.21.15.27:0/410349122 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d04009550 con 0x7f0d1415a820 2023-07-05T23:36:47.766 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.755+0000 7f0d137fe700 1 --2- 172.21.15.27:0/410349122 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0d1415a820 0x7f0d141ef930 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c00cbc0 tx=0x7f0d0c00ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:36:47.766 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.755+0000 7f0cfbfff700 1 -- 172.21.15.27:0/410349122 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d0c003c00 con 0x7f0d1415a820 2023-07-05T23:36:47.767 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.756+0000 7f0cfbfff700 1 -- 172.21.15.27:0/410349122 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f0d0c003d60 con 0x7f0d1415a820 2023-07-05T23:36:47.767 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.756+0000 7f0d1986f700 1 -- 172.21.15.27:0/410349122 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d1415b5c0 con 0x7f0d1415a820 2023-07-05T23:36:47.767 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.756+0000 7f0cfbfff700 1 -- 172.21.15.27:0/410349122 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d0c00ab00 con 0x7f0d1415a820 2023-07-05T23:36:47.767 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.756+0000 7f0d1986f700 1 -- 172.21.15.27:0/410349122 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d140c94d0 con 0x7f0d1415a820 2023-07-05T23:36:47.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.757+0000 7f0d1986f700 1 -- 172.21.15.27:0/410349122 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d1415bae0 con 0x7f0d1415a820 2023-07-05T23:36:47.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.757+0000 7f0cfbfff700 1 -- 172.21.15.27:0/410349122 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0d0c00ac60 con 0x7f0d1415a820 2023-07-05T23:36:47.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.757+0000 7f0cfbfff700 1 --2- 172.21.15.27:0/410349122 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f0d0006ace0 0x7f0d0006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:47.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.757+0000 7f0cfbfff700 1 -- 172.21.15.27:0/410349122 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0d0c089760 con 0x7f0d1415a820 2023-07-05T23:36:47.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.758+0000 7f0d12ffd700 1 --2- 172.21.15.27:0/410349122 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f0d0006ace0 0x7f0d0006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:47.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.758+0000 7f0d12ffd700 1 --2- 172.21.15.27:0/410349122 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f0d0006ace0 0x7f0d0006d190 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0d140c8bb0 tx=0x7f0d08009210 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:36:47.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:47.762+0000 7f0cfbfff700 1 -- 172.21.15.27:0/410349122 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0d1415bae0 con 0x7f0d1415a820 2023-07-05T23:36:48.006 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.004+0000 7f0d1986f700 1 -- 172.21.15.27:0/410349122 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0d1415bae0 con 0x7f0d1415a820 2023-07-05T23:36:48.007 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.004+0000 7f0cfbfff700 1 -- 172.21.15.27:0/410349122 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4670 (secure 0 0 0) 0x7f0d1415bae0 con 0x7f0d1415a820 2023-07-05T23:36:48.007 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:36:48.007 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/4263442347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":4263442347},{"type":"v1","addr":"172.21.15.162:6837","nonce":4263442347}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/2486008632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2486008632},{"type":"v1","addr":"172.21.15.162:6836","nonce":2486008632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/217781445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":217781445},{"type":"v1","addr":"172.21.15.27:6834","nonce":217781445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-05T23:32:53.313219+0000","modified":"2023-07-05T23:33:16.797372+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6835/3387103520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":3387103520},{"type":"v1","addr":"172.21.15.27:6835","nonce":3387103520}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-05T23:36:48.008 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.006+0000 7f0d1986f700 1 -- 172.21.15.27:0/410349122 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f0d0006ace0 msgr2=0x7f0d0006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:48.009 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.006+0000 7f0d1986f700 1 --2- 172.21.15.27:0/410349122 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f0d0006ace0 0x7f0d0006d190 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0d140c8bb0 tx=0x7f0d08009210 comp rx=0 tx=0).stop 2023-07-05T23:36:48.009 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.006+0000 7f0d1986f700 1 -- 172.21.15.27:0/410349122 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0d1415a820 msgr2=0x7f0d141ef930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:48.009 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.006+0000 7f0d1986f700 1 --2- 172.21.15.27:0/410349122 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0d1415a820 0x7f0d141ef930 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c00cbc0 tx=0x7f0d0c00ced0 comp rx=0 tx=0).stop 2023-07-05T23:36:48.010 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.006+0000 7f0d1986f700 1 -- 172.21.15.27:0/410349122 shutdown_connections 2023-07-05T23:36:48.010 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.006+0000 7f0d1986f700 1 --2- 172.21.15.27:0/410349122 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d140d0b00 0x7f0d14153d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:48.010 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.006+0000 7f0d1986f700 1 --2- 172.21.15.27:0/410349122 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f0d0006ace0 0x7f0d0006d190 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:48.010 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.006+0000 7f0d1986f700 1 --2- 172.21.15.27:0/410349122 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0d1415a820 0x7f0d141ef930 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:48.010 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.006+0000 7f0d1986f700 1 --2- 172.21.15.27:0/410349122 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d140d0f70 0x7f0d1415bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:48.011 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.006+0000 7f0d1986f700 1 -- 172.21.15.27:0/410349122 >> 172.21.15.27:0/410349122 conn(0x7f0d1406e530 msgr2=0x7f0d140cd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:36:48.011 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.006+0000 7f0d1986f700 1 -- 172.21.15.27:0/410349122 shutdown_connections 2023-07-05T23:36:48.011 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.007+0000 7f0d1986f700 1 -- 172.21.15.27:0/410349122 wait complete. 2023-07-05T23:36:48.011 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 9 2023-07-05T23:36:48.021 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-05T23:36:48.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.143+0000 7f59f6768700 1 Processor -- start 2023-07-05T23:36:48.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.143+0000 7f59f6768700 1 -- start start 2023-07-05T23:36:48.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.144+0000 7f59f6768700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f59f00ccf90 0x7f59f00cd360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:48.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.144+0000 7f59f6768700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f59f006a890 0x7f59f006ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:48.148 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.144+0000 7f59f6768700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59f00cd8a0 con 0x7f59f0158850 2023-07-05T23:36:48.148 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.144+0000 7f59f6768700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59f015d1f0 con 0x7f59f006a890 2023-07-05T23:36:48.148 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.144+0000 7f59f6768700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59f015cc30 con 0x7f59f00ccf90 2023-07-05T23:36:48.148 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.144+0000 7f59f4d05700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f59f006a890 0x7f59f006ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:48.148 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.144+0000 7f59f4d05700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f59f006a890 0x7f59f006ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46866/0 (socket says 172.21.15.27:46866) 2023-07-05T23:36:48.150 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.144+0000 7f59f4d05700 1 -- 172.21.15.27:0/392944788 learned_addr learned my addr 172.21.15.27:0/392944788 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:36:48.150 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.144+0000 7f59effff700 1 --2- 172.21.15.27:0/392944788 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f59f00ccf90 0x7f59f00cd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:48.150 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.144+0000 7f59f4d05700 1 -- 172.21.15.27:0/392944788 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f59f00ccf90 msgr2=0x7f59f00cd360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:36:48.151 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.144+0000 7f59f4d05700 1 --2- 172.21.15.27:0/392944788 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f59f00ccf90 0x7f59f00cd360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:48.151 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.144+0000 7f59f4d05700 1 -- 172.21.15.27:0/392944788 >> v1:172.21.15.162:6789/0 conn(0x7f59f0158850 legacy=0x7f59f015c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:48.151 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.144+0000 7f59f4d05700 1 -- 172.21.15.27:0/392944788 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59f015cf10 con 0x7f59f006a890 2023-07-05T23:36:48.151 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.144+0000 7f59f4d05700 1 --2- 172.21.15.27:0/392944788 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59f006a890 0x7f59f006ad10 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f59e8009e50 tx=0x7f59e800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1fbfd7ec592bc01 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:36:48.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.145+0000 7f59eeffd700 1 -- 172.21.15.27:0/392944788 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e800e070 con 0x7f59f006a890 2023-07-05T23:36:48.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.145+0000 7f59eeffd700 1 -- 172.21.15.27:0/392944788 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f59e800b9c0 con 0x7f59f006a890 2023-07-05T23:36:48.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.145+0000 7f59eeffd700 1 -- 172.21.15.27:0/392944788 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e800bd90 con 0x7f59f006a890 2023-07-05T23:36:48.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.145+0000 7f59f6768700 1 -- 172.21.15.27:0/392944788 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59f006a890 msgr2=0x7f59f006ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:48.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.145+0000 7f59f6768700 1 --2- 172.21.15.27:0/392944788 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59f006a890 0x7f59f006ad10 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f59e8009e50 tx=0x7f59e800b330 comp rx=0 tx=0).stop 2023-07-05T23:36:48.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.145+0000 7f59f6768700 1 -- 172.21.15.27:0/392944788 shutdown_connections 2023-07-05T23:36:48.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.145+0000 7f59f6768700 1 --2- 172.21.15.27:0/392944788 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59f006a890 0x7f59f006ad10 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:48.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.145+0000 7f59f6768700 1 --2- 172.21.15.27:0/392944788 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f59f00ccf90 0x7f59f00cd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:48.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.145+0000 7f59f6768700 1 -- 172.21.15.27:0/392944788 >> 172.21.15.27:0/392944788 conn(0x7f59f00b1740 msgr2=0x7f59f006cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:36:48.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.145+0000 7f59f6768700 1 -- 172.21.15.27:0/392944788 shutdown_connections 2023-07-05T23:36:48.154 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.145+0000 7f59f6768700 1 -- 172.21.15.27:0/392944788 wait complete. 2023-07-05T23:36:48.156 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.146+0000 7f59f6768700 1 Processor -- start 2023-07-05T23:36:48.156 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.147+0000 7f59f6768700 1 -- start start 2023-07-05T23:36:48.156 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.147+0000 7f59f6768700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f59f006a890 0x7f59f0153570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:48.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.147+0000 7f59f6768700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f59f00ccf90 0x7f59f00b3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:48.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.147+0000 7f59f6768700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59f0158850 0x7f59f00b4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:48.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.147+0000 7f59f6768700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f00ca0b0 con 0x7f59f0158850 2023-07-05T23:36:48.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.147+0000 7f59f6768700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f00cabf0 con 0x7f59f00ccf90 2023-07-05T23:36:48.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.147+0000 7f59f6768700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59f0153ab0 con 0x7f59f006a890 2023-07-05T23:36:48.158 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.147+0000 7f59f4d05700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59f0158850 0x7f59f00b4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:48.158 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.148+0000 7f59f4d05700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59f0158850 0x7f59f00b4350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46872/0 (socket says 172.21.15.27:46872) 2023-07-05T23:36:48.158 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.148+0000 7f59f4d05700 1 -- 172.21.15.27:0/1076604700 learned_addr learned my addr 172.21.15.27:0/1076604700 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:36:48.158 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.148+0000 7f59ef7fe700 1 --2- 172.21.15.27:0/1076604700 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f59f00ccf90 0x7f59f00b3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:48.158 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.148+0000 7f59effff700 1 --2- 172.21.15.27:0/1076604700 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f59f006a890 0x7f59f0153570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:48.159 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.148+0000 7f59f4d05700 1 -- 172.21.15.27:0/1076604700 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f59f006a890 msgr2=0x7f59f0153570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:48.159 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.148+0000 7f59f4d05700 1 --2- 172.21.15.27:0/1076604700 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f59f006a890 0x7f59f0153570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:48.159 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.148+0000 7f59f4d05700 1 -- 172.21.15.27:0/1076604700 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f59f00ccf90 msgr2=0x7f59f00b3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:48.159 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.148+0000 7f59f4d05700 1 --2- 172.21.15.27:0/1076604700 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f59f00ccf90 0x7f59f00b3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:48.159 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.148+0000 7f59f4d05700 1 -- 172.21.15.27:0/1076604700 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e8009b30 con 0x7f59f0158850 2023-07-05T23:36:48.159 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.148+0000 7f59ef7fe700 1 --2- 172.21.15.27:0/1076604700 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f59f00ccf90 0x7f59f00b3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T23:36:48.160 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.148+0000 7f59f4d05700 1 --2- 172.21.15.27:0/1076604700 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59f0158850 0x7f59f00b4350 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f59f0066b70 tx=0x7f59e8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:36:48.160 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.148+0000 7f59ecff9700 1 -- 172.21.15.27:0/1076604700 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e8004250 con 0x7f59f0158850 2023-07-05T23:36:48.160 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.148+0000 7f59ecff9700 1 -- 172.21.15.27:0/1076604700 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f59e80043b0 con 0x7f59f0158850 2023-07-05T23:36:48.160 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.148+0000 7f59f6768700 1 -- 172.21.15.27:0/1076604700 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59f00ca2c0 con 0x7f59f0158850 2023-07-05T23:36:48.161 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.148+0000 7f59ecff9700 1 -- 172.21.15.27:0/1076604700 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e8004780 con 0x7f59f0158850 2023-07-05T23:36:48.161 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.148+0000 7f59f6768700 1 -- 172.21.15.27:0/1076604700 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59f00ca880 con 0x7f59f0158850 2023-07-05T23:36:48.161 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.149+0000 7f59f6768700 1 -- 172.21.15.27:0/1076604700 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59f00cad60 con 0x7f59f0158850 2023-07-05T23:36:48.161 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.150+0000 7f59ecff9700 1 -- 172.21.15.27:0/1076604700 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f59e801b430 con 0x7f59f0158850 2023-07-05T23:36:48.161 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.150+0000 7f59ecff9700 1 --2- 172.21.15.27:0/1076604700 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f59d006ace0 0x7f59d006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:48.162 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.150+0000 7f59ecff9700 1 -- 172.21.15.27:0/1076604700 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f59e808a9a0 con 0x7f59f0158850 2023-07-05T23:36:48.162 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.150+0000 7f59effff700 1 --2- 172.21.15.27:0/1076604700 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f59d006ace0 0x7f59d006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:48.162 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.151+0000 7f59effff700 1 --2- 172.21.15.27:0/1076604700 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f59d006ace0 0x7f59d006d190 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f59e0009930 tx=0x7f59e0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:36:48.162 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.154+0000 7f59ecff9700 1 -- 172.21.15.27:0/1076604700 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f59e8055860 con 0x7f59f0158850 2023-07-05T23:36:48.357 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.355+0000 7f59f6768700 1 -- 172.21.15.27:0/1076604700 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f59f0073910 con 0x7f59f0158850 2023-07-05T23:36:48.358 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.357+0000 7f59ecff9700 1 -- 172.21.15.27:0/1076604700 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20215 (secure 0 0 0) 0x7f59e8088e60 con 0x7f59f0158850 2023-07-05T23:36:48.359 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-05T23:36:48.359 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":30,"fsid":"23eebe48-65f5-4d3c-8c2d-4aa171c055d5","created":"2023-07-05T23:32:27.989612+0000","modified":"2023-07-05T23:33:34.883498+0000","last_up_change":"2023-07-05T23:32:39.601570+0000","last_in_change":"2023-07-05T23:32:30.488261+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-05T23:32:41.624598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-05T23:32:46.481587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-05T23:32:51.025210+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-05T23:32:52.286964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-05T23:32:55.354212+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ac2071e4-394b-4385-b9ba-fad5265efc65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6814","nonce":3766536605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6818","nonce":3766536605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6823","nonce":3766536605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":3766536605},{"type":"v1","addr":"172.21.15.27:6821","nonce":3766536605}]},"public_addr":"172.21.15.27:6814/3766536605","cluster_addr":"172.21.15.27:6818/3766536605","heartbeat_back_addr":"172.21.15.27:6823/3766536605","heartbeat_front_addr":"172.21.15.27:6821/3766536605","state":["exists","up"]},{"osd":1,"uuid":"8c9b61a0-39d5-46bf-afd6-5add78453ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6801","nonce":1579117455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6803","nonce":1579117455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6807","nonce":1579117455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":1579117455},{"type":"v1","addr":"172.21.15.27:6805","nonce":1579117455}]},"public_addr":"172.21.15.27:6801/1579117455","cluster_addr":"172.21.15.27:6803/1579117455","heartbeat_back_addr":"172.21.15.27:6807/1579117455","heartbeat_front_addr":"172.21.15.27:6805/1579117455","state":["exists","up"]},{"osd":2,"uuid":"dcd032a2-06b1-4055-b798-b86c71a7107d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6825","nonce":807520271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6827","nonce":807520271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6831","nonce":807520271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":807520271},{"type":"v1","addr":"172.21.15.27:6829","nonce":807520271}]},"public_addr":"172.21.15.27:6825/807520271","cluster_addr":"172.21.15.27:6827/807520271","heartbeat_back_addr":"172.21.15.27:6831/807520271","heartbeat_front_addr":"172.21.15.27:6829/807520271","state":["exists","up"]},{"osd":3,"uuid":"b0ffe0fc-47ba-4636-b5ea-6bab637642c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6809","nonce":2125656143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6811","nonce":2125656143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6817","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6819","nonce":2125656143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6813","nonce":2125656143},{"type":"v1","addr":"172.21.15.27:6815","nonce":2125656143}]},"public_addr":"172.21.15.27:6809/2125656143","cluster_addr":"172.21.15.27:6811/2125656143","heartbeat_back_addr":"172.21.15.27:6819/2125656143","heartbeat_front_addr":"172.21.15.27:6815/2125656143","state":["exists","up"]},{"osd":4,"uuid":"7fab4e5a-1246-4efe-9562-10c4a6c789ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6801","nonce":2111223016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6803","nonce":2111223016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6807","nonce":2111223016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2111223016},{"type":"v1","addr":"172.21.15.162:6805","nonce":2111223016}]},"public_addr":"172.21.15.162:6801/2111223016","cluster_addr":"172.21.15.162:6803/2111223016","heartbeat_back_addr":"172.21.15.162:6807/2111223016","heartbeat_front_addr":"172.21.15.162:6805/2111223016","state":["exists","up"]},{"osd":5,"uuid":"110c4d9f-cef6-48ab-a818-5a81e72372af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6825","nonce":3102609008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6827","nonce":3102609008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6831","nonce":3102609008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3102609008},{"type":"v1","addr":"172.21.15.162:6829","nonce":3102609008}]},"public_addr":"172.21.15.162:6825/3102609008","cluster_addr":"172.21.15.162:6827/3102609008","heartbeat_back_addr":"172.21.15.162:6831/3102609008","heartbeat_front_addr":"172.21.15.162:6829/3102609008","state":["exists","up"]},{"osd":6,"uuid":"16803bcc-2c92-4aed-954e-487938c9f24a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6809","nonce":2657688865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6811","nonce":2657688865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6815","nonce":2657688865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2657688865},{"type":"v1","addr":"172.21.15.162:6813","nonce":2657688865}]},"public_addr":"172.21.15.162:6809/2657688865","cluster_addr":"172.21.15.162:6811/2657688865","heartbeat_back_addr":"172.21.15.162:6815/2657688865","heartbeat_front_addr":"172.21.15.162:6813/2657688865","state":["exists","up"]},{"osd":7,"uuid":"b7c35377-3cf2-4569-b6b9-72376eb463bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6817","nonce":2096609978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6819","nonce":2096609978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6823","nonce":2096609978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2096609978},{"type":"v1","addr":"172.21.15.162:6821","nonce":2096609978}]},"public_addr":"172.21.15.162:6817/2096609978","cluster_addr":"172.21.15.162:6819/2096609978","heartbeat_back_addr":"172.21.15.162:6823/2096609978","heartbeat_front_addr":"172.21.15.162:6821/2096609978","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.735448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.645561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.759120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.682507+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.736228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.694664+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.716002+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-05T23:32:35.680485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":3,"to":2}]},{"pgid":"4.26","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-05T23:36:48.361 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.359+0000 7f59f6768700 1 -- 172.21.15.27:0/1076604700 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f59d006ace0 msgr2=0x7f59d006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:48.361 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.359+0000 7f59f6768700 1 --2- 172.21.15.27:0/1076604700 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f59d006ace0 0x7f59d006d190 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f59e0009930 tx=0x7f59e0008040 comp rx=0 tx=0).stop 2023-07-05T23:36:48.361 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.359+0000 7f59f6768700 1 -- 172.21.15.27:0/1076604700 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59f0158850 msgr2=0x7f59f00b4350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:48.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.359+0000 7f59f6768700 1 --2- 172.21.15.27:0/1076604700 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59f0158850 0x7f59f00b4350 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f59f0066b70 tx=0x7f59e8004ad0 comp rx=0 tx=0).stop 2023-07-05T23:36:48.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.359+0000 7f59f6768700 1 -- 172.21.15.27:0/1076604700 shutdown_connections 2023-07-05T23:36:48.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.359+0000 7f59f6768700 1 --2- 172.21.15.27:0/1076604700 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f59d006ace0 0x7f59d006d190 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:48.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.359+0000 7f59f6768700 1 --2- 172.21.15.27:0/1076604700 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59f0158850 0x7f59f00b4350 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:48.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.359+0000 7f59f6768700 1 --2- 172.21.15.27:0/1076604700 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f59f006a890 0x7f59f0153570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:48.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.359+0000 7f59f6768700 1 --2- 172.21.15.27:0/1076604700 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f59f00ccf90 0x7f59f00b3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:48.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.359+0000 7f59f6768700 1 -- 172.21.15.27:0/1076604700 >> 172.21.15.27:0/1076604700 conn(0x7f59f00b1740 msgr2=0x7f59f0154430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:36:48.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.359+0000 7f59f6768700 1 -- 172.21.15.27:0/1076604700 shutdown_connections 2023-07-05T23:36:48.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.359+0000 7f59f6768700 1 -- 172.21.15.27:0/1076604700 wait complete. 2023-07-05T23:36:48.373 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-05T23:36:48.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.497+0000 7fd4eb481700 1 Processor -- start 2023-07-05T23:36:48.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.497+0000 7fd4eb481700 1 -- start start 2023-07-05T23:36:48.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.498+0000 7fd4eb481700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd4e406a890 0x7fd4e406acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:48.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.498+0000 7fd4eb481700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4e415cc30 con 0x7fd4e40ccf90 2023-07-05T23:36:48.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.498+0000 7fd4eb481700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4e415cf10 con 0x7fd4e4158850 2023-07-05T23:36:48.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.498+0000 7fd4eb481700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4e415d1f0 con 0x7fd4e406a890 2023-07-05T23:36:48.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.498+0000 7fd4e921d700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fd4e40ccf90 0x7fd4e40cd360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:54042/0 (socket says 172.21.15.27:54042) 2023-07-05T23:36:48.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.498+0000 7fd4e921d700 1 -- 172.21.15.27:0/2235358658 learned_addr learned my addr 172.21.15.27:0/2235358658 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-07-05T23:36:48.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.498+0000 7fd4e9a1e700 1 --2- 172.21.15.27:0/2235358658 >> v2:172.21.15.162:3300/0 conn(0x7fd4e406a890 0x7fd4e406acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:48.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.498+0000 7fd4dbfff700 1 -- 172.21.15.27:0/2235358658 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2643872984 0 0) 0x7fd4e415cc30 con 0x7fd4e40ccf90 2023-07-05T23:36:48.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.498+0000 7fd4dbfff700 1 -- 172.21.15.27:0/2235358658 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4d00035b0 con 0x7fd4e40ccf90 2023-07-05T23:36:48.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.498+0000 7fd4dbfff700 1 -- 172.21.15.27:0/2235358658 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 802568137 0 0) 0x7fd4d00035b0 con 0x7fd4e40ccf90 2023-07-05T23:36:48.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.498+0000 7fd4dbfff700 1 -- 172.21.15.27:0/2235358658 >> v2:172.21.15.162:3300/0 conn(0x7fd4e406a890 msgr2=0x7fd4e406acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:36:48.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.498+0000 7fd4dbfff700 1 --2- 172.21.15.27:0/2235358658 >> v2:172.21.15.162:3300/0 conn(0x7fd4e406a890 0x7fd4e406acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:48.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.498+0000 7fd4dbfff700 1 -- 172.21.15.27:0/2235358658 >> v1:172.21.15.162:6789/0 conn(0x7fd4e4158850 legacy=0x7fd4e415c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:48.508 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.498+0000 7fd4dbfff700 1 -- 172.21.15.27:0/2235358658 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4e406a090 con 0x7fd4e40ccf90 2023-07-05T23:36:48.508 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.498+0000 7fd4dbfff700 1 -- 172.21.15.27:0/2235358658 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1246168953 0 0) 0x7fd4e0001670 con 0x7fd4e40ccf90 2023-07-05T23:36:48.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.499+0000 7fd4dbfff700 1 -- 172.21.15.27:0/2235358658 >> v1:172.21.15.27:6789/0 conn(0x7fd4e40ccf90 legacy=0x7fd4e40cd360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:48.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.499+0000 7fd4dbfff700 1 --2- 172.21.15.27:0/2235358658 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd4d0003a00 0x7fd4d0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:48.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.499+0000 7fd4dbfff700 1 --2- 172.21.15.27:0/2235358658 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd4d0004850 0x7fd4d0004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:48.511 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.499+0000 7fd4dbfff700 1 --2- 172.21.15.27:0/2235358658 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4d0005200 0x7fd4d000cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:48.511 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.499+0000 7fd4dbfff700 1 -- 172.21.15.27:0/2235358658 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e415d1f0 con 0x7fd4d0004850 2023-07-05T23:36:48.512 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.499+0000 7fd4dbfff700 1 -- 172.21.15.27:0/2235358658 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d000d190 con 0x7fd4d0005200 2023-07-05T23:36:48.512 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.499+0000 7fd4dbfff700 1 -- 172.21.15.27:0/2235358658 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d000d350 con 0x7fd4d0003a00 2023-07-05T23:36:48.513 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.499+0000 7fd4e8a1c700 1 --2- 172.21.15.27:0/2235358658 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd4d0004850 0x7fd4d0004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:48.513 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.499+0000 7fd4e9a1e700 1 --2- 172.21.15.27:0/2235358658 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4d0005200 0x7fd4d000cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:48.513 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.499+0000 7fd4e921d700 1 --2- 172.21.15.27:0/2235358658 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd4d0003a00 0x7fd4d0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:48.514 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.499+0000 7fd4e8a1c700 1 -- 172.21.15.27:0/2235358658 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd4d0003a00 msgr2=0x7fd4d0003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:36:48.514 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.499+0000 7fd4e8a1c700 1 --2- 172.21.15.27:0/2235358658 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd4d0003a00 0x7fd4d0003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:48.515 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.499+0000 7fd4e8a1c700 1 -- 172.21.15.27:0/2235358658 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4d0005200 msgr2=0x7fd4d000cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:36:48.515 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.499+0000 7fd4e8a1c700 1 --2- 172.21.15.27:0/2235358658 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4d0005200 0x7fd4d000cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:48.515 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.499+0000 7fd4e8a1c700 1 -- 172.21.15.27:0/2235358658 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d00035b0 con 0x7fd4d0004850 2023-07-05T23:36:48.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.499+0000 7fd4e9a1e700 1 -- 172.21.15.27:0/2235358658 reap_dead start 2023-07-05T23:36:48.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.499+0000 7fd4e921d700 1 --2- 172.21.15.27:0/2235358658 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd4d0003a00 0x7fd4d0003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T23:36:48.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.499+0000 7fd4e8a1c700 1 --2- 172.21.15.27:0/2235358658 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd4d0004850 0x7fd4d0004cc0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fd4d4001800 tx=0x7fd4d0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65d7cee65f433131 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:36:48.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.499+0000 7fd4dbfff700 1 -- 172.21.15.27:0/2235358658 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d40012f0 con 0x7fd4d0004850 2023-07-05T23:36:48.517 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.499+0000 7fd4dbfff700 1 -- 172.21.15.27:0/2235358658 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd4d4005310 con 0x7fd4d0004850 2023-07-05T23:36:48.517 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.499+0000 7fd4dbfff700 1 -- 172.21.15.27:0/2235358658 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d4006860 con 0x7fd4d0004850 2023-07-05T23:36:48.517 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.500+0000 7fd4eb481700 1 -- 172.21.15.27:0/2235358658 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd4d0004850 msgr2=0x7fd4d0004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:48.517 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.500+0000 7fd4eb481700 1 --2- 172.21.15.27:0/2235358658 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd4d0004850 0x7fd4d0004cc0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fd4d4001800 tx=0x7fd4d0005880 comp rx=0 tx=0).stop 2023-07-05T23:36:48.518 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.500+0000 7fd4eb481700 1 -- 172.21.15.27:0/2235358658 shutdown_connections 2023-07-05T23:36:48.518 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.500+0000 7fd4eb481700 1 --2- 172.21.15.27:0/2235358658 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd4d0004850 0x7fd4d0004cc0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:48.518 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.500+0000 7fd4eb481700 1 -- 172.21.15.27:0/2235358658 >> 172.21.15.27:0/2235358658 conn(0x7fd4e40b1740 msgr2=0x7fd4e406cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:36:48.518 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.500+0000 7fd4eb481700 1 -- 172.21.15.27:0/2235358658 shutdown_connections 2023-07-05T23:36:48.518 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.500+0000 7fd4eb481700 1 -- 172.21.15.27:0/2235358658 wait complete. 2023-07-05T23:36:48.520 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.501+0000 7fd4eb481700 1 Processor -- start 2023-07-05T23:36:48.521 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.501+0000 7fd4eb481700 1 -- start start 2023-07-05T23:36:48.521 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.502+0000 7fd4eb481700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd4d0004850 0x7fd4e414b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:48.521 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.502+0000 7fd4eb481700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4e40b28e0 0x7fd4e4155e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:48.521 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.502+0000 7fd4eb481700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd4e4156380 0x7fd4e40ca470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:48.522 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.502+0000 7fd4eb481700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e414bc50 con 0x7fd4e4156380 2023-07-05T23:36:48.522 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.502+0000 7fd4eb481700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e41569b0 con 0x7fd4e40b28e0 2023-07-05T23:36:48.522 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.502+0000 7fd4eb481700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e4156c90 con 0x7fd4d0004850 2023-07-05T23:36:48.522 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.502+0000 7fd4e9a1e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd4e4156380 0x7fd4e40ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:48.522 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.502+0000 7fd4e9a1e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd4e4156380 0x7fd4e40ca470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46890/0 (socket says 172.21.15.27:46890) 2023-07-05T23:36:48.523 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.502+0000 7fd4e9a1e700 1 -- 172.21.15.27:0/3721011758 learned_addr learned my addr 172.21.15.27:0/3721011758 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:36:48.523 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.502+0000 7fd4e921d700 1 --2- 172.21.15.27:0/3721011758 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd4d0004850 0x7fd4e414b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:48.523 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.502+0000 7fd4e8a1c700 1 --2- 172.21.15.27:0/3721011758 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4e40b28e0 0x7fd4e4155e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:48.523 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.502+0000 7fd4e9a1e700 1 -- 172.21.15.27:0/3721011758 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd4d0004850 msgr2=0x7fd4e414b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:48.523 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.502+0000 7fd4e9a1e700 1 --2- 172.21.15.27:0/3721011758 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd4d0004850 0x7fd4e414b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:48.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.502+0000 7fd4e9a1e700 1 -- 172.21.15.27:0/3721011758 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4e40b28e0 msgr2=0x7fd4e4155e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:48.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.502+0000 7fd4e9a1e700 1 --2- 172.21.15.27:0/3721011758 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4e40b28e0 0x7fd4e4155e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:48.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.502+0000 7fd4e9a1e700 1 -- 172.21.15.27:0/3721011758 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4e406b750 con 0x7fd4e4156380 2023-07-05T23:36:48.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.502+0000 7fd4e9a1e700 1 --2- 172.21.15.27:0/3721011758 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd4e4156380 0x7fd4e40ca470 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd4e40ce6d0 tx=0x7fd4dc011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:36:48.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.503+0000 7fd4d9ffb700 1 -- 172.21.15.27:0/3721011758 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc00e040 con 0x7fd4e4156380 2023-07-05T23:36:48.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.503+0000 7fd4d9ffb700 1 -- 172.21.15.27:0/3721011758 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd4dc00f040 con 0x7fd4e4156380 2023-07-05T23:36:48.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.503+0000 7fd4d9ffb700 1 -- 172.21.15.27:0/3721011758 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc00fc60 con 0x7fd4e4156380 2023-07-05T23:36:48.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.503+0000 7fd4eb481700 1 -- 172.21.15.27:0/3721011758 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4e40b1e00 con 0x7fd4e4156380 2023-07-05T23:36:48.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.503+0000 7fd4eb481700 1 -- 172.21.15.27:0/3721011758 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4e40b23c0 con 0x7fd4e4156380 2023-07-05T23:36:48.526 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.504+0000 7fd4eb481700 1 -- 172.21.15.27:0/3721011758 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4e40b25e0 con 0x7fd4e4156380 2023-07-05T23:36:48.526 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.504+0000 7fd4d9ffb700 1 -- 172.21.15.27:0/3721011758 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd4dc022460 con 0x7fd4e4156380 2023-07-05T23:36:48.526 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.505+0000 7fd4d9ffb700 1 --2- 172.21.15.27:0/3721011758 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fd4c806ace0 0x7fd4c806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:48.526 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.505+0000 7fd4d9ffb700 1 -- 172.21.15.27:0/3721011758 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd4dc089de0 con 0x7fd4e4156380 2023-07-05T23:36:48.527 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.505+0000 7fd4e921d700 1 --2- 172.21.15.27:0/3721011758 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fd4c806ace0 0x7fd4c806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:48.527 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.505+0000 7fd4e921d700 1 --2- 172.21.15.27:0/3721011758 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fd4c806ace0 0x7fd4c806d190 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd4e404fa50 tx=0x7fd4e0007040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:36:48.527 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.509+0000 7fd4d9ffb700 1 -- 172.21.15.27:0/3721011758 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd4dc058560 con 0x7fd4e4156380 2023-07-05T23:36:48.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:48.751+0000 7fd4eb481700 1 -- 172.21.15.27:0/3721011758 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fd4e4073910 con 0x7fd4e4156380 2023-07-05T23:36:49.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.219+0000 7fd4d9ffb700 1 -- 172.21.15.27:0/3721011758 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7fd4dc0580f0 con 0x7fd4e4156380 2023-07-05T23:36:49.223 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.221+0000 7fd4eb481700 1 -- 172.21.15.27:0/3721011758 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fd4c806ace0 msgr2=0x7fd4c806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:49.224 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.221+0000 7fd4eb481700 1 --2- 172.21.15.27:0/3721011758 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fd4c806ace0 0x7fd4c806d190 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd4e404fa50 tx=0x7fd4e0007040 comp rx=0 tx=0).stop 2023-07-05T23:36:49.224 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.221+0000 7fd4eb481700 1 -- 172.21.15.27:0/3721011758 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd4e4156380 msgr2=0x7fd4e40ca470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:49.224 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.221+0000 7fd4eb481700 1 --2- 172.21.15.27:0/3721011758 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd4e4156380 0x7fd4e40ca470 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd4e40ce6d0 tx=0x7fd4dc011ed0 comp rx=0 tx=0).stop 2023-07-05T23:36:49.224 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.221+0000 7fd4eb481700 1 -- 172.21.15.27:0/3721011758 shutdown_connections 2023-07-05T23:36:49.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.221+0000 7fd4eb481700 1 --2- 172.21.15.27:0/3721011758 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fd4c806ace0 0x7fd4c806d190 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:49.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.221+0000 7fd4eb481700 1 --2- 172.21.15.27:0/3721011758 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd4e4156380 0x7fd4e40ca470 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:49.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.221+0000 7fd4eb481700 1 --2- 172.21.15.27:0/3721011758 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd4d0004850 0x7fd4e414b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:49.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.221+0000 7fd4eb481700 1 --2- 172.21.15.27:0/3721011758 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4e40b28e0 0x7fd4e4155e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:49.226 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.221+0000 7fd4eb481700 1 -- 172.21.15.27:0/3721011758 >> 172.21.15.27:0/3721011758 conn(0x7fd4e40b1740 msgr2=0x7fd4e4151e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:36:49.226 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.221+0000 7fd4eb481700 1 -- 172.21.15.27:0/3721011758 shutdown_connections 2023-07-05T23:36:49.226 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.222+0000 7fd4eb481700 1 -- 172.21.15.27:0/3721011758 wait complete. 2023-07-05T23:36:49.226 INFO:teuthology.orchestra.run.smithi027.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-05T23:36:49.238 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-05T23:36:49.262 INFO:tasks.ceph.mds.a.smithi027.stdout:starting mds.a at 2023-07-05T23:36:49.370 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.368+0000 7ff606012700 1 Processor -- start 2023-07-05T23:36:49.370 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.368+0000 7ff606012700 1 -- start start 2023-07-05T23:36:49.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.369+0000 7ff606012700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff60006e030 0x7ff60006e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:49.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.369+0000 7ff606012700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff6000acf30 0x7ff6000ad390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:49.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.369+0000 7ff606012700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff60006f0e0 con 0x7ff6000cd5e0 2023-07-05T23:36:49.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.369+0000 7ff606012700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6000ce2c0 con 0x7ff6000acf30 2023-07-05T23:36:49.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.369+0000 7ff606012700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff60006eb20 con 0x7ff60006e030 2023-07-05T23:36:49.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.369+0000 7ff5fffff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff6000acf30 0x7ff6000ad390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:49.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.369+0000 7ff5ff7fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7ff6000cd5e0 0x7ff6000cd9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:54074/0 (socket says 172.21.15.27:54074) 2023-07-05T23:36:49.374 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.369+0000 7ff5ff7fe700 1 -- 172.21.15.27:0/2249052832 learned_addr learned my addr 172.21.15.27:0/2249052832 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-07-05T23:36:49.374 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.369+0000 7ff5feffd700 1 --2- 172.21.15.27:0/2249052832 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff60006e030 0x7ff60006e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:49.374 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.369+0000 7ff5fffff700 1 -- 172.21.15.27:0/2249052832 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff60006e030 msgr2=0x7ff60006e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:36:49.374 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.369+0000 7ff5fffff700 1 --2- 172.21.15.27:0/2249052832 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff60006e030 0x7ff60006e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:49.375 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.369+0000 7ff5fffff700 1 -- 172.21.15.27:0/2249052832 >> v1:172.21.15.27:6789/0 conn(0x7ff6000cd5e0 legacy=0x7ff6000cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:49.375 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.369+0000 7ff5fe7fc700 1 -- 172.21.15.27:0/2249052832 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2363020982 0 0) 0x7ff60006f0e0 con 0x7ff6000cd5e0 2023-07-05T23:36:49.375 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.369+0000 7ff5fffff700 1 -- 172.21.15.27:0/2249052832 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff60006ee00 con 0x7ff6000acf30 2023-07-05T23:36:49.375 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.369+0000 7ff5fffff700 1 --2- 172.21.15.27:0/2249052832 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6000acf30 0x7ff6000ad390 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8009d90 tx=0x7ff5f800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a021967e79baabdd server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:36:49.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.369+0000 7ff5fe7fc700 1 -- 172.21.15.27:0/2249052832 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f800e070 con 0x7ff6000acf30 2023-07-05T23:36:49.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.369+0000 7ff5fe7fc700 1 -- 172.21.15.27:0/2249052832 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff5f800bb20 con 0x7ff6000acf30 2023-07-05T23:36:49.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.369+0000 7ff5fe7fc700 1 -- 172.21.15.27:0/2249052832 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f8012430 con 0x7ff6000acf30 2023-07-05T23:36:49.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.370+0000 7ff606012700 1 -- 172.21.15.27:0/2249052832 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6000acf30 msgr2=0x7ff6000ad390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:49.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.370+0000 7ff606012700 1 --2- 172.21.15.27:0/2249052832 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6000acf30 0x7ff6000ad390 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8009d90 tx=0x7ff5f800b330 comp rx=0 tx=0).stop 2023-07-05T23:36:49.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.370+0000 7ff606012700 1 -- 172.21.15.27:0/2249052832 shutdown_connections 2023-07-05T23:36:49.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.370+0000 7ff606012700 1 --2- 172.21.15.27:0/2249052832 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6000acf30 0x7ff6000ad390 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:49.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.370+0000 7ff606012700 1 --2- 172.21.15.27:0/2249052832 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff60006e030 0x7ff60006e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:49.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.370+0000 7ff606012700 1 -- 172.21.15.27:0/2249052832 >> 172.21.15.27:0/2249052832 conn(0x7ff60006b920 msgr2=0x7ff6000cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:36:49.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.370+0000 7ff606012700 1 -- 172.21.15.27:0/2249052832 shutdown_connections 2023-07-05T23:36:49.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.370+0000 7ff606012700 1 -- 172.21.15.27:0/2249052832 wait complete. 2023-07-05T23:36:49.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.371+0000 7ff606012700 1 Processor -- start 2023-07-05T23:36:49.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.371+0000 7ff606012700 1 -- start start 2023-07-05T23:36:49.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.372+0000 7ff606012700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff60006e030 0x7ff600139920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:49.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.372+0000 7ff606012700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff6000acf30 0x7ff6000b1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:49.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.372+0000 7ff606012700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff6000cd5e0 0x7ff6000af650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:49.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.372+0000 7ff606012700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff600139e60 con 0x7ff60006e030 2023-07-05T23:36:49.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.372+0000 7ff606012700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6000b3aa0 con 0x7ff6000acf30 2023-07-05T23:36:49.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.372+0000 7ff606012700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6000b1b50 con 0x7ff6000cd5e0 2023-07-05T23:36:49.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.372+0000 7ff5ff7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff60006e030 0x7ff600139920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:49.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.372+0000 7ff5ff7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff60006e030 0x7ff600139920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46914/0 (socket says 172.21.15.27:46914) 2023-07-05T23:36:49.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.372+0000 7ff5ff7fe700 1 -- 172.21.15.27:0/2530889855 learned_addr learned my addr 172.21.15.27:0/2530889855 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:36:49.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.372+0000 7ff5fffff700 1 --2- 172.21.15.27:0/2530889855 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff6000cd5e0 0x7ff6000af650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:49.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.372+0000 7ff5feffd700 1 --2- 172.21.15.27:0/2530889855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff6000acf30 0x7ff6000b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:49.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.373+0000 7ff5ff7fe700 1 -- 172.21.15.27:0/2530889855 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff6000cd5e0 msgr2=0x7ff6000af650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:49.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.373+0000 7ff5ff7fe700 1 --2- 172.21.15.27:0/2530889855 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff6000cd5e0 0x7ff6000af650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:49.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.373+0000 7ff5ff7fe700 1 -- 172.21.15.27:0/2530889855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff6000acf30 msgr2=0x7ff6000b1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:49.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.373+0000 7ff5ff7fe700 1 --2- 172.21.15.27:0/2530889855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff6000acf30 0x7ff6000b1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:49.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.373+0000 7ff5ff7fe700 1 -- 172.21.15.27:0/2530889855 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f8009a70 con 0x7ff60006e030 2023-07-05T23:36:49.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.373+0000 7ff5fffff700 1 --2- 172.21.15.27:0/2530889855 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff6000cd5e0 0x7ff6000af650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-05T23:36:49.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.373+0000 7ff5ff7fe700 1 --2- 172.21.15.27:0/2530889855 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff60006e030 0x7ff600139920 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7ff5f40010e0 tx=0x7ff5f400cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:36:49.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.373+0000 7ff5e7fff700 1 -- 172.21.15.27:0/2530889855 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f40074e0 con 0x7ff60006e030 2023-07-05T23:36:49.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.373+0000 7ff5e7fff700 1 -- 172.21.15.27:0/2530889855 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff5f4007640 con 0x7ff60006e030 2023-07-05T23:36:49.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.373+0000 7ff5e7fff700 1 -- 172.21.15.27:0/2530889855 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f4005a90 con 0x7ff60006e030 2023-07-05T23:36:49.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.373+0000 7ff606012700 1 -- 172.21.15.27:0/2530889855 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6000b1e30 con 0x7ff60006e030 2023-07-05T23:36:49.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.373+0000 7ff606012700 1 -- 172.21.15.27:0/2530889855 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6000b1740 con 0x7ff60006e030 2023-07-05T23:36:49.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.374+0000 7ff606012700 1 -- 172.21.15.27:0/2530889855 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff60004ea20 con 0x7ff60006e030 2023-07-05T23:36:49.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.376+0000 7ff5e7fff700 1 -- 172.21.15.27:0/2530889855 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff5f4005bf0 con 0x7ff60006e030 2023-07-05T23:36:49.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.376+0000 7ff5e7fff700 1 --2- 172.21.15.27:0/2530889855 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7ff5ec06ace0 0x7ff5ec06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:49.387 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.376+0000 7ff5e7fff700 1 -- 172.21.15.27:0/2530889855 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6957+0+0 (secure 0 0 0) 0x7ff5f40891f0 con 0x7ff60006e030 2023-07-05T23:36:49.387 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.376+0000 7ff5feffd700 1 --2- 172.21.15.27:0/2530889855 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7ff5ec06ace0 0x7ff5ec06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:49.387 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.377+0000 7ff5feffd700 1 --2- 172.21.15.27:0/2530889855 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7ff5ec06ace0 0x7ff5ec06d190 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff60006e980 tx=0x7ff5f0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:36:49.388 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.380+0000 7ff5e7fff700 1 -- 172.21.15.27:0/2530889855 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff5f4053f70 con 0x7ff60006e030 2023-07-05T23:36:49.631 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:49.629+0000 7ff606012700 1 -- 172.21.15.27:0/2530889855 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff6000b5990 con 0x7ff60006e030 2023-07-05T23:36:50.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.226+0000 7ff5e7fff700 1 -- 172.21.15.27:0/2530889855 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff5f4017020 con 0x7ff60006e030 2023-07-05T23:36:50.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.229+0000 7ff606012700 1 -- 172.21.15.27:0/2530889855 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7ff5ec06ace0 msgr2=0x7ff5ec06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:50.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.229+0000 7ff606012700 1 --2- 172.21.15.27:0/2530889855 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7ff5ec06ace0 0x7ff5ec06d190 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff60006e980 tx=0x7ff5f0008040 comp rx=0 tx=0).stop 2023-07-05T23:36:50.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.229+0000 7ff606012700 1 -- 172.21.15.27:0/2530889855 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff60006e030 msgr2=0x7ff600139920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:50.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.229+0000 7ff606012700 1 --2- 172.21.15.27:0/2530889855 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff60006e030 0x7ff600139920 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7ff5f40010e0 tx=0x7ff5f400cae0 comp rx=0 tx=0).stop 2023-07-05T23:36:50.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.229+0000 7ff606012700 1 -- 172.21.15.27:0/2530889855 shutdown_connections 2023-07-05T23:36:50.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.229+0000 7ff606012700 1 --2- 172.21.15.27:0/2530889855 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7ff5ec06ace0 0x7ff5ec06d190 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:50.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.229+0000 7ff606012700 1 --2- 172.21.15.27:0/2530889855 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff6000cd5e0 0x7ff6000af650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:50.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.229+0000 7ff606012700 1 --2- 172.21.15.27:0/2530889855 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff60006e030 0x7ff600139920 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:50.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.229+0000 7ff606012700 1 --2- 172.21.15.27:0/2530889855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff6000acf30 0x7ff6000b1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:50.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.229+0000 7ff606012700 1 -- 172.21.15.27:0/2530889855 >> 172.21.15.27:0/2530889855 conn(0x7ff60006b920 msgr2=0x7ff600152fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:36:50.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.230+0000 7ff606012700 1 -- 172.21.15.27:0/2530889855 shutdown_connections 2023-07-05T23:36:50.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.230+0000 7ff606012700 1 -- 172.21.15.27:0/2530889855 wait complete. 2023-07-05T23:36:50.246 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-05T23:36:50.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.418+0000 7f36ba362700 1 Processor -- start 2023-07-05T23:36:50.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.418+0000 7f36ba362700 1 -- start start 2023-07-05T23:36:50.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.419+0000 7f36ba362700 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f36b406e030 0x7f36b406e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:50.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.419+0000 7f36ba362700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f36b40acf30 0x7f36b40ad350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:50.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.419+0000 7f36ba362700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36b406f0e0 con 0x7f36b40cd5e0 2023-07-05T23:36:50.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.419+0000 7f36ba362700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36b40ce2c0 con 0x7f36b40acf30 2023-07-05T23:36:50.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.419+0000 7f36ba362700 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36b406eb20 con 0x7f36b406e030 2023-07-05T23:36:50.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.419+0000 7f36b88ff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f36b40acf30 0x7f36b40ad350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:50.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.419+0000 7f36b88ff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f36b40acf30 0x7f36b40ad350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46928/0 (socket says 172.21.15.27:46928) 2023-07-05T23:36:50.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.419+0000 7f36b88ff700 1 -- 172.21.15.27:0/2477004569 learned_addr learned my addr 172.21.15.27:0/2477004569 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:36:50.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.419+0000 7f36b37fe700 1 --2- 172.21.15.27:0/2477004569 >> v2:172.21.15.162:3300/0 conn(0x7f36b406e030 0x7f36b406e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:50.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.419+0000 7f36b88ff700 1 -- 172.21.15.27:0/2477004569 >> v2:172.21.15.162:3300/0 conn(0x7f36b406e030 msgr2=0x7f36b406e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:36:50.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.419+0000 7f36b88ff700 1 --2- 172.21.15.27:0/2477004569 >> v2:172.21.15.162:3300/0 conn(0x7f36b406e030 0x7f36b406e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:50.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.419+0000 7f36b88ff700 1 -- 172.21.15.27:0/2477004569 >> v1:172.21.15.162:6789/0 conn(0x7f36b40cd5e0 legacy=0x7f36b40cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:50.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.419+0000 7f36b88ff700 1 -- 172.21.15.27:0/2477004569 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36b406ee00 con 0x7f36b40acf30 2023-07-05T23:36:50.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.419+0000 7f36b88ff700 1 --2- 172.21.15.27:0/2477004569 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36b40acf30 0x7f36b40ad350 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f36b415ced0 tx=0x7f36ac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc7c5f52a0bdd586 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:36:50.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.420+0000 7f36b2ffd700 1 -- 172.21.15.27:0/2477004569 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ac00e070 con 0x7f36b40acf30 2023-07-05T23:36:50.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.420+0000 7f36b2ffd700 1 -- 172.21.15.27:0/2477004569 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f36ac00b910 con 0x7f36b40acf30 2023-07-05T23:36:50.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.420+0000 7f36b2ffd700 1 -- 172.21.15.27:0/2477004569 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ac00bce0 con 0x7f36b40acf30 2023-07-05T23:36:50.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.420+0000 7f36ba362700 1 -- 172.21.15.27:0/2477004569 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36b40acf30 msgr2=0x7f36b40ad350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:50.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.420+0000 7f36ba362700 1 --2- 172.21.15.27:0/2477004569 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36b40acf30 0x7f36b40ad350 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f36b415ced0 tx=0x7f36ac00b330 comp rx=0 tx=0).stop 2023-07-05T23:36:50.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.420+0000 7f36ba362700 1 -- 172.21.15.27:0/2477004569 shutdown_connections 2023-07-05T23:36:50.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.420+0000 7f36ba362700 1 --2- 172.21.15.27:0/2477004569 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36b40acf30 0x7f36b40ad350 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:50.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.420+0000 7f36ba362700 1 --2- 172.21.15.27:0/2477004569 >> v2:172.21.15.162:3300/0 conn(0x7f36b406e030 0x7f36b406e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:50.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.420+0000 7f36ba362700 1 -- 172.21.15.27:0/2477004569 >> 172.21.15.27:0/2477004569 conn(0x7f36b406b920 msgr2=0x7f36b40cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:36:50.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.420+0000 7f36ba362700 1 -- 172.21.15.27:0/2477004569 shutdown_connections 2023-07-05T23:36:50.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.420+0000 7f36ba362700 1 -- 172.21.15.27:0/2477004569 wait complete. 2023-07-05T23:36:50.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.421+0000 7f36ba362700 1 Processor -- start 2023-07-05T23:36:50.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.422+0000 7f36ba362700 1 -- start start 2023-07-05T23:36:50.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.422+0000 7f36ba362700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36b406e030 0x7f36b41f15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:50.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.422+0000 7f36ba362700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36b40acf30 0x7f36b40c3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:50.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.422+0000 7f36ba362700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36b40cd5e0 0x7f36b415c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:50.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.422+0000 7f36ba362700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b40c3fa0 con 0x7f36b406e030 2023-07-05T23:36:50.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.422+0000 7f36ba362700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b40c4df0 con 0x7f36b40acf30 2023-07-05T23:36:50.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.422+0000 7f36ba362700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36b40c5280 con 0x7f36b40cd5e0 2023-07-05T23:36:50.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.422+0000 7f36b3fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36b406e030 0x7f36b41f15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:50.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.423+0000 7f36b3fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36b406e030 0x7f36b41f15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46930/0 (socket says 172.21.15.27:46930) 2023-07-05T23:36:50.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.423+0000 7f36b3fff700 1 -- 172.21.15.27:0/1845418394 learned_addr learned my addr 172.21.15.27:0/1845418394 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:36:50.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.423+0000 7f36b37fe700 1 --2- 172.21.15.27:0/1845418394 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36b40acf30 0x7f36b40c3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:50.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.423+0000 7f36b88ff700 1 --2- 172.21.15.27:0/1845418394 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36b40cd5e0 0x7f36b415c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:50.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.423+0000 7f36b3fff700 1 -- 172.21.15.27:0/1845418394 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36b40cd5e0 msgr2=0x7f36b415c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:50.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.423+0000 7f36b3fff700 1 --2- 172.21.15.27:0/1845418394 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36b40cd5e0 0x7f36b415c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:50.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.423+0000 7f36b3fff700 1 -- 172.21.15.27:0/1845418394 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36b40acf30 msgr2=0x7f36b40c3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:50.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.423+0000 7f36b3fff700 1 --2- 172.21.15.27:0/1845418394 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36b40acf30 0x7f36b40c3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:50.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.423+0000 7f36b3fff700 1 -- 172.21.15.27:0/1845418394 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36ac009b30 con 0x7f36b406e030 2023-07-05T23:36:50.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.423+0000 7f36b37fe700 1 --2- 172.21.15.27:0/1845418394 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36b40acf30 0x7f36b40c3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-05T23:36:50.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.423+0000 7f36b3fff700 1 --2- 172.21.15.27:0/1845418394 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36b406e030 0x7f36b41f15a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f36a800c4d0 tx=0x7f36a800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:36:50.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.423+0000 7f36b0ff9700 1 -- 172.21.15.27:0/1845418394 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a80052d0 con 0x7f36b406e030 2023-07-05T23:36:50.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.423+0000 7f36b0ff9700 1 -- 172.21.15.27:0/1845418394 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f36a8005430 con 0x7f36b406e030 2023-07-05T23:36:50.437 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.423+0000 7f36ba362700 1 -- 172.21.15.27:0/1845418394 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36b40c41e0 con 0x7f36b406e030 2023-07-05T23:36:50.437 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.423+0000 7f36b0ff9700 1 -- 172.21.15.27:0/1845418394 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a8003910 con 0x7f36b406e030 2023-07-05T23:36:50.437 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.423+0000 7f36ba362700 1 -- 172.21.15.27:0/1845418394 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36b40c47a0 con 0x7f36b406e030 2023-07-05T23:36:50.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.424+0000 7f36ba362700 1 -- 172.21.15.27:0/1845418394 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36b404ea20 con 0x7f36b406e030 2023-07-05T23:36:50.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.425+0000 7f36b0ff9700 1 -- 172.21.15.27:0/1845418394 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f36a8003a70 con 0x7f36b406e030 2023-07-05T23:36:50.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.425+0000 7f36b0ff9700 1 --2- 172.21.15.27:0/1845418394 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f36a006ace0 0x7f36a006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:50.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.425+0000 7f36b0ff9700 1 -- 172.21.15.27:0/1845418394 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6957+0+0 (secure 0 0 0) 0x7f36a8088cb0 con 0x7f36b406e030 2023-07-05T23:36:50.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.425+0000 7f36b37fe700 1 --2- 172.21.15.27:0/1845418394 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f36a006ace0 0x7f36a006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:50.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.426+0000 7f36b37fe700 1 --2- 172.21.15.27:0/1845418394 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f36a006ace0 0x7f36a006d190 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f36b40c3920 tx=0x7f36a4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:36:50.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.429+0000 7f36b0ff9700 1 -- 172.21.15.27:0/1845418394 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f36a80539e0 con 0x7f36b406e030 2023-07-05T23:36:50.632 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:50.629+0000 7f36ba362700 1 -- 172.21.15.27:0/1845418394 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f36b41534e0 con 0x7f36b406e030 2023-07-05T23:36:51.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:51.229+0000 7f36b0ff9700 1 -- 172.21.15.27:0/1845418394 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v32) v1 ==== 181+0+0 (secure 0 0 0) 0x7f36a8057000 con 0x7f36b406e030 2023-07-05T23:36:51.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:51.233+0000 7f36ba362700 1 -- 172.21.15.27:0/1845418394 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f36a006ace0 msgr2=0x7f36a006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:51.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:51.233+0000 7f36ba362700 1 --2- 172.21.15.27:0/1845418394 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f36a006ace0 0x7f36a006d190 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f36b40c3920 tx=0x7f36a4008040 comp rx=0 tx=0).stop 2023-07-05T23:36:51.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:51.233+0000 7f36ba362700 1 -- 172.21.15.27:0/1845418394 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36b406e030 msgr2=0x7f36b41f15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:51.239 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:51.233+0000 7f36ba362700 1 --2- 172.21.15.27:0/1845418394 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36b406e030 0x7f36b41f15a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f36a800c4d0 tx=0x7f36a800c890 comp rx=0 tx=0).stop 2023-07-05T23:36:51.239 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:51.233+0000 7f36ba362700 1 -- 172.21.15.27:0/1845418394 shutdown_connections 2023-07-05T23:36:51.239 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:51.233+0000 7f36ba362700 1 --2- 172.21.15.27:0/1845418394 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f36a006ace0 0x7f36a006d190 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:51.239 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:51.233+0000 7f36ba362700 1 --2- 172.21.15.27:0/1845418394 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36b40cd5e0 0x7f36b415c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:51.240 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:51.233+0000 7f36ba362700 1 --2- 172.21.15.27:0/1845418394 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36b406e030 0x7f36b41f15a0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:51.240 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:51.233+0000 7f36ba362700 1 --2- 172.21.15.27:0/1845418394 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36b40acf30 0x7f36b40c3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:51.241 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:51.233+0000 7f36ba362700 1 -- 172.21.15.27:0/1845418394 >> 172.21.15.27:0/1845418394 conn(0x7f36b406b920 msgr2=0x7f36b4153a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:36:51.241 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:51.234+0000 7f36ba362700 1 -- 172.21.15.27:0/1845418394 shutdown_connections 2023-07-05T23:36:51.241 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:51.234+0000 7f36ba362700 1 -- 172.21.15.27:0/1845418394 wait complete. 2023-07-05T23:36:51.242 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_metadata' removed 2023-07-05T23:36:51.252 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-05T23:36:51.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:51.395+0000 7f0dc5144700 1 Processor -- start 2023-07-05T23:36:51.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:51.396+0000 7f0dc5144700 1 -- start start 2023-07-05T23:36:51.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:51.396+0000 7f0dc5144700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f0dc006e970 0x7f0dc006a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:51.402 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:51.396+0000 7f0dc5144700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dc00ce620 con 0x7f0dc00aecc0 2023-07-05T23:36:51.402 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:51.396+0000 7f0dc5144700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dc0160580 con 0x7f0dc015fc60 2023-07-05T23:36:51.402 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:51.396+0000 7f0dc5144700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dc0160860 con 0x7f0dc006e970 2023-07-05T23:36:51.402 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:51.396+0000 7f0dbf59e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f0dc006e970 0x7f0dc006a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:51.403 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:51.396+0000 7f0dbe59c700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f0dc00aecc0 0x7f0dc00cea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:54104/0 (socket says 172.21.15.27:54104) 2023-07-05T23:36:51.403 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:51.396+0000 7f0dbe59c700 1 -- 172.21.15.27:0/1319857444 learned_addr learned my addr 172.21.15.27:0/1319857444 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-07-05T23:36:51.403 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:51.397+0000 7f0dbf59e700 1 -- 172.21.15.27:0/1319857444 >> v1:172.21.15.162:6789/0 conn(0x7f0dc015fc60 legacy=0x7f0dc006e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:51.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:51.397+0000 7f0dbf59e700 1 -- 172.21.15.27:0/1319857444 >> v1:172.21.15.27:6789/0 conn(0x7f0dc00aecc0 legacy=0x7f0dc00cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:51.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:51.397+0000 7f0dbf59e700 1 -- 172.21.15.27:0/1319857444 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc0160b40 con 0x7f0dc006e970 2023-07-05T23:36:51.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:51.397+0000 7f0dbdd9b700 1 -- 172.21.15.27:0/1319857444 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3526944311 0 0) 0x7f0dc00ce620 con 0x7f0dc00aecc0 2023-07-05T23:36:51.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:51.397+0000 7f0dbf59e700 1 --2- 172.21.15.27:0/1319857444 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0dc006e970 0x7f0dc006a900 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f0db8009d90 tx=0x7f0db800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e52f903796988bd server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:36:51.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:51.397+0000 7f0dbdd9b700 1 -- 172.21.15.27:0/1319857444 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db800e070 con 0x7f0dc006e970 2023-07-05T23:36:51.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:51.397+0000 7f0dbdd9b700 1 -- 172.21.15.27:0/1319857444 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f0db800bbd0 con 0x7f0dc006e970 2023-07-05T23:36:51.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:51.397+0000 7f0dbdd9b700 1 -- 172.21.15.27:0/1319857444 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db8012430 con 0x7f0dc006e970 2023-07-05T23:36:51.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:51.398+0000 7f0dc5144700 1 -- 172.21.15.27:0/1319857444 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0dc006e970 msgr2=0x7f0dc006a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:51.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:51.398+0000 7f0dc5144700 1 --2- 172.21.15.27:0/1319857444 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0dc006e970 0x7f0dc006a900 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f0db8009d90 tx=0x7f0db800b330 comp rx=0 tx=0).stop 2023-07-05T23:36:51.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:51.398+0000 7f0dc5144700 1 -- 172.21.15.27:0/1319857444 shutdown_connections 2023-07-05T23:36:51.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:51.398+0000 7f0dc5144700 1 --2- 172.21.15.27:0/1319857444 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0dc006e970 0x7f0dc006a900 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:51.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:51.398+0000 7f0dc5144700 1 -- 172.21.15.27:0/1319857444 >> 172.21.15.27:0/1319857444 conn(0x7f0dc006b920 msgr2=0x7f0dc00cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:36:51.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:51.398+0000 7f0dc5144700 1 -- 172.21.15.27:0/1319857444 shutdown_connections 2023-07-05T23:36:51.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:51.398+0000 7f0dc5144700 1 -- 172.21.15.27:0/1319857444 wait complete. 2023-07-05T23:36:51.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:51.400+0000 7f0dc5144700 1 Processor -- start 2023-07-05T23:36:51.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:51.400+0000 7f0dc5144700 1 -- start start 2023-07-05T23:36:51.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:51.401+0000 7f0dc5144700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0dc006e970 0x7f0dc00b0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:51.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:51.401+0000 7f0dc5144700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0dc00aecc0 0x7f0dc015a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:51.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:51.401+0000 7f0dc5144700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0dc015fc60 0x7f0dc015ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:51.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:51.401+0000 7f0dc5144700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc00cb560 con 0x7f0dc00aecc0 2023-07-05T23:36:51.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:51.401+0000 7f0dc5144700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc015b0d0 con 0x7f0dc006e970 2023-07-05T23:36:51.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:51.401+0000 7f0dc5144700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc00b3620 con 0x7f0dc015fc60 2023-07-05T23:36:51.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:51.401+0000 7f0dbe59c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0dc00aecc0 0x7f0dc015a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:51.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:51.401+0000 7f0dbe59c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0dc00aecc0 0x7f0dc015a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46944/0 (socket says 172.21.15.27:46944) 2023-07-05T23:36:51.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:51.401+0000 7f0dbe59c700 1 -- 172.21.15.27:0/3632470935 learned_addr learned my addr 172.21.15.27:0/3632470935 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:36:51.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:51.401+0000 7f0dbf59e700 1 --2- 172.21.15.27:0/3632470935 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0dc015fc60 0x7f0dc015ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:51.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:51.401+0000 7f0dbed9d700 1 --2- 172.21.15.27:0/3632470935 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0dc006e970 0x7f0dc00b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:51.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:51.401+0000 7f0dbe59c700 1 -- 172.21.15.27:0/3632470935 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0dc015fc60 msgr2=0x7f0dc015ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:51.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:51.401+0000 7f0dbe59c700 1 --2- 172.21.15.27:0/3632470935 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0dc015fc60 0x7f0dc015ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:51.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:51.401+0000 7f0dbe59c700 1 -- 172.21.15.27:0/3632470935 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0dc006e970 msgr2=0x7f0dc00b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:51.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:51.401+0000 7f0dbe59c700 1 --2- 172.21.15.27:0/3632470935 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0dc006e970 0x7f0dc00b0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:51.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:51.401+0000 7f0dbe59c700 1 -- 172.21.15.27:0/3632470935 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db8009a70 con 0x7f0dc00aecc0 2023-07-05T23:36:51.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:51.401+0000 7f0dbe59c700 1 --2- 172.21.15.27:0/3632470935 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0dc00aecc0 0x7f0dc015a650 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f0da800c520 tx=0x7f0da800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:36:51.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:51.401+0000 7f0db77fe700 1 -- 172.21.15.27:0/3632470935 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da8004c80 con 0x7f0dc00aecc0 2023-07-05T23:36:51.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:51.402+0000 7f0db77fe700 1 -- 172.21.15.27:0/3632470935 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f0da8004e00 con 0x7f0dc00aecc0 2023-07-05T23:36:51.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:51.402+0000 7f0dc5144700 1 -- 172.21.15.27:0/3632470935 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dc00b3900 con 0x7f0dc00aecc0 2023-07-05T23:36:51.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:51.402+0000 7f0db77fe700 1 -- 172.21.15.27:0/3632470935 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da8007330 con 0x7f0dc00aecc0 2023-07-05T23:36:51.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:51.402+0000 7f0dc5144700 1 -- 172.21.15.27:0/3632470935 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dc00b3ec0 con 0x7f0dc00aecc0 2023-07-05T23:36:51.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:51.403+0000 7f0dc5144700 1 -- 172.21.15.27:0/3632470935 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dc00cb2c0 con 0x7f0dc00aecc0 2023-07-05T23:36:51.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:51.403+0000 7f0db77fe700 1 -- 172.21.15.27:0/3632470935 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0da8007490 con 0x7f0dc00aecc0 2023-07-05T23:36:51.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:51.404+0000 7f0db77fe700 1 --2- 172.21.15.27:0/3632470935 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f0da006ace0 0x7f0da006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:51.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:51.404+0000 7f0db77fe700 1 -- 172.21.15.27:0/3632470935 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6519+0+0 (secure 0 0 0) 0x7f0da80892f0 con 0x7f0dc00aecc0 2023-07-05T23:36:51.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:51.404+0000 7f0dbed9d700 1 --2- 172.21.15.27:0/3632470935 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f0da006ace0 0x7f0da006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:51.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:51.404+0000 7f0dbed9d700 1 --2- 172.21.15.27:0/3632470935 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f0da006ace0 0x7f0da006d190 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0dc01f5c80 tx=0x7f0db0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:36:51.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:51.408+0000 7f0db77fe700 1 -- 172.21.15.27:0/3632470935 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0dc00cb2c0 con 0x7f0dc00aecc0 2023-07-05T23:36:51.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:51.612+0000 7f0dc5144700 1 -- 172.21.15.27:0/3632470935 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0dc00cb6a0 con 0x7f0dc00aecc0 2023-07-05T23:36:52.243 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:52.239+0000 7f0db77fe700 1 -- 172.21.15.27:0/3632470935 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v33) v1 ==== 169+0+0 (secure 0 0 0) 0x7f0dc00cb6a0 con 0x7f0dc00aecc0 2023-07-05T23:36:52.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:52.244+0000 7f0dc5144700 1 -- 172.21.15.27:0/3632470935 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f0da006ace0 msgr2=0x7f0da006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:52.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:52.244+0000 7f0dc5144700 1 --2- 172.21.15.27:0/3632470935 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f0da006ace0 0x7f0da006d190 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0dc01f5c80 tx=0x7f0db0009040 comp rx=0 tx=0).stop 2023-07-05T23:36:52.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:52.244+0000 7f0dc5144700 1 -- 172.21.15.27:0/3632470935 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0dc00aecc0 msgr2=0x7f0dc015a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:52.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:52.244+0000 7f0dc5144700 1 --2- 172.21.15.27:0/3632470935 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0dc00aecc0 0x7f0dc015a650 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f0da800c520 tx=0x7f0da800c830 comp rx=0 tx=0).stop 2023-07-05T23:36:52.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:52.248+0000 7f0dc5144700 1 -- 172.21.15.27:0/3632470935 shutdown_connections 2023-07-05T23:36:52.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:52.248+0000 7f0dc5144700 1 --2- 172.21.15.27:0/3632470935 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0dc006e970 0x7f0dc00b0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:52.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:52.248+0000 7f0dc5144700 1 --2- 172.21.15.27:0/3632470935 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7f0da006ace0 0x7f0da006d190 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:52.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:52.248+0000 7f0dc5144700 1 --2- 172.21.15.27:0/3632470935 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0dc015fc60 0x7f0dc015ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:52.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:52.248+0000 7f0dc5144700 1 --2- 172.21.15.27:0/3632470935 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0dc00aecc0 0x7f0dc015a650 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:52.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:52.248+0000 7f0dc5144700 1 -- 172.21.15.27:0/3632470935 >> 172.21.15.27:0/3632470935 conn(0x7f0dc006b920 msgr2=0x7f0dc00b0d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:36:52.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:52.248+0000 7f0dc5144700 1 -- 172.21.15.27:0/3632470935 shutdown_connections 2023-07-05T23:36:52.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:52.249+0000 7f0dc5144700 1 -- 172.21.15.27:0/3632470935 wait complete. 2023-07-05T23:36:52.256 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_data' removed 2023-07-05T23:36:52.274 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-07-05T23:36:52.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:52.406+0000 7fa97d27c700 1 Processor -- start 2023-07-05T23:36:52.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:52.406+0000 7fa97d27c700 1 -- start start 2023-07-05T23:36:52.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:52.407+0000 7fa97d27c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa9780b51d0 0x7fa9780cf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:52.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:52.407+0000 7fa97d27c700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9780b5ec0 con 0x7fa9780b5a70 2023-07-05T23:36:52.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:52.407+0000 7fa97d27c700 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9780cd9d0 con 0x7fa9780d0a60 2023-07-05T23:36:52.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:52.407+0000 7fa97d27c700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9780d0060 con 0x7fa9780b51d0 2023-07-05T23:36:52.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:52.407+0000 7fa9777fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa9780b51d0 0x7fa9780cf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:52.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:52.407+0000 7fa9767fc700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fa9780b5a70 0x7fa9780d2e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:54118/0 (socket says 172.21.15.27:54118) 2023-07-05T23:36:52.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:52.407+0000 7fa9767fc700 1 -- 172.21.15.27:0/4232613915 learned_addr learned my addr 172.21.15.27:0/4232613915 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-07-05T23:36:52.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:52.407+0000 7fa9777fe700 1 -- 172.21.15.27:0/4232613915 >> v1:172.21.15.162:6789/0 conn(0x7fa9780d0a60 legacy=0x7fa9780d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-05T23:36:52.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:52.407+0000 7fa9777fe700 1 -- 172.21.15.27:0/4232613915 >> v1:172.21.15.27:6789/0 conn(0x7fa9780b5a70 legacy=0x7fa9780d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:52.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:52.407+0000 7fa975ffb700 1 -- 172.21.15.27:0/4232613915 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2578428717 0 0) 0x7fa9780b5ec0 con 0x7fa9780b5a70 2023-07-05T23:36:52.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:52.407+0000 7fa9777fe700 1 -- 172.21.15.27:0/4232613915 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9780b5610 con 0x7fa9780b51d0 2023-07-05T23:36:52.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:52.408+0000 7fa9777fe700 1 --2- 172.21.15.27:0/4232613915 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa9780b51d0 0x7fa9780cf910 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fa970009d90 tx=0x7fa97000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f62f424d589aa190 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:36:52.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:52.408+0000 7fa975ffb700 1 -- 172.21.15.27:0/4232613915 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97000e070 con 0x7fa9780b51d0 2023-07-05T23:36:52.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:52.408+0000 7fa975ffb700 1 -- 172.21.15.27:0/4232613915 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa97000bb90 con 0x7fa9780b51d0 2023-07-05T23:36:52.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:52.408+0000 7fa975ffb700 1 -- 172.21.15.27:0/4232613915 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa970003a20 con 0x7fa9780b51d0 2023-07-05T23:36:52.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:52.408+0000 7fa97d27c700 1 -- 172.21.15.27:0/4232613915 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa9780b51d0 msgr2=0x7fa9780cf910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:52.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:52.408+0000 7fa97d27c700 1 --2- 172.21.15.27:0/4232613915 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa9780b51d0 0x7fa9780cf910 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fa970009d90 tx=0x7fa97000b330 comp rx=0 tx=0).stop 2023-07-05T23:36:52.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:52.408+0000 7fa97d27c700 1 -- 172.21.15.27:0/4232613915 shutdown_connections 2023-07-05T23:36:52.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:52.408+0000 7fa97d27c700 1 --2- 172.21.15.27:0/4232613915 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa9780b51d0 0x7fa9780cf910 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:52.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:52.408+0000 7fa97d27c700 1 -- 172.21.15.27:0/4232613915 >> 172.21.15.27:0/4232613915 conn(0x7fa978071620 msgr2=0x7fa9780719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:36:52.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:52.408+0000 7fa97d27c700 1 -- 172.21.15.27:0/4232613915 shutdown_connections 2023-07-05T23:36:52.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:52.408+0000 7fa97d27c700 1 -- 172.21.15.27:0/4232613915 wait complete. 2023-07-05T23:36:52.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:52.410+0000 7fa97d27c700 1 Processor -- start 2023-07-05T23:36:52.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:52.410+0000 7fa97d27c700 1 -- start start 2023-07-05T23:36:52.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:52.411+0000 7fa97d27c700 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9780b51d0 0x7fa9781f1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:52.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:52.411+0000 7fa97d27c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa9780b5a70 0x7fa978145070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:52.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:52.411+0000 7fa97d27c700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9780d0a60 0x7fa9780b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:52.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:52.411+0000 7fa97d27c700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa978142fe0 con 0x7fa9780b5a70 2023-07-05T23:36:52.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:52.411+0000 7fa97d27c700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa978143580 con 0x7fa9780d0a60 2023-07-05T23:36:52.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:52.411+0000 7fa97d27c700 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa978145b30 con 0x7fa9780b51d0 2023-07-05T23:36:52.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:52.411+0000 7fa9767fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa9780b5a70 0x7fa978145070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:52.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:52.411+0000 7fa9767fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa9780b5a70 0x7fa978145070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46958/0 (socket says 172.21.15.27:46958) 2023-07-05T23:36:52.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:52.411+0000 7fa9767fc700 1 -- 172.21.15.27:0/1712586804 learned_addr learned my addr 172.21.15.27:0/1712586804 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-07-05T23:36:52.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:52.412+0000 7fa9777fe700 1 --2- 172.21.15.27:0/1712586804 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9780d0a60 0x7fa9780b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:52.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:52.412+0000 7fa9767fc700 1 -- 172.21.15.27:0/1712586804 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9780b51d0 msgr2=0x7fa9781f1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:52.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:52.412+0000 7fa976ffd700 1 --2- 172.21.15.27:0/1712586804 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9780b51d0 0x7fa9781f1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:52.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:52.412+0000 7fa9767fc700 1 --2- 172.21.15.27:0/1712586804 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9780b51d0 0x7fa9781f1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:52.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:52.412+0000 7fa9767fc700 1 -- 172.21.15.27:0/1712586804 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9780d0a60 msgr2=0x7fa9780b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:52.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:52.412+0000 7fa9767fc700 1 --2- 172.21.15.27:0/1712586804 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9780d0a60 0x7fa9780b6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:52.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:52.412+0000 7fa9767fc700 1 -- 172.21.15.27:0/1712586804 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa970009a70 con 0x7fa9780b5a70 2023-07-05T23:36:52.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:52.412+0000 7fa9767fc700 1 --2- 172.21.15.27:0/1712586804 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa9780b5a70 0x7fa978145070 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fa96800c520 tx=0x7fa96800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:36:52.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:52.412+0000 7fa95f7fe700 1 -- 172.21.15.27:0/1712586804 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa968004c80 con 0x7fa9780b5a70 2023-07-05T23:36:52.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:52.412+0000 7fa95f7fe700 1 -- 172.21.15.27:0/1712586804 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa968004e00 con 0x7fa9780b5a70 2023-07-05T23:36:52.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:52.412+0000 7fa97d27c700 1 -- 172.21.15.27:0/1712586804 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa978145e10 con 0x7fa9780b5a70 2023-07-05T23:36:52.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:52.412+0000 7fa95f7fe700 1 -- 172.21.15.27:0/1712586804 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa968007330 con 0x7fa9780b5a70 2023-07-05T23:36:52.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:52.412+0000 7fa97d27c700 1 -- 172.21.15.27:0/1712586804 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9780b7be0 con 0x7fa9780b5a70 2023-07-05T23:36:52.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:52.413+0000 7fa97d27c700 1 -- 172.21.15.27:0/1712586804 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9781436f0 con 0x7fa9780b5a70 2023-07-05T23:36:52.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:52.413+0000 7fa95f7fe700 1 -- 172.21.15.27:0/1712586804 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa968007490 con 0x7fa9780b5a70 2023-07-05T23:36:52.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:52.414+0000 7fa95f7fe700 1 --2- 172.21.15.27:0/1712586804 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fa96406ace0 0x7fa96406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-05T23:36:52.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:52.414+0000 7fa95f7fe700 1 -- 172.21.15.27:0/1712586804 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6047+0+0 (secure 0 0 0) 0x7fa968089340 con 0x7fa9780b5a70 2023-07-05T23:36:52.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:52.414+0000 7fa976ffd700 1 --2- 172.21.15.27:0/1712586804 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fa96406ace0 0x7fa96406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-05T23:36:52.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:52.415+0000 7fa976ffd700 1 --2- 172.21.15.27:0/1712586804 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fa96406ace0 0x7fa96406d190 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa96c00a7d0 tx=0x7fa96c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-05T23:36:52.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:52.418+0000 7fa95f7fe700 1 -- 172.21.15.27:0/1712586804 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa9680542e0 con 0x7fa9780b5a70 2023-07-05T23:36:52.619 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:52.616+0000 7fa97d27c700 1 -- 172.21.15.27:0/1712586804 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa97804ea20 con 0x7fa9780b5a70 2023-07-05T23:36:52.980 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:36:52.982 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:36:53.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:53.240+0000 7fa95f7fe700 1 -- 172.21.15.27:0/1712586804 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v34) v1 ==== 178+0+0 (secure 0 0 0) 0x7fa968056210 con 0x7fa9780b5a70 2023-07-05T23:36:53.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:53.245+0000 7fa97d27c700 1 -- 172.21.15.27:0/1712586804 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fa96406ace0 msgr2=0x7fa96406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:53.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:53.245+0000 7fa97d27c700 1 --2- 172.21.15.27:0/1712586804 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fa96406ace0 0x7fa96406d190 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa96c00a7d0 tx=0x7fa96c008040 comp rx=0 tx=0).stop 2023-07-05T23:36:53.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:53.245+0000 7fa97d27c700 1 -- 172.21.15.27:0/1712586804 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa9780b5a70 msgr2=0x7fa978145070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-05T23:36:53.249 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:53.245+0000 7fa97d27c700 1 --2- 172.21.15.27:0/1712586804 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa9780b5a70 0x7fa978145070 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fa96800c520 tx=0x7fa96800c8e0 comp rx=0 tx=0).stop 2023-07-05T23:36:53.250 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:53.247+0000 7fa97d27c700 1 -- 172.21.15.27:0/1712586804 shutdown_connections 2023-07-05T23:36:53.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:53.247+0000 7fa97d27c700 1 --2- 172.21.15.27:0/1712586804 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9780d0a60 0x7fa9780b6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:53.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:53.247+0000 7fa97d27c700 1 --2- 172.21.15.27:0/1712586804 >> [v2:172.21.15.162:6832/3790028097,v1:172.21.15.162:6833/3790028097] conn(0x7fa96406ace0 0x7fa96406d190 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:53.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:53.247+0000 7fa97d27c700 1 --2- 172.21.15.27:0/1712586804 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9780b51d0 0x7fa9781f1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:53.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:53.247+0000 7fa97d27c700 1 --2- 172.21.15.27:0/1712586804 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa9780b5a70 0x7fa978145070 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-05T23:36:53.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:53.247+0000 7fa97d27c700 1 -- 172.21.15.27:0/1712586804 >> 172.21.15.27:0/1712586804 conn(0x7fa978071620 msgr2=0x7fa9780b6070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-05T23:36:53.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:53.247+0000 7fa97d27c700 1 -- 172.21.15.27:0/1712586804 shutdown_connections 2023-07-05T23:36:53.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-07-05T23:36:53.247+0000 7fa97d27c700 1 -- 172.21.15.27:0/1712586804 wait complete. 2023-07-05T23:36:53.253 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_data_ec' removed 2023-07-05T23:36:53.267 INFO:teuthology.misc:Shutting down mds daemons... 2023-07-05T23:36:53.267 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-05T23:36:53.268 INFO:teuthology.orchestra.run:waiting for 300 2023-07-05T23:36:53.277 INFO:tasks.ceph.mds.a:Stopped 2023-07-05T23:36:53.277 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-05T23:36:53.278 INFO:teuthology.orchestra.run:waiting for 300 2023-07-05T23:36:53.328 INFO:tasks.ceph.mds.c:Stopped 2023-07-05T23:36:53.328 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-05T23:36:53.329 INFO:teuthology.orchestra.run:waiting for 300 2023-07-05T23:36:53.339 INFO:tasks.ceph.mds.b:Stopped 2023-07-05T23:36:53.340 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-05T23:36:53.340 INFO:teuthology.orchestra.run:waiting for 300 2023-07-05T23:36:53.392 INFO:tasks.ceph.mds.d:Stopped 2023-07-05T23:36:53.392 INFO:teuthology.misc:Shutting down osd daemons... 2023-07-05T23:36:53.393 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-07-05T23:36:53.393 INFO:teuthology.orchestra.run:waiting for 300 2023-07-05T23:36:53.425 INFO:tasks.ceph.osd.0:Stopped 2023-07-05T23:36:53.426 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-07-05T23:36:53.426 INFO:teuthology.orchestra.run:waiting for 300 2023-07-05T23:36:53.502 INFO:tasks.ceph.osd.1:Stopped 2023-07-05T23:36:53.503 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-07-05T23:36:53.503 INFO:teuthology.orchestra.run:waiting for 300 2023-07-05T23:36:53.578 INFO:tasks.ceph.osd.2:Stopped 2023-07-05T23:36:53.578 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-07-05T23:36:53.579 INFO:teuthology.orchestra.run:waiting for 300 2023-07-05T23:36:53.660 INFO:tasks.ceph.osd.3:Stopped 2023-07-05T23:36:53.661 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-07-05T23:36:53.661 INFO:teuthology.orchestra.run:waiting for 300 2023-07-05T23:36:53.715 INFO:tasks.ceph.osd.4:Stopped 2023-07-05T23:36:53.716 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-07-05T23:36:53.716 INFO:teuthology.orchestra.run:waiting for 300 2023-07-05T23:36:53.754 INFO:tasks.ceph.osd.5:Stopped 2023-07-05T23:36:53.755 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-07-05T23:36:53.755 INFO:teuthology.orchestra.run:waiting for 300 2023-07-05T23:36:53.833 INFO:tasks.ceph.osd.6:Stopped 2023-07-05T23:36:53.833 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-07-05T23:36:53.834 INFO:teuthology.orchestra.run:waiting for 300 2023-07-05T23:36:53.915 INFO:tasks.ceph.osd.7:Stopped 2023-07-05T23:36:53.915 INFO:teuthology.misc:Shutting down mgr daemons... 2023-07-05T23:36:53.916 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-07-05T23:36:53.916 INFO:teuthology.orchestra.run:waiting for 300 2023-07-05T23:36:53.942 INFO:tasks.ceph.mgr.y:Stopped 2023-07-05T23:36:53.944 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-07-05T23:36:53.945 INFO:teuthology.orchestra.run:waiting for 300 2023-07-05T23:36:53.972 INFO:tasks.ceph.mgr.x:Stopped 2023-07-05T23:36:53.973 INFO:teuthology.misc:Shutting down mon daemons... 2023-07-05T23:36:53.973 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-07-05T23:36:53.974 INFO:teuthology.orchestra.run:waiting for 300 2023-07-05T23:36:53.995 INFO:tasks.ceph.mon.a:Stopped 2023-07-05T23:36:53.995 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-07-05T23:36:53.996 INFO:teuthology.orchestra.run:waiting for 300 2023-07-05T23:36:54.025 INFO:tasks.ceph.mon.b:Stopped 2023-07-05T23:36:54.026 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-07-05T23:36:54.027 INFO:teuthology.orchestra.run:waiting for 300 2023-07-05T23:36:54.077 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2023-07-05T23:36:54.077 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2023-07-05T23:36:54.078 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2023-07-05T23:36:54.078 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2023-07-05T23:36:54.078 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2023-07-05T23:36:54.079 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2023-07-05T23:36:54.079 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2023-07-05T23:36:54.080 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-07-05T23:36:54.080 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2023-07-05T23:36:54.080 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2023-07-05T23:36:54.081 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2023-07-05T23:36:54.081 INFO:tasks.ceph.mon.c:Stopped 2023-07-05T23:36:54.082 INFO:tasks.ceph:Checking cluster log for badness... 2023-07-05T23:36:54.082 DEBUG:teuthology.orchestra.run.smithi027:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-07-05T23:36:54.117 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi027.front.sepia.ceph.com 2023-07-05T23:36:54.119 DEBUG:teuthology.orchestra.run.smithi027:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-07-05T23:36:54.489 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi027.front.sepia.ceph.com 2023-07-05T23:36:54.490 DEBUG:teuthology.orchestra.run.smithi027:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-07-05T23:36:54.592 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi027.front.sepia.ceph.com 2023-07-05T23:36:54.593 DEBUG:teuthology.orchestra.run.smithi027:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-07-05T23:36:54.671 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi027.front.sepia.ceph.com 2023-07-05T23:36:54.671 DEBUG:teuthology.orchestra.run.smithi027:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-07-05T23:36:54.752 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi162.front.sepia.ceph.com 2023-07-05T23:36:54.752 DEBUG:teuthology.orchestra.run.smithi162:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-07-05T23:36:55.061 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi162.front.sepia.ceph.com 2023-07-05T23:36:55.061 DEBUG:teuthology.orchestra.run.smithi162:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-07-05T23:36:55.134 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi162.front.sepia.ceph.com 2023-07-05T23:36:55.135 DEBUG:teuthology.orchestra.run.smithi162:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-07-05T23:36:55.212 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi162.front.sepia.ceph.com 2023-07-05T23:36:55.213 DEBUG:teuthology.orchestra.run.smithi162:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-07-05T23:36:55.284 INFO:tasks.ceph:Archiving mon data... 2023-07-05T23:36:55.286 DEBUG:teuthology.misc:Transferring archived files from smithi027:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2023-07-05_18:32:52-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7327586/data/mon.a.tgz 2023-07-05T23:36:55.286 DEBUG:teuthology.orchestra.run.smithi027:> mktemp 2023-07-05T23:36:55.305 INFO:teuthology.orchestra.run.smithi027.stdout:/tmp/tmp.s0NP6PqDYQ 2023-07-05T23:36:55.305 DEBUG:teuthology.orchestra.run.smithi027:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.s0NP6PqDYQ 2023-07-05T23:36:55.442 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 0666 /tmp/tmp.s0NP6PqDYQ 2023-07-05T23:36:55.529 DEBUG:teuthology.orchestra.remote:smithi027:/tmp/tmp.s0NP6PqDYQ is 306KB 2023-07-05T23:36:55.596 DEBUG:teuthology.orchestra.run.smithi027:> rm -fr /tmp/tmp.s0NP6PqDYQ 2023-07-05T23:36:55.614 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2023-07-05_18:32:52-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7327586/data/mon.b.tgz 2023-07-05T23:36:55.615 DEBUG:teuthology.orchestra.run.smithi162:> mktemp 2023-07-05T23:36:55.633 INFO:teuthology.orchestra.run.smithi162.stdout:/tmp/tmp.oEjH9kMENn 2023-07-05T23:36:55.633 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.oEjH9kMENn 2023-07-05T23:36:55.798 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 0666 /tmp/tmp.oEjH9kMENn 2023-07-05T23:36:55.884 DEBUG:teuthology.orchestra.remote:smithi162:/tmp/tmp.oEjH9kMENn is 409KB 2023-07-05T23:36:55.953 DEBUG:teuthology.orchestra.run.smithi162:> rm -fr /tmp/tmp.oEjH9kMENn 2023-07-05T23:36:55.969 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2023-07-05_18:32:52-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7327586/data/mon.c.tgz 2023-07-05T23:36:55.970 DEBUG:teuthology.orchestra.run.smithi162:> mktemp 2023-07-05T23:36:56.025 INFO:teuthology.orchestra.run.smithi162.stdout:/tmp/tmp.EF9ph4NUMj 2023-07-05T23:36:56.026 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.EF9ph4NUMj 2023-07-05T23:36:56.166 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 0666 /tmp/tmp.EF9ph4NUMj 2023-07-05T23:36:56.250 DEBUG:teuthology.orchestra.remote:smithi162:/tmp/tmp.EF9ph4NUMj is 409KB 2023-07-05T23:36:56.346 DEBUG:teuthology.orchestra.run.smithi162:> rm -fr /tmp/tmp.EF9ph4NUMj 2023-07-05T23:36:56.362 INFO:tasks.ceph:Cleaning ceph cluster... 2023-07-05T23:36:56.362 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-07-05T23:36:56.364 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-07-05T23:36:56.427 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-07-05T23:36:56.428 DEBUG:teuthology.orchestra.run.smithi027:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-07-05T23:36:56.438 DEBUG:teuthology.orchestra.run.smithi162:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-07-05T23:36:56.480 INFO:teuthology.orchestra.run.smithi027.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-07-05T23:36:56.504 INFO:teuthology.orchestra.run.smithi162.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-07-05T23:36:56.510 INFO:tasks.ceph:Archiving crash dumps... 2023-07-05T23:36:56.512 DEBUG:teuthology.misc:Transferring archived files from smithi027:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-07-05_18:32:52-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7327586/remote/smithi027/crash 2023-07-05T23:36:56.513 DEBUG:teuthology.orchestra.run.smithi027:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-07-05T23:36:56.557 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-07-05_18:32:52-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7327586/remote/smithi162/crash 2023-07-05T23:36:56.558 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-07-05T23:36:56.587 INFO:tasks.ceph:Shutting down logrotate 2023-07-05T23:36:56.587 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:36:56.602 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-05T23:36:56.687 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-07-05T23:36:56.718 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-07-05T23:36:56.744 INFO:tasks.ceph:Compressing logs... 2023-07-05T23:36:56.745 DEBUG:teuthology.orchestra.run.smithi027:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-07-05T23:36:56.760 DEBUG:teuthology.orchestra.run.smithi162:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-07-05T23:36:56.788 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116645.log 2023-07-05T23:36:56.789 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109614.log 2023-07-05T23:36:56.789 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.116645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118283.log 2023-07-05T23:36:56.789 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.109614.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.116645.log.gz 2023-07-05T23:36:56.790 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112457.log 2023-07-05T23:36:56.790 INFO:teuthology.orchestra.run.smithi027.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.109614.log.gz 2023-07-05T23:36:56.793 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.118283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108130.log 2023-07-05T23:36:56.793 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.112457.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.118283.log.gz 2023-07-05T23:36:56.794 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110550.log 2023-07-05T23:36:56.794 INFO:teuthology.orchestra.run.smithi027.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.112457.log.gz 2023-07-05T23:36:56.794 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.108130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112687.log 2023-07-05T23:36:56.794 INFO:teuthology.orchestra.run.smithi027.stderr: 89.3%/var/log/ceph/ceph-client.admin.110550.log: -- replaced with /var/log/ceph/ceph-client.admin.108130.log.gz 2023-07-05T23:36:56.794 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111997.log 2023-07-05T23:36:56.795 INFO:teuthology.orchestra.run.smithi027.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.110550.log.gz 2023-07-05T23:36:56.795 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.112687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109522.log 2023-07-05T23:36:56.795 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.111997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108082.log 2023-07-05T23:36:56.795 INFO:teuthology.orchestra.run.smithi027.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.112687.log.gz 2023-07-05T23:36:56.795 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.109522.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.111997.log.gz 2023-07-05T23:36:56.796 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116737.log 2023-07-05T23:36:56.796 INFO:teuthology.orchestra.run.smithi027.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.109522.log.gz 2023-07-05T23:36:56.796 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117998.log 2023-07-05T23:36:56.796 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.108082.log: /var/log/ceph/ceph-client.admin.116737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116142.log 2023-07-05T23:36:56.796 INFO:teuthology.orchestra.run.smithi027.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.108082.log.gz 2023-07-05T23:36:56.797 INFO:teuthology.orchestra.run.smithi027.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.116737.log.gz 2023-07-05T23:36:56.797 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.117998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109909.log 2023-07-05T23:36:56.797 INFO:teuthology.orchestra.run.smithi027.stderr: 87.5%/var/log/ceph/ceph-client.admin.116142.log: -- replaced with /var/log/ceph/ceph-client.admin.117998.log.gz 2023-07-05T23:36:56.797 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107921.log 2023-07-05T23:36:56.797 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.109909.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.116142.log.gz 2023-07-05T23:36:56.798 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-07-05T23:36:56.798 INFO:teuthology.orchestra.run.smithi027.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.109909.log.gz 2023-07-05T23:36:56.798 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.107921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112871.log 2023-07-05T23:36:56.798 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-osd.2.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.107921.log.gz 2023-07-05T23:36:56.798 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111813.log 2023-07-05T23:36:56.808 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.112871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118471.log 2023-07-05T23:36:56.808 INFO:teuthology.orchestra.run.smithi027.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.112871.log.gz 2023-07-05T23:36:56.808 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.111813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112595.log 2023-07-05T23:36:56.809 INFO:teuthology.orchestra.run.smithi027.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.111813.log.gz 2023-07-05T23:36:56.809 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111595.log 2023-07-05T23:36:56.810 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.118471.log: /var/log/ceph/ceph-client.admin.112595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108510.log 2023-07-05T23:36:56.810 INFO:teuthology.orchestra.run.smithi027.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.118471.log.gz 2023-07-05T23:36:56.810 INFO:teuthology.orchestra.run.smithi027.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.112595.log.gz 2023-07-05T23:36:56.811 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.111595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116188.log 2023-07-05T23:36:56.811 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.108510.log: -- /var/log/ceph/ceph.log 2023-07-05T23:36:56.811 INFO:teuthology.orchestra.run.smithi027.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.111595.log.gz 2023-07-05T23:36:56.811 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.116188.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.108510.log.gz 2023-07-05T23:36:56.811 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117839.log 2023-07-05T23:36:56.812 INFO:teuthology.orchestra.run.smithi027.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.116188.log.gz 2023-07-05T23:36:56.812 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116599.log 2023-07-05T23:36:56.812 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110320.log 2023-07-05T23:36:56.812 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.117839.log: /var/log/ceph/ceph-client.admin.116599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107515.log 2023-07-05T23:36:56.812 INFO:teuthology.orchestra.run.smithi027.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.117839.log.gz 2023-07-05T23:36:56.813 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.110320.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.116599.log.gz 2023-07-05T23:36:56.813 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117701.log 2023-07-05T23:36:56.813 INFO:teuthology.orchestra.run.smithi027.stderr: 85.5% -- replaced with /var/log/ceph/ceph.log.gz 2023-07-05T23:36:56.813 INFO:teuthology.orchestra.run.smithi027.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.110320.log.gz 2023-07-05T23:36:56.813 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.107515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117471.log 2023-07-05T23:36:56.814 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.113323.log 2023-07-05T23:36:56.814 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.117701.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.107515.log.gz 2023-07-05T23:36:56.814 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.117471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117747.log 2023-07-05T23:36:56.814 INFO:teuthology.orchestra.run.smithi027.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.117701.log.gz 2023-07-05T23:36:56.815 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.0.113323.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.0.113323.log.gz--verbose 2023-07-05T23:36:56.815 INFO:teuthology.orchestra.run.smithi027.stderr:-- /var/log/ceph/ceph-client.admin.118228.log 89.1% 2023-07-05T23:36:56.815 INFO:teuthology.orchestra.run.smithi027.stderr: -- replaced with /var/log/ceph/ceph-client.admin.117471.log.gz 2023-07-05T23:36:56.815 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.117747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107783.log 2023-07-05T23:36:56.816 INFO:teuthology.orchestra.run.smithi027.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.117747.log.gz 2023-07-05T23:36:56.816 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.118228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111217.log 2023-07-05T23:36:56.816 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.107783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107967.log 2023-07-05T23:36:56.816 INFO:teuthology.orchestra.run.smithi027.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.118228.log.gz 2023-07-05T23:36:56.816 INFO:teuthology.orchestra.run.smithi027.stderr: 89.2%/var/log/ceph/ceph-client.admin.111217.log: -- replaced with /var/log/ceph/ceph-client.admin.107783.log.gz 2023-07-05T23:36:56.817 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117425.log 2023-07-05T23:36:56.817 INFO:teuthology.orchestra.run.smithi027.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.111217.log.gz 2023-07-05T23:36:56.817 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.107967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108232.log 2023-07-05T23:36:56.817 INFO:teuthology.orchestra.run.smithi027.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.107967.log.gz 2023-07-05T23:36:56.817 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.117425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110847.log 2023-07-05T23:36:56.818 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.108232.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.117425.log.gz 2023-07-05T23:36:56.818 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112089.log 2023-07-05T23:36:56.818 INFO:teuthology.orchestra.run.smithi027.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.108232.log.gz 2023-07-05T23:36:56.818 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.110847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110642.log 2023-07-05T23:36:56.819 INFO:teuthology.orchestra.run.smithi027.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.110847.log.gz 2023-07-05T23:36:56.819 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.112089.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-07-05T23:36:56.819 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.110642.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.112089.log.gz 2023-07-05T23:36:56.819 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108464.log 2023-07-05T23:36:56.819 INFO:teuthology.orchestra.run.smithi027.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.110642.log.gz 2023-07-05T23:36:56.820 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109817.log 2023-07-05T23:36:56.820 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.108464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111859.log 2023-07-05T23:36:56.820 INFO:teuthology.orchestra.run.smithi027.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.108464.log.gz 2023-07-05T23:36:56.820 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.109817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111951.log 2023-07-05T23:36:56.820 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108418.log 2023-07-05T23:36:56.821 INFO:teuthology.orchestra.run.smithi027.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.109817.log.gz 2023-07-05T23:36:56.821 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.111859.log: /var/log/ceph/ceph-client.admin.111951.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.111859.log.gz 2023-07-05T23:36:56.821 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107829.log 2023-07-05T23:36:56.821 INFO:teuthology.orchestra.run.smithi027.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.111951.log.gz 2023-07-05T23:36:56.822 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.108418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101253.log 2023-07-05T23:36:56.822 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-07-05T23:36:56.822 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.107829.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.108418.log.gz 2023-07-05T23:36:56.822 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.101253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112411.log 2023-07-05T23:36:56.822 INFO:teuthology.orchestra.run.smithi027.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.107829.log.gz 2023-07-05T23:36:56.823 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-mds.a.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.101253.log.gz 2023-07-05T23:36:56.823 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109863.log 2023-07-05T23:36:56.823 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.112411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110504.log 2023-07-05T23:36:56.823 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.109863.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.112411.log.gz 2023-07-05T23:36:56.824 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.110504.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.109863.log.gz 2023-07-05T23:36:56.824 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109568.log 2023-07-05T23:36:56.824 INFO:teuthology.orchestra.run.smithi027.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.110504.log.gz 2023-07-05T23:36:56.824 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110366.log 2023-07-05T23:36:56.824 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.109568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117379.log 2023-07-05T23:36:56.825 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.110366.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.109568.log.gz 2023-07-05T23:36:56.825 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-07-05T23:36:56.825 INFO:teuthology.orchestra.run.smithi027.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.110366.log.gz 2023-07-05T23:36:56.825 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.117379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111216.log 2023-07-05T23:36:56.825 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107469.log 2023-07-05T23:36:56.826 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-osd.3.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.117379.log.gz 2023-07-05T23:36:56.826 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.111216.log: /var/log/ceph/ceph-client.admin.107469.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.111216.log.gz 2023-07-05T23:36:56.826 INFO:teuthology.orchestra.run.smithi027.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.107469.log.gz 2023-07-05T23:36:56.826 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117059.log 2023-07-05T23:36:56.836 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-07-05T23:36:56.836 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100951.log 2023-07-05T23:36:56.836 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-07-05T23:36:56.837 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.100951.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-07-05T23:36:56.837 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.100951.log.gz 2023-07-05T23:36:56.837 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101044.log 2023-07-05T23:36:56.837 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.107668.log 2023-07-05T23:36:56.837 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.101044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101090.log 2023-07-05T23:36:56.838 INFO:teuthology.orchestra.run.smithi162.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.101044.log.gz 2023-07-05T23:36:56.838 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.1.107668.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-07-05T23:36:56.838 INFO:teuthology.orchestra.run.smithi162.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.107668.log.gz 2023-07-05T23:36:56.838 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.101090.log: 92.0% -- replaced with /var/log/ceph/ceph.log.gz 2023-07-05T23:36:56.838 INFO:teuthology.orchestra.run.smithi162.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.101090.log.gz 2023-07-05T23:36:56.838 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.107676.log 2023-07-05T23:36:56.839 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-07-05T23:36:56.839 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.1.107676.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.107676.log.gz 2023-07-05T23:36:56.839 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-07-05T23:36:56.839 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-07-05T23:36:56.839 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101234.log 2023-07-05T23:36:56.840 INFO:teuthology.orchestra.run.smithi162.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-07-05T23:36:56.840 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-mgr.x.log: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-07-05T23:36:56.840 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.108287.log 2023-07-05T23:36:56.840 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.101234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100998.log 2023-07-05T23:36:56.841 INFO:teuthology.orchestra.run.smithi162.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.101234.log.gz 2023-07-05T23:36:56.841 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.3.108287.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.108287.log.gz 2023-07-05T23:36:56.841 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.100998.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.100998.log.gz 2023-07-05T23:36:56.841 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101135.log 2023-07-05T23:36:56.841 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101181.log 2023-07-05T23:36:56.841 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.101135.log: /var/log/ceph/ceph-client.admin.101181.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.101135.log.gz 2023-07-05T23:36:56.842 INFO:teuthology.orchestra.run.smithi162.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.101181.log.gz 2023-07-05T23:36:56.842 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-07-05T23:36:56.842 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101278.log 2023-07-05T23:36:56.842 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.108283.log 2023-07-05T23:36:56.842 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.101278.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.101278.log.gz 2023-07-05T23:36:56.843 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.3.108283.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.108283.log.gz 2023-07-05T23:36:56.843 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-07-05T23:36:56.843 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-07-05T23:36:56.843 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-osd.7.log: /var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-07-05T23:36:56.843 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-mds.b.log: 92.4% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-07-05T23:36:56.852 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117105.log 2023-07-05T23:36:56.852 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.117059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118699.log 2023-07-05T23:36:56.852 INFO:teuthology.orchestra.run.smithi027.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.117059.log.gz 2023-07-05T23:36:56.852 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.117105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115522.log 2023-07-05T23:36:56.853 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.118699.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.117105.log.gz 2023-07-05T23:36:56.853 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108672.log 2023-07-05T23:36:56.853 INFO:teuthology.orchestra.run.smithi027.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.118699.log.gz 2023-07-05T23:36:56.853 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.115522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118902.log 2023-07-05T23:36:56.853 INFO:teuthology.orchestra.run.smithi027.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.115522.log.gz 2023-07-05T23:36:56.854 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.108672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115606.log 2023-07-05T23:36:56.854 INFO:teuthology.orchestra.run.smithi027.stderr: 89.1%/var/log/ceph/ceph-client.admin.118902.log: -- replaced with /var/log/ceph/ceph-client.admin.108672.log.gz 2023-07-05T23:36:56.854 INFO:teuthology.orchestra.run.smithi027.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.118902.log.gz 2023-07-05T23:36:56.854 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.115606.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.115606.log.gz 2023-07-05T23:36:56.854 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107736.log 2023-07-05T23:36:56.855 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101139.log 2023-07-05T23:36:56.855 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.107736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111203.log 2023-07-05T23:36:56.855 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.101139.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.107736.log.gz 2023-07-05T23:36:56.855 INFO:teuthology.orchestra.run.smithi027.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.101139.log.gz 2023-07-05T23:36:56.855 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108326.log 2023-07-05T23:36:56.856 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.111203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115714.log 2023-07-05T23:36:56.856 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.108326.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.111203.log.gz 2023-07-05T23:36:56.856 INFO:teuthology.orchestra.run.smithi027.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.108326.log.gz 2023-07-05T23:36:56.856 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116783.log 2023-07-05T23:36:56.856 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.115714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116691.log 2023-07-05T23:36:56.857 INFO:teuthology.orchestra.run.smithi027.stderr: 88.7%/var/log/ceph/ceph-client.admin.116783.log: -- replaced with /var/log/ceph/ceph-client.admin.115714.log.gz 2023-07-05T23:36:56.857 INFO:teuthology.orchestra.run.smithi027.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.116783.log.gz 2023-07-05T23:36:56.857 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.116691.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.116691.log.gz 2023-07-05T23:36:56.857 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116829.log 2023-07-05T23:36:56.857 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-07-05T23:36:56.858 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.116829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.113331.log 2023-07-05T23:36:56.858 INFO:teuthology.orchestra.run.smithi027.stderr: 87.7%/var/log/ceph/ceph-mds.c.log: -- replaced with /var/log/ceph/ceph-client.admin.116829.log.gz 2023-07-05T23:36:56.858 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.0.113331.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.113331.log.gz 2023-07-05T23:36:56.858 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111207.log 2023-07-05T23:36:56.858 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118136.log 2023-07-05T23:36:56.859 INFO:teuthology.orchestra.run.smithi027.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-07-05T23:36:56.859 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.111207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107875.log 2023-07-05T23:36:56.859 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.118136.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.111207.log.gz 2023-07-05T23:36:56.859 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.107875.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.118136.log.gz 2023-07-05T23:36:56.859 INFO:teuthology.orchestra.run.smithi027.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.107875.log.gz 2023-07-05T23:36:56.860 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117793.log 2023-07-05T23:36:56.860 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109752.log 2023-07-05T23:36:56.860 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.117793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110047.log 2023-07-05T23:36:56.860 INFO:teuthology.orchestra.run.smithi027.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.117793.log.gz 2023-07-05T23:36:56.860 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.109752.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.109752.log.gz 2023-07-05T23:36:56.861 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.110047.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.110047.log.gz 2023-07-05T23:36:56.862 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116281.log 2023-07-05T23:36:56.862 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117952.log 2023-07-05T23:36:56.862 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.116281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116016.log 2023-07-05T23:36:56.862 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.117952.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.116281.log.gz 2023-07-05T23:36:56.863 INFO:teuthology.orchestra.run.smithi027.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.117952.log.gz 2023-07-05T23:36:56.863 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.116016.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.116016.log.gz 2023-07-05T23:36:56.863 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108556.log 2023-07-05T23:36:56.863 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110001.log 2023-07-05T23:36:56.863 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.108556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116875.log 2023-07-05T23:36:56.864 INFO:teuthology.orchestra.run.smithi027.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.108556.log.gz 2023-07-05T23:36:56.864 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.110001.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.110001.log.gz 2023-07-05T23:36:56.864 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.116875.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.116875.log.gz 2023-07-05T23:36:56.864 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110412.log 2023-07-05T23:36:56.864 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116967.log 2023-07-05T23:36:56.865 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.110412.log: /var/log/ceph/ceph-client.admin.116967.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.110412.log.gz 2023-07-05T23:36:56.865 INFO:teuthology.orchestra.run.smithi027.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.116967.log.gz 2023-07-05T23:36:56.865 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111592.log 2023-07-05T23:36:56.865 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111598.log 2023-07-05T23:36:56.865 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.111592.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-07-05T23:36:56.866 INFO:teuthology.orchestra.run.smithi027.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.111592.log.gz 2023-07-05T23:36:56.866 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.111598.log: /var/log/ceph/ceph.audit.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.111598.log.gz 2023-07-05T23:36:56.866 INFO:teuthology.orchestra.run.smithi027.stderr: 88.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-07-05T23:36:56.866 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114210.log 2023-07-05T23:36:56.866 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.113984.log 2023-07-05T23:36:56.867 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.114210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112641.log 2023-07-05T23:36:56.867 INFO:teuthology.orchestra.run.smithi027.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.114210.log.gz 2023-07-05T23:36:56.867 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.2.113984.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.2.113984.log.gz--verbose 2023-07-05T23:36:56.867 INFO:teuthology.orchestra.run.smithi027.stderr:-- /var/log/ceph/ceph-client.admin.107406.log 2023-07-05T23:36:56.867 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.112641.log: /var/log/ceph/ceph-client.admin.107406.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.112641.log.gz 2023-07-05T23:36:56.867 INFO:teuthology.orchestra.run.smithi027.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.107406.log.gz 2023-07-05T23:36:56.868 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118856.log 2023-07-05T23:36:56.868 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112273.log 2023-07-05T23:36:56.868 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.118856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108372.log 2023-07-05T23:36:56.868 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.112273.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.118856.log.gz 2023-07-05T23:36:56.868 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.108372.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.112273.log.gz 2023-07-05T23:36:56.869 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116327.log 2023-07-05T23:36:56.869 INFO:teuthology.orchestra.run.smithi027.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.108372.log.gz 2023-07-05T23:36:56.869 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117287.log 2023-07-05T23:36:56.869 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116235.log 2023-07-05T23:36:56.869 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.116327.log: /var/log/ceph/ceph-client.admin.117287.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.116327.log.gz 2023-07-05T23:36:56.870 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.116235.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.117287.log.gz 2023-07-05T23:36:56.870 INFO:teuthology.orchestra.run.smithi027.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.116235.log.gz 2023-07-05T23:36:56.870 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111603.log 2023-07-05T23:36:56.870 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117906.log 2023-07-05T23:36:56.870 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.111603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107313.log 2023-07-05T23:36:56.871 INFO:teuthology.orchestra.run.smithi027.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.111603.log.gz 2023-07-05T23:36:56.871 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.117906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116553.log 2023-07-05T23:36:56.871 INFO:teuthology.orchestra.run.smithi027.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.117906.log.gz 2023-07-05T23:36:56.871 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.107313.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.107313.log.gz 2023-07-05T23:36:56.871 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.116553.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.116553.log.gz 2023-07-05T23:36:56.872 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110845.log 2023-07-05T23:36:56.872 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107690.log 2023-07-05T23:36:56.872 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.110845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118653.log 2023-07-05T23:36:56.872 INFO:teuthology.orchestra.run.smithi027.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.110845.log.gz 2023-07-05T23:36:56.872 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.107690.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.107690.log.gz 2023-07-05T23:36:56.873 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118653.log: /var/log/ceph/ceph-client.admin.111905.log 2023-07-05T23:36:56.873 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112181.log 2023-07-05T23:36:56.873 INFO:teuthology.orchestra.run.smithi027.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.118653.log.gz 2023-07-05T23:36:56.873 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.111905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110458.log 2023-07-05T23:36:56.873 INFO:teuthology.orchestra.run.smithi027.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.111905.log.gz 2023-07-05T23:36:56.874 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.112181.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.112181.log.gz 2023-07-05T23:36:56.874 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109660.log 2023-07-05T23:36:56.874 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.110458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110848.log 2023-07-05T23:36:56.874 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.109660.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.110458.log.gz 2023-07-05T23:36:56.875 INFO:teuthology.orchestra.run.smithi027.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.109660.log.gz 2023-07-05T23:36:56.875 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.110848.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.110848.log.gz 2023-07-05T23:36:56.875 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116507.log 2023-07-05T23:36:56.875 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111208.log 2023-07-05T23:36:56.875 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.116507.log: /var/log/ceph/ceph-client.admin.111208.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.116507.log.gz 2023-07-05T23:36:56.876 INFO:teuthology.orchestra.run.smithi027.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.111208.log.gz 2023-07-05T23:36:56.876 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117655.log 2023-07-05T23:36:56.876 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112503.log 2023-07-05T23:36:56.877 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.117655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110843.log 2023-07-05T23:36:56.877 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.112503.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.117655.log.gz 2023-07-05T23:36:56.877 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.110843.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.112503.log.gz 2023-07-05T23:36:56.877 INFO:teuthology.orchestra.run.smithi027.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.110843.log.gz 2023-07-05T23:36:56.877 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110849.log 2023-07-05T23:36:56.878 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-07-05T23:36:56.878 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.110849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111213.log 2023-07-05T23:36:56.878 INFO:teuthology.orchestra.run.smithi027.stderr: 88.2%/var/log/ceph/ceph-osd.1.log: -- replaced with /var/log/ceph/ceph-client.admin.110849.log.gz 2023-07-05T23:36:56.878 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.111213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117333.log 2023-07-05T23:36:56.878 INFO:teuthology.orchestra.run.smithi027.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.111213.log.gz 2023-07-05T23:36:56.879 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.117333.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.117333.log.gz 2023-07-05T23:36:56.879 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110274.log 2023-07-05T23:36:56.879 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111596.log 2023-07-05T23:36:56.879 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.110274.log: /var/log/ceph/ceph-client.admin.111596.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.110274.log.gz 2023-07-05T23:36:56.879 INFO:teuthology.orchestra.run.smithi027.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.111596.log.gz 2023-07-05T23:36:56.880 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110596.log 2023-07-05T23:36:56.880 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108184.log 2023-07-05T23:36:56.880 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.110596.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.110596.log.gz 2023-07-05T23:36:56.881 INFO:teuthology.orchestra.run.smithi162.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-07-05T23:36:56.887 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.108184.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.108184.log.gz 2023-07-05T23:36:56.887 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108602.log 2023-07-05T23:36:56.888 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109476.log 2023-07-05T23:36:56.888 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.108602.log: /var/log/ceph/ceph-client.admin.109476.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.109476.log.gz 2023-07-05T23:36:56.888 INFO:teuthology.orchestra.run.smithi027.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.108602.log.gz 2023-07-05T23:36:56.888 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118810.log 2023-07-05T23:36:56.888 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110836.log 2023-07-05T23:36:56.889 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.118810.log: 88.5%/var/log/ceph/ceph-client.admin.110836.log: -- replaced with /var/log/ceph/ceph-client.admin.118810.log.gz 2023-07-05T23:36:56.889 INFO:teuthology.orchestra.run.smithi027.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.110836.log.gz 2023-07-05T23:36:56.889 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107605.log 2023-07-05T23:36:56.889 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114256.log 2023-07-05T23:36:56.889 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.107605.log: /var/log/ceph/ceph-client.admin.114256.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.107605.log.gz 2023-07-05T23:36:56.890 INFO:teuthology.orchestra.run.smithi027.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.114256.log.gz 2023-07-05T23:36:56.890 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118044.log 2023-07-05T23:36:56.890 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112227.log 2023-07-05T23:36:56.890 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.118044.log: /var/log/ceph/ceph-client.admin.112227.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.118044.log.gz 2023-07-05T23:36:56.890 INFO:teuthology.orchestra.run.smithi027.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.112227.log.gz 2023-07-05T23:36:56.891 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116921.log 2023-07-05T23:36:56.891 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118350.log 2023-07-05T23:36:56.891 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.116921.log: /var/log/ceph/ceph-client.admin.118350.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.116921.log.gz 2023-07-05T23:36:56.891 INFO:teuthology.orchestra.run.smithi027.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.118350.log.gz 2023-07-05T23:36:56.891 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110228.log 2023-07-05T23:36:56.892 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111602.log 2023-07-05T23:36:56.892 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.110228.log: /var/log/ceph/ceph-client.admin.111602.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.110228.log.gz 2023-07-05T23:36:56.892 INFO:teuthology.orchestra.run.smithi027.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.111602.log.gz 2023-07-05T23:36:56.892 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116419.log 2023-07-05T23:36:56.892 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111606.log 2023-07-05T23:36:56.893 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.116419.log: 88.6%/var/log/ceph/ceph-client.admin.111606.log: -- replaced with /var/log/ceph/ceph-client.admin.116419.log.gz 2023-07-05T23:36:56.893 INFO:teuthology.orchestra.run.smithi027.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.111606.log.gz 2023-07-05T23:36:56.893 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112365.log 2023-07-05T23:36:56.893 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.113988.log 2023-07-05T23:36:56.893 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.112365.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.112365.log.gz 2023-07-05T23:36:56.894 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.2.113988.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.113988.log.gz 2023-07-05T23:36:56.894 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112135.log 2023-07-05T23:36:56.894 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111215.log 2023-07-05T23:36:56.894 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.112135.log: /var/log/ceph/ceph-client.admin.111215.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.112135.log.gz 2023-07-05T23:36:56.894 INFO:teuthology.orchestra.run.smithi027.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.111215.log.gz 2023-07-05T23:36:56.895 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117609.log 2023-07-05T23:36:56.895 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110093.log 2023-07-05T23:36:56.895 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.117609.log: 88.3%/var/log/ceph/ceph-client.admin.110093.log: -- replaced with /var/log/ceph/ceph-client.admin.117609.log.gz 2023-07-05T23:36:56.895 INFO:teuthology.orchestra.run.smithi027.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.110093.log.gz 2023-07-05T23:36:56.895 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112319.log 2023-07-05T23:36:56.896 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117013.log 2023-07-05T23:36:56.896 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.112319.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.112319.log.gz 2023-07-05T23:36:56.896 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.117013.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.117013.log.gz 2023-07-05T23:36:56.896 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112043.log 2023-07-05T23:36:56.896 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.94592.log 2023-07-05T23:36:56.897 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.112043.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.112043.log.gz 2023-07-05T23:36:56.897 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph.tmp-client.admin.94592.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.94592.log.gz 2023-07-05T23:36:56.897 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115862.log 2023-07-05T23:36:56.897 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118561.log 2023-07-05T23:36:56.898 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.115862.log: /var/log/ceph/ceph-client.admin.118561.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.115862.log.gz 2023-07-05T23:36:56.898 INFO:teuthology.orchestra.run.smithi027.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.118561.log.gz 2023-07-05T23:36:56.898 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109706.log 2023-07-05T23:36:56.898 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111600.log 2023-07-05T23:36:56.898 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.109706.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.109706.log.gz 2023-07-05T23:36:56.899 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.111600.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.111600.log.gz 2023-07-05T23:36:56.899 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117563.log 2023-07-05T23:36:56.899 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108280.log 2023-07-05T23:36:56.899 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.117563.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.117563.log.gz 2023-07-05T23:36:56.899 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.108280.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.108280.log.gz 2023-07-05T23:36:56.900 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109955.log 2023-07-05T23:36:56.900 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117517.log 2023-07-05T23:36:56.900 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.109955.log: /var/log/ceph/ceph-client.admin.117517.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.109955.log.gz 2023-07-05T23:36:56.900 INFO:teuthology.orchestra.run.smithi027.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.117517.log.gz 2023-07-05T23:36:56.900 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116373.log 2023-07-05T23:36:56.901 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111204.log 2023-07-05T23:36:56.901 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.116373.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.116373.log.gz 2023-07-05T23:36:56.901 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.111204.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.111204.log.gz 2023-07-05T23:36:56.901 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100831.log 2023-07-05T23:36:56.902 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118763.log 2023-07-05T23:36:56.902 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.100831.log: /var/log/ceph/ceph-client.admin.118763.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.100831.log.gz 2023-07-05T23:36:56.902 INFO:teuthology.orchestra.run.smithi027.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.118763.log.gz 2023-07-05T23:36:56.902 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110846.log 2023-07-05T23:36:56.902 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113553.log 2023-07-05T23:36:56.903 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.110846.log: /var/log/ceph/ceph-client.admin.113553.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.110846.log.gz 2023-07-05T23:36:56.903 INFO:teuthology.orchestra.run.smithi027.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.113553.log.gz 2023-07-05T23:36:56.903 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108013.log 2023-07-05T23:36:56.903 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-07-05T23:36:56.903 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.108013.log: /var/log/ceph/ceph-mon.a.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.108013.log.gz 2023-07-05T23:36:56.907 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118607.log 2023-07-05T23:36:56.907 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.118607.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.118607.log.gz 2023-07-05T23:36:56.907 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109259.log 2023-07-05T23:36:56.908 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.109259.log: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.109259.log.gz 2023-07-05T23:36:56.908 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110182.log 2023-07-05T23:36:56.908 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.110182.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.110182.log.gz 2023-07-05T23:36:56.908 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115790.log 2023-07-05T23:36:56.909 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.115790.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.115790.log.gz 2023-07-05T23:36:56.909 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112549.log 2023-07-05T23:36:56.909 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.112549.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.112549.log.gz 2023-07-05T23:36:56.909 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118090.log 2023-07-05T23:36:56.909 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.118090.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.118090.log.gz 2023-07-05T23:36:56.910 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115970.log 2023-07-05T23:36:56.910 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.115970.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.115970.log.gz 2023-07-05T23:36:56.910 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118515.log 2023-07-05T23:36:56.910 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.118515.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.118515.log.gz 2023-07-05T23:36:56.910 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118417.log 2023-07-05T23:36:56.911 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.118417.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.118417.log.gz 2023-07-05T23:36:56.911 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-07-05T23:36:56.911 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-mgr.y.log: 93.4% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-07-05T23:36:56.911 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118182.log 2023-07-05T23:36:56.912 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.118182.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.118182.log.gz 2023-07-05T23:36:56.912 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110841.log 2023-07-05T23:36:56.912 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.110841.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.110841.log.gz 2023-07-05T23:36:56.928 INFO:teuthology.orchestra.run.smithi162.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-07-05T23:36:56.953 INFO:teuthology.orchestra.run.smithi162.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-07-05T23:36:57.194 INFO:teuthology.orchestra.run.smithi027.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-07-05T23:36:57.444 INFO:teuthology.orchestra.run.smithi027.stderr: 93.1% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-07-05T23:36:58.850 INFO:teuthology.orchestra.run.smithi162.stderr: 93.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-07-05T23:36:59.082 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2023-07-05T23:36:59.082 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2023-07-05T23:36:59.082 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2023-07-05T23:36:59.083 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2023-07-05T23:36:59.083 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2023-07-05T23:36:59.083 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2023-07-05T23:36:59.083 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2023-07-05T23:36:59.083 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2023-07-05T23:36:59.084 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2023-07-05T23:36:59.084 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2023-07-05T23:36:59.084 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2023-07-05T23:36:59.101 INFO:teuthology.orchestra.run.smithi027.stderr: 92.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-07-05T23:36:59.195 INFO:teuthology.orchestra.run.smithi162.stderr: 92.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-07-05T23:36:59.237 INFO:teuthology.orchestra.run.smithi162.stderr: 92.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-07-05T23:36:59.251 INFO:teuthology.orchestra.run.smithi027.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-07-05T23:36:59.370 INFO:teuthology.orchestra.run.smithi162.stderr: 92.8% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-07-05T23:36:59.372 INFO:teuthology.orchestra.run.smithi162.stderr: 2023-07-05T23:36:59.372 INFO:teuthology.orchestra.run.smithi162.stderr:real 0m2.572s 2023-07-05T23:36:59.372 INFO:teuthology.orchestra.run.smithi162.stderr:user 0m9.363s 2023-07-05T23:36:59.372 INFO:teuthology.orchestra.run.smithi162.stderr:sys 0m0.359s 2023-07-05T23:36:59.385 INFO:teuthology.orchestra.run.smithi027.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-07-05T23:36:59.400 INFO:teuthology.orchestra.run.smithi027.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-07-05T23:36:59.402 INFO:teuthology.orchestra.run.smithi027.stderr: 2023-07-05T23:36:59.402 INFO:teuthology.orchestra.run.smithi027.stderr:real 0m2.626s 2023-07-05T23:36:59.402 INFO:teuthology.orchestra.run.smithi027.stderr:user 0m10.555s 2023-07-05T23:36:59.402 INFO:teuthology.orchestra.run.smithi027.stderr:sys 0m0.486s 2023-07-05T23:36:59.403 INFO:tasks.ceph:Archiving logs... 2023-07-05T23:36:59.403 DEBUG:teuthology.misc:Transferring archived files from smithi027:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-07-05_18:32:52-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7327586/remote/smithi027/log 2023-07-05T23:36:59.405 DEBUG:teuthology.orchestra.run.smithi027:> sudo tar c -f - -C /var/log/ceph -- . 2023-07-05T23:37:00.863 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-07-05_18:32:52-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7327586/remote/smithi162/log 2023-07-05T23:37:00.864 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /var/log/ceph -- . 2023-07-05T23:37:02.166 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-07-05T23:37:02.177 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-07-05T23:37:02.178 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-07-05T23:37:02.180 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-07-05T23:37:02.276 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-07-05T23:37:02.285 INFO:teuthology.task.clock:Checking final clock skew... 2023-07-05T23:37:02.286 DEBUG:teuthology.orchestra.run.smithi027:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-05T23:37:02.289 DEBUG:teuthology.orchestra.run.smithi162:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-05T23:37:02.305 INFO:teuthology.orchestra.run.smithi027.stderr:bash: ntpq: command not found 2023-07-05T23:37:02.307 INFO:teuthology.orchestra.run.smithi162.stderr:bash: ntpq: command not found 2023-07-05T23:37:02.311 INFO:teuthology.orchestra.run.smithi027.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-05T23:37:02.311 INFO:teuthology.orchestra.run.smithi027.stdout:=============================================================================== 2023-07-05T23:37:02.311 INFO:teuthology.orchestra.run.smithi027.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 64 +115us[ +114us] +/- 98ms 2023-07-05T23:37:02.311 INFO:teuthology.orchestra.run.smithi027.stdout:^* hv02.front.sepia.ceph.com 3 6 377 1 -829us[ -830us] +/- 64ms 2023-07-05T23:37:02.312 INFO:teuthology.orchestra.run.smithi027.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 64 +970us[ +969us] +/- 79ms 2023-07-05T23:37:02.312 INFO:teuthology.orchestra.run.smithi027.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-07-05T23:37:02.313 INFO:teuthology.orchestra.run.smithi162.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-05T23:37:02.313 INFO:teuthology.orchestra.run.smithi162.stdout:=============================================================================== 2023-07-05T23:37:02.314 INFO:teuthology.orchestra.run.smithi162.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 65 +104us[ +124us] +/- 98ms 2023-07-05T23:37:02.314 INFO:teuthology.orchestra.run.smithi162.stdout:^* hv02.front.sepia.ceph.com 3 6 377 62 -822us[ -802us] +/- 63ms 2023-07-05T23:37:02.314 INFO:teuthology.orchestra.run.smithi162.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 65 +964us[ +983us] +/- 79ms 2023-07-05T23:37:02.314 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-07-05T23:37:02.315 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-07-05T23:37:02.324 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-07-05T23:37:02.325 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-07-05T23:37:02.345 DEBUG:teuthology.orchestra.run.smithi027:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-07-05T23:37:02.458 DEBUG:teuthology.orchestra.run.smithi162:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-07-05T23:37:02.558 DEBUG:teuthology.orchestra.run.smithi027:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-05T23:37:02.593 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-05T23:37:02.593 DEBUG:teuthology.orchestra.run.smithi162:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-05T23:37:02.626 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-05T23:37:02.627 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-07-05T23:37:02.637 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-07-05T23:37:02.656 INFO:teuthology.task.internal:Duration was 988.876771 seconds 2023-07-05T23:37:02.657 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-07-05T23:37:02.689 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-07-05T23:37:02.689 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-07-05T23:37:02.692 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-07-05T23:37:02.739 INFO:teuthology.orchestra.run.smithi162.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-05T23:37:02.740 INFO:teuthology.orchestra.run.smithi027.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-05T23:37:03.020 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-07-05T23:37:03.021 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi027.front.sepia.ceph.com 2023-07-05T23:37:03.021 DEBUG:teuthology.orchestra.run.smithi027:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-07-05T23:37:03.044 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi162.front.sepia.ceph.com 2023-07-05T23:37:03.045 DEBUG:teuthology.orchestra.run.smithi162:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-07-05T23:37:03.066 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-07-05T23:37:03.066 DEBUG:teuthology.orchestra.run.smithi027:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-05T23:37:03.086 DEBUG:teuthology.orchestra.run.smithi162:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-05T23:37:03.146 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-07-05T23:37:03.147 DEBUG:teuthology.orchestra.run.smithi027:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-07-05T23:37:03.170 DEBUG:teuthology.orchestra.run.smithi162:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-07-05T23:37:03.259 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-07-05T23:37:03.270 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-07-05T23:37:03.271 DEBUG:teuthology.orchestra.run.smithi027:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-07-05T23:37:03.298 DEBUG:teuthology.orchestra.run.smithi162:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-07-05T23:37:03.327 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-07-05T23:37:03.339 DEBUG:teuthology.orchestra.run.smithi027:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-07-05T23:37:03.344 DEBUG:teuthology.orchestra.run.smithi162:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-07-05T23:37:03.368 INFO:teuthology.orchestra.run.smithi027.stdout:kernel.core_pattern = core 2023-07-05T23:37:03.394 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern = core 2023-07-05T23:37:03.407 DEBUG:teuthology.orchestra.run.smithi027:> test -e /home/ubuntu/cephtest/archive/coredump 2023-07-05T23:37:03.438 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-05T23:37:03.439 DEBUG:teuthology.orchestra.run.smithi162:> test -e /home/ubuntu/cephtest/archive/coredump 2023-07-05T23:37:03.463 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-05T23:37:03.464 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-07-05T23:37:03.476 INFO:teuthology.task.internal:Transferring archived files... 2023-07-05T23:37:03.477 DEBUG:teuthology.misc:Transferring archived files from smithi027:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-07-05_18:32:52-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7327586/remote/smithi027 2023-07-05T23:37:03.478 DEBUG:teuthology.orchestra.run.smithi027:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-07-05T23:37:03.517 DEBUG:teuthology.misc:Transferring archived files from smithi162:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-07-05_18:32:52-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7327586/remote/smithi162 2023-07-05T23:37:03.518 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-07-05T23:37:03.560 INFO:teuthology.task.internal:Removing archive directory... 2023-07-05T23:37:03.561 DEBUG:teuthology.orchestra.run.smithi027:> rm -rf -- /home/ubuntu/cephtest/archive 2023-07-05T23:37:03.564 DEBUG:teuthology.orchestra.run.smithi162:> rm -rf -- /home/ubuntu/cephtest/archive 2023-07-05T23:37:03.608 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-07-05T23:37:03.622 INFO:teuthology.task.internal:Not uploading archives. 2023-07-05T23:37:03.622 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-07-05T23:37:03.652 INFO:teuthology.task.internal:Tidying up after the test... 2023-07-05T23:37:03.653 DEBUG:teuthology.orchestra.run.smithi027:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-07-05T23:37:03.655 DEBUG:teuthology.orchestra.run.smithi162:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-07-05T23:37:03.670 INFO:teuthology.orchestra.run.smithi027.stdout: 262307 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 5 23:37 /home/ubuntu/cephtest 2023-07-05T23:37:03.672 INFO:teuthology.orchestra.run.smithi162.stdout: 262307 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 5 23:37 /home/ubuntu/cephtest 2023-07-05T23:37:03.673 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-07-05T23:37:03.684 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-07-05T23:37:03.748 INFO:teuthology.nuke:Checking targets against current locks 2023-07-05T23:37:03.779 DEBUG:teuthology.nuke:shortname: smithi027 2023-07-05T23:37:03.780 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-05T23:37:03.807 DEBUG:teuthology.nuke:shortname: smithi162 2023-07-05T23:37:03.808 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-05T23:37:03.811 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi027.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-05_18:32:52-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7327586', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-05 23:14:23.800244', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-05T23:37:03.834 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi162.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-05_18:32:52-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7327586', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-05 23:14:23.801747', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-07-05T23:37:03.868 INFO:teuthology.orchestra.console:Power off smithi027 2023-07-05T23:37:03.870 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-05T23:37:03.896 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-05T23:37:03.920 INFO:teuthology.orchestra.console:Power off smithi162 2023-07-05T23:37:03.921 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-05T23:37:03.944 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-05T23:37:07.932 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-05T23:37:07.970 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-05T23:37:12.049 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-05T23:37:12.083 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-05T23:37:12.262 INFO:teuthology.orchestra.console:Power off for smithi027 completed 2023-07-05T23:37:12.295 INFO:teuthology.orchestra.console:Power off for smithi162 completed 2023-07-05T23:37:12.401 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/workunit/quota} duration: 988.8767709732056 failure_reason: 'Command failed (workunit test fs/quota/quota.sh) on smithi162 with status 1: ''mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0a781ef0807ae9473fb1306ef07036226ca4f1a6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/fs/quota/quota.sh''' flavor: default owner: scheduled_rishabh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=df72ddf896344e48be4bf8564f082cde status: fail success: false 2023-07-05T23:37:12.402 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-05T23:37:12.502 INFO:teuthology.run:FAIL